The Obsessive Dreyfus-Hawking Conundrum

I’ve been obsessed lately. I was up at 5 A.M. yesterday and drove to Ruidoso to do some hiking (trails T93 to T92, if interested). The San Augustin Pass was desolate as the sun began breaking over, so I inched up into triple digit speeds in the M6. Because that is what the machine is made for. Booming across White Sands Missile Range, I recalled watching base police work with National Park Rangers to chase oryx down the highway while early F117s practiced touch-and-gos at Holloman in the background, and then driving my carpool truck out to the high energy laser site or desert ship to deliver documents.

I settled into Starbucks an hour and a half later and started writing on ¡Reconquista!, cranking out thousands of words before trying to track down the trailhead and starting on my hike. (I would have run the thing but wanted to go to lunch later and didn’t have access to a shower. Neither restaurant nor diners deserve an après-run moi.) And then I was on the trail and I kept stopping and taking plot and dialogue notes, revisiting little vignettes and annotating enhancements that I would later salt in to the main text over lunch. And I kept rummaging through the development of characters, refining and sifting the facts of their lives through different sets of sieves until they took on both a greater valence within the story arc and, often, more comedic value.

I was obsessed and remain so. It is a joyous thing to be in this state, comparable only to working on large-scale software systems when the hours melt away and meals slip as one cranks through problem after problem, building and modulating the subsystems until the units begin to sing together like a chorus.… Read the rest

Tweak, Memory

Artificial Neural Networks (ANNs) were, from early on in their formulation as Threshold Logic Units (TLUs) or Perceptrons, mostly focused on non-sequential decision-making tasks. With the invention of back-propagation training methods, the application to static presentations of data became somewhat fixed as a methodology. During the 90s Support Vector Machines became the rage and then Random Forests and other ensemble approaches held significant mindshare. ANNs receded into the distance as a quaint, historical approach that was fairly computationally expensive and opaque when compared to the other methods.

But Deep Learning has brought the ANN back through a combination of improvements, both minor and major. The most important enhancements include pre-training of the networks as auto-encoders prior to pursuing error-based training using back-propagation or  Contrastive Divergence with Gibbs Sampling. The critical other enhancement derives from Schmidhuber and others work in the 90s on managing temporal presentations to ANNs so the can effectively process sequences of signals. This latter development is critical for processing speech, written language, grammar, changes in video state, etc. Back-propagation without some form of recurrent network structure or memory management washes out the error signal that is needed for adjusting the weights of the networks. And it should be noted that increased compute fire-power using GPUs and custom chips has accelerated training performance enough that experimental cycles are within the range of doable.

Note that these are what might be called “computer science” issues rather than “brain science” issues. Researchers are drawing rough analogies between some observed properties of real neuronal systems (neurons fire and connect together) but then are pursuing a more abstract question as to how a very simple computational model of such neural networks can learn.… Read the rest

The Inevitability of Cultural Appropriation

Picasso in Native HeaddressI’m on a TGV from Paris to Monaco. The sun was out this morning and the Jardin de Tuileries was filled with homages in tulips to various still lifes at the Louvre. Two days ago, at the Musée de quai Branly—Jacques Chirac, I saw the Picasso Primitif exposition that showcased the influence of indigenous arts on Picasso’s work through the years, often by presenting statues from Africa or Papua New Guinea side-by-side with examples of Picasso’s efforts through the years. If you never made the connection between his cubism and the statuary of Chad (like me), it is eye opening. He wasn’t particularly culturally sensitive—like everyone else until at least the 1960s—because the fascinating people and their cultural works were largely aesthetic objects to him. If he was aware of the significance of particular pieces (and he might have been), it was something he rarely acknowledged or discussed. The photos that tie Picasso to the African statues are the primary thread of the exhibition, with each one, taken at his California atelier or in Paris or whatnot, inscribed by the curators with a dainty red circle or oval to highlight a grainy African statue lurking in the background. Sometimes they provide a blow-up in case you can’t quite make it out. It is only with a full Native American headdress given to Picasso by the actor Gary Cooper that we see him actively mugging for a camera and providing weight to the show’s theme. Then, next, Brigitte Bardot is leaning over him at the California studio and her cleavage renders the distant red oval uninteresting.

I am writing daily about things I don’t fully understand but try to imbue with a sense of character, of interest, and even of humor.… Read the rest

Amazonian Griffins and the Fantastical New World

Background research for ¡Reconquista! (or any book) takes unexpected dips and turns, from Google Street Views of Mexicali, Mexico to the origins of Alta California and the campaigns of Colonel Frémont. But the most unusual find in a week punctuated by trail running in Guadalupe Mountains National Park and a brief, one hour, twenty minute circuit of Carlsbad Caverns (I was first in and had the descent largely to myself!), was a 19th-century translation of the Queen of California from Las Sergas de Esplandián. This 1510 book by Garci Rodríguez de Montalvo related an amazing tale that, as the translator and commenter Edward Everett Hale notes, provided the origin of the name of California, for Cortez imagined what is now Baja California to be an island that was to the West of the Indies, following Columbus’ lead in mislabeling the New World.

Hale’s translation and commentary are even more remarkable in their intertextual reading of the postbellum mindset that pervades all the way to San Francisco. He carries a descriptive thread likening the battle prowess of the Queen of California’s man-killing griffins to Civil War naval craft:

These griffins are the Monitors of the story, or, if the reader pleases, the Merrimacs.

And in those comparisons, he shows a careful traversal of residual war sentiments, though he is more direct in calling out the implicit racism of Hiram Powers’ statue of California for being incorrect in depicting Queen Calafia (sic) as classically whitewashed when she was described very clearly as “large, and black as the ace of clubs.”

But what of the story of Calafia? She is queen of an island of Amazonian-like women who kill men and boy children alike by feeding them to a hoard of semi-controllable griffins.… Read the rest

The Ethics of Knowing

In the modern American political climate, I’m constantly finding myself at sea in trying to unravel the motivations and thought processes of the Republican Party. The best summation I can arrive at involves the obvious manipulation of the electorate—but that is not terrifically new—combined with a persistent avoidance of evidence and facts.

In my day job, I research a range of topics trying to get enough of a grasp on what we do and do not know such that I can form a plan that innovates from the known facts towards the unknown. Here are a few recent investigations:

  • What is the state of thinking about the origins of logic? Logical rules form into broad classes that range from the uncontroversial (modus tollens, propositional logic, predicate calculus) to the speculative (multivalued and fuzzy logic, or quantum logic, for instance). In most cases we make an assumption based on linguistic convention that they are true and then demonstrate their extension, despite the observation that they are tautological. Synthetic knowledge has no similar limitations but is assumed to be girded by the logical basics.
  • What were the early Christian heresies, how did they arise, and what was their influence? Marcion of Sinope is perhaps the most interesting one of these, in parallel with the Gnostics, asserting that the cruel tribal god of the Old Testament was distinct from the New Testament Father, and proclaiming perhaps (see various discussions) a docetic Jesus figure. The leading “mythicists” like Robert Price are invaluable in this analysis (ignore first 15 minutes of nonsense). The thin braid of early Christian history and the constant humanity that arises in morphing the faith before settling down after Nicaea (well, and then after Martin Luther) reminds us that abstractions and faith have a remarkable persistence in the face of cultural change.
Read the rest

The Dynamics of Dignity

My wife got a Jeep Wrangler Unlimited Rubicon a few days back. It has necessitated a new education in off-road machinery like locking axles, low 4, and disconnectable sway bars. It seemed the right choice for our reinsertion into New Mexico, a land that was only partially accessible by cheap, whatever-you-can-afford, vehicles twenty years ago when we were grad students. So we had to start driving random off-road locations and found Faulkner’s Canyon in the Robledos. Billy the Kid used this area as a refuge at one point and we searched out his hidey-hole this morning but ran out of LTE coverage and couldn’t confirm the specific site until returning from our adventure. We will try another day!

Billy the Kid was, of course, a killer of questionable moral standing.

With the Neil Gorsuch nomination to SCOTUS, his role in the legal and moral philosophies surrounding assisted suicide has come under scrutiny. In everyday discussions, the topic often centers on the notion of dignity for the dying. Indeed, the autonomy of the person (and with it some assumption of rational choice) combines with a consideration of alternatives to the human-induced death based on pain, discomfort, loss of physical or mental faculties, and also the future-looking speculation about these possibilities.

Now I combined legal and moral in the same sentence because that is also one way to consider the way in which law is or ought to be formulated. But, in fact, one can also claim that the two don’t need to overlap; law can exist simply as a system of rules that does not include moral repercussions and, if the two have a similar effect on behavior, it is merely a happenstance.… Read the rest

Against Superheroes is live on Amazon!

Grab a copy immediately if you must, but there will be a five day promotional give-away of the Kindle edition starting tomorrow. If you prefer print, the paperback edition should be available in a day or two.

This is the first edition and it is trimmed down from a rather portly initial cut, though it still runs to 300+ pages. The metanarrative that was removed will be available in the second edition. And then, I imagine, there will be the extended cut with additional excised spelling mistakes or something…… Read the rest

Twilight of the Artistic Mind

Kristen Stewart, of Twilight fame, co-authored a paper on using deep learning neural networks in her new movie that she is directing. The basic idea is very old but the details and scale are more recent. If you take an artificial neural network and have it autoencode the input stream with bottlenecking, you can then submit any stimulus and will get some reflection of the training in the output. The output can be quite surreal, too, because the effect of bottlenecking combined with other optimizations results in an exaggeration of the features that define the input data set. If the input is images, the output will contain echoes of those images.

For Stewart’s effort, the goal was to transfer her highly stylized concept art into the movie scene. So they trained the network on her concept image and then submitted frames from the film to the network. The result reflected aspects of the original stylized image and the input image, not surprisingly.

There has been a long meditation on the unique status of art and music as a human phenomenon since the beginning of the modern era. The efforts at actively deconstructing the expectations of art play against a background of conceptual genius or divine inspiration. The abstract expressionists and the aleatoric composers show this as a radical 20th Century urge to re-imagine what art might be when freed from the strictures of formal ideas about subject, method, and content.

Is there any significance to the current paper? Not a great deal. The bottom line was that there was a great deal of tweaking to achieve a result that was subjectively pleasing and fit with the production goals of the film.… Read the rest

Apprendre à traduire

Google’s translate has always been a useful tool for awkward gists of short texts. The method used was based on building a phrase-based statistical translation model. To do this, you gather up “parallel” texts that are existing, human, translations. You then “align” them by trying to find the most likely corresponding phrases in each sentence or sets of sentences. Often, between languages, fewer or more sentences will be used to express the same ideas. Once you have that collection of phrasal translation candidates, you can guess the most likely translation of a new sentence by looking up the sequence of likely phrase groups that correspond to that sentence. IBM was the progenitor of this approach in the late 1980’s.

It’s simple and elegant, but it always was criticized for telling us very little about language. Other methods that use techniques like interlingual transfer and parsers showed a more linguist-friendly face. In these methods, the source language is parsed into a parse tree and then that parse tree is converted into a generic representation of the meaning of the sentence. Next a generator uses that representation to create a surface form rendering in the target language. The interlingua must be like the deep meaning of linguistic theories, though the computer science versions of it tended to look a lot like ontological representations with fixed meanings. Flexibility was never the strong suit of these approaches, but their flaws were much deeper than just that.

For one, nobody was able to build a robust parser for any particular language. Next, the ontology was never vast enough to accommodate the rich productivity of real human language. Generators, being the inverse of the parser, remained only toy projects in the computational linguistic community.… Read the rest