Begging the Pseudo-Question

 

I recently got involved in an “audiophile” online discussion thread replete with devious trolling, commenter bans, incivility—the works. I do this from time to time because raucous argumentation forces one to think in tactical and strategic ways that are not the norm in everyday life. I also learn new things. In this case, I went on several quests, hunting down papers on the ability of Chinese language speakers to disambiguate tones in Gaussian noise, how distortion artifacts impact our perception of spatialization in binaural audio presentations, and even Rayleigh wave detection by sand scorpions (I actually worked on a simulator for that as a late undergrad). One of the key disagreements in the thread was over the notion of “science.” There were several perspectives on this, with the first one being that science requires experimentation and therefore using scientifically-derived tools for investigating the performance of audio equipment does not amount to science. This is obviously a shrugger and a distraction. The other primary perspective is always that science is in constant revision and there may be new insights that prove this-or-that subtle hearing capability since human hearing is just sooooo amazing. We are sooooo amazing.

There’s a bit of a Two Cultures-like tension in this universe of audio equipment aficionados: while engineering and science brings them audio gear, they want it to be poetic and ineffable and the work of mastery based in genius rather than Fast Fourier Transforms. Graphs are boring. Listening is beautiful.

Part of the reason for the disagreement is clearly that we just don’t have shared meanings about concepts like science. We circle around them and try to triangulate using metaphors, analogies, and explore the logical consequences of limits and extensions to their meaning.… Read the rest

Inferred Modular Superparrots

The buzz about ChatGPT and related efforts has been surprisingly resistant to the standard deflationary pressure of the Gartner hype cycle. Quantum computing definitely fizzled but appears to be moving towards the plateau of productivity with recent expansions of the number of practical qubits available by IBM and Origin in China, as well as additional government funding out of national security interests and fears. But ChatGPT attracted more sustained attention because people can play with it easily without needing to understand something like Shor’s algorithm for factoring integers. Instead, you just feed it a prompt and are amazed that it writes so well. And related image generators are delightful (as above) and may represent a true displacement of creative professionals even at this early stage, with video hallucinators evolving rapidly too.

But are Large Language Models (LLMs) like ChatGPT doing much more than stitching together recorded fragments of texts ingested from an internet-scale corpus of text? Are they inferring patterns that are in any way beyond just being stochastic parrots? And why would scaling up a system result in qualitative new capabilities, if there are any at all?

Some new work covered in Quanta Magazine has some intriguing suggestions that there is a bit more going on in LLMs, although the subtitle contains the word “understanding” that I think is premature. At heart is the idea that as networks scale up given ordering rules that are not highly uniform or correlated they tend to break up into collections of subnetworks that are distinct (substitute “graphs” for networks if you are a specialist). The theory, then, is that the ingest of sufficient magnitudes of text into a sufficiently large network and the error-minimization involved in tuning that network to match output to input also segregates groupings that the Quanta author and researchers at Princeton and DeepMind refer to as skills.… Read the rest

An Ancient Mind Plague

In addition to Cormac McCarthy, Milan Kundera died this summer after a remarkable run of 94 years. I first read The Unbearable Lightness of Being in the early 90s and loved the strange detachment of the narrator and small moments like the critique of muzak in restaurant settings (I am now much more critical of restaurants that poorly manage sound reflections; how am I to enjoy my company in a cacophony?) But I had little use for his central philosophical pretense concerning eternal return or the use of metaphors as placeholders for people, though I have known people who strain to operate that way. Structuring a narrative around flimsy Continental ideas from Nietzsche, in turn influenced by Hinduism, Buddhism, and even Pythagoras, was too conspicuously self-absorbed with an intellectual airiness. It’s easy to achieve pretension but quite another thing to convey lofty thoughts effortlessly. I might have accepted a narrator musing on the topic among many others, playing with it while laughing at his own ridiculousness, and concluding that such concepts were mythological at best.

But there is a certain circularity in that otherwise educated people continue to latch onto narratives and metaphors that are appealing and unexpectedly strange, from little dioramas about the motives of people in our lives to grand conspiracies and mythologies filled with resurrections, demons, and eschatologies. The conspiracy narratives are a special contemporary problem accelerated by modern communications technologies, but there is nothing particularly new about them in thrust, focus, or pervasiveness.

Aluminum cans cause Alzheimer’s disease? Procter and Gamble’s logo was satanic? When I was in the Peace Corps in Fiji, the Hindu kids thought that certain toothpastes from Australia were adulterated with cow fat or something to undermine Hinduism.… Read the rest

Contrasts and Failures, Hope and Awe

Russell Moore writes in the Atlantic that American evangelicalism is in crisis. There is a Faustian pact of unholy MAGA politics, conspiracy theories, and religious feelings that can only be remedied with a revival of the faith itself, laser-focused on Moore’s conceptions of what Christianity should strive to become. He acknowledges that there is a dark history to America’s evangelical movement through the 20th century. It was always political in close focus, with the maintenance of racism and exclusion at its core well before abortion was even a talking point. Anti-Catholicism and antisemitism were equally bundled up with the evangelical mindset. Beyond the moral failings that sloshed into politics, there was the structural marketing of the faith by televangelists and traveling ministries that turned the hoped-for internal conversion into a more cynical plot:

In the end, a market-driven religion gives rise to a market-driven approach to truth, and this development ultimately eviscerated conservative Christianity in the US and left it the possession of hypocrites and hucksters.

I’m not at all surprised. As information has become unlocked from the vaults of academic pursuits by modern technologies, the ripples of uncertainty about faith claims have spread and clashed with the desire to totalize the political, personal, pragmatic, and moral dimensions of evangelical beliefs. If a thing is so unquestionably right and good, it must infiltrate and own the mind, the body, the soul, the community, and the nation. So why is the world drifting away, seemingly inexorably?

But even those who leave their faith communities feel adrift, clinging to vague spirituality or buffet gorging across traditions in search of something that is satisfactory but different. But that is only in the best of moments, when a song triggers nostalgia or late after eggnog on Christmas Eve.… Read the rest

Tit, Tat, and Political Sensitivities

I’m almost always surprised by the spectrum of political responses to events and circumstances around the world. The political animal, it seems, is very different from me. I don’t need a fusillade of analysis to understand a Supreme Court decision, or an indictment, or an economic event. I don’t want to be glad handed an interpretation meant to soothe me or align me with a tribe. I just need facts and am willing to hold labeling and castigation at arms length while looking at the matter in as dispassionate a manner as I can summon. Even when I feel a jolt of irreverence or schadenfreude or disgust, I try to maintain neutrality in my initial analysis. I am boringly optimistic, too, which seems quaintly outdated in an America that keeps getting richer and more powerful but acts like a caged animal in raging from one crackpot stimulus to another.

But why are so many of our fellow citizens like that? It is easy to be dismissive—those freakin’ idiots!—but there may be something deeper at play. For example, in many human predispositions and even illnesses we have recent studies that show that insofar as there is a clear genetic channel, the range of genes involved is so enormous that we can’t really nail down any single or distinctive causal factor. The terms for this are polygeny and pleiotropy and they simply mean that many alleles are involved, interact with one another, and likely interact with the environment during development. Most mental illness (and here) as well as gayness are current examples of this. Our understanding may change, of course, but for now we have the unsurprising realization that we are very complex animals.… Read the rest

Follow the Paths

There is a little corner of philosophical inquiry that asks whether knowledge is justified based on all our other knowledge. This epistemological foundationalism rests on the concept that if we keep finding justifications for things we can literally get to the bottom of it all. So, for instance, if we ask why we think there is a planet called Earth, we can find reasons for that belief that go beyond just “’cause I know!” like “I sense the ground beneath my feet” and “I’ve learned empirically-verified facts about the planet during my education that have been validated by space missions.” Then, in turn, we need to justify the idea that empiricism is a valid way of attaining knowledge with something like, “It’s shown to be reliable over time.” This idea of reliability is certainly changing and variable, however, since scientific insights and theories have varied, depending on the domain in question and timeframe. And why should we in fact value our senses as being reliable (or mostly reliable) given what we know about hallucinations, apophenia, and optical illusions?

There is also a curious argument in philosophy that parallels this skepticism about the reliability of our perceptions, reason, and the “warrants” for our beliefs called the Evolutionary Argument Against Naturalism (EAAN). I’ve previously discussed some aspects of EAAN, but it is, amazingly, still discussed in academic circles. In a nutshell it asserts that our reliable reasoning can’t be evolved because evolution does not reliably deliver good, truthful ways of thinking about the world.

While it may seem obvious that the evolutionary algorithm does not deliver or guarantee completely reliable facilities for discerning true things from false things, the notion of epistemological pragmatism is a direct parallel to evolutionary search (as Fitelson and Sober hint).… Read the rest

Sentience is Physical, Part 3: Now with Flaming Birds

Moving to Portland brings all the positives and negatives of urban living. A notable positive is access to the arts and I’m looking forward to catching Stravinsky’s The Firebird this weekend with the Oregon Symphony. Part of the program is a new work by composer Vijay Iyer who has a history of incorporating concepts derived from African rhythms, hip hop, and jazz into his compositional efforts. I took the opportunity this morning to read his 1998 dissertation from Berkeley that capped off his interdisciplinary program in the cognitive science of music. I’ll just say up front that I’m not sure it rises to the level of a dissertation since it does not really provide any significant new results. He notes the development of a microtiming programming environment coded in MAX but doesn’t give significant results or novel experimental testing of the system or of human perceptions of microtiming. What the dissertation does do, however, is give a lucid overview and some new insights about how cognition and music interact, as well as point towards ways to test the theories that Iyer develops during the course of his work. A too-long master’s thesis might be a better category for it, but I’ve never been exposed to musicology dissertations so perhaps this level of work is normal.

Iyer’s core thesis is that musical cognition and expression arise from a physical engagement with our environments combined with cultural situatedness. That is, rhythm is tied to a basic “tactus” or spontaneously perceived regular pulse or beat of music that is physically associated with walking, heartbeats, tapping, chewing, and so forth. Similarly, the culture of musical production as well as the history that informs a given piece all combine to influence how music is produced and experienced.… Read the rest

Entanglements: Collected Short Works

Now available in Kindle, softcover, and hardcover versions, Entanglements assembles a decade of short works by author, scientist, entrepreneur, and inventor Mark William Davis.

The fiction includes an intimate experimental triptych on the evolution of sexual identities. A genre-defying poetic meditation on creativity and environmental holocaust competes with conventional science fiction about quantum consciousness and virtual worlds. A postmodern interrogation of the intersection of storytelling and film rounds out the collected works as a counterpoint to an introductory dive into the ethics of altruism.

The nonfiction is divided into topics ranging from literary theory to philosophical concerns of religion, science, and artificial intelligence. Legal theories are magnified to examine the meaning of liberty and autonomy. A qualitative mathematics of free will is developed over the course of two essays and contextualized as part of the algorithm of evolution. What meaning really amounts to is always a central concern, whether discussing politics, culture, or ideas.

The works show the author’s own evolution in his thinking of our entanglement with reality as driven by underlying metaphors that transect science, reason, and society. For Davis, metaphors and the constellations of words that help frame them are the raw materials of thought, and their evolution and refinement is the central narrative of our growth as individuals in a webwork of societies and systems.

Entanglements is for readers who are in love with ideas and the networks of language that support and enervate them. It is a metalinguistic swim along a polychromatic reef of thought where fiction and nonfictional analysis coexist like coral and fish in a greater ecosystem.

Mark William Davis is the author of three dozen scientific papers and patents in cognitive science, search, machine translation, and even the structure of art.… Read the rest

Sentience is Physical

Sentience is all the rage these days. With large language models (LLMs) based on deep learning neural networks, question-answering behavior of these systems takes on curious approximations to talking with a smart person. Recently a member of Google’s AI team was fired after declaring one of their systems sentient. His offense? Violating public disclosure rules. I and many others who have a firm understanding of how these systems work—by predicting next words from previous productions crossed with the question token stream—are quick to dismiss the claims of sentience. But what does sentience really amount to and how can we determine if a machine becomes sentient?

Note that there are those who differentiate sentience (able to have feelings), from sapience (able to have thoughts), and consciousness (some private, subjective phenomenal sense of self). I am willing to blend them together a bit since the topic here isn’t narrowly trying to address the ethics of animal treatment, for example, where the distinction can be useful.

First we have the “imitation game” Turing test-style approach to the question of how we might ever determine if a machine becomes sentient. If a remote machine can fool a human into believing it is a person, it must be as intelligent as a person and therefore sentient like we presume of people. But this is a limited goal line. If the interaction is only over a limited domain like solving your cable internet installation problems, we don’t think of that as a sentient machine. Even against a larger domain of open-ended question and answering, if the human doesn’t hit upon a revealing kind of error that a machine might make that a human would not, we remain unconvinced that the target is sentient.… Read the rest

Notes on Pumps: Sensibilities and Framing with Algorithmic Feedback

“A sensibility is one of the hardest things to talk about.” So begins Sontag’s Notes on “Camp” in the 1964 Partisan Review. And what of the political anger and disillusionment across the United States and in the developed world? What of the gnawing desire towards superiority and control that accompanies authoritarian urges? What of the fear of loss of power to minority ethnic and religious groups? These may be the most discussed sociopolitical aspects of our modern political sensibility since Trump’s election in 2016 when a bitter, vindictive, hostile, crude, fat thug briefly took the reigns of America, then pushed and conspired to oppose the election of his successor.

What attracted his followers to him? I never encountered a George W. Bush fanatic during his presidency. Though not physically small, he talked about “compassionate conservatism” with a voice that hung in the upper register of middle pitches for men. He was neither sonorous nor mean. His eyebrows often had a look of surprise and self-doubt that was hinted at in claims he was a very reluctant candidate for president. I met people who voted for him but they seemed to accept him as an acceptable alternative to Gore or, later, to Kerry—not as a figure of passionate intrigue. Bush Jr. did receive a rally-around-the-flag effect that was based on circumstances that would later bring rebuke over the casus belli of the Iraq War. Similar sensibilities were true of the Obama years—there was a low positivity for him on the Left combined with a mildly deranged antagonism towards him on the Right.

Was the lack of Trump-like animating fanaticism due to the feeling that Bush Jr. was a compromise made to the electorate while Trump was, finally, a man who expressed the real hostility of those who vote Republican?… Read the rest