How J.J. Horning Unlocked the Logic of Language
In 1969, computational linguistics was at an impasse. A powerful theorem suggested that neither machines nor humans could learn language without explicit instruction. J.J. Horning, with a brilliant application of statistics, shattered that assumption. His breakthrough laid the conceptual groundwork for how modern artificial intelligence, from Google Translate to ChatGPT, processes the structure of human speech. The Problem: Gold's Pessimism To understand the weight of Horning's contribution, we must first look at the "pessimism" he confronted. Before Horning, E.M. Gold had published Gold's Theorem , arguing that even simple languages could not be "identified in the limit" (learned) if the learner only saw positive examples. In Gold's model, "positive examples" are simply correct sentences ("The astronomer saw stars"). To learn which sentences are incorrect ("Saw astronomer the stars"), Gold argued that a learner ...