I recently learned about Cyc (pronounced “sike”). It’s an AI project that focuses on implicit knowledge—which is exactly what so many LLMs are so bad at. As this 2016 article describes, “Cyc also understands that if you let go of an apple it will fall to the ground; that an apple is not bigger than a person; and that a person cannot throw an apple into space.”
Cyc has been built over 40 years using hand-coded axioms in its own ontology. It has a system of implicit and explicit knowledge that has been created for it, or perhaps it’s more appropriate to say that Cyc is that collection of knowledge.
In contrast, an LLM is trained on relationships within phrases, sentences, and larger clumps of text. So it can literally only “know” the things that are written about—it doesn’t know the things we don’t talk about. It doesn’t know the context that we leave out that detract or distract from our thesis. The neglected information might be too obvious, irrelevant, taboo, redundant, relevant-but-contradictory.
From this perspective, every communication is incomplete. If it contained all of the implicit knowledge, it would attempt to be a complete model of reality, while reality is changing. There’s simply too much to communicate. This means that what LLMs do is fundamentally different from what people do: LLM word generation is all about sequencing the next word to include, while people spend most of their energy choosing what to leave out.
I think about this unspoken information as it works within human communities, too. You probably belong to a community, whether professional or personal, that has unspoken, unwritten rules that would be hard to explain to a newcomer. It’s this kind of implicit knowledge that allows insiders to navigate the community more successfully. A person with more implicit knowledge about the community knows who’s more likely to be enthusiastic about a new idea, who’s likely to squash it, and what the likely frictions will be for timing, resources, and other needs.
I’ve been reading science fiction since I could read, thanks to my parents. I am enthusiastic about comprehensive definitions of “personhood” that include non-human entities. But until my Dad mentioned this Cyc project, I hadn’t made any connection between implicit knowledge and what it means for personhood or community.
I wonder how many more connections my community will help me make, tomorrow.