Artificial Intelligence? My Scaly Left Foot It Is
Wednesday, September 4th, 2024 12:20 pmI just listened to a This American Life episode (audio or transcript) where David Kestenbaum, an experienced science journalist, kvelled about how awesome Chat GPT is, how they are truly approaching AGI—artificial general intelligence. His turning point was that the large language model was trained on text, and wrote its own graphic-generating program when prompted to show an image. And that's pretty cool, but ...
I asked ChatGPT-4o some super-basic questions about my family history, all documented in US Census data. The results were stunningly bad.
My maternal grandfather's cousin was Richard Neutra, who was a well-known modern architect. ChatGPT-4o insisted that everyone in my family was related to him--that my maternal grandmother was really married to him. It would show accurate 1940 Census data—-my maternal grandmother with her actual name and and then say, but no, my grandmother was actually married to famous person and my mother was his daughter.
It answered an identical census question incorrectly and then correctly in immediate succession.
As erinptah has been diligently documenting, "AI" is simply not there yet, although this hasn't prevented everybody and their dog claiming it as the absolute new hotness.
I acknowledge that I have no technical qualifications to assess the relevance of these hallucinated answers to the overall reliability of "AI". I welcome new knowledge!