Tom and Bob are together on one side of a river and want to travel to the other side. There is no bridge or boat available to cross, nor shallows they can ford, nor can either swim. However, Tom has a rope that is more than long enough to span the river. He suggests "What if we tie one end of this rope to a tree on this side of the river, and tie the other end to that tree on the other side, and then use the rope to shimmy across above the river?” Bob calls him stupid for not realizing the obvious problem with this proposal. What was the obvious problem Bob had in mind?
I've asked this question to several different frontier models including o3.—None of them can answer it. None of them even come close to an inkling of the VERY BASIC answer. This has political implications because I've seen people cite AI as some oracle whose proclamations are inherently true despite the fact that, whenever you ask it a question about a subject you know well, the results are always cringe. It's basically the Gell-Mann amnesia effect and it's going to cause major social problems in the near future:
en.wikipedia.org