There's a lot of talk about how AI "hallucinates” but think on one of the basic premises of computer science: GIGO. Garbage In, Garbage Out.
The AIs produce ever more inaccurate, wildly incorrect garbage.
Sophisticated automated mansplaining.
Maybe it's just an inner reflection of the developers' actual intent
@flargh When I think about this GIGO is always my first response and I concur. I also remind myself that every story ever passed on by humans changes each time it gets told.
Perhaps our issue is one of expectations, thinking that we can apply the rules of math to the rules of reasoning.