I get the sentiment behind this post, and it’s almost always funny when LLM are such dumbass. But this is not a good argument against the technology.

It’s a pretty good argument against the technology, at least as it currently stands. This was a trivial question where anybody with a basic reading ability can see it’s just completely wrong, the problem comes when you ask it a question you don’t already know the answer to and can’t easily check and it give equally wrong answers.