Just imagine the average reddit, twitter, facebook, and instagram content. Then realize that half of that content is dumber than that. That’s half of what these AI models use to learn. The “smarter” half is probably filled with sarcasm, inside jokes, and other types of innuendo that the AI at this stage has no chance of understanding correctly.
It reminds me of how tech companies are all scrambling to use AI. There was a funny article recently where the author pointed out that these companies are struggling to do very basic things, so the idea that they could somehow tackle AI in a way that’s useful and profitable is silly.
Here’s the article, very entertaining and worth the read.