Not necessarily, they train models on real world data, often of what people believe to be true, not what works, and those models are not yet able to perform experiments, register results and learn from them (what even a child does, even a dumb one), and real world is cruel, bigotry is not even the worst part of it, neither are anti-scientific beliefs. But unlike these models, the real world has more entropy.
If you’ve seen Babylon V, the philosophy difference between Vorlons and Shadows was somewhere near this.
One can say in philosophy blockchain is a Vorlon technology and LLMs are a Shadow technology (it’s funny, because technically it would be the other way around, one is kinda grassroots and the other is done by few groups with humongous amounts of data and computing resources), but ultimately they are both attempts to compensate what they see as wrong in the real world. Introducing new wrongs in their blind zones.
(In some sense the reversal of alignment of Vorlons and Shadows, between philosophy and implementation, is right - you hide in technical traits of your tooling that which you can’t keep in your philosophy ; so “you’ll think what we tell you to think” works for Vorlons (or Democrats), but Republicans have to hide that inside tooling and mechanisms they prefer, while “power makes power” is something Democrats can’t just say, but can hide inside tooling they prefer or at least don’t fight too much. That’s why cryptocurrencies’ popularity came in one side’s ideological dominance time, and “AIs” in the others’. Maybe this is a word salad.)
So, what I meant, - the degeneracy of such tools is the bias in his favor, there’s no need for anything else.
He means they must insert ideological bias on his behalf.
Not necessarily, they train models on real world data, often of what people believe to be true, not what works, and those models are not yet able to perform experiments, register results and learn from them (what even a child does, even a dumb one), and real world is cruel, bigotry is not even the worst part of it, neither are anti-scientific beliefs. But unlike these models, the real world has more entropy.
If you’ve seen Babylon V, the philosophy difference between Vorlons and Shadows was somewhere near this.
One can say in philosophy blockchain is a Vorlon technology and LLMs are a Shadow technology (it’s funny, because technically it would be the other way around, one is kinda grassroots and the other is done by few groups with humongous amounts of data and computing resources), but ultimately they are both attempts to compensate what they see as wrong in the real world. Introducing new wrongs in their blind zones.
(In some sense the reversal of alignment of Vorlons and Shadows, between philosophy and implementation, is right - you hide in technical traits of your tooling that which you can’t keep in your philosophy ; so “you’ll think what we tell you to think” works for Vorlons (or Democrats), but Republicans have to hide that inside tooling and mechanisms they prefer, while “power makes power” is something Democrats can’t just say, but can hide inside tooling they prefer or at least don’t fight too much. That’s why cryptocurrencies’ popularity came in one side’s ideological dominance time, and “AIs” in the others’. Maybe this is a word salad.)
So, what I meant, - the degeneracy of such tools is the bias in his favor, there’s no need for anything else.