Not necessarily, they train models on real world data, often of what people believe to be true, not what works, and those models are not yet able to perform experiments, register results and learn from them (what even a child does, even a dumb one), and real world is cruel, bigotry is not even the worst part of it, neither are anti-scientific beliefs. But unlike these models, the real world has more entropy.
If you’ve seen Babylon V, the philosophy difference between Vorlons and Shadows was somewhere near this.
One can say in philosophy blockchain is a Vorlon technology and LLMs are a Shadow technology (it’s funny, because technically it would be the other way around, one is kinda grassroots and the other is done by few groups with humongous amounts of data and computing resources), but ultimately they are both attempts to compensate what they see as wrong in the real world. Introducing new wrongs in their blind zones.
(In some sense the reversal of alignment of Vorlons and Shadows, between philosophy and implementation, is right - you hide in technical traits of your tooling that which you can’t keep in your philosophy ; so “you’ll think what we tell you to think” works for Vorlons (or Democrats), but Republicans have to hide that inside tooling and mechanisms they prefer, while “power makes power” is something Democrats can’t just say, but can hide inside tooling they prefer or at least don’t fight too much. That’s why cryptocurrencies’ popularity came in one side’s ideological dominance time, and “AIs” in the others’. Maybe this is a word salad.)
So, what I meant, - the degeneracy of such tools is the bias in his favor, there’s no need for anything else.
I can’t believe you worked a B5 ref into a discussion, much less operational differences between Vorlon and Shadow.
Major difference even in the analogy is that Shadows actively and destructively sought control and withheld info whereas Vorlons manipulated by parceling out cryptic messages.
Anyway, yeah… the internet is completely fucked up and full of stupidity, malice, and casual cruelty. Many of us filter it by simply avoiding it by chance (it’s not what we look for) or actively filter it (blocking communities, sites, media, etc.), so we don’t see the shitholes of the internet and the hordes of trolls and wingnuts that are the denizens of these spaces.
Removing filters from LLMs and training them on shitholes will have the expected result.
He means they must insert ideological bias on his behalf.
Not necessarily, they train models on real world data, often of what people believe to be true, not what works, and those models are not yet able to perform experiments, register results and learn from them (what even a child does, even a dumb one), and real world is cruel, bigotry is not even the worst part of it, neither are anti-scientific beliefs. But unlike these models, the real world has more entropy.
If you’ve seen Babylon V, the philosophy difference between Vorlons and Shadows was somewhere near this.
One can say in philosophy blockchain is a Vorlon technology and LLMs are a Shadow technology (it’s funny, because technically it would be the other way around, one is kinda grassroots and the other is done by few groups with humongous amounts of data and computing resources), but ultimately they are both attempts to compensate what they see as wrong in the real world. Introducing new wrongs in their blind zones.
(In some sense the reversal of alignment of Vorlons and Shadows, between philosophy and implementation, is right - you hide in technical traits of your tooling that which you can’t keep in your philosophy ; so “you’ll think what we tell you to think” works for Vorlons (or Democrats), but Republicans have to hide that inside tooling and mechanisms they prefer, while “power makes power” is something Democrats can’t just say, but can hide inside tooling they prefer or at least don’t fight too much. That’s why cryptocurrencies’ popularity came in one side’s ideological dominance time, and “AIs” in the others’. Maybe this is a word salad.)
So, what I meant, - the degeneracy of such tools is the bias in his favor, there’s no need for anything else.
I can’t believe you worked a B5 ref into a discussion, much less operational differences between Vorlon and Shadow.
Major difference even in the analogy is that Shadows actively and destructively sought control and withheld info whereas Vorlons manipulated by parceling out cryptic messages.
Anyway, yeah… the internet is completely fucked up and full of stupidity, malice, and casual cruelty. Many of us filter it by simply avoiding it by chance (it’s not what we look for) or actively filter it (blocking communities, sites, media, etc.), so we don’t see the shitholes of the internet and the hordes of trolls and wingnuts that are the denizens of these spaces.
Removing filters from LLMs and training them on shitholes will have the expected result.