AI girlfriend bots are already flooding OpenAI’s GPT store::OpenAI’s store rules are already being broken, illustrating that regulating GPTs could be hard to control

  • sramder@lemmy.world
    link
    fedilink
    English
    arrow-up
    47
    arrow-down
    5
    ·
    10 months ago

    [Yawn]

    I’m all for a bit of Ai panic, but this is the worst kind of desperate journalism.

    The facts as reported:

    • 1 day before opening the doors of their new online store OAi updated their policy to ban comfort-bots and bad-bots.
    • On opening day there are 7 Ai girlfriends available for purchase/download.

    The articles conclusion: Ai regulation is doomed to fail and the machines will wipe out humanity.

    • zarkanian@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      21
      arrow-down
      2
      ·
      10 months ago

      The articles conclusion: Ai regulation is doomed to fail and the machines will wipe out humanity.

      Well, as we all know, AI girlfriend is the first step to AI Hitler.

    • afraid_of_zombies@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      1
      ·
      10 months ago

      If we get wiped out by AI girlfriends we deserve it. If the reason why a person never reproduced is solely because they had a chatbot they really should not reproduce.

    • lightnsfw@reddthat.com
      link
      fedilink
      English
      arrow-up
      4
      ·
      10 months ago

      Not that I’m really interested in one but what’s actually wrong with making an AI gf app?

      • sramder@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        10 months ago

        I’m not sure there’s anything wrong with it, that’s what the article reported on as though it were some sort of harbinger of doom… Felt like my smarmy retorts would be slightly less punchy if I had opened up a side discussion regarding appropriate uses for AI. I suppose part of my motivation was that it seemed incredibly innocent relatively speaking.

        Open AI claims to be in this to save humanity from Skynet, this seems like a fairly pathetic attempt keep their store from filling up with “disreputable” content before… what exactly I don’t know. The killer app for AI that would be magically devoid of controversy?

        • afraid_of_zombies@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          10 months ago

          Are people really wargaming this? Planning on making anti-skynets to defend humanity from skynets? I can’t decide if that is a massive waste of time or a vital use of it.

    • afraid_of_zombies@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      10 months ago

      Your comment gave me an idea. These alarmist articles are so common that I bet writing them could be automated. We can get bots to write articles about the dangers of bots. I asked chatgpt to write one from the perspective of Southern Baptist

      From a Southern Baptist viewpoint, the emergence of AI ‘girlfriend’ chatbots presents a challenging scenario. This perspective, grounded in Scripture, values authentic human relationships as cornerstones of society, as reflected in passages like Genesis 2:18, where companionship is emphasized as a fundamental human need. These AI entities, simulating intimate relationships, are seen as diverging from the Biblical understanding of companionship and marriage, which are sacred and uniquely human connections. The Bible’s teachings on idolatry, such as in Exodus 20:4-5, also bring into question the ethics of replacing real interpersonal relationships with artificial constructs.

      Not bad for a first pass.

  • Smokeydope@lemmy.world
    link
    fedilink
    English
    arrow-up
    40
    arrow-down
    2
    ·
    edit-2
    10 months ago

    “lol at least it will help get some losers out of the gene pool, lonely unfuckable loosers deserve what they get if they resort to a chatbot for affection lol” fucking hell what nastiness some people have in them.

    Im not 100% comfortable with AI gfs and the direction society could potentially be heading. I don’t like that some people have given up on human interaction and the struggle for companionship, and feel the need to resort to a poor artificial substitute for genuine connection. Its very sad.

    However, I also understand what it truly means to be alone, for decades. You can point the finger and mock people for their social failings. It doesn’t make them feel any less empty. Some people are genuinely so psychologically or physically damaged, their confidence so ultimately shattered, that dating or even just fucking seem like pipe dreams. A psychologically normal, average looking human being who can’t stand a month or two of being single could never empathize with what that feels like.

    If an AI girlfriend could help relieve that feeling for one irreparably broken human being on this planet, lessen that unbearable lonelyness even a smidge through faux interaction, then good. I’ll never want one, but im happy its an option for those who really need something like it. They’ll get no mockery or meanness or judgement from me.

    • patatahooligan@lemmy.world
      link
      fedilink
      English
      arrow-up
      13
      ·
      10 months ago

      Im not 100% comfortable with AI gfs and the direction society could potentially be heading. I don’t like that some people have given up on human interaction and the struggle for companionship, and feel the need to resort to a poor artificial substitute for genuine connection.

      That’s not even the scary part. What we really shouldn’t be uncomfortable with is this very closed technology having so much power over people. There’s going to be a handful of gargantuan immoral companies controlling a service that the most emotionally vulnerable people will become addicted to.

      • Nindelofocho@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        10 months ago

        Imo the safest solution for that would be a self hosted one that doesent dial out to a conpany server

    • T156@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      edit-2
      10 months ago

      Im not 100% comfortable with AI gfs and the direction society could potentially be heading. I don’t like that some people have given up on human interaction and the struggle for companionship, and feel the need to resort to a poor artificial substitute for genuine connection. Its very sad.

      The marketing for some of them also seems quite predatory, which doesn’t seem like a good sign.

      Although I’m personally less concerned about the people that seek them out, and more the ones that just get used in the wild.

      Imagine hitting it off with someone, having a friendship for a while, only to find out that they’re an engagement or scam bot? It’d be devastating.

        • UnderpantsWeevil@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          10 months ago

          Was functionally the entire business model of sites like “Seeking Arrangements” since their inception. AI isn’t doing what phone sex operators and cam-whores have been doing for decades. They’re just filling in as a cheap inferior substitute that can over-saturate the market at very little cost to the distributors.

          AI Girlfriend is the new 419 Scam, kicked up a notch.

  • paraphrand@lemmy.world
    link
    fedilink
    English
    arrow-up
    33
    arrow-down
    1
    ·
    10 months ago

    Once LLMs can have perfect memory of past conversations, we are going to see a lot of companion bots. Running into the context window sucks.

    • ExLisper@linux.community
      link
      fedilink
      English
      arrow-up
      7
      ·
      10 months ago

      Is it even feasible with this technology? You can’t have infinite prompts so you would have to adjust the weights dynamically, right? But would that produce the effect of memory? I don’t think so. I think it will take another major breakthrough before we have personal models with memory.

      • tias@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        4
        ·
        edit-2
        10 months ago

        I agree that it has limits but there are things we could do to make it reasonably good. ChatGPT knows how to execute actions (such as calling an API or doing a web search). It could probably be made to store and look up information in a vector database, essentially giving it a long-term memory.

        Given some smaller breakthroughs in performance and model size we could conceivably retrain the network on new input continuously, in order to incorporate new knowledge.

        • ExLisper@linux.community
          link
          fedilink
          English
          arrow-up
          4
          ·
          10 months ago

          That’s the thing, I don’t think a database can work as a long term memory here. How would it work? Let’s say you tell your AI girlfriend that Interstellar movie was so bad it made you vomit. What would it store in the DB? When would it look that info up? It would be even worse with specific events. Should it remember the exact date of each event perfectly like DB does? It would be unnatural. To actually simulate memory it should alter the model somehow and the scale of the change should be proportional to the emotional charge of the message. I think this is on a completely different level than current models.

          • tias@discuss.tchncs.de
            link
            fedilink
            English
            arrow-up
            4
            ·
            edit-2
            10 months ago

            Vector databases are relatively good at this kind of thing, because they can find records based on queries that are semantically close instead of just a lexical search. It would probably still make sense to split the information up in fragments such as e.g., “Interstellar movie,” “watched on February 2nd, 2021,” “made me vomit”, and then connect those records to each other. GPTs are good at that kind of preprocessing. The idea would not be to store exact data such as timestamps and that’s not how vector databases work, so recall would be more associative just like for humans (I can’t ask you what movie you watched on Feburary 2nd, 2021 and expect an accurate reply either).

            • ExLisper@linux.community
              link
              fedilink
              English
              arrow-up
              3
              ·
              10 months ago

              But you would have to do something like multiple steps of preprocessing with expanding search depth on each step and do it both ways: when recollecting and changing memories. Like if I say:

              • Remember when I told you I’ve seen Interstellar last year?
              • AI: Yes, you said it made you vomit.
              • I lied. It was great.

              So you process the first input, find the relevant info in the ‘memory’ but then for the second one you have to recognize that this is regarding the same memory, understand the memory and alter it/append to it. It would get complicated really fast. We would need some AI memory management system to manage the memory for the AI. I’m sure it’s technically possible but I think it will take another breakthrough and we won’t see it soon.

              • tias@discuss.tchncs.de
                link
                fedilink
                English
                arrow-up
                4
                ·
                10 months ago

                Again, you will certainly hit limitations if you push it, but the example you give would work fine if you just append the added information to the database. A query for Interstellar would return both your original statements and the fact that you later said you lied about it, and all of these records are inserted into the GPT’s context (short-term memory) when discussing that subject.

          • Demdaru@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            10 months ago

            …i may be too green to see something here, but wouldn’t simply saving month, year, topic, mood and quote enough? If AI needs everything formatted in certain input, run this through API. Teach AI to save only moments where user uses agitated language or smth and to periodically run checks if current convo allows for throwback, for example by topic, with advanced query when user asks if AI remembers something.

            Then sell all this data for fat profit.

            • ExLisper@linux.community
              link
              fedilink
              English
              arrow-up
              2
              ·
              10 months ago

              So imagine a convo:

              • Let’s see a movie.
              • AI: What movie would you like to see?
              • Interstellar.
              • AI: Ok.

              1 years later:

              • Do you remember the movie Interstelar?

              Now the AI can find the meesage that said ‘Interstellar’ in the history but without any context. To know you were talking about the movie it would have to analyze the entire conversation again. And the emotional charge of the message can also change instantly:

              • My whole family died in a plane crash.
              • AI: OMG!
              • Just kidding, April fools!

              What would the AI ‘remember’? It would require some higher level of understanding of the conversation and the ‘memories’ would have to be updated all the time. It’s just not possible to replicate with simple log.

              • Demdaru@lemmy.world
                link
                fedilink
                English
                arrow-up
                2
                ·
                10 months ago

                Thanks for examples, now yeah, that’s really ain’t that simple…and hard af to foolproof. :/

              • paraphrand@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                10 months ago

                It’s when people dive into this sort of memory stuff that I always remember: “oh yeah, this is why people call it a stochastic parrot.”

                LLMs can do a lot. But without memory, they run into walls fast.

      • Akisamb@programming.dev
        link
        fedilink
        English
        arrow-up
        2
        ·
        10 months ago

        There are two issues with large prompts. One is linked to the current language technology, were the computation time and memory usage scale badly with prompt size. This is being solved by projects such as RWKV or mamba, but these remain unproven at large sizes (more than 100 billion parameters). Somebody will have to spend some millions to train one.

        The other issue will probably be harder to solve. There is less high quality long context training data. Most datasets were created for small context models.

        • paraphrand@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          10 months ago

          The other issue will probably be harder to solve. There is less high quality long context training data. Most datasets were created for small context models.

          I never considered that this was a dynamic that was involved. Thats interesting. So each piece of data fed into a model during training also has to fit into a “context window” of a certain size too?

          • Akisamb@programming.dev
            link
            fedilink
            English
            arrow-up
            3
            ·
            10 months ago

            Yes to your question, but that’s not what I was saying.

            Here is one of the most popular training datasets : https://pile.eleuther.ai/

            If you look at the pdf describing the dataset, you’ll find the mean length of these documents to be somewhat short with mean length being less than 20kb (20000 characters) for most documents.

            You are asking for a model to retain a memory for the whole duration of a discussion, which can be very long. If I chat for one hour I’ll type approximately 8400 words, or around 42KB. Longer than most documents in the training set. If I chat for 20 hours, It’ll be longer than almost all the documents in the training set. The model needs to learn how to extract information from a long context and it can’t do that well if the documents on which it trained are short.

            You are also right that during training the text is cut off. A value I often see is 2k to 8k tokens. This is arbitrary, some models are trained with a cut off of 200k tokens. You can use models on context lengths longer than that what they were trained on (with some caveats) but performance falls of badly.

      • paraphrand@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        10 months ago

        Yeah I dunno. It might be a fundamental flaw that you will run into forever. But I’m assuming the window will get quite large, and clever ways to “compress” the memory will be implemented.

        Other people replied. I’ll go read those now…

    • evranch@lemmy.ca
      link
      fedilink
      English
      arrow-up
      2
      ·
      10 months ago

      I would argue that AI possibly makes a better companion in some ways when it’s a little stupid. I’ve mostly ignored AI but have been experimenting with local models a bit the last couple days while stuck hiding from the cold.

      I found I like AI best around the “talking dog” level of intellect. Kind of like the Titanfall AI, he’s friendly and eager to uphold the mission, very competent at his job, but clearly not a human and kind of charmingly foolish. A dog is also a good companion, while clearly not a human and honestly a lot dumber than many AI models now.

      Using it as an answer engine or to write code snippets feels like working with a dog on the farm, you talk to it but don’t expect too much back. It doesn’t give that uncanny feeling, just provides some company without feeling like something you’re trying to replace other humans with.

      I’m a lot more accepting of talking dogs than something that pretends to be your girlfriend. That just comes off weird and creepy, to me.

      For some reason having it running on my machine made it feel more like a real entity than typing into the cloud. Hard to explain, but I found I treated it with a lot more dignity than a cloud based AI.

  • werefreeatlast@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    arrow-down
    1
    ·
    10 months ago

    This is just a stepping stone to the ultimate guilt free porn. No one gets hurt, 300 simulated penises. Except that no one is simulating penises yet. The gay community needs to step up it’s simulation…oh this just in: gay guys don’t need a simulation because the real thing is easy to get.

    • UnderpantsWeevil@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      ·
      10 months ago

      No one gets hurt, 300 simulated penises.

      I would argue that a continuous state of isolation, bolstered by shoddy simulations of human interaction, that we treat as a stand in to real human contact and expression, is going to hurt a whole lot of people in the long run.

      It all just feels like some 18th century Libertarian looking at an opium den full of washed out dope-heads and saying “Look at how happy they are! There’s no such thing as an opium crisis, because its all voluntary and the end result is profound bliss.”

      The gay community needs to step up it’s simulation…

      The gay community doesn’t need simulation precisely because it is rich with enthusiastic socially active and eager individuals. The NEET community needs simulations because they’ve fallen victim to their own anxieties, failed to develop strong social skills, and alienated themselves from everyone else in their lives who might provide them with the experiences they’re seeking a rough approximation of in simulation.

      • crimsonpoodle@pawb.social
        link
        fedilink
        English
        arrow-up
        6
        ·
        10 months ago

        I would say the following things would help:

        •	Rethink the way our cities are built and reduce the ratio of work to weekends so that people can find time and have ease in going to spaces where they can interact with others socially.
        
        •	Allow for the construction of third spaces, especially for adolescents. Seriously, as a teenager in the 2010s, the amount of surveillance and regulation by parents and schools was kinda insane. It pushes teenagers online, as it’s the one place where they tend to have an edge on their elders enough to break free from it. (And it also normalizes invasions of privacy by corporations.)
        
        •	Withhold judgment by mass public opinion for minor transgressions. We have all said things that make us cringe at ourselves down the line when we think of them, or even when reminded of the perhaps more innocent action of simply looking foolish. It is little wonder, then, that people, already socially withered from lack of experience, shy away from the very actions that might give them confidence when faced with the potential for public immortalization of these acts via the internet.
        
        •	Regulate platforms to reduce the existing profitability of addiction. It is no contest when the largest companies spend billions and employ thousands to keep their users under their thrall. The only recourse for the individual is to join in group action to wield the power of government for the public good.
        

        While by no means an exhaustive list, I feel as though if we follow the steps of RAWR, we can at least make an incremental improvement.

  • asdfasdfasdf@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    10 months ago

    I don’t get it. What’s wrong with pretending to have a relationship with an AI? Fantasy video games are super popular, and probably a more realistic experience than the current state of ChatGPT.

    • Lesrid@lemm.ee
      link
      fedilink
      English
      arrow-up
      6
      ·
      10 months ago

      Yeah there’s a bit of similarity to pursuing a “romance route” in a video game. Funny to think that it’s more acceptable to fuck a fake bear in Baldur’s Gate 3 than to have weekly conversations with a bot that pretends to understand your written words.

      I suppose the key difference being that my wife in Skyrim is more akin to a one-night stand since she can’t reciprocate my notes of affection.

    • TORFdot0@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      10 months ago

      In my opinion, it’s immoral to profit off of someone’s loneliness. Of course that’s a huge sector of the economy now and why dating apps focus on vapid, meaningless hookups rather than finding real working relationships, and cam girls exploiting whales, so on a so forth.

      But I still think that things like AI girlfriends promote isolation, hostility, and anti-social behaviors that are harmful to society.