• magnetosphere@kbin.social
    link
    fedilink
    arrow-up
    10
    arrow-down
    1
    ·
    10 months ago

    I’m confused. Teachers/professors have said that using AI to detect papers written by AI is highly unreliable. How can this work effectively with a much smaller sample of text to work with (even when it looks for “similarities” between multiple reviews)? What happens in a week when Amazon starts writing fake reviews in different tones/“voices”/styles that are intentionally difficult or impossible to compare?

    • PoopMonster@lemmy.world
      link
      fedilink
      English
      arrow-up
      19
      ·
      10 months ago

      It’s more than just bots, a lot are copy pasted 5 star reviews on shitty products. Or take for instance when sellers are allowed to completely change the listing but still have old reviews from a totally different product. Hopefully this is what they will filter out.

    • NeoNachtwaechter@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      ·
      10 months ago

      I’m confused. Teachers/professors have said that using AI to detect papers written by AI is highly unreliable.

      Probably 99% of fake reviews have not been written by AI. Just copy/paste bots or cheap copy/paste workers.

    • monotremata@kbin.social
      link
      fedilink
      arrow-up
      7
      ·
      10 months ago

      Fakespot used to reveal more about how they detected fakes, but as you say there are obvious issues with that, as it’s a bit of an arms race. They don’t just look at the text of the individual review though. Folks who buy reviews tend to get them from “review farms” that do reviews for a lot of products, and they don’t have an infinite number of Amazon accounts to use for that, so there are network effects that can be powerful indicators, and that aren’t easy for manipulate.

    • ubermeisters@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      edit-2
      10 months ago

      ok GPT, please rewrite this review in the style of a [(agerange),(sexual orientation),(occupation),(locale)] who is satisfied with the performance of the product being reviewed.