• 3 Posts
  • 18 Comments
Joined 3 months ago
cake
Cake day: July 18th, 2024

help-circle





  • Here you go:

    https://ponder.cat/wp/wp-sources.zip

    It’s in python, suitable for sticking directly into the bot if the bot is in python. There are docs. It’s a first cut. How did you envision this working? I can make a real API, if for some reason that makes things easier, but it’s not immediately obvious how it would get integrated into things.

    Running it on the last 50 articles posted to /c/politics, we see:

    It’s more complex to use this than MBFC, because there’s a lot more depth to the rankings, and sometimes human judgement is needed to assign scores. There’s a category “needinfo,” meaning it’s necessary to know what topic is being discussed or when an article was written, because of an ownership change or similar factor. I’ve applied that judgement above. That, to me, is a good thing. It means the bot is grounded in something, and not just blithely spitting out arbitrary scores without bothering to ground them in any reality.

    In practice, I think it would be realistic to assign a single reliability ranking to most of the “needinfo” sources. You can manually edit the .json data to do so. Almost all of the posts are going to fit into one of Wikipedia’s categorizations or another. Newsweek is unreliable, The Guardian is reliable, and so on.

    I think most of the mixed-consensus sources can be used without a second thought. Mostly, the questions about them boil down to open partisanship of the source, which for a political community is perfectly fine as long as they’re trustable factually.

    If you want me to boil this down further, so that it gives a single “yes” or “no” score to each source, I can do that and probably keep almost all of the accuracy of the rankings, now that I’ve looked at it for a little while.

    When you talk about “adding” this to the bot, are you proposing to still have MBFC be the main source, with this as a footnote? A lot of the criticism of the bot is on the grounds that MBFC is a very bad source for judging reliability, so I would question the idea of keeping it on as the primary source.


  • Why is it admin level? Are there admins that tell you what you can and can’t do with the politics community, in this case? Or does the politics moderation team have the ability to ditch the bot if they decide to?

    This is such a strange situation. If you’re stuck in that former position, though, it would make a lot of your responses in this comments section make a whole lot more sense.




  • We’re not roasting the volunteer mods because we can’t ignore the bot. We’re roasting the volunteer mods because the experience of having someone in a position of power over your environment, and having them show callous indifference to how everyone in the community sees it, and what we want them to be doing with their position of power, leads people to start roasting. Sometimes out of all possible proportion to how big a deal the thing being complained about actually is.

    It’s part of the healthy interplay of human society that keeps the social contract well-maintained. Take it as a sign of love, that we value this community and want it to function well.



  • How much are you paying for the MBFC API? The page says it isn’t free. I’ll give you an API endpoint which will check sources against https://en.wikipedia.org/wiki/Wikipedia:Reliable_sources/Perennial_sources, if you pay me half of whatever you were paying MBFC previously. That list is quite a lot better than relying on MBFC.

    I already scraped the list. It’ll take around an hour for my script to finish going down the sources and assigning web sites to each one, but I can have a working API endpoint for you tomorrow morning. I can do the bot part also, if you prefer. That’s probably easier than making a new endpoint and hooking it to a bot and debugging the connection and all.

    Like I said, I think the idea that readers won’t be able to determine that Breitbart is unreliable is missing a pretty big elephant in the misinformational room. If the issue that’s causing you to keep MBFC is finding a better source that’s programmatic, though, then solving that is almost trivially easy and at least seems like some kind of step forward.



  • In what way does having the MediaBiasFactCheck bot help with misinformation? It’s not very accurate, probably less than the average Lemmy reader’s preexisting knowledge level. People elsewhere in these comments are posting specific examples, in a coherent, respectful fashion.

    Most misinformation clearly comes in the form of accounts that post a steady stream of “reliable” articles which don’t technically break the rules, and/or in bad-faith comments. You may well be doing plenty of work on that also, I’m not saying you’re not, but it doesn’t seem from the outside like a priority in the way that the bot is. What is the use case where the bot ever helped prevent some misinformation? Do you have an example when it happened?

    I’m not trying to be hostile in the way that I’m asking these questions. It’s just very strange to me that there is an overwhelming consensus by the users of this community in one direction, and that the people who are moderating it are pursuing this weird non-answer way of reacting to the overwhelming consensus. What bad thing would happen if you followed the example of the !news moderators, and just said, “You know what? We like the bot, but the community hates it, so out it goes.” It doesn’t seem like that should be a complex situation or a difficult decision, and I’m struggling to see why the moderation team is so attached to this bot and their explanations are so bizarre when they’re questioned on it.