We’ve had some trouble recently with posts from aggregator links like Google Amp, MSN, and Yahoo.

We’re now requiring links go to the OG source, and not a conduit.

In an example like this, it can give the wrong attribution to the MBFC bot, and can give a more or less reliable rating than the original source, but it also makes it harder to run down duplicates.

So anything not linked to the original source, but is stuck on Google Amp, MSN, Yahoo, etc. will be removed.

    • jordanlund@lemmy.worldOPM
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      16
      ·
      2 months ago

      Not seeing any suggestions there to improve the bot, but lots of bannable attacks on other users, mods and admins.

      So I’ll say it again, as I’ve told other people complaining, I’m open to making the bot better. If you have suggestions, I’d love to hear them.

      1. It has to be automated, which means accessible through an API.

      2. It has to be no/low cost. Lemmy.World doesn’t have a budget for this. We met with an MBFC alternative, they wanted 6 figures. HARD no.

      • Docus@lemmy.world
        link
        fedilink
        English
        arrow-up
        17
        ·
        2 months ago

        Ok, i’ll bite. I don’t value the bot (in part because it rates sites/newspapers and not authors or articles. Good news sites have the occasional shit article and vice versa), so please reduce the precious space it takes up on my mobile device. A one liner with a link would be enough.

        • jordanlund@lemmy.worldOPM
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          1
          ·
          2 months ago

          I feel your pain. Some readers, like mine (Boost) don’t handle the spoiler tag markup correctly and it ends up bigger than designed.

      • catloaf@lemm.ee
        link
        fedilink
        English
        arrow-up
        17
        ·
        2 months ago

        You could get rid of it. No automation, API, or cost whatsoever.

          • PhilipTheBucket@ponder.cat
            link
            fedilink
            English
            arrow-up
            14
            ·
            2 months ago

            Why is it admin level? Are there admins that tell you what you can and can’t do with the politics community, in this case? Or does the politics moderation team have the ability to ditch the bot if they decide to?

            This is such a strange situation. If you’re stuck in that former position, though, it would make a lot of your responses in this comments section make a whole lot more sense.

            • jordanlund@lemmy.worldOPM
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              6
              ·
              2 months ago

              The Admins run lemmy.world, we serve at their pleasure.

              Sure, I could ban it, then likely get removed and have the bot re-instated, and what good would that do anyone?

              • Maalus@lemmy.world
                link
                fedilink
                English
                arrow-up
                7
                ·
                2 months ago

                It would do a lot of good to everyone. This is the exact same problem that was on reddit during the “boycotts” - moderators afraid of losing power over people, rolling over when a corporation came knocking. Right here it’s instance admins instead. You volunteer your time to do moderation and let them dictate you implement an unpopular change - introducing a biased bot. People don’t like the bot - it constantly is being downvoted, commented about.

                The world would be an entirely different place if people had the spine to do what’s right, not only what’s convenient. Reddit would be burnt to a crisp with no moderators if that were the case. So much for an independent platform where people’s voice matters.

              • catloaf@lemm.ee
                link
                fedilink
                English
                arrow-up
                7
                arrow-down
                1
                ·
                2 months ago

                If the admins need to micro-manage the communities on their instance, let them moderate them.

                • njm1314@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  5
                  ·
                  2 months ago

                  But that would be require him to give up his small made up powers that make him feel big

          • catloaf@lemm.ee
            link
            fedilink
            English
            arrow-up
            9
            ·
            2 months ago

            You could ask them to remove it. Or you could ban it. The other news community doesn’t have it any more. Clearly, it is possible.

      • PhilipTheBucket@ponder.cat
        link
        fedilink
        English
        arrow-up
        18
        arrow-down
        2
        ·
        2 months ago

        How much are you paying for the MBFC API? The page says it isn’t free. I’ll give you an API endpoint which will check sources against https://en.wikipedia.org/wiki/Wikipedia:Reliable_sources/Perennial_sources, if you pay me half of whatever you were paying MBFC previously. That list is quite a lot better than relying on MBFC.

        I already scraped the list. It’ll take around an hour for my script to finish going down the sources and assigning web sites to each one, but I can have a working API endpoint for you tomorrow morning. I can do the bot part also, if you prefer. That’s probably easier than making a new endpoint and hooking it to a bot and debugging the connection and all.

        Like I said, I think the idea that readers won’t be able to determine that Breitbart is unreliable is missing a pretty big elephant in the misinformational room. If the issue that’s causing you to keep MBFC is finding a better source that’s programmatic, though, then solving that is almost trivially easy and at least seems like some kind of step forward.

        • Rooki@lemmy.world
          link
          fedilink
          English
          arrow-up
          8
          arrow-down
          3
          ·
          2 months ago

          MBFC API is free as they gave us access for us as a Non Profit.

          We already had in mind adding these sources to our bot but we didnt had the time and knowledge how to scrape that. Personally i would like to host it on our own server so that we dont require you to use your own money just for one bot, in what programming language did you write it?

          Thanks a lot!
          Rooki

          • PhilipTheBucket@ponder.cat
            link
            fedilink
            English
            arrow-up
            10
            ·
            2 months ago

            On a different topic: It sounds like jordanlund is saying that if he tried to remove the MBFC bot from the politics sub, he might be removed as a moderator, and replaced with someone else, and the bot would come back.

            https://lemmy.world/comment/12825768

            Is that true? Is the admin team mandating the use of this bot, and if so, why?

            • Rooki@lemmy.world
              link
              fedilink
              English
              arrow-up
              6
              arrow-down
              2
              ·
              edit-2
              2 months ago

              No, i dont get it from where he would get that idea, because see c/politics mods wanted the bot gone and we removed it no question asked.

              @jordanlund@lemmy.world if you really dont want the bot here we can remove the bot and shut the bot down ( please consult other c/world mods too )

          • PhilipTheBucket@ponder.cat
            link
            fedilink
            English
            arrow-up
            10
            ·
            2 months ago

            Here you go:

            https://ponder.cat/wp/wp-sources.zip

            It’s in python, suitable for sticking directly into the bot if the bot is in python. There are docs. It’s a first cut. How did you envision this working? I can make a real API, if for some reason that makes things easier, but it’s not immediately obvious how it would get integrated into things.

            Running it on the last 50 articles posted to /c/politics, we see:

            It’s more complex to use this than MBFC, because there’s a lot more depth to the rankings, and sometimes human judgement is needed to assign scores. There’s a category “needinfo,” meaning it’s necessary to know what topic is being discussed or when an article was written, because of an ownership change or similar factor. I’ve applied that judgement above. That, to me, is a good thing. It means the bot is grounded in something, and not just blithely spitting out arbitrary scores without bothering to ground them in any reality.

            In practice, I think it would be realistic to assign a single reliability ranking to most of the “needinfo” sources. You can manually edit the .json data to do so. Almost all of the posts are going to fit into one of Wikipedia’s categorizations or another. Newsweek is unreliable, The Guardian is reliable, and so on.

            I think most of the mixed-consensus sources can be used without a second thought. Mostly, the questions about them boil down to open partisanship of the source, which for a political community is perfectly fine as long as they’re trustable factually.

            If you want me to boil this down further, so that it gives a single “yes” or “no” score to each source, I can do that and probably keep almost all of the accuracy of the rankings, now that I’ve looked at it for a little while.

            When you talk about “adding” this to the bot, are you proposing to still have MBFC be the main source, with this as a footnote? A lot of the criticism of the bot is on the grounds that MBFC is a very bad source for judging reliability, so I would question the idea of keeping it on as the primary source.

            • Rooki@lemmy.world
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              2
              ·
              2 months ago

              By “adding” i mean adding it into the field higher than MBFC ( as i personally think wikipedia is a little bit better for that ).

              new:

              Wikipedia: Reliability consensus is mixed…l ( whatever the scrapper scrapes ) MBFC: Right-Center - Credibility: High - Factual Reporting: Mostly Factual - United States of America
              Search Wikipedia about this source

              I would like to implement your code into the bot myself so i can learn how you would do it. If you are willing to share your code, please send me a github link ( or invite me if you want it to be private between you and me ) or if its super simple just send it in the dms.

                • Rooki@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  1
                  ·
                  2 months ago

                  Ok i implemented it into the bot and it took about 1 hour and 6 minutes to fetch all links and i am now implementing the part where it is inserted into the new text.

                • Rooki@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  4
                  arrow-down
                  3
                  ·
                  2 months ago

                  Ok i will look into it, thanks i thought it was just the sources not the code.

          • nmtake@lemm.ee
            link
            fedilink
            English
            arrow-up
            8
            ·
            2 months ago

            Since it’s a MediaWiki page you can get Markdown source of the page with appending action=raw query to the URL.

        • jordanlund@lemmy.worldOPM
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          10
          ·
          2 months ago

          I can’t ignore suggestions nobody is making. Have a better service in mind? Feel free to present it.

          We looked at AllSides, which is good for bias, but has no scoring for credibility.

          • Catoblepas@lemmy.blahaj.zone
            link
            fedilink
            English
            arrow-up
            24
            ·
            2 months ago

            “We have to keep using the ratings website made by a random dude with no background in journalism who makes it available for free because real fact checking services cost money” is perhaps not the argument I would use for why the bot is both accurate and useful.

            You don’t have to have a bot at all, especially to replace something like blacklisting Breitbart URLs, but someone thought the idea sounds cool. So “don’t have the bot” has been unnecessarily eliminated as an option. Even though sometimes the best option really is to just not have a bot.

            • CanadaPlus@lemmy.sdf.org
              link
              fedilink
              English
              arrow-up
              7
              arrow-down
              1
              ·
              edit-2
              2 months ago

              I mean, it’s a great argument for not going with actual fact checkers, unless you’re volunteering to pay.

              Not having one is also an option, but for my 2 cents the bot seems accurate enough so far, and it’s easy enough to ignore if you really don’t like it.

              • Catoblepas@lemmy.blahaj.zone
                link
                fedilink
                English
                arrow-up
                11
                ·
                2 months ago

                I’m definitely not paying to have a “think for me” bot on an instance I’m not part of. You can’t automod your way out of media illiteracy.

          • grue@lemmy.world
            link
            fedilink
            English
            arrow-up
            17
            ·
            edit-2
            2 months ago

            Stop pretending that “get rid of the bot” doesn’t count as a suggestion. That’s dishonest.

            I don’t even care about the bot itself, but at this point I’m just getting pissed off by all the constant distracting bickering about it.

            • jordanlund@lemmy.worldOPM
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              11
              ·
              2 months ago

              When the question is “how do we improve it?” the answer “get rid of it” is not a genuine suggestion.

              The GOOD news is, we DO have a genuinely good suggestion here and the bot creator will be reaching out.

              • Maalus@lemmy.world
                link
                fedilink
                English
                arrow-up
                9
                ·
                2 months ago

                It is a genuine suggestion. If something is a net negative, you don’t go for the sunken cost fallacy and jam it down users throats even harder. If that’s the only question you are willing to ask, then that means you don’t listen to suggestions - you just want to seem like you do.

              • Dumnorix@lemmy.world
                link
                fedilink
                English
                arrow-up
                6
                ·
                2 months ago

                Honest question,

                If I understand the comment thread correctly, this means you’ll integrate the Wikipedia/Wikidata info in the existing bot, correct? Will an announcement be posted when or if this happens, so that people like me who blocked the bot can unblock it? I do like the concept of the bot, but I prefer an open source collaborative effort compared to a one man, rightwing aligned website.

                Thanks for your openness to improve the service.

                • jordanlund@lemmy.worldOPM
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  2
                  ·
                  2 months ago

                  Dunno yet, that’s something Rooki and the other user will have to sort out, but I’m all for improvements!