this post was submitted on 10 Oct 2024
117 points (85.9% liked)

World News

39174 readers
2206 users here now

A community for discussing events around the World

Rules:

Similarly, if you see posts along these lines, do not engage. Report them, block them, and live a happier life than they do. We see too many slapfights that boil down to "Mom! He's bugging me!" and "I'm not touching you!" Going forward, slapfights will result in removed comments and temp bans to cool off.

We ask that the users report any comment or post that violate the rules, to use critical thinking when reading, posting or commenting. Users that post off-topic spam, advocate violence, have multiple comments or posts removed, weaponize reports or violate the code of conduct will be banned.

All posts and comments will be reviewed on a case-by-case basis. This means that some content that violates the rules may be allowed, while other content that does not violate the rules may be removed. The moderators retain the right to remove any content and ban users.


Lemmy World Partners

News [email protected]

Politics [email protected]

World Politics [email protected]


Recommendations

For Firefox users, there is media bias / propaganda / fact check plugin.

https://addons.mozilla.org/en-US/firefox/addon/media-bias-fact-check/

founded 1 year ago
MODERATORS
 

We've had some trouble recently with posts from aggregator links like Google Amp, MSN, and Yahoo.

We're now requiring links go to the OG source, and not a conduit.

In an example like this, it can give the wrong attribution to the MBFC bot, and can give a more or less reliable rating than the original source, but it also makes it harder to run down duplicates.

So anything not linked to the original source, but is stuck on Google Amp, MSN, Yahoo, etc. will be removed.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 5 points 1 month ago* (last edited 1 month ago) (1 children)

That's not saying what you want it to say. It's a top level picture taking great pains to speak in general terms. So no, it's not a guard against MBFC having a bias where it rates conservative stuff higher.

We've found concrete examples of bias in MBFC that would be very hard to see if you're just smashing 11,000 data points against each other. This requires checking the actual sites by hand, basically doing their self appointed job again and checking their work. Then checking it against MBFCs other ratings for internal consistency.

[–] [email protected] -3 points 1 month ago (1 children)

No, if there were serious, pervasive bias impacting scores, it would lower the correlation and MBFC would be an outlier in the group because they would be in agreement less. If something's happening at such a low level that it doesn't impact correlation, it's just an outlier. Multiple researchers conclude that the differences between monitors is too low to impact downstream analysis which is hard to square with your claim. And, each entry represents about 0.01% of their content, so what percentage of that data is being used to draw sweeping conclusions about the whole?

There is just high agreement about what constitutes high and low quality news sites. The notion that MBFC is somehow inferior to other bias monitors or extremely biased is not supported by evidence. If one of those organizations is better than the others, it isn't much better. As this study concludes, because the level of agreement between them is so high, it doesn't really matter which one you use. They're all fine. Even they think so. Not only do MBFC ratings correlate nearly perfectly with Newsguard, Newsguard's rating of MBFC is a perfect score. They're well-respected by each other.

And, really, how could these researchers who've dedicated their lives to understanding this stuff have gotten it so wrong? Academia definitely isn't a hotbed of conservatism. Using awful tools could destroy their careers but MBFC is regularly used in research. Why? How are these studies getting through peer-review? How are they getting published? There are just too many failure points required.

[–] [email protected] 3 points 1 month ago

Because there's a lot that goes into statistics. Notice I didn't say they would be conservative, just that sometimes they can be wrong. And they take great pains to say this is a general thing. That means there's a lot of room in the numbers. It's not at all what you're trying to say it is.