The website itself says it’s distinctions of left and right are US based which is very skewed from the rest of the world. There should be a disclaimer or it shouldn’t be used in any world news communities.
Centrist Bias
The website follows the idea of “enlightened centrism” since if it determines a website has a left/right lean (again arbitrary) it affects the factual ratings of the sources.
Despite my personal opinions on the pointlessness of using a US based left/right bias criteria I’d feel better if it was at least kept it it’s own section but when you allow it to affect the factual rating of the source it’s just outright wrong. The factual accuracy of the website should be the sole thing that affects this rating.
Questionable Fact Checking
Even just checking some of their ratings raises doubts on the websites credibility.
“Wikipedia’s editors declared that the Anti-Defamation League cannot be trusted to give reliable information on the Israel-Palestine conflict, and they overwhelmingly said the ADL is an unreliable source on antisemitism.”
Maybe Wikipedia editors are a good arbiter of truth and maybe they aren’t but as people can see there isn’t a consensus and so by choosing Media Bias/Fact Check you’re explicitly choosing to align your “truth” with this websites biases.
Everywhere in the world is very skewed from the rest of the world. Someone in Venezuela would likely not agree with a bias rating given by someone in the UK and they likely wouldn’t agree with someone in India who would likely not agree with someone in China. What you’re basically saying, perhaps without realizing it, is that bias ratings shouldn’t be given at all.
Centrist Bias
I don’t know why FAIR is being rated as “High” instead of “Very High” by MB/FC but I don’t see this as some kind of overwhelming issue. The Intercept ranking has an explanation in the report and you should read it but it comes down to the fact that they’re known to only cover certain stories, they’re known to repress journalists, and they’ve been previously caught with writers that were making stuff up. Despite all of that they’re still being rated “mostly factual”, so again I’m not seeing this as an overwhelming issue.
MB/FC does still rate ADL as “High” but it’s worth note that the Wikepedia re-date happened after MB/FC’s last review of the ADL. The next time that MB/FC re-rates the ADL it’s like to go down or get specific notes regarding the Palestinian Conflict.
I thank you for taking the time to reply. I did look at and consider your argument and your sources but at the end I find them to be unpersuasive. There’s no sign of serious problems, how MB/FC evaluates sources is clearly stated and appears to be consistently applied. I will watch the ADL ranking to see what, if anything happens, but a single example of something that needs a re-rank on a specific issue doesn’t demonstrate a pattern. Finally there’s isn’t a single media bias checker on the planet that can be all things to all people at all times, it’s not possible, and since it’s not possible you really can’t knock them for not being up to a literally impossible standard.
Wrote this over on the announcement post for this bot:
Just looking over the methodology it’s clear that it has it’s own biases:
American Bias
The website itself says it’s distinctions of left and right are US based which is very skewed from the rest of the world. There should be a disclaimer or it shouldn’t be used in any world news communities.
Centrist Bias
The website follows the idea of “enlightened centrism” since if it determines a website has a left/right lean (again arbitrary) it affects the factual ratings of the sources.
Examples of this are: FAIR only getting the 2nd highest rating despite never having failed a fact check.
The Intercept getting only a “mostly factual” rating (3rd highest) despite their admittance it has never failed a fact check.
Despite my personal opinions on the pointlessness of using a US based left/right bias criteria I’d feel better if it was at least kept it it’s own section but when you allow it to affect the factual rating of the source it’s just outright wrong. The factual accuracy of the website should be the sole thing that affects this rating.
Questionable Fact Checking
Even just checking some of their ratings raises doubts on the websites credibility.
The ADL is rated as high (2nd highest) and wasn’t found to fail any fact checks.
The ADL was found to be so unreliable on it’s reporting of the Israel-Palestine conflict it is considered an unreliable source by Wikipedia.
“Wikipedia’s editors declared that the Anti-Defamation League cannot be trusted to give reliable information on the Israel-Palestine conflict, and they overwhelmingly said the ADL is an unreliable source on antisemitism.”
Maybe Wikipedia editors are a good arbiter of truth and maybe they aren’t but as people can see there isn’t a consensus and so by choosing Media Bias/Fact Check you’re explicitly choosing to align your “truth” with this websites biases.
Everywhere in the world is very skewed from the rest of the world. Someone in Venezuela would likely not agree with a bias rating given by someone in the UK and they likely wouldn’t agree with someone in India who would likely not agree with someone in China. What you’re basically saying, perhaps without realizing it, is that bias ratings shouldn’t be given at all.
I don’t know why FAIR is being rated as “High” instead of “Very High” by MB/FC but I don’t see this as some kind of overwhelming issue. The Intercept ranking has an explanation in the report and you should read it but it comes down to the fact that they’re known to only cover certain stories, they’re known to repress journalists, and they’ve been previously caught with writers that were making stuff up. Despite all of that they’re still being rated “mostly factual”, so again I’m not seeing this as an overwhelming issue.
So the ADL is ranked the same as FAIR. Seems consistent. You’re also overstating the Wikipedia article, Wikipedia only considers them unreliable on the Palestinian Conflict. The ADL is still perfectly fine (with them) for other things.
MB/FC does still rate ADL as “High” but it’s worth note that the Wikepedia re-date happened after MB/FC’s last review of the ADL. The next time that MB/FC re-rates the ADL it’s like to go down or get specific notes regarding the Palestinian Conflict.
I thank you for taking the time to reply. I did look at and consider your argument and your sources but at the end I find them to be unpersuasive. There’s no sign of serious problems, how MB/FC evaluates sources is clearly stated and appears to be consistently applied. I will watch the ADL ranking to see what, if anything happens, but a single example of something that needs a re-rank on a specific issue doesn’t demonstrate a pattern. Finally there’s isn’t a single media bias checker on the planet that can be all things to all people at all times, it’s not possible, and since it’s not possible you really can’t knock them for not being up to a literally impossible standard.