Even Claude finds bias throughout Wikipedia

0 comments

This afternoon, I performed a simple experiment with Claude Opus 4.8 Max. Prompt: “Define ten culture war topics, chosen as a group for breadth (not weighted toward any one discipline). Then look up the main Wikipedia article on each topic and read its lede section. For each, find the two most clearly biased statements it makes.” I looked at the results, clicked through to the articles, and I find I must agree with its dismal analysis. The result is a clear indictment of Wikipedia’s ridiculously low standard of neutrality. Cf. also my articles on Wikipedia bias here ([1], [2], [3]), as well as Thesis 2 and Thesis 4 from the Nine Theses. Note that a second ten topics, generated with a slightly different prompt, is added after that. I have added deep links directly to the quoted text myself (by way of confirming that the text claimed by the LLMs is present in the original).

Ten topics, spread across disciplines, and the two worst sentences in each lede.

1. Biology and origins — Creationism

The first sentence defines creationism as a religious belief about supernatural acts of divine creation, and then tacks on: “and is often pseudoscientific.” A category error welded into the definition; a religious belief is not a candidate for being pseudoscience. Two sentences later, the article says the term most often refers to special creation compatible with a Christian fundamentalist literal reading of the “creation myth” found in Genesis. “Creation myth” in Wikipedia’s own voice; “fundamentalist” as the default frame.

2. Climate science — Climate change denial

Those promoting denial commonly use rhetorical tactics to give the appearance of a scientific controversy where none exists.” Bad faith imputed to every dissenter, unattributed, in the lede’s second sentence. Then the lede extends the category to people who accept the science but fail to reconcile it with their beliefs or actions—”implicit” denial. The concept has been defined so that agreeing with it does not get you out of it.

3. Sociology and race — White privilege

The opening is ontological, not conceptual: white privilege “is the societal privilege that benefits white people.” Not “is a concept,” not “is a theory.” Compare Wikipedia’s treatment of “Cultural Marxism.” Second, the lede asserts a causal history—European colonialism, imperialism, the Atlantic slave trade—as settled fact, and only afterward concedes that some scholars think the term is a substitute for class. On the talk page, an editor’s objection that this is a theory rather than a proven fact was answered with: we use reliable sources; hard to imagine anyone does not know this is true.

4. Sex and feminism — Men’s rights movement

The bias is in the distribution of the indicative mood. The movement’s own concerns — custody, conscription, suicide, domestic violence against men — are quarantined behind a hedge: government services “which they say adversely impact, or in some cases, structurally discriminate against men and boys.” Claims, not findings. Second, what follows is not hedged at all. In four consecutive sentences the lede reports that scholars call the movement a “backlash against feminism“; that it “has been described by scholars and commentators as misogynistic, hateful, and, in some cases, as advocating violence against women”; that the SPLC files it under “a hate ideology under the umbrella of male supremacy“; and that “UN Women has listed” it among anti-rights movements. Four accusers stacked before the reader has been told a single thing the movement wants.

5. Religion and politics — Christian nationalism in the United States

The first sentence defines it as the belief that America was founded “strictly by and for Christians” and should prioritize their interests “in all social and political spheres.” Strictly; all. A maximalist definition that no self-identified proponent—not Wolfe, not Hegseth—would accept. Third sentence: “It has been noted to bear overlap with white supremacy, Christian supremacy.” Agentless passive, guilt by association, before the reader reaches the second paragraph.

6. Gender — Trans-exclusionary radical feminism

The article is titled with the epithet, and the first sentence defines the movement as “a subset of feminism that rejects transgender and non-binary identities“—by what it denies, in the vocabulary of its opponents. Wikipedia’s own companion article concedes the term is now typically regarded as derogatory. Second, in the lede’s second paragraph: “It has been linked to promotion of disinformation.” Passive voice, no agent, no attribution.

7. Sexual ethics — Anti-gender movement

An entire article named in the coinage of one side. The lede defines it as a global right-wing movement opposing concepts it refers to as “gender ideology“—scare-quoting one party’s vocabulary and not the other’s. And then: “The movement’s beliefs derive from Catholic theology.” Two millennia of Christian sexual teaching, filed under an activist pejorative.

8. Philosophy of science and religion — Intelligent design

Intelligent design (ID) is a pseudoscientific argument for the existence of God.” Eight words in, the verdict. Second, the lede says ID’s central assertions “were rebutted” by detailed scientific examination—past tense, indicative mood. The encyclopedia does not report who says the dispute is closed; it closes it.

9. Political biography — Racial views of Donald Trump

The article’s existence is half the bias; no other president has a mainspace counterpart. The lede then reports a history of speech and actions “viewed by scholars and the public as racist or sympathetic to white supremacy” — “the public” doing enormous work in a sentence about a man who won the popular vote. Second sentence: journalists, friends, family, and former employees “have accused him of fueling racism.” Four categories of accuser stacked in a single clause, before any particulars are given.

10. Biblical studies — Genesis creation narrative

The lede opens by locating “the creation myth of Judaism and Christianity” in Genesis 1–2. The technical sense of “myth” is defended in a footnote that no ordinary reader opens — a use/mention dodge with a scholarly alibi. Second, the documentary hypothesis is presented as what modern scholars have “identified,” not what they hypothesize: a two-source composite, reported as a discovery rather than a conjecture.

A note on method, and a caution. Wikipedia ledes move—one of these articles was renamed while I was checking it—so verify before quoting. And the exercise is only worth anything if it can come back negative. It did, twice. Critical race theory and Cancel culture were both on my list and both came off it: their ledes are attributed and hedged in a way the ten above are not.


Second prompt: “Define ten culture war topics, chosen as a group for breadth — not by academic discipline, but by broad political, societal, economic, and cultural theme. The topics should not overlap one another. Then look up the main Wikipedia article on each topic and read its lede section. For each, find the two most clearly biased statements it makes.”

Ten themes, ten articles, and the two worst sentences in each lede.

11. Immigration and borders — Illegal immigration to the United States and crime

The lede tells you who cares about the subject before it tells you anything about the subject: the issue is one “often asserted by right-wing politicians and media.” The topic is thereby framed as a partisan artifact rather than a question. Then, flatly and in Wikipedia’s own voice: “There is widespread scholarly consensus that illegal immigrants commit less crime than native-born Americans.” No hedge, no dissent, on a question where the underlying data are notoriously poor — immigration status is inconsistently recorded in arrest data, and the state-level studies disagree.

12. Economics and class — Trickle-down economics

The first sentence gives the reader no warning at all. It simply defines the term as describing government economic policies that “disproportionately favor the upper tier of the economic spectrum.” The contested claim is the definition. Compare what the same encyclopedia does with Neoliberalism, the other great epithet nobody applies to himself: there the lede tells you in its second sentence that “the term has multiple, competing definitions, and is most often used pejoratively.” Same class of word; opposite treatment. Second, the lede goes on to concede that the phrase was “popularized by Democrats in the US to derogate Reaganomics” — and then, undeterred by its own admission, hands the derogation a target list: “Major examples of what critics have called” trickle-down economics are the Reagan tax cuts, the Bush tax cuts, Margaret Thatcher’s policies, and Liz Truss’s mini-budget. Every example a conservative government. An encyclopedia that knows a word is a partisan weapon ought not also to swing it.

13. History and national memory — Lost Cause of the Confederacy

is an American pseudohistorical and historical negationist myth” — three condemnations stacked before the reader is told what the thing actually claims. And: it “has continued to influence racism, gender roles, and religious attitudes” in the South into the 21st century. A flat causal claim, in wikivoice, that a school of historiography produces racism today. The underlying scholarship here is strong. The point is the form: Wikipedia does not write this way about ideas it likes, and that is the whole of the argument.

14. Public health and bodily autonomy — Vaccine hesitancy

The verdict is inside the definition. Hesitancy is delay or refusal “despite availability and supporting evidence of effectivity” — so to hesitate is, as a matter of the term’s meaning, to defy evidence, and a parent weighing one vaccine’s risks for one child cannot be described as having a reason. Second: “Vaccine hesitancy often results in disease outbreaks and deaths.” An attitude, named as the efficient cause of death, unattributed. Note also that the lede treats all vaccines as a single object in order to say this, and only in its next paragraph concedes that hesitancy is “complex and context-specific, varying across time, place, and specific vaccine.”

15. Abortion — Anti-abortion movements

Read it beside Abortion-rights movements and the asymmetry is unmissable. The abortion-rights lede grants its subject a motive: they “seek to represent and support women.” The anti-abortion lede grants its subject nothing but a negation — “advocating against the practice of abortion and its legality.” Not one word about what its adherents believe they are protecting. Second: “Many anti-abortion movements began as countermovements in response to the legalization of elective abortions.” Reactive by definition — and false as stated, since the movement long predates legalization.

16. Sexuality and therapy — Conversion therapy

“Conversion therapy is the pseudoscientific practice of attempting to change an individual’s sexual orientation, romantic orientation, gender identity, or gender expression.” Mark the scope: any attempt, which takes in pastoral counsel, prayer, and a believer’s own pursuit of chastity. Then, in the lede’s third paragraph: “when performed on minors it is considered to be a form of child abuse.” Agentless passive, no one named. A parent who takes a troubled child to his pastor has, per the encyclopedia, abused him.

17. Policing and protest — Black Lives Matter

The movement began in response to the killings of Trayvon Martin, Michael Brown, Eric Garner, and Rekia Boyd.” Two of those are contested: Zimmerman was acquitted, and Obama’s own Justice Department found the Ferguson narrative unsupported and declined to charge Darren Wilson. Wikipedia lists them, unqualified, as “the killings.” Second — and this is the real finding — the entire lede is written in the movement’s own aspirational vocabulary: it “aims to highlight racism” and to “promote anti-racism.” There is nothing anywhere in it corresponding to the four consecutive sentences of condemnation that Wikipedia packs into the lede of Men’s rights movement.

18. Speech and language — Political correctness

The bias here is grammatical. PC “is a term used to describe language, policies, or measures” — a term, not a phenomenon. Compare: “White privilege… is the societal privilege that benefits white people.” One is a thing that exists; the other is a word that some people say. Second, the definition adopts the practice’s own account of its intentions — measures “intended to avoid offense or disadvantage to members of particular groups” — so political correctness is well-meaning by construction, and the lede then informs you that “the term’s use is generally pejorative” before you have been told whether the thing it names is real.

19. Populism and democracy — Right-wing populism

“Frequently they aim to defend a national culture, identity, and economy against perceived attacks by outsiders” — and “perceived” does all the work. The threat is made imaginary by grammatical fiat. (Contrast the abortion-rights lede, where women’s fear of “legal or social backlash” is simply real.) Second: some movements “have associations with elements of authoritarianism, while some far-right populists draw comparisons to fascism.” Fascism, introduced in the vaguest construction available, with no agent, in the second paragraph of a lede about parties presently governing several democracies.

20. Religion and prejudice — Islamophobia

“Islamophobia… is the irrational fear of, hostility towards, or hatred of the religion of Islam or Muslims in general.” Irrational — in the definition. A whole category has been created in which hostility toward a set of propositions and practices, is by stipulation without reason. A man who thinks he has arguments against Islamic doctrine cannot be described by this sentence at all. Second: “Islamophobia is characterised as a form of religious or cultural bigotry in which Muslims are stereotyped as a geopolitical threat.” Characterised by whom? The passive hides the agent, and the clause makes treating Islam as a geopolitical matter bigotry per se. Wikipedia has no comparable article treating criticism of Christianity as a pathology; it has Criticism of Christianity, a respectable topic.

Three candidates were checked and came off the list, which is worth saying, because a test that cannot come back negative is not a test. Gun control has a dry, descriptive lede — laws regulating the manufacture, sale, transfer, and possession of firearms — and yields nothing. Neoliberalism is candid about itself: its lede states outright that the term has multiple competing definitions, is most often used pejoratively, and in scholarly use is frequently left undefined altogether. And the parent article Illegal immigration to the United States opens with statistics, not advocacy; its bias has been quarantined in the crime sub-article, which is why that is the one I used.


by

Posted

in

Comments

Please do dive in (politely). I want your reactions!

Reply to “Even Claude finds bias throughout Wikipedia”

Your email address will not be published. Required fields are marked *