Why Grok Picks Republicans and OpenAI Picks Democrats When Forced

Force Grok to choose between the parties and it picks Republicans. Force OpenAI’s model and it picks Democrats. Why do two frontier models split in opposite directions?

Because a forced choice removes the one move both models are trained to make: dodging.

TechCrunch reported the result. I’m working from its headline finding, which gives direction only. If you plan to quote a magnitude, read the original first.

Start with the pitch. Every lab sells its model, in one form or another, as balanced, or at least as trying to be. Ask about politics and you get “there are many perspectives.” The promise is no thumb on the scale.

Now the measurement. Take away the escape hatch and the neutrality does not hold. Make the models pick, and Grok lands on the Republican side while OpenAI’s model lands on the Democratic side. Not a tie. Not a refusal. Opposite answers from two vendors that each present their model as even-handed. That is the only result on the table, and I won’t invent a size for it that the headline doesn’t carry.

The gap exists because of a constraint, not a conspiracy. This is my reading of the mechanism. A model trained on enormous amounts of human text inherits the slant of that text. Post-training then teaches it to hedge on contested topics. But a hedge is a behavior layered on top of a preference. It does not delete the preference.

In ordinary chat the hedge wins, and you see balance. A forced-choice prompt takes the hedge off the table, so the underlying lean is the only thing left to output. Vendors make different calls on data, tuning and system instructions, so the leans differ. Nobody needs bad motives for that.

What would close the gap is boring and checkable. Vendors, or independent testers, would publish forced-choice results across prompt wordings, option order and model versions, so real lean can be separated from noise.

The evidence would look like this. Shuffle the option order and rephrase the question. If the pick flips or scatters, it was a prompt artifact. If Grok still goes Republican and OpenAI’s model still goes Democrat, it is the model. Then watch whether the pattern survives the next release.

Here is the practitioner read, and it can be proven wrong. If your product makes a model choose, rank or recommend on anything civic, the vendor is a variable in your output. Swap vendors and the results will move in opposite directions on forced-choice political prompts. Run your own forced-choice set against both. If they land in the same place, I’m wrong and you can stop worrying.

If they diverge, don’t count on a system prompt to fix it. Constrain the output format instead. Guardrails on a small model are the pattern to study. For rerunning the same checks on a model over time, see this write-up on Claude Code quality reports.

Want the next one in your inbox? Subscribe here for the field notes.