
ModelCompare: Why Every AI Model Gives the Same 'Controversial' Take on Humans
ModelCompare says every AI model gives the same 'controversial' take on humans. The cause is a shared training recipe, and it breaks cross-model checking.
Why would models from rival labs, built on different budgets and different data, hand you the same “controversial” take on humans?
Because the differences you can see are not the ones that matter. ModelCompare’s post, “Every AI model has the same ‘controversial’ take on humans,” is fresh evidence. The explanation is a change in tempo most builders missed: the industry converged on one training recipe in under a year.
March 2022: OpenAI publishes InstructGPT. Tuning on human preference rankings produces a model people prefer over a far larger untuned one.
November 2022: ChatGPT ships. Preference-tuned behavior becomes what everyone expects from a chat model.
December 2022: Anthropic publishes Constitutional AI. It replaces some human raters with AI feedback scored against written principles.
The methods differ, but the target is the same: the answer a rater, human or model, scores as good.
That is the through-line. Pretraining hands every lab overlapping raw material, the public web. Post-training then pushes every model toward the same objective. The raters share cultural priors. The labs chase the same public benchmarks.
So when a “controversial” opinion arrives identically from every vendor, it is not five independent minds agreeing. It is one opinion, reproduced.
I am not going to retell the take here. Read ModelCompare’s post for that. The content matters less than the fact of the agreement.
The practical consequence is this: agreement between models is not verification.
If your pipeline asks a second model to check the first, and both came out of the same recipe, they share blind spots. Correlated errors pass the check cleanly. The check feels rigorous and catches the mistakes least likely to be caught.
Put verification outside the models. Use tests, schema validation and lookups against ground truth. That is the logic behind wrapping a small model in hard guardrails instead of hoping a bigger one behaves. If you are chaining agents end to end, the full agentic SDLC breakdown shows where those checks belong.
There is a product angle too. If your pitch is the model’s “honest opinion,” you are shipping the same opinion as every competitor. Your differentiation is your data, your constraints and your workflow, not the model’s voice.
My prediction: by December 2026, any new frontier model run through the same prompt will land on the same take. The agreement will persist, not fade. If a major release breaks it, I am wrong.
Want the next one in your inbox? Subscribe. One AI signal a day. 90 seconds. No fluff.