HackerRank Open Sources Its ATS — And Nobody Trusts the Score
HackerRank open sourced its ATS and developers immediately found the resume scoring wildly inconsistent — a warning shot for AI hiring tools.
The signal: HackerRank open sourced its applicant tracking system, and the HN thread turned into a live stress test — the same resume scoring 74, then 88, then 90 depending on how you looked at it.
Why it matters: If you’re building anything with AI-scored resumes or candidate ranking, this is your canary. Variance that wide isn’t a bug you ship around — it’s a trust-killer, and developers are now poking at the internals in public.
The pattern I’m watching: Open sourcing hiring tools is becoming a credibility move, but it’s a double-edged sword. The moment you hand developers the keys, they run the adversarial tests your QA team never thought to run. GLM 5.2 reportedly beating Claude in benchmarks this same week tells me model evaluation instability is the thread connecting everything right now.
What I’d do with this: Fork it, run your own resume through it ten times, and log the variance before you trust any AI scoring layer in your hiring pipeline. If you’re building HR tech, treat score consistency as a first-class metric — not an afterthought.