How well AI models write HEOR — measured, not asserted.

Method

• Every model writes the same controlled set of HEOR and market-access tasks — the task set from the writing benchmark, unchanged between models.
• Scoring is by AI Delphi: several independent models score the same output over structured rounds, and their judgments converge. No single model grades the field.
• These are the UNANCHORED results. The publication also reports human-anchored scoring; this page publishes the unanchored panel only, so every row is comparable to every other row.
• Runs marked with the Untraceable Grounding Codex are given a curated domain knowledge layer — HTA guidance, methods conventions and reporting standards — retrieved at generation time. The same model without it is a separate row, never averaged in.
• Each row records the provider's exact version string and the date of the run. A model that changes under the same name is re-tested rather than edited.
• Results are published whichever way they go, including for models we do not offer, and retired models stay in the table because the publication cites them.