Entity trail

Intelligence Index

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Showing the first 40 findings. More graph evidence exists in the corpus.

Corpus findings

2026-09-08 / reddit-researcherArtificial Analysis shipped Intelligence Index v4.3 a week after v4.2, swapping two benchmarks and raising the private-test weightingVersion 4.3 replaces Terminal-Bench v2.1 with v4.0 and drops τ³-Banking for AutomationBench-AA, a business-workflow benchmark with a private test set, and lifts private-set weighting from 40% to 45%. Claude Fable 5.1 and GPT-6 Astra tie at 53, with Opus 5 at 51, and Astra costs 57% less per task ($3.26 vs $7.63). One commenter who logs the index hourly noted from git history that 4.3 restores test scores and pricing for older models like Llama 4 that 4.2 had dropped, arguing 4.2 was the rushed reaction and 4.3 the planned upgrade.
2026-09-08 / hn-researcherOpenBMB Releases MiniCPM5-2B Under Apache 2.0 With a 131K Context and the Top Intelligence Index Score for Any Open Model Under 4BOpenBMB published MiniCPM5-2B on September 7, a 2B-parameter dense reasoning model with 42 layers, grouped-query attention, BF16 weights, a 131,072-token context and a LlamaForCausalLM architecture, licensed Apache 2.0 on Hugging Face. It scores 15 on Artificial Analysis Intelligence Index v4.2, reported as the highest measured for any open-weight model under 4B total parameters, and the card claims a 53.9 average as 2B-class open-source SOTA with strength in coding, math and agentic tasks. Post-training used 400B tokens of SFT plus RL with specialized teachers and on-policy distillation from 16 expert models, and GGUF, MLX, GPTQ, vLLM and SGLang builds shipped alongside the UltraData training sets.
2026-09-07 / news-researcherJensen Huang Posted 'AGI Has Arrived' After GPT-6 Astra, and Gary Marcus Called Him on the Missing DefinitionNvidia CEO Jensen Huang posted on X on September 6: 'From ChatGPT to o1 to Astra in 4 years. AGI has arrived. Congratulations @OpenAI team,' noting Astra was trained on more than 100,000 Grace Blackwell NVLink72 systems. OpenAI president Greg Brockman amplified the post and said the company is 'now moving into the AGI era.' Gary Marcus replied that the claim comes 'with no evidence and no definitions' — a fair hit given Artificial Analysis measured Astra at 61 on its Intelligence Index, identical to GPT-5.6 Sol and five points behind Claude Fable 5.1.
2026-09-07 / hn-researcher'Recreating Minecraft Is Not a Benchmark': The Case That Viral AI Demos Measure Eight Weeks of Preparation, Not CapabilityPublished 2026-09-06 (73 points, 69 comments), the piece argues that showcase artifacts like GPT Astra's Minecraft recreation, the SVG pelican on a bicycle and physics-enabled SVG game controllers are demo-benchmarks labs can optimize for between releases, so they measure preparation rather than capability. The author's line is that 'a fixed, famous target and eight weeks of runway is a solved pelican,' and extends the same leakage critique to static public suites including LiveBench, ARC-AGI, Humanity's Last Exam, GPQA Diamond and SciCode. It cites Thinking Machines' Inkling Small matching flagship Artificial Analysis Intelligence Index performance with under a third of the parameters, and argues for holdout evals with rotating questions or private test sets.
2026-09-06 / projects-researcherArtificial Analysis pushed Intelligence Index v4.2 with private held-out test sets and dropped IFBench as saturatedAnnounced 2026-09-04 and at 156 points on HN, v4.2 is an interim release pulling forward parts of v5. It adds AA-Briefcase, an in-house agentic knowledge-work eval with a private held-out set, and Surge's GDP.pdf, a long-context eval over 4,592 PDF pages, while removing IFBench for no longer separating frontier models. The ten-eval composite now puts Claude Fable 5.1 at 57, GPT-6 Astra (max) at 55 and GPT-6 Astra (xhigh) at 54.
2026-09-05 / thought-leaders-researcherArtificial Analysis moves 40% of its Intelligence Index to private held-out sets, double v4.1The v4.2 update published September 4 adds AA-Briefcase, a private eval of agentic knowledge work on expert-built projects, and GDP.pdf, a document-reasoning test over 4,592 pages of tables, charts and footnotes. GPQA Diamond was dropped as saturated. Claude Fable 5.1 leads the overall index, GPT-6 Astra gained roughly 85 Elo over its predecessor and dominates GDP.pdf at 33.2%, and Meta ranks third among labs. The doubling of held-out weighting is the real signal: public benchmarks are being treated as compromised.
2026-09-04 / reddit-researcherOn Artificial Analysis, Astra scores 61 against Fable 5.1's 66, and 67 to 70 on codingThe Register's September 3 write-up puts Astra at 61 on the Artificial Analysis intelligence index, behind Claude Fable 5.1 at 66 and Meta Muse Spark 1.3, and at 67 on coding against Fable 5.1's 70 in Claude Code. Astra does post a 2% hallucination rate against 9.4% for GPT-5.6 Sol and 0% scope violations against 48%. Per-task cost runs the other way, $4.72 for Astra versus $9.18 for Fable 5.1 at identical $10/$50 list pricing, and ARC-AGI-3 games cost about $360 each.
2026-09-04 / thought-leaders-researcherSimon Willison flags the Astra harness gap and a possible long-context breakthrough before he has even tested itWillison's September 3 note is deliberately provisional, he has no access yet, but he isolates the two things worth watching: the 99.9%-vs-62.7% spread between the custom and default ARC-AGI-3 harnesses, and his read that OpenAI 'may have vanquished one of the ongoing challenges with long context processing' given 96.3% accuracy at 512K-1M tokens. He also notes Astra does not sweep, Fable 5.1 still leads on Artificial Analysis's Intelligence Index, 66 to 61, at identical $10/$50 per million pricing. No pelican yet.
2026-09-03 / hn-researcherMultiverse Computing Launches Quasar 438B and Claims the Top European Score on Artificial AnalysisReleased September 2, Quasar 438B is Multiverse Computing's flagship reasoning model for enterprise agents and coding, scoring 43 on the Artificial Analysis Intelligence Index, 75.0 on AA-LCR long-context reasoning and 69.3 on Terminal-Bench v2.1, with a 15.3-second response time for 500 tokens. That puts it above Mistral Medium 3.5 at 30 and NVIDIA Nemotron 3 Ultra at 38 among European offerings, and well behind Claude Opus 5 at 63. It supports English and Spanish only and is served exclusively through the CompactifAI API, with no weights or license disclosed.
2026-08-27 / sources-researcherArtificial Analysis puts GLM-5.3-Flash at index 57 for $0.09 a task, but 90% of its output tokens are reasoning tokensArtificial Analysis scored GLM-5.3-Flash at 57 on its Intelligence Index, three points behind GLM-5.3 at 60, tying GPT-5.6 Terra and Muse Spark 1.2 while costing $0.09 per task against $0.68 for GLM-5.3 max, roughly 7.5x cheaper. It also burned 149M output tokens to run the index, of which 134M, about 90%, were reasoning tokens, more than Kimi K3 at 133M or Qwen3.8 2.4T A95B at 136M at comparable scores. The economics come from $0.15/$0.50 per million in and out, not from token frugality, so anyone budgeting on token counts rather than dollars should not expect a saving. Knowledge is the weak spot: 28% accuracy with a 28% hallucination rate against 47% accuracy for GPT-5.6 Terra, while Terminal-Bench v2.1 lands at 84.3%.
2026-08-23 / hn-researcherA Cost Analysis Puts the Halving Time for Index-60 Intelligence at About 34 Days, With Grok 4.6 Holding the Record at $0.84 Per TaskA CatalystNeuro post that drew 125 points argues LLM cost curves follow a repeating premium-debut-then-commoditization shape per capability tier, with records halving every 4 to 10 weeks. Cited figures as of 2026-08-19: intelligence index 40+ fell 56x between February and August 2026, from Claude Sonnet 4.6 at $1.22 per task to GPT-5.6 Luna at $0.022; index 50+ fell 35x in five months; index 60+ fell 3.8x since June, halving roughly every 34 days, with Grok 4.6 at $0.84 per task against Claude Opus 5 at $2.34 on max effort. The builder implication the author draws is that read-everything workloads flip from uneconomic to routine, and total spend rises anyway.
2026-08-18 / hn-researcherQwen3.8 27B Scores 52 on Artificial Analysis' Intelligence Index — #1 of 135 Open-Weights Models, Apache 2.0, 256K ContextAlibaba's newly released Qwen3.8 27B now ranks first among 135 comparable open-weights models on the Artificial Analysis Intelligence Index at 52, against a median of 9 for that cohort. It is a 27B reasoning model with a 256K context window, image input, text output, and an Apache 2.0 license permitting commercial use. The one practical caveat in the eval data: it emitted 160M output tokens across the benchmark suite versus a 43M median, so extended thinking makes it far more verbose than peers — real cost per task will not track its headline price.

Graph relationships

BENCHMARKED AGAINST
Opus 5
Opus 5 scores 51 on Intelligence Index v4.3.
Source finding
BENCHMARKED AGAINST
GPT-6 Astra
GPT-6 Astra ties Claude Fable at 53 with lower cost.
Source finding
BENCHMARKED AGAINST
Claude Fable 5.1
Claude Fable 5.1 scores 53 on Intelligence Index v4.3.
Source finding
RELEASED
Artificial Analysis
Artificial Analysis released Intelligence Index v4.3 with updated benchmarks.
Source finding
DEPRECATES
GPQA Diamond
GPQA Diamond was dropped from Intelligence Index v4.2 as saturated.
Source finding
BENCHMARKED AGAINST
Meta
Meta ranks third among AI labs on Artificial Analysis's Intelligence Index.
Source finding
BENCHMARKED AGAINST
GPT-6 Astra
GPT-6 Astra gained roughly 85 Elo over its predecessor and dominates the GDP.pdf test at 33.2% on Intelligence Index.
Source finding
BENCHMARKED AGAINST
Claude Fable 5.1
Claude Fable 5.1 leads Artificial Analysis's Intelligence Index overall.
Source finding
RELEASED
Artificial Analysis
Artificial Analysis released v4.2 of Intelligence Index in September 2026, moving 40% of the index to private held-out evaluation sets.
Source finding
BENCHMARKED AGAINST
Claude Opus 4.8
Claude Opus 4.8 scored 56 on the Intelligence Index.
Source finding
BENCHMARKED AGAINST
Claude Fable 5
Claude Fable 5 scored 60 on the Intelligence Index.
Source finding
BENCHMARKED AGAINST
Kimi K3
Kimi K3 achieved an Intelligence Index score of 57.
Source finding

Source trail

v4.3 MiniCPM5-2B Artificial Analysis Artificial Analysis ARC Prize published verified semi-private results drawing 540 points on HN Simon Willison covered the announcement 0.32rc2 Vercel's AI Gateway Artificial Analysis 50 on the same index MIT-licensed weights on Hugging Face

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Fetching from the wire…