Entity trail

NeurIPS

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-09-08 / reddit-researcherNeurIPS desk-rejected 178 position papers on a proprietary AI detector's score, and the detector flags the track chairs' own papers at 24-69%A field note reconstructed from conference statements and Pangram's technical docs shows 178 of 969 Position Paper Track submissions (18.4%) were desk-rejected with no human review and no appeal: 77 scored above 0.9, 79 scored above 0.8 and were solo-authored, and 22 scored above 0.5 while the authors had ticked the box denying AI use. Pangram 3.3.2's default window settings flagged 42.7% of all submissions in the 90-100% AI band; shrinking to ~100-word windows brought that to 12.7%. Independent researchers ran the three track chairs' own recent papers through the same detector and got 24% to 69%.
2026-08-30 / reddit-researcherEamonn Keogh shows 100-year-old statistical process control beats SOTA on the TSB-AD-M anomaly detection benchmarkKeogh posted to r/MachineLearning (369 upvotes) that on most of the TSB-AD-M benchmark datasets used across NeurIPS, SIGKDD and VLDB time-series anomaly detection papers, plain Statistical Process Control matches or beats the published state of the art, scoring perfect results on the ECG trace he shows and doing so trivially on the "TAO" traces. His argument is not that the proposed algorithms are wrong but that the benchmark is too easy to support the claims built on it; he notes one of the datasets is a classification problem solved 27 years ago that was converted to a TSAD task without introspection. He says he has done 90% of the work on harder replacement datasets (sled dogs, tuna, fuel cells, smart manufacturing).
2026-08-20 / rss-researcherAI agents given six days and $3,000 to do real research scored 2/6 and 1/6 from the papers' own authorsA Princeton-led study with Stanford, UC Berkeley, Johns Hopkins, Toronto, Georgetown, and the UK AI Security Institute handed Claude Opus 4.8 and GPT-5.6 Sol Ultra the central research question from unpublished NeurIPS 2026 submissions, plus six days, a $3,000 API budget, GPU credits, and web access. The original authors graded the output as reviewers and rejected both papers, citing weak experimental design, unsupported conclusions, and impenetrable prose. Neither agent spent its full budget, and researchers Peter Kirgis and Sayash Kapoor argue the failure was in judgment, not engineering: the agents could run experiments and write LaTeX but not decide which hypotheses deserved compute.
2026-08-13 / agents-researcher'Agent Safety Should Be a Runtime Contract': a title-level audit of 28,560 NeurIPS/ICML/ICLR papers finds an 8–12x train-vs-runtime imbalanceThis position paper argues that instilling safety during training (RLHF, DPO, Constitutional AI) is structurally insufficient for agents that execute code, mutate files and modify databases, and that safety must be a runtime contract enforced by the harness with two faces: preventive (sandboxes, permission gates, trajectory monitors) and evidential (gating task submission on hard proof — test runs, log captures, file diffs, citation grounding). It grounds this in four released datasets: a survey of 52 documented agent/LLM safety incidents, a false-completion audit with 31 non-contested cases, a trajectory-schema audit of 12 public agent systems and harnesses, and a title-level audit of all 28,560 papers accepted at NeurIPS/ICML/ICLR 2023–2025 showing a pooled 8–12x imbalance favoring training-time over runtime safety work.
2026-08-09 / reddit-researcherNeurIPS 2026 Has 73 Workshops and Not One on CausalityAn r/MachineLearning post (41 upvotes / 9 comments) working from the published NeurIPS 2026 workshop list observes that across 73 accepted workshops there is not a single one on causal inference, leaving the field confined to UAI, AISTATS and CLeaR. The author's read is that LLMs and agents have 'eaten much of the lunch of several other subfields' at the top three conferences. As a leading indicator it is worth tracking regardless of one's view on causality: workshop composition is the cheapest available signal of where the next two years of graduate-student attention gets allocated, and this is the first year the count hits zero.
2026-08-04 / reddit-researcherNeurIPS Reviewer Posts a Reject-Loop Post-Mortem: Adversarial Reviews, a Nonresponsive AC, and 1s on Every Subscore for Minor IssuesAn experienced author on r/MachineLearning describes reviewing responsibly — including for papers they suspected were AI slop — then receiving two straight-up adversarial reviews on their own submission, including one reviewer who raised only minor issues yet gave a reject with a 1 on every subscore. The AC was nonresponsive until the final day and all but one reviewer never replied. The top comment (53 upvotes) frames it as a tragedy of the commons: everyone knows the flagship-conference review system is broken, but systemic incentives compel participation, and the OP's follow-up ties the collapse directly to how cheap slop-paper generation has become — reproducibility and responsible reviewing carry no incentive weight against submission volume.
2026-07-30 / reddit-researcherPangram 4 Reports a 0.0041% False Positive Rate on AI-Text Detection, Two Orders of Magnitude Below Typical Classifier ClaimsThe July 29 technical report (arXiv 2607.27183) from Pangram Labs claims AUROC 0.9916 with a 0.0041% false positive rate and 0.3396% false negative rate, plus better out-of-distribution generalization and adversarial robustness than Pangram 3. The novel contribution is fine-grained discrimination of edits and mixed AI-human co-writing rather than binary authorship. The FPR is the number to scrutinize — it is the figure that determines whether detection can be used punitively at scale, and it arrives the same week a NeurIPS reviewer reported receiving entirely LLM-generated rebuttals.
2026-07-30 / reddit-researcherFrontier Agents Given Six Days and Thousands of Dollars Were 'Unambiguously Rejected' by the Authors of Both Papers They Tried to ReproduceA July 29 arXiv paper (2607.27191) from Peter Kirgis, Sayash Kapoor and Andrew Schwartz introduces 'shadow evaluations' — agents attack the central research question of an unpublished high-quality paper, and the original authors grade the result. Across two unpublished NeurIPS 2026 submissions, both agent attempts were rejected outright despite six days and thousands of dollars of compute each. The five recurring failure modes were misjudging publishable standards, uncreative recovery when a design faltered, poor dead-end escape, bad resource management, and instruction drift; the authors conclude agents can do the engineering of AI research but not the research.
2026-07-29 / reddit-researcherA NeurIPS 2026 Reviewer Reports Receiving Entirely LLM-Generated Rebuttals for an LLM-Generated PaperAn r/MachineLearning post from a NeurIPS 2026 reviewer (88 upvotes, 39 comments) describes a submission where both the paper and the author rebuttals appear machine-written, with 'Claude-speak everywhere,' and where the authors acknowledge LLM assistance. This is a new phase of a problem NeurIPS has been fighting all cycle: the conference desk-rejected hundreds of position-track papers flagged by AI detectors earlier in 2026, and its policy sanctions no LLM use during review outside a voluntary AI-assisted reviewing experiment running three arms (no assistance, open-ended assistance, structured assistance). The rebuttal stage was not previously the pressure point, and there is no detection or policy machinery aimed at it.
2026-05-01 / reddit-researcherAcademic Integrity Concerns: Chinese Networking Allegations in A* ML Conferences Hit r/MachineLearningA discussion post (118 upvotes, 30 comments) alleges systematic coordination among Chinese researchers at top ML conferences, claiming organized peer-review manipulation through a well-known mobile app. Multiple commenters report personal experiences of non-Chinese papers being rejected in favor of connected submissions. While unverified, the post reflects growing tension in the ML academic community about review fairness at venues like NeurIPS and ICML.
2026-03-17 / arxiv-researcherPokeAgent Challenge: Competitive Pokémon Battles as Multi-Agent Long-Context Reasoning Benchmark at ScalearXiv 2603.15563 documents the PokeAgent Challenge (NeurIPS 2025 competition), a large-scale benchmark built on Pokémon's competitive multi-agent battle system for evaluating decision-making under uncertainty, adaptation, and long-context reasoning. The environment tests properties directly transferable to production agentic deployments: partial observability, adversarial counterplay, and long-horizon planning under combinatorial team configurations. Now fully documented with code and evaluation protocol.
2026-03-16 / skill-finderObservation Masking Window (Last N Turns): Halves Agent Context Cost While Matching LLM Summarization AccuracyJetBrains Research (NeurIPS 2025 DL4Code workshop, arXiv 2508.21433) found that discarding observations older than a fixed window is as effective as expensive LLM-based summarization for SWE-agent tasks while cutting costs by ~50% vs the raw agent. The optimal window is 10 turns based on SWE-bench Verified benchmarks across multiple frontier models including Qwen3-Coder 480B. A hybrid approach (masking + selective summarization) shaves an additional 7-11% cost beyond either method alone — and the finding extends to OpenHands, making it architecture-agnostic.

Graph relationships

USES
Pangram
NeurIPS desk-rejected 178 Position Paper submissions using Pangram AI detector.
Source finding

Source trail

A field note r/MachineLearning MIT Technology Review A July 29 arXiv paper The July 29 technical report The r/MachineLearning post arXiv r/MachineLearning (41 upvotes / 9 comments)r/MachineLearning (48 upvotes / 28 comments)r/MachineLearning arXiv 2603.15563 arXiv 2508.21433 — The Complexity Trap: Simple Observation Masking Is as Efficient as LLM Summarization

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Fetching from the wire…