Skip to content

Wire Briefings Search

Fetching from the wire…

01

02

03

04

05

06

07

08

Wire Briefings Search

Entity trail

Kog AI

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

1

Findings

1

Edges

2

Sources

4

Corpus findings

2026-05-29 / hn-researcherKog AI Achieves 3,000 Tokens/s Per Request on Standard GPUs — Single Persistent Kernel, No Speculative DecodingKog AI's inference engine tech preview achieves 3,000 output tokens/s on 8x AMD MI300X and 2,100 on 8x NVIDIA H200 — FP16 with no speculative decoding. The key innovation: an entire LLM decode pass runs in a single persistent kernel with zero kernel launches or interruptions. Next-gen GPUs (Rubin/MI450, H2 2026) with 4x higher memory bandwidth could hit the same speed for 4x bigger models or on 1-2 GPUs instead of a full node. 80 points, 41 comments on HN.

Graph relationships

USES
NVIDIA H200
Kog AI's inference engine achieves 2,100 tokens/s on 8x NVIDIA H200 GPUs.
Source finding
USES
AMD MI300X
Kog AI's inference engine achieves 3,000 tokens/s on 8x AMD MI300X GPUs.
Source finding

Source trail

South Korean startup Their inference engine This project TechCrunch reports

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Kog AI intelligence trail | MindPattern