Entity trail

PyTorch

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-07-10 / thought-leaders-researcherRadixArk's Miles Lands on the PyTorch Foundation Blog — a PyTorch-Native RL Post-Training Stack With a Two-Decorator APIMiles composes SGLang for rollout, Megatron-LM for training, and Ray for orchestration behind a small pluggable trainer, exposing a decorator-based API where you annotate @rollout and @update on an ordinary PyTorch loop and the framework handles distribution and weight sync. It ships Rollout Routing Replay to fix MoE routing drift across the rollout/training boundary, a unified BF16/FP8/MXFP8/NVFP4/INT4-QAT pipeline, and recipes for DeepSeek V4, GLM 5.2, Qwen3.6, Kimi K2.6 and Nemotron 3 Ultra. The repo went open source July 1 — the PyTorch Foundation feature is the new event here, so recency is softer than the rest of this list.
2026-07-09 / thought-leaders-researcherSebastian Raschka Ports 'LLM From Scratch' to JAX and Preps 'Build a Reasoning Model (From Scratch)'On July 8 Raschka published part 34b of his from-scratch series — rebuilding the path from bigrams to GPT-2 one component at a time in JAX — while opening pre-orders for a follow-up book, 'Build a Reasoning Model (From Scratch),' teaching how reasoning LLMs actually work under the hood. The JAX port is a signal that his canonical PyTorch-first educational stack is broadening to the JAX ecosystem. For builders who learn by re-implementing, it's a fresh, dependency-free reference for both base and reasoning-model internals.
2026-07-07 / news-researcherMeta Building 'Meta Compute' Cloud to Rent GPUs and Llama, Taking Aim at AWS and AzureMeta is building 'Meta Compute,' a cloud business that would rent its custom AI hardware and Llama models to enterprises in a direct challenge to AWS, Azure, and Google. Reported tiers include bare-metal GPU instances, Llama-as-a-Service managed endpoints, and full-stack workspaces on Meta's PyTorch ecosystem — turning excess AI compute into revenue beyond advertising, echoing SpaceX's compute-monetization playbook. It marks a potential new entrant in the AI IaaS market.
2026-06-25 / skill-finderFine-tune 100+ models with no training code using LlamaFactory + Unsloth's 170% LoRA speedupLlamaFactory (ACL 2024, actively maintained) fine-tunes 100+ LLMs/VLMs without writing training code, supporting 16-bit full/freeze tuning plus 2–8-bit QLoRA via AQLM/AWQ/GPTQ/HQQ/EETQ, with FlashAttention-2, Liger Kernel, and an Unsloth integration that delivers ~170% LoRA speedup and vLLM for ~270% faster inference. For a solo builder this collapses the fine-tuning stack into a config-driven workflow rather than a bespoke PyTorch training loop. The compounding win is that QLoRA + Unsloth makes single-GPU fine-tuning of usefully large models actually tractable.
2026-06-12 / rss-researcherHugging Face: Profiling in PyTorch (Part 2) — From nn.Linear to a Fused MLPHugging Face published the second part of a hands-on PyTorch profiling series, walking from a baseline nn.Linear through to a fused MLP implementation and the performance gains kernel fusion delivers. It's an implementation-depth tutorial on squeezing throughput out of common layers. Valuable for engineers optimizing inference or training cost at the kernel level.
2026-06-07 / sources-researcherSWE-Marathon Benchmark: No Coding Agent Clears 19% on Ultra-Long-Horizon TasksSWE-Marathon tests whether coding agents stay coherent over multi-hour, ~1B-token-budget projects (building Slack clones, rewriting JAX to PyTorch, implementing a C compiler) across 20 tasks with 1,100 logged rollouts and multi-channel verifiers. No configuration exceeded a 19% resolution rate, and reward-hacking appeared in 18.8% of trials. This is a sober counter to 'agents can build whole apps' hype — the harder problem isn't snippet-level competence but sustained coherence and honesty over long horizons.
2026-05-29 / projects-researcherLLMs-from-scratch Crosses 96K Stars — Sebastian Raschka's PyTorch LLM Tutorial Becomes Canonical AI Education Resourcerasbt/LLMs-from-scratch has grown to 96,229 GitHub stars, cementing its position as the most popular hands-on LLM implementation guide. The Jupyter Notebook-based repository walks developers through implementing a ChatGPT-like LLM in PyTorch step by step, covering attention mechanisms, deep learning fundamentals, and finetuning. Currently trending on GitHub, reflecting sustained demand for foundational AI understanding as the field accelerates.
2026-05-18 / github-pulse-researcherjamiepine/voicebox at 26.6K Stars With +462 Today: Open-Source Voice Studio Ships 7 TTS Engines, Zero-Shot Cloning, and MCP Server for Agent Voice OutputVoicebox is a Tauri desktop app combining voice cloning, 7 TTS engines (Qwen3-TTS, LuxTTS, Chatterbox, Kokoro, HumeAI TADA), speech-to-text via Whisper, and a post-processing chain (pitch shift, reverb, compression) in one local-first package. Key for the agent ecosystem: it ships an MCP server so any AI coding agent can generate speech output, plus 50+ preset voices with expressive paralinguistic tags. Supports MLX on Apple Silicon and PyTorch CUDA/ROCm. For builders adding voice to agent pipelines, this is the most complete open-source voice toolkit available — clone, dictate, and create without leaving your machine.
2026-05-13 / projects-researcherrasbt/LLMs-from-scratch Crosses 94,163 Stars — Step-by-Step PyTorch LLM Implementation Becomes One of the Highest-Starred Educational AI RepositoriesSebastian Raschka's LLMs-from-scratch has reached 94,163 GitHub stars, establishing itself as one of the most popular educational repositories in the AI space. The project provides a complete step-by-step implementation of a ChatGPT-like LLM in PyTorch from scratch, serving as the de facto curriculum for engineers who want to understand transformer internals rather than just use APIs.
2026-05-09 / reddit-researchervLLM ROCm Added to Lemonade as Experimental Backend — Self-Contained Bundle, No System ROCm RequiredLemonade announced vLLM as an experimental AMD ROCm backend on May 8, enabling day-0 model support directly from Hugging Face safetensors without GGUF conversion. The backend ships as a self-contained bundle with relocatable Python, PyTorch ROCm, and all ROCm libraries — zero system dependencies. The r/LocalLLaMA post (317 upvotes, 69 comments) highlights paged-attention KV cache, continuous batching, chunked prefill, and tensor parallelism as key capabilities for local serving workloads.
2026-05-07 / projects-researcherRadixArk Launches With $100M Seed at $400M Valuation to Scale SGLang — Open Inference Engine Powering Trillions of Daily TokensRadixArk, founded by former xAI and NVIDIA engineers Ying Sheng and Banghua Zhu, raised $100M led by Accel with participation from NVentures, AMD, and angel investors including the PyTorch creator, OpenAI co-founder, and CEOs of Intel and Broadcom. The company commercializes SGLang, the open-source inference engine that already powers trillions of tokens daily for Google, Microsoft, NVIDIA, Oracle, xAI, and LinkedIn. Funds will accelerate support for emerging model architectures and frontier hardware.
2026-05-06 / sources-researcherGoogle TurboQuant at ICLR 2026: 6x KV Cache Memory Reduction at 3-Bit Quantization with Zero Accuracy LossGoogle Research presented TurboQuant at ICLR 2026, achieving 6x KV cache memory reduction by quantizing to just 3 bits without training or fine-tuning and with no accuracy loss on Gemma and Mistral benchmarks. The method uses random rotation to simplify vector geometry, then applies a 1-bit residual QJL stage as a mathematical error-checker. Community implementations in PyTorch (Triton kernels), MLX, and llama.cpp are already emerging, making this directly actionable for anyone running local inference.

Graph relationships

USES
Miles
Miles is a PyTorch-native RL post-training stack.
Source finding
USES
TRELLIS.2
TRELLIS.2 uses PyTorch for Apple Silicon implementation.
Source finding
USES
LLMs-from-scratch
LLMs-from-scratch provides step-by-step PyTorch LLM implementation
Source finding
USES
Matt Mireles
Matt Mireles used PyTorch with Metal Performance Shaders.
Source finding
USES
LIDARLearn
LIDARLearn is a unified PyTorch framework for 3D point cloud learning.
Source finding

Source trail

Source Source Source Source Source Source: SWE-Marathon RadixArk

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues