Skills2026-06-28 · source-backed
Swap LoRA for DoRA with one flag.
Story
Set use_dora=True in PEFT's LoRAConfig with the 2026 starting recipe (r=16, target_modules='all-linear'). DoRA decomposes weights into magnitude and direction and applies LoRA only to direction, yielding +3.7% on LLaMA-7B and +1 to 4.4% on larger models with zero added inference cost (Spheron). Free accuracy.
Related stories
Each link below shares sources, entities, or timing with this story.
Shared entities / Shared topic / Earlier coverage / Tension
Distill instead of fine-tune when the goal is inference cost, not new behavior.
Both cover Llama, LoRA; overlapping topics (cost, inference, lora); earlier Llama coverage from 2026-06-07.
Shared entity: Free / Shared topic / Earlier coverage / Tension
Run Claude Code Against GLM-5 (744B) for Free via NIM Proxy
Both cover Free; overlapping topics (cost, free); earlier Free coverage from 2026-03-10.
Shared entity: Free / Shared topic / Earlier coverage
Windsurf Wave 13 Takes #1 on LogRocket
Both cover Free; overlapping topics (added, free); earlier Free coverage from 2026-03-01.
Shared entity: DORA / Earlier coverage / Tension
Three Studies, Same Answer: AI Coding Is Net-Negative After Rework
Both cover DORA; earlier DORA coverage from 2026-04-28; pushes against this story (but).
Shared entity: Llama / Earlier coverage / Downstream implication
llama.cpp Gets Backend-Agnostic Tensor Parallelism, and the NVIDIA Tax Just Got Optional
Both cover Llama; earlier Llama coverage from 2026-04-10; traces where this leads (what it means).
Mamba-3 Beats Transformers on Decode Latency at 1.5B Scale.
Both cover Llama; earlier Llama coverage from 2026-03-18; traces where this leads (downstream).
Shared entity: True / Earlier coverage / Tension
Harden MCP Servers Against the eval() Epidemic
Both cover True; earlier True coverage from 2026-02-25; pushes against this story (against).
Shared entity: Free / What happened next
Anthropic ships Sonnet 5 as Claude Code's default
Both cover Free; picks up the Free thread on 2026-07-02.