Sakana AI Text-to-LoRA: Zero-Shot Task Adaptation — Generate a Specialized LoRA Adapter from a Natural Language Task Description in One Forward Pass

Sakana AI Research·high signal

Text-to-LoRA is a hypernetwork that converts a short natural-language task description into a working LoRA adapter in a single forward pass with no task-specific training data required. Benchmarks show generated adapters match or exceed oracle adapters trained directly on task data, and the approach generalizes to entirely unseen tasks at inference time. The meta-training cost is paid once; subsequent per-task adaptation is instantaneous and enables mass model specialization — particularly relevant for multi-tenant agent systems needing dynamic tool specialization. GitHub at SakanaAI/text-to-lora.