Hugging Face shipped harness adapters on November 20, training a small LoRA inside the agent's actual runtime rather than a re-implementation of it S¹. On Qwen3.8-27B running the Pi harness against Terminal-Bench 2.1, accuracy climbed from 39% to 55% pass@1 while average token use fell from 2.9K to 1.5K per task S¹ — figures that are Hugging Face's own, with no error bars reported and no evaluation code released for outside reproduction. Most RL frameworks train against a copy of the agent loop, not the harness that ships to production S¹. The model optimizes for a simulator, then encounters a different system when deployed.
Hugging Face's protocol executes the harness as delivered, placing a proxy between the harness and vLLM that captures the exact tokens generated for the trainer S¹. That proxy is the core mechanism: the model tunes against the same tool calls, prompt formatting, and failure modes it will encounter in production.
My read: The 16-point jump is striking but entirely self-reported, with no independent corroboration S¹. I would watch whether the merged "super adapter" actually matches the individual adapters' scores, because the launch post only says it runs unchanged under all three harnesses, not that it performs as well. The token halving is the number that matters for inference bills, but the title's "cost" promise rests on token efficiency, not demonstrated pricing savings.

Adapters train inside each harness's live runtime
The team trained one LoRA adapter per harness for Qwen3.8-27B, using reinforcement learning inside each harness itself S¹. The three harnesses were Pi, OpenCode, and Hermes Agent, tested on harder real-world software engineering tasks than the data-analysis and code-building work in prior experiments S¹. Training, datasets, and agent rollouts ran on the Hub using TRL's AsyncGRPOTrainer, OpenEnv, and harbor S¹. The base model's weights stayed frozen. Only the LoRA adapter changed.
According to Hugging Face, most of the gain came from the model reasoning less, calling fewer tools, and getting it right on the first attempt S¹. Each individual adapter beat the base model under its own harness on both performance and efficiency S¹. The three LoRAs were also merged into a single adapter that runs unchanged under Pi, OpenCode, and Hermes Agent, though the launch post does not claim the merged version matches the individual adapters' scores S¹.
Public artifacts include adapters, Docker images, and a tool-call inspector
Hugging Face released all artifacts through a public collection: the adapters, GGUF files, RL tasks, and a safeagents plugin that inspects every tool call before it runs S¹. Ready-to-use Docker images come with the target harnesses pre-installed, using Pi 1.5.2, OpenCode 2.2.7, and Hermes Agent 0.22.6 S¹.
A team running Qwen3.8-27B inside Pi on a coding workload could pull the Pi-specific adapter from the collection, load it alongside the frozen base model, and compare pass@1 and token use on their own task distribution against the unadapted baseline. The safeagents plugin adds a guardrail layer, checking each tool call before execution S¹.
No one outside Hugging Face has independently verified the benchmark numbers. The results cover only the 27B parameter scale and only three harnesses, and the launch post's title promises cost improvements but demonstrates token efficiency rather than pricing data S¹. Related approaches exist in the same space: Agent Lightning v1.0 keeps the deploy-time harness in the loop through a proxy, an approach its authors call "harnessed agentic RL" S¹, and SkyRL's Harbor integration trains on Harbor trials by converting chat histories into tokens for the trainer S¹. The broader push to cut RL training costs is visible in work like NgramRL's 7x rollout reduction.
The Hugging Face collection is live now. The adapters were trained on a custom agentic coding dataset built with the Hub, OpenEnv, and Repo2RLEnv S¹, and performance on tasks outside that distribution remains untested.
Sources: S1 — Introducing harness adapters: adapt your favorite model to your harnes · P2 — Harness adapters: Safe RL for efficient agentic development · P3 — QwenLM/Qwen3 · P4 — Hugging Face – Blog · P5 — huggingface/transformers
Written from 5 sourced items, 5 of them primary.