Alma, an AI agent system developed by independent specialist yetone, secured third place in the intermediate review of FrontierHarness v1.1, an open benchmark for agent systems conducted by Runta. This intermediate ranking was compiled on November 11th while testing was still ongoing, and positions in the table changed daily.
When Pandaily checked the completed table on November 15th, Alma ranked sixth based on the percentage of successful completions. FrontierHarness tests 21 system configurations, including Claude Code, Codex CLI, and OpenCode, using five open models and 62 tasks across software engineering, science, data, systems, machine learning, and security domains.
Each system undergoes four attempts with scoring for every task for each model, and only confirmed successful runs are counted. According to a report from the Chinese tech publication Zhixingxing dated November 11th, Alma demonstrated a 72.7% success rate. This placed it behind Codex CLI at 77.9% and Pi at 72.8%, but ahead of Claude Code, which showed 70.0%.
The cost to execute one successful task using Alma was approximately $0.80, whereas for Claude Code, this cost was $0.94.
Final Testing Results
The final table reflected 26,040 evaluated trials and generally lower scores. Alma's success rate was 59.7%, which was lower than ZCode (61.9%), Codex CLI (61.1%), KimiCode (60.2%), Grok Build (60.0%), and Hermes Agent (59.9%). The success rates for all 21 systems ranged from 50.6% to 61.9%. By default, the table ranking is based on cost per run. By this criterion, Alma ranked 13th with a cost of $1.22, while Codex CLI cost $0.937, and Claude Code cost $1.55. Alma achieved its best result at 64.1% when using Kimi-K3.
Alma is capable of reading and editing files, executing terminal commands, searching the internet for information, and supports various skills, MCP, and multiple models. Furthermore, according to the Zhixingxing review and information on the Alma website, additional features have been added:
To enable remote access, yetone opened the source code for Alma Relay, which can be deployed on Cloudflare Workers or using Docker. With end-to-end encryption enabled, which is the default setting, the relay only sees encrypted data and retains nothing on disk, according to its documentation.


