TerminalOps
Terminal tasks for managing files, running commands, and diagnosing failures.
Explore datasets for AI training and evaluation, plus Web3 market and on-chain data.
Terminal tasks for managing files, running commands, and diagnosing failures.
Multi-step tool-use tasks covering tool selection, argument construction, and error recovery.
Browser tasks for finding information, comparing results, and completing forms.
Agent evaluation tasks for passing context and unfinished work between agents.
Questions that assess domain knowledge, concept relationships, and factual accuracy.
Multi-step reasoning problems for checking intermediate deductions and final answers.
Scientific reasoning tasks involving experimental evidence, assumptions, and calculations.
Evaluation tasks for grounding answers in source documents and handling conflicting evidence.
Trading data covering order books, trades, and derivatives activity.
Prediction market data covering odds, trading activity, and resolved outcomes.
On-chain data covering swaps, liquidity changes, and protocol activity.
Wallet activity and risk data covering fund flows, exposure, and liquidation events.