skill
PinchBench is a benchmarking system for evaluating LLM models as OpenClaw coding agents.
- Type
- Agent Skill
- Open source
- Yes
- GitHub Stars
- ★ 1.2k
- Source
- skill-github
- Repository
- github.com/pinchbench/skill
Overview
PinchBench is a benchmarking system designed to assess the performance of LLM models as OpenClaw coding agents. It tests model capabilities through real-world tasks such as scheduling meetings, writing code, and handling emails. PinchBench helps developers understand how well models perform in areas like tool usage, multi-step reasoning, handling ambiguous instructions, and generating actual outputs. To integrate with PinchBench, clone the repository and run the script. Ideal for developers looking to evaluate and improve LLM model performance.
Capabilities
- ▪Tool usage capability
- ▪Multi-step reasoning capability
- ▪Handling ambiguous instructions
- ▪Actual result generation
- ▪Automated scoring
Use cases
Setup
git clone https://github.com/pinchbench/skill.git && cd skill && ./scripts/run.sh --model openrouter/anthropic/claude-sonnet-4
This information was compiled by AI from public sources and may contain inaccuracies — please refer to the source.
FAQ
How do I register an API token?
Run the command ./scripts/run.sh --register.
How do I submit official results?
Use the --official-key flag or set the PINCHBENCH_OFFICIAL_KEY environment variable.
Related skills
gemini-cli
Gemini CLI is an open-source AI agent that brings Gemini's powerful capabilities directly into the terminal.
private-gpt
Provides a complete API layer for local models, supporting RAG, skills, tools, and more.
planning-with-files
File-based persistent planning skill, ideal for AI coding agents and long-running tasks.
scientific-agent-skills
Transform any AI agent into a scientific assistant with 147 ready-to-use research skills.
susi_alexa_skill
A skill that enables question-and-answer interactions between Alexa and Susi AI.
claude-context
Provides code search capabilities for Claude Code, turning the entire codebase into context.