promptfoo
CLI and library for evaluating and red-teaming LLM applications.
- Region
- Overseas
- Pricing
- Free
- Open source
- Yes
- GitHub Stars
- ★ 21.9k
- Source
- GitHub
- Added
- 2026-06-05
- Last verified
- 2026-06-05
Overview
Promptfoo is a CLI and library for evaluating and red-teaming LLM applications. It addresses the repetitive trial-and-error process in AI application development, helping developers build secure and reliable AI applications. With simple declarative configuration files, users can easily integrate Promptfoo into command-line workflows or CI/CD pipelines to compare performance across different language models.
Key features
- ▪Supports multi-LLM performance comparison
- ▪Provides red teaming and vulnerability scanning
- ▪Easy integration with CI/CD
- ▪Local execution for privacy protection
Use cases
Pros
- ＋Supports multiple platform APIs
- ＋Fully local execution
- ＋Fast iteration development
Limitations / notes
- －Requires Node.js environment
Who it's for
This overview was compiled by AI from public sources and may contain inaccuracies — please refer to the official site.
FAQ
How do I get started with Promptfoo?
After installing Node.js, globally install promptfoo via npm and initialize a sample project.
Is Promptfoo open source?
Yes, Promptfoo is an open-source project licensed under MIT.
Something wrong? Let us know on the About page and we'll fix it.