Promptfoo

Open-source LLM testing and red-teaming tool for developers

Code & DevelopmentFree

Promptfoo is an open-source tool for testing, evaluating, and red-teaming LLM applications. Developers use it to run automated prompt evaluations, compare model outputs side-by-side, detect prompt injection vulnerabilities, and catch regressions in CI. Promptfoo supports 50+ LLM providers and integrates into any dev workflow.

Key Features

• ✓Automated prompt evaluation
• ✓Side-by-side model comparison
• ✓Red-teaming and safety testing
• ✓50+ LLM provider support
• ✓CI/CD pipeline integration
• ✓Custom assertion functions