alihan/llm-promptfoo
1
0
Fork 0
mirror of https://github.com/promptfoo/promptfoo.git synced 2023-08-15 01:10:51 +03:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Ian Webster
2023-08-01 17:54:07 -07:00
committed by GitHub
parent f4b4c39a34
commit 9662a2165c
1 changed files with 5 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
README.md
View File

@@ -4,15 +4,15 @@
[![GitHub Workflow Status](https://img.shields.io/github/actions/workflow/status/typpo/promptfoo/main.yml)](https://github.com/typpo/promptfoo/actions/workflows/main.yml)
![MIT license](https://img.shields.io/github/license/typpo/promptfoo)
`promptfoo` is a tool for testing and evaluating LLM prompt quality.
`promptfoo` is a tool for testing and evaluating LLM output quality.
With promptfoo, you can:
- **Systematically test prompts** against predefined test cases
- **Systematically test prompts & models** against predefined test cases
- **Evaluate quality and catch regressions** by comparing LLM outputs side-by-side
- **Speed up evaluations** with caching and concurrent tests
- **Score outputs automatically** by defining "expectations"
- Use as a CLI, or integrate into your workflow as a library
- **Speed up evaluations** with caching and concurrency
- **Score outputs automatically** by defining test cases
- Use as a CLI, library, or in CI/CD
- Use OpenAI, Anthropic, open-source models like Llama and Vicuna, or integrate custom API providers for any LLM API
The goal: **test-driven prompt engineering**, rather than trial-and-error.