llm-promptfoo/examples/simple-cli

This example is pre-configured in promptfooconfig.yaml (both identical examples). That means you can just run:

promptfoo eval

To override prompts, providers, output, etc. you can run:

promptfoo eval --prompts prompts.txt --providers openai:chat --output output.json