343 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Ian Webster	2b12feff8d	Bump version to 0.19.1 0.19.1	2023-08-14 10:48:44 -07:00
Ian Webster	c3e2d8b4a9	clean up usage of getApiKey	2023-08-14 10:48:10 -07:00
Ian Webster	9d59b4c3ed	Add support for OpenAI organization (#106)	2023-08-14 10:47:26 -07:00
Ian Webster	bd67b67219	Bump version to 0.19.0	2023-08-14 08:40:38 -07:00
Ian Webster	5c9b119b99	use proper 404 status code	2023-08-14 08:28:44 -07:00
Ian Webster	2f3e759963	clean up types	2023-08-14 08:25:10 -07:00
Ian Webster	240002e9c6	Fix static build	2023-08-13 21:31:50 -07:00
Ian Webster	4ebb21d72f	Add support for loading shared evals	2023-08-13 21:20:50 -07:00
Ian Webster	143ca55961	add vercel envar	2023-08-13 21:00:58 -07:00
Ian Webster	a97e382765	web build fixes	2023-08-13 20:57:42 -07:00
Ian Webster	8f6491d583	Web UI for running evals (#103)	2023-08-13 20:52:27 -07:00
dependabot[bot]	4bb5415b0a	Bump certifi from 2023.5.7 to 2023.7.22 in /examples/langchain-python (#104) ... Bumps [certifi](https://github.com/certifi/python-certifi) from 2023.5.7 to 2023.7.22. - [Commits](https://github.com/certifi/python-certifi/compare/2023.05.07...2023.07.22) --- updated-dependencies: - dependency-name: certifi dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2023-08-13 13:00:47 -07:00
Ian Webster	534a96e4fe	bump version to 0.18.4 0.18.4	2023-08-10 23:46:24 -07:00
Ian Webster	cb116fb808	remove empty lines in ollama provider	2023-08-10 11:28:37 -07:00
Ian Webster	1b2eb8970f	Update requirements.txt of langchain example	2023-08-09 08:21:25 -07:00
Ian Webster	55207041d9	bump version to 0.18.3 0.18.3	2023-08-08 16:36:39 -07:00
Ian Webster	76d18f5ffb	default to not forcing line breaks	2023-08-08 16:35:42 -07:00
Ian Webster	4e6b580f7b	Add ollama provider (#102)	2023-08-08 16:30:55 -07:00
Ian Webster	a603eeea6a	try to remove the latest data symlink no matter what	2023-08-08 16:30:40 -07:00
Ian Webster	508ab41159	Disable nunjucks autoescaping by default (#101)	2023-08-08 11:43:42 -07:00
Ian Webster	9f3213c407	formatting	2023-08-08 11:37:27 -07:00
Ian Webster	73c3f6e24e	bump version to 0.18.2 0.18.2	2023-08-07 17:09:10 -07:00
Ian Webster	01df513073	fix share	2023-08-07 17:06:22 -07:00
Ian Webster	98df9aa8fc	remove unused import	2023-08-07 16:19:37 -07:00
Ian Webster	bdd1deadb5	fix error with provider map parsing	2023-08-07 16:15:03 -07:00
Ian Webster	747d6f3434	Add assertions in webview (#100)	2023-08-07 16:14:55 -07:00
Paul	2e40da26bf	testing providers w/ same model diff params (#83)	2023-08-07 12:15:12 -07:00
Ian Webster	785442413a	Don't short circuit test failures by default - so that weights are calculated accurately	2023-08-07 09:54:53 -07:00
Ian Webster	50a5c75943	Add postprocessing example to function call test case. #95	2023-08-07 09:44:58 -07:00
Ian Webster	6b5457a2ce	Bump version to 0.18.1 0.18.1	2023-08-06 09:59:54 -07:00
Ian Webster	e6aed7a339	Fix symlink check. Closes #96	2023-08-06 09:58:32 -07:00
Ian Webster	9662a2165c	Update README.md	2023-08-01 17:54:07 -07:00
Ian Webster	f4b4c39a34	Add LLAMA_BASE_URL envar	2023-07-30 20:18:19 -07:00
Ian Webster	690729c3c8	Add support for llama.cpp server (#94)	2023-07-30 20:13:10 -07:00
Ian Webster	8c044b59f5	bump version to 0.18.0 0.18.0	2023-07-27 22:55:41 -07:00
Ian Webster	aca0821924	Theories -> Scenarios and load scenarios from default config	2023-07-27 22:49:22 -07:00
Skylertodd	2187908b44	Promptfoo Theories (#89)	2023-07-27 22:46:33 -07:00
Ian Webster	253ae606cd	fix eval history cleanup bug	2023-07-27 22:19:30 -07:00
Ian Webster	81a4a26838	handle broken symlink	2023-07-27 22:16:15 -07:00
Ian Webster	979e63843f	remove unused type	2023-07-27 08:19:43 -07:00
Ian Webster	497b6987a2	Fix ansi escape codes in console table	2023-07-27 08:19:43 -07:00
Ian Webster	5aff43afcf	Add support for native function ApiProviders and Assertions (#93)	2023-07-27 07:34:34 -07:00
Ian Webster	bef4b436c6	Add python assertion type that runs python code and returns the output (#78)	2023-07-26 23:16:12 -07:00
Ian Webster	6ad0853ff6	Add support for outputPath in evaluate node package. #91	2023-07-26 09:20:13 -07:00
Ian Webster	a40a24237c	bump version to 0.17.9 0.17.9	2023-07-23 21:48:51 -07:00
Ian Webster	c8a8bb25cf	Add support for loading test cases from file/directory path (#88)	2023-07-23 21:46:38 -07:00
Ian Webster	4f9f6e93cd	Update README.md	2023-07-23 21:46:30 -07:00
Ian Webster	8de6e12e78	Fix filepath compatibility issue with Windows ... Issue #87	2023-07-23 12:29:35 -07:00
Ian Webster	67ed3d6f4d	Record latency in results (#85)	2023-07-22 10:20:42 -07:00
Ian Webster	4eaddee482	bump version to 0.17.8 0.17.8	2023-07-21 20:43:16 -07:00