Commit Graph

28 Commits

Author SHA1 Message Date
Ian Webster
0c2f5d4c8c Add support for rouge NLP metric 2023-06-10 15:37:24 -07:00
Ian Webster
62561b552e Fix reference parsing for yaml files 2023-06-10 11:28:19 -07:00
Ian Webster
6cd3459c53 Bump version to 0.10.0 2023-06-09 11:16:53 -07:00
Ian Webster
d6fb66106e bump version to 0.9.0 2023-06-04 22:39:53 -04:00
Ian Webster
1a82de7fe8 add cache-manager types. closes #22 2023-06-04 21:50:57 -04:00
Ian Webster
e6f2bcbff4 Add explicit dev dependency for jest. #24 2023-06-04 21:47:39 -04:00
Ian Webster
91faaf82f1 bump version to 0.8.3 2023-05-31 16:05:34 -04:00
Ian Webster
4cacfd31c4 bump version 0.8.2 2023-05-30 11:16:32 -04:00
Ian Webster
85551e74a4 fix package entrypoint and bump version to 0.8.1 2023-05-30 10:49:37 -04:00
Ian Webster
57a12bdbf5 bump version to 0.8.0 2023-05-30 09:04:51 -04:00
Ian Webster
bf81260b44 Simplify API and add support for unified test suite definition (#14) 2023-05-30 06:02:49 -07:00
Ian Webster
f259969051 bump version to 0.7.0 2023-05-28 22:57:49 -04:00
Ian Webster
34fa1d1282 Improve caching and cache all requests by default (#17)
* Improve caching and cache requests by default

* disable cache in test

* add tests

* update readme

* improve cache configurability

* Report cache stats
2023-05-28 06:56:55 -07:00
Ian Webster
a842713b32 bump version to 0.6.0 2023-05-27 18:05:01 -07:00
Ian Webster
fdb2365121 Add glob support (#13) 2023-05-27 15:24:17 -07:00
Ian Webster
1ddf6ed37e package version bump 2023-05-27 09:38:42 -07:00
Ian Webster
7d8bc5622d bump version to 0.5.1 2023-05-23 07:28:33 -07:00
Ian Webster
b1d98ab747 bail on esm pain 2023-05-22 22:57:05 -07:00
Ian Webster
cb846c3fd8 bump version to 0.5.0 2023-05-22 09:43:30 -07:00
Ian Webster
3d74acd634 Add support for grading by semantic similarity (#7) 2023-05-22 09:42:29 -07:00
Ian Webster
a83765fe7c Browser UI for eval results (#5) 2023-05-13 08:04:29 -07:00
Ian Webster
94e176c99d Add concurrency 2023-05-01 13:36:37 -07:00
Ian Webster
f97773ef2e cli progress bar 2023-05-01 12:07:54 -07:00
Ian Webster
a33a18bfab Add table functionality 2023-04-29 16:24:19 -07:00
Ian Webster
fc0a88bae1 support json/yaml input and output 2023-04-29 08:12:49 -07:00
Ian Webster
878acb2175 add logger and output coloring 2023-04-29 08:01:56 -07:00
Ian Webster
0b2a671330 simplify and cleanup 2023-04-28 22:08:32 -07:00
Ian Webster
6affccb903 Initial commit 2023-03-31 08:47:37 -07:00