alihan/OpenPipe-llm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
327 Commits 60 Branches 0 Tags
c0f10cd52241df732fa599249b8b70657aef0a4b
Commit Graph

327 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
David Corbitt
ab3445eaaa Add more padding to bottom of outputs table 2023-07-10 13:34:54 -06:00
arcticfly
b99b2e715d Dynamically resize viewport height on mobile (#31) 2023-07-10 13:15:09 -06:00
arcticfly
8ae344a286 Increase scenarios header negative margin (#30) 2023-07-10 12:55:21 -06:00
arcticfly
96dacb0378 Move experiment scrollbar to bottom of page, make scenarios header sticky (#29) 
* Remove newline from promptVariants router

* Move horizontal scroll bar to bottom of OutputsTable

* Make scenarios header sticky
 2023-07-10 12:40:02 -06:00
arcticfly
e64a94e06e Record experiment updated in more places (#24) 
* Record experiment updated in more places

* Update experiment updatedAt in same transaction
 2023-07-10 12:00:24 -06:00
Kyle Corbitt
d6a46b9e9d fix lockfile 2023-07-10 06:47:16 -07:00
arcticfly
32a80f8475 Limit evaluations to visible test scenarios (#28) 2023-07-10 02:10:23 -06:00
arcticfly
337469a3f7 Update README.md 2023-07-10 01:33:07 -06:00
arcticfly
dc068b04cf Update README.md 2023-07-10 00:17:22 -06:00
arcticfly
200ebf4610 Update README.md with link to demo 2023-07-08 23:35:00 -07:00
Kyle Corbitt
840ca03c4b don't check the pnpm-lock.yaml file with prettier 2023-07-08 22:15:08 -07:00
Kyle Corbitt
a8db6cadfd format with prettier 3 2023-07-08 22:12:47 -07:00
arcticfly
6b32619e87 Add streaming to the default prompt (#27) 2023-07-08 21:22:02 -07:00
David Corbitt
e2f6ddde52 Update repo name throughout codebase 2023-07-08 21:00:20 -07:00
arcticfly
f61ebe6e78 Update repo name in README.md 2023-07-08 20:58:59 -07:00
arcticfly
087edf867e Update logo in README.md 2023-07-08 16:44:51 -07:00
arcticfly
9e26035ff4 Show cost tooltip on mobile, modify styles (#23) 
* Show tooltip on mobile, modify styles

* Tokens -> Token Usage
 2023-07-08 10:29:30 -07:00
David Corbitt
a51bab3591 Use NextJS link for breadcrumb 2023-07-07 23:24:39 -07:00
David Corbitt
b7a60b7301 Fix Experiments link top margin on experiments page 2023-07-07 23:24:23 -07:00
jarenm
d7fb4a7236 add cost tooltip (#22) 
* add cost tooltip

* add padding and style
 2023-07-07 19:34:45 -07:00
arcticfly
48c3b7dcab Update README.md 2023-07-07 18:37:15 -07:00
arcticfly
8fe73c3a5a Update README.md with logo 2023-07-07 18:10:10 -07:00
arcticfly
0415a04dc6 Redirect to experiments page after deleting experiment (#21) 2023-07-07 18:01:38 -07:00
Kyle Corbitt
b2dc1ff58b repo move 2023-07-07 17:48:34 -07:00
Kyle Corbitt
8e0722cd22 wrong denominator 2023-07-07 17:48:34 -07:00
David Corbitt
f160a7c2e1 Navigate to home on logo click 2023-07-07 16:02:28 -07:00
arcticfly
539aabbe9c Make mobile prettier (#19) 
* Fix mobile experiment buttons

* Fix mobile NewExperimentButton

* Add base columns for experiments

* Shrink side navbar on mobile

* Compress social links
 2023-07-07 15:30:52 -07:00
arcticfly
db4476d1cb Change website layout (#18) 
* Add basic experiments page

* Isolate experiment components

* Fix grid on small screens

* Change nav bar

* Add padding to logo

* Fix linking

* Remove right margin on ExperimentCard flask

* Change favicon

* Use humanize in formatTimePast

* Add TODO
 2023-07-07 14:47:54 -07:00
Kyle Corbitt
918f209227 rename querykey -> openpipe 2023-07-07 12:27:21 -07:00
Kyle Corbitt
46344d8fc4 small bugfixes 2023-07-07 12:22:27 -07:00
Kyle Corbitt
70a1448d73 header bar improvements 2023-07-07 06:46:09 -07:00
arcticfly
8e1384fed9 Break error words without breakLongWord (#16) 
* List number of scenarios

* Remove breakLongWords
 2023-07-06 21:43:56 -07:00
arcticfly
a2c7ef73ec Retry requests that receive 429 (#15) 
* List number of scenarios

* Retry requests after 429

* Rename requestCallback

* Add sleep function

* Allow manual retry on frontend

* Remove unused utility functions

* Auto refetch

* Display wait time with Math.ceil

* Take one second modulo into account

* Add pluralize
 2023-07-06 21:39:23 -07:00
Kyle Corbitt
cb15216d0b fix more issues with output cell mutation 2023-07-06 18:35:55 -07:00
Kyle Corbitt
97f44ea5c4 handle issues with OutputCell mutation 2023-07-06 17:56:08 -07:00
arcticfly
d2a50c3d1f List number of scenarios (#14) 2023-07-06 17:21:19 -07:00
Kyle Corbitt
878cf0f68d limit seeded data 2023-07-06 16:56:26 -07:00
arcticfly
fe501a80cb Add total token cost to variant stats (#13) 
* Add total token cost to variant stats

* Copy over token counts for new variants

* Update invalidate call
 2023-07-06 15:33:49 -07:00
Kyle Corbitt
1fa0d7bc62 bugfixes 2023-07-06 15:22:35 -07:00
Kyle Corbitt
0844fb0da7 fewer reddit stories for now 2023-07-06 15:20:48 -07:00
arcticfly
92c240e7b8 Add request cost to OutputStats (#12) 2023-07-06 14:36:31 -07:00
Kyle Corbitt
f728027ef6 add evaluations 2023-07-06 13:44:03 -07:00
arcticfly
1ae5612d55 Add promptTokens and completionTokens to model output (#11) 
* Default to streaming in config

* Add tokens to database

* Add NEXT_PUBLIC_SOCKET_URL to .env.example

* Disable streaming for functions

* Add newline to types
 2023-07-06 13:12:59 -07:00
Kyle Corbitt
6ecb952a68 don't default open 2023-07-06 07:12:24 -07:00
Kyle Corbitt
4275e6b19b settings drawer 2023-07-05 21:34:00 -07:00
Kyle Corbitt
6510b26b1e re-attach scenarios 2023-07-05 21:34:00 -07:00
Kyle Corbitt
e4c101a843 change outputs table to make room for evals 2023-07-05 21:34:00 -07:00
arcticfly
e1f05a7b59 Add seed file for reddit, restrict max height of variable value editor (#10) 
* Add reddit seeds

* Restrict scenario variable value editor maxH to 60

* Add seed file for reddit experiments

* Further decrease max height

* Make score a string
 2023-07-05 18:51:34 -07:00
Kyle Corbitt
63f6b646dc scenario vars can't have spaces 2023-07-05 13:54:02 -07:00
Kyle Corbitt
552199da4a rename prompt-lab to querykey 2023-07-05 10:43:28 -07:00