Commit Graph

21 Commits

Author SHA1 Message Date
arcticfly
1fb428ef4a Add scenario editing modal, twitter sentiment seeding (#101)
* testing agi-eval benchmark

* Add scenario modal editor

* Add initial values to ScenarioEditorModal

* Add seedTwitterSentiment.ts

---------

Co-authored-by: Kyle Corbitt <kyle@corbt.com>
2023-08-01 01:26:43 -07:00
David Corbitt
e885bdd365 Fix ScenarioEditor padding 2023-07-20 13:38:46 -07:00
arcticfly
55c077d604 Create FloatingLabelInput for scenario variables (#68)
* Create FloatingLabelInput

* Fix prettier

* Simplify changes
2023-07-20 12:20:12 -07:00
Kyle Corbitt
1dcdba04a6 User accounts
Allows for the creation of user accounts. A few notes on the specifics:

 - Experiments are the main access control objects. If you can view an experiment, you can view all its prompts/scenarios/evals. If you can edit it, you can edit or delete all of those as well.
 - Experiments are owned by Organizations in the database. Organizations can have multiple members and members can have roles of ADMIN, MEMBER or VIEWER.
 - Organizations can either be "personal" or general. Each user has a "personal" organization created as soon as they try to create an experiment. There's currently no UI support for creating general orgs or adding users to them; they're just in the database to future-proof all the ACL logic.
 - You can require that a user is signed-in to see a route using the `protectedProcedure` helper. When you use `protectedProcedure`, you also have to call `ctx.markAccessControlRun()` (or delegate to a function that does it for you; see accessControl.ts). This is to remind us to actually check for access control when we define a new endpoint.
2023-07-18 21:19:03 -07:00
Kyle Corbitt
54369dba54 Fix seeds and update eval field names 2023-07-17 14:14:20 -07:00
Kyle Corbitt
26ee8698be Make it so you can't delete the last prompt or scenario
No reason for an experiment to have 0 prompts or 0 scenarios and it makes the UI look bad.
2023-07-14 15:49:42 -07:00
Kyle Corbitt
4770ea34a8 Use javascript functions for prompt completions instead of templated json 2023-07-13 18:01:07 -07:00
arcticfly
b01ae677f5 Show more experiment content on screen, hide individual cost and time (#35)
* Fit more text on screen

* Hide individual cost and time
2023-07-11 01:17:01 -06:00
arcticfly
187d6492f8 Reevaluate all prompt stats when scenario is hidden (#32)
* Reevaluate when scenario is hidden

* Add newline
2023-07-10 13:51:40 -06:00
Kyle Corbitt
a8db6cadfd format with prettier 3 2023-07-08 22:12:47 -07:00
Kyle Corbitt
1fa0d7bc62 bugfixes 2023-07-06 15:22:35 -07:00
arcticfly
e1f05a7b59 Add seed file for reddit, restrict max height of variable value editor (#10)
* Add reddit seeds

* Restrict scenario variable value editor maxH to 60

* Add seed file for reddit experiments

* Further decrease max height

* Make score a string
2023-07-05 18:51:34 -07:00
arcticfly
c2c512d751 Prevent scenario from dragging when input is hovered (#8)
* Prevent scenario from dragging when input is hovered

* Prevent VariantHeader from dragging when input is hovered
2023-07-01 10:23:04 -07:00
arcticfly
3f6ef5adcf Add AutoResizeTextArea (#7) 2023-07-01 08:52:20 -07:00
David Corbitt
210efdcd6b Move scenario variables to the top of their container 2023-06-30 18:12:06 -07:00
Kyle Corbitt
cd9e7bce1a prettier side panel 2023-06-26 18:25:21 -07:00
Kyle Corbitt
0646fc0ba3 lots of changes on making new experiments work 2023-06-26 18:03:26 -07:00
Kyle Corbitt
3f850bbd7f editing template variables works 2023-06-26 14:32:45 -07:00
Kyle Corbitt
1d78a78b1d validate json schema for openai api 2023-06-26 12:36:34 -07:00
Kyle Corbitt
15087f6bcd hiding and reordering scenarios 2023-06-26 11:05:49 -07:00
Kyle Corbitt
e6fdd2d5c5 prettifying the ux 2023-06-26 06:26:19 -07:00