Run workers in a separate Docker container

We've outgrown the run-everything-on-one-machine setup. This change moves background jobs to a different Docker image in production. It also adds a `jobKey` to certain jobs so if we try to process the same cell multiple times it'll only actually run the job once.
2023-08-18 11:16:00 -07:00
parent b1802fc04b
commit 10dd53e7f6
6 changed files with 24 additions and 13 deletions
--- a/app/run-prod.sh
+++ b/app/run-prod.sh
@@ -10,6 +10,4 @@ pnpm tsx src/promptConstructor/migrate.ts

 echo "Starting the server"

-pnpm concurrently --kill-others \
-  "pnpm start" \
-  "pnpm tsx src/server/tasks/worker.ts"
+pnpm start