Performance tests, notebook tests, and sharding (#5236)

* Renamed test files * temp push of performance branch * comma * stash * final * rename to imagery * remove old * stash * fix name * Add plain notebook e2e and perf test * Shard and add perf to ci * Import fixtures * 3 * also off by one? * forgive me, father * update perf test name * SHARD * one mo shot * add suites * failfast * remove allure * add more testsuites * full * skip * ignore glob * headless? * skip audit to save ci time * temp push * remove allure * remove doubled test and update snapshots * update snapthos 2 * back to ci * update comments * remove notebook * updates * remove npx playwright install * Prevent deleting browsers * circleci comment * re-enable audit * Add html reporter * speed up execution * speed up CI * Add performance line to bug report * PR Comments * change dir of report * remove test * Update Tracepath. Update playwright-percy * Remove shim * Improve stability and move html report * fix space * Add more slowdown for moveObjects * Get rid of navigation event * fix missing events * review comments * last change! Co-authored-by: unlikelyzero <jchill2@gmail.com>
2022-05-25 15:45:11 -07:00
parent f74a35f45a
commit c56d458ecb
15 changed files with 555 additions and 30 deletions
--- a/e2e/playwright-performance.config.js
+++ b/e2e/playwright-performance.config.js
@@ -0,0 +1,41 @@
+/* eslint-disable no-undef */
+// playwright.config.js
+// @ts-check
+
+/** @type {import('@playwright/test').PlaywrightTestConfig} */
+const config = {
+    retries: 0,
+    testDir: 'tests/performance/',
+    timeout: 30 * 1000,
+    workers: 1, //Only run in serial with 1 worker
+    webServer: {
+        command: 'npm run start',
+        port: 8080,
+        timeout: 200 * 1000,
+        reuseExistingServer: !process.env.CI
+    },
+    use: {
+        browserName: "chromium",
+        baseURL: 'http://localhost:8080/',
+        headless: Boolean(process.env.CI), //Only if running locally
+        ignoreHTTPSErrors: true,
+        screenshot: 'off',
+        trace: 'off',
+        video: 'off'
+    },
+    projects: [
+        {
+            name: 'chrome',
+            use: {
+                browserName: 'chromium'
+            }
+        }
+    ],
+    reporter: [
+        ['list'],
+        ['junit', { outputFile: 'test-results/results.xml' }],
+        ['json', { outputFile: 'test-results/results.json' }]
+    ]
+};
+
+module.exports = config;