Commit 2f42553
authored
ci: use a container and HEADLESS=false for running benchmarks (#37725)
## **Description**
Previously, benchmarks would crash if you ran them too many times. The
solution here is to use a container and run them `HEADLESS=false`, just
like the E2E tests run.
Also undo the `pingTimeout` change.
The container did not have the AWS CLI installed, so we had to install
it. TODO is pre-install this in the container.
## **Changelog**
CHANGELOG entry: null
## **Related issues**
Fixes: #36935
<!--## **Manual testing steps**
## **Screenshots/Recordings**
## **Pre-merge author checklist**
## **Pre-merge reviewer checklist**-->
<!-- CURSOR_SUMMARY -->
---
> [!NOTE]
> Runs benchmarks in a container with HEADLESS=false and removes the
`pingTimeout` option from Snaps execution service (and its tests).
>
> - **CI / Benchmarks (`.github/workflows/run-benchmarks.yml`)**
> - Run in container
`ghcr.io/metamask/metamask-extension-e2e-image:v24.11.0` with
credentials.
> - Set `HEADLESS=false`; configure Xvfb for display.
> - Install AWS CLI inside container.
> - Increase `powerUserHome` loads: `--browserLoads 10 --pageLoads 10`.
> - **Snaps Execution Service**
> - Remove `pingTimeout` from `OffscreenExecutionService` and
`IframeExecutionService` initialization in
`app/scripts/controller-init/snaps/execution-service-init.ts`.
> - Update test `execution-service-init.test.ts` to drop `pingTimeout`
expectation.
>
> <sup>Written by [Cursor
Bugbot](https://cursor.com/dashboard?tab=bugbot) for commit
f3d9eeb. This will update automatically
on new commits. Configure
[here](https://cursor.com/dashboard?tab=bugbot).</sup>
<!-- /CURSOR_SUMMARY -->1 parent 6f70c0f commit 2f42553
File tree
3 files changed
+14
-5
lines changed- .github/workflows
- app/scripts/controller-init/snaps
3 files changed
+14
-5
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
16 | | - | |
| 16 | + | |
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
| |||
22 | 22 | | |
23 | 23 | | |
24 | 24 | | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
25 | 30 | | |
26 | 31 | | |
27 | 32 | | |
| |||
31 | 36 | | |
32 | 37 | | |
33 | 38 | | |
34 | | - | |
| 39 | + | |
35 | 40 | | |
36 | 41 | | |
37 | 42 | | |
| |||
63 | 68 | | |
64 | 69 | | |
65 | 70 | | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
66 | 78 | | |
67 | 79 | | |
68 | 80 | | |
| |||
Lines changed: 0 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
69 | 69 | | |
70 | 70 | | |
71 | 71 | | |
72 | | - | |
73 | 72 | | |
74 | 73 | | |
75 | 74 | | |
Lines changed: 0 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
56 | 56 | | |
57 | 57 | | |
58 | 58 | | |
59 | | - | |
60 | 59 | | |
61 | 60 | | |
62 | 61 | | |
| |||
71 | 70 | | |
72 | 71 | | |
73 | 72 | | |
74 | | - | |
75 | 73 | | |
76 | 74 | | |
77 | 75 | | |
0 commit comments