feat(firefox-beta): roll to r1514

[microsoft-playwright-automation]

No description provided.

[github-actions]

Test results for "MCP"

2 failed
❌ [chrome] › mcp/autowait.spec.ts:19 › racy navigation destroys context @mcp-windows-latest-chrome
❌ [webkit] › mcp/config.ini.spec.ts:57 › ini config sets browser launch options @mcp-windows-latest-webkit

1 flaky

⚠️ [chrome] › mcp/cdp.spec.ts:24 › cdp server `@mcp-windows-latest-chrome`

6940 passed, 1052 skipped

---

Merge workflow run.

[github-actions]

Test results for "tests 1"

3 failed
❌ [firefox-page] › page/page-emulate-media.spec.ts:196 › should report hover and fine pointer for desktop @firefox-ubuntu-22.04-node20
❌ [playwright-test] › reporter-html.spec.ts:159 › created › should include image diff @ubuntu-latest-node22
❌ [playwright-test] › reporter-html.spec.ts:956 › created › should render annotations @windows-latest-node20

7 flaky

⚠️ [installation tests] › playwright-test-package-managers.spec.ts:61 › yarn: @playwright/test should work `@package-installations-windows-latest`
⚠️ [chromium-library] › library/beforeunload.spec.ts:130 › should support dismissing the dialog multiple times `@chromium-ubuntu-22.04-arm-node20`
⚠️ [chromium-library] › library/video.spec.ts:476 › screencast › should capture static page in persistent context @smoke `@chromium-ubuntu-22.04-node24`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:953 › run-server › socks proxy › should proxy requests from fetch api over ipv6 `@chromium-ubuntu-22.04-node22`
⚠️ [firefox-page] › page/page-leaks.spec.ts:85 › click should not leak `@firefox-ubuntu-22.04-node20`
⚠️ [playwright-test] › ui-mode-test-output.spec.ts:118 › should collapse repeated console messages for test `@ubuntu-latest-node20`
⚠️ [playwright-test] › ui-mode-test-output.spec.ts:118 › should collapse repeated console messages for test `@ubuntu-latest-node22`

41645 passed, 851 skipped

---

Merge workflow run.

[github-actions]

Test results for "tests others"

22 flaky

⚠️ [electron-page] › page/page-goto.spec.ts:462 › should fail when replaced by another navigation `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:28 › should work with cross-process _blank target `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:36 › should work with _blank target in form `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-request-continue.spec.ts:398 › should respect set-cookie in redirect response `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-route.spec.ts:74 › should not support ? in glob pattern `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-route.spec.ts:169 › should not override cookie header `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-goto.spec.ts:462 › should fail when replaced by another navigation `@electron-macos-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:28 › should work with cross-process _blank target `@electron-macos-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:36 › should work with _blank target in form `@electron-macos-latest`
⚠️ [electron-page] › page/page-request-continue.spec.ts:398 › should respect set-cookie in redirect response `@electron-macos-latest`
⚠️ [electron-page] › page/page-route.spec.ts:74 › should not support ? in glob pattern `@electron-macos-latest`
⚠️ [electron-page] › page/page-route.spec.ts:169 › should not override cookie header `@electron-macos-latest`
⚠️ [chromium-library] › library/video.spec.ts:647 › screencast › should capture full viewport `@frozen-time-library-chromium-linux`
⚠️ [chromium-library] › library/video.spec.ts:682 › screencast › should capture full viewport on hidpi `@frozen-time-library-chromium-linux`
⚠️ [chromium-library] › library/video.spec.ts:719 › screencast › should work with video+trace `@frozen-time-library-chromium-linux`
⚠️ [chromium-library] › library/video.spec.ts:275 › screencast › should capture navigation `@realtime-time-library-chromium-linux`
⚠️ [electron-page] › page/page-goto.spec.ts:462 › should fail when replaced by another navigation `@electron-windows-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:28 › should work with cross-process _blank target `@electron-windows-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:36 › should work with _blank target in form `@electron-windows-latest`
⚠️ [electron-page] › page/page-request-continue.spec.ts:398 › should respect set-cookie in redirect response `@electron-windows-latest`
⚠️ [electron-page] › page/page-route.spec.ts:74 › should not support ? in glob pattern `@electron-windows-latest`
⚠️ [electron-page] › page/page-route.spec.ts:169 › should not override cookie header `@electron-windows-latest`

19687 passed, 651 skipped

---

Merge workflow run.

[github-actions]

Test results for "tests 2"

7 fatal errors, not part of any test
37 failed
❌ [chromium-library] › library/trace-viewer.spec.ts:195 › should filter actions by text @chromium-macos-26-large
❌ [firefox-library] › library/beforeunload.spec.ts:130 › should support dismissing the dialog multiple times @firefox-macos-26-xlarge
❌ [firefox-library] › library/capabilities.spec.ts:105 › should support webgl @smoke @firefox-macos-26-xlarge
❌ [firefox-library] › library/capabilities.spec.ts:113 › should support webgl 2 @smoke @firefox-macos-26-xlarge
❌ [firefox-page] › page/page-screenshot.spec.ts:321 › page screenshot › should work for webgl @firefox-macos-26-xlarge
❌ [firefox-library] › library/screencast.spec.ts:28 › screencast.start delivers frames via onFrame callback @firefox-headed-macos-15-xlarge
❌ [firefox-library] › library/screencast.spec.ts:55 › onFrame receives viewport size @firefox-headed-macos-15-xlarge
❌ [firefox-page] › page/page-emulate-media.spec.ts:196 › should report hover and fine pointer for desktop @firefox-beta-ubuntu-22.04
❌ [firefox-page] › page/page-emulate-media.spec.ts:196 › should report hover and fine pointer for desktop @tracing-firefox
❌ [firefox-library] › library/capabilities.spec.ts:105 › should support webgl @smoke @firefox-beta-windows-latest
❌ [firefox-page] › page/page-screenshot.spec.ts:321 › page screenshot › should work for webgl @firefox-beta-windows-latest
❌ [firefox-page] › page/page-emulate-media.spec.ts:196 › should report hover and fine pointer for desktop @firefox-ubuntu-24.04
❌ [firefox-library] › library/capabilities.spec.ts:105 › should support webgl @smoke @firefox-macos-26-large
❌ [firefox-library] › library/capabilities.spec.ts:113 › should support webgl 2 @smoke @firefox-macos-26-large
❌ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:113 › should restore state from userDataDir @firefox-macos-26-large
❌ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:140 › should create userDataDir if it does not exist @firefox-macos-26-large
❌ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:234 › should support har option @firefox-macos-26-large
❌ [firefox-library] › library/hit-target.spec.ts:259 › should not click an element overlaying iframe with the target @firefox-macos-26-large
❌ [firefox-library] › library/proxy.spec.ts:199 › should exclude patterns @firefox-macos-26-large
❌ [firefox-library] › library/trace-viewer.spec.ts:195 › should filter actions by text @firefox-macos-26-large
❌ [firefox-library] › library/tracing.spec.ts:210 › should respect tracesDir and name @firefox-macos-26-large
❌ [firefox-page] › page/page-screenshot.spec.ts:321 › page screenshot › should work for webgl @firefox-macos-26-large
❌ [firefox-library] › library/capabilities.spec.ts:105 › should support webgl @smoke @firefox-beta-macos-latest
❌ [firefox-library] › library/capabilities.spec.ts:113 › should support webgl 2 @smoke @firefox-beta-macos-latest
❌ [firefox-page] › page/page-screenshot.spec.ts:321 › page screenshot › should work for webgl @firefox-beta-macos-latest
❌ [firefox-library] › library/capabilities.spec.ts:105 › should support webgl @smoke @firefox-macos-15-large
❌ [firefox-library] › library/capabilities.spec.ts:113 › should support webgl 2 @smoke @firefox-macos-15-large
❌ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:161 › should have passed URL when launching with ignoreDefaultArgs: true @firefox-macos-15-large
❌ [firefox-library] › library/trace-viewer.spec.ts:195 › should filter actions by text @firefox-macos-15-large
❌ [firefox-page] › page/page-screenshot.spec.ts:321 › page screenshot › should work for webgl @firefox-macos-15-large
❌ [firefox-library] › library/capabilities.spec.ts:105 › should support webgl @smoke @firefox-windows-latest
❌ [firefox-page] › page/page-screenshot.spec.ts:321 › page screenshot › should work for webgl @firefox-windows-latest
❌ [firefox-library] › library/capabilities.spec.ts:105 › should support webgl @smoke @firefox-macos-15-xlarge
❌ [firefox-library] › library/capabilities.spec.ts:113 › should support webgl 2 @smoke @firefox-macos-15-xlarge
❌ [firefox-page] › page/page-screenshot.spec.ts:321 › page screenshot › should work for webgl @firefox-macos-15-xlarge
❌ [webkit-library] › library/capabilities.spec.ts:95 › should play audio @smoke @webkit-macos-15-large
❌ [webkit-library] › library/trace-viewer.spec.ts:195 › should filter actions by text @webkit-macos-15-large

80 flaky

⚠️ [chromium-page] › page/page-click.spec.ts:124 › should click the button after navigation `@msedge-dev-windows-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:173 › launchServer › should ignore page.pause when headed `@chromium-macos-26-large`
⚠️ [chromium-page] › page/page-set-input-files.spec.ts:146 › should upload large file `@chromium-macos-26-large`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:141 › launchServer › should be able to reconnect to a browser `@chromium-tip-of-tree-macos-15--headed`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:161 › launchServer › should be able to visit ipv6 `@chromium-tip-of-tree-macos-15--headed`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:173 › launchServer › should ignore page.pause when headed `@chromium-tip-of-tree-macos-15--headed`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:278 › launchServer › disconnected event should be emitted when browser is closed or server is closed `@chromium-tip-of-tree-macos-15--headed`
⚠️ [chromium-library] › library/headful.spec.ts:293 › headless and headful should use same default fonts `@chromium-headed-macos-15-xlarge`
⚠️ [chromium-library] › library/video.spec.ts:275 › screencast › should capture navigation `@chrome-ubuntu-22.04`
⚠️ [chromium-library] › library/trace-viewer.spec.ts:195 › should filter actions by text `@chromium-tip-of-tree-macos-15`
⚠️ [chromium-library] › library/browsercontext-proxy.spec.ts:103 › should set cookie for top-level domain `@msedge-beta-windows-latest`
⚠️ [chromium-library] › library/browsercontext-proxy.spec.ts:103 › should set cookie for top-level domain `@msedge-windows-latest`
⚠️ [chromium-page] › page/page-event-console.spec.ts:255 › should have timestamp in consoleMessages `@chromium-windows-latest`
⚠️ [chromium-library] › library/trace-viewer.spec.ts:195 › should filter actions by text `@chromium-macos-15-large`
⚠️ [chromium-library] › library/video.spec.ts:682 › screencast › should capture full viewport on hidpi `@chromium-macos-15-xlarge`
⚠️ [chromium-library] › library/browsercontext-user-agent.spec.ts:110 › should work for navigator.userAgentData and sec-ch-ua headers `@msedge-beta-macos-latest`
⚠️ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:639 › should skip default overrides with noDefaults `@msedge-beta-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:370 › launchServer › should reject waitForSelector when browser closes `@msedge-dev-macos-latest`
⚠️ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:639 › should skip default overrides with noDefaults `@msedge-dev-macos-latest`
⚠️ [chromium-library] › library/video.spec.ts:647 › screencast › should capture full viewport `@chromium-macos-26-xlarge`
⚠️ [chromium-library] › library/video.spec.ts:682 › screencast › should capture full viewport on hidpi `@chromium-macos-26-xlarge`
⚠️ [chromium-library] › library/trace-viewer.spec.ts:1153 › should show action source `@chromium-tip-of-tree-ubuntu-22.04--headed`
⚠️ [firefox-library] › library/inspector/cli-codegen-3.spec.ts:224 › cli codegen › should generate frame locators (4) `@firefox-beta-ubuntu-22.04`
⚠️ [firefox-library] › library/video.spec.ts:567 › screencast › should wait for video to finish if page was closed `@tracing-firefox`
⚠️ [firefox-library] › library/browsercontext-reuse.spec.ts:155 › reuse launch › should reset serviceworker that hangs in importScripts `@firefox-beta-windows-latest`
⚠️ [firefox-library] › library/browsercontext-storage-state.spec.ts:54 › should set local storage `@firefox-beta-windows-latest`
⚠️ [firefox-library] › library/proxy.spec.ts:44 › should use proxy for second page `@firefox-beta-windows-latest`
⚠️ [firefox-library] › library/proxy.spec.ts:93 › should proxy local network requests › with other bypasses › loopback address `@firefox-beta-windows-latest`
⚠️ [firefox-library] › library/proxy.spec.ts:127 › should allow bypassing 127.0.0.1 requests `@firefox-beta-windows-latest`
⚠️ [firefox-library] › library/proxy.spec.ts:146 › should authenticate `@firefox-beta-windows-latest`
⚠️ [firefox-page] › page/page-leaks.spec.ts:85 › click should not leak `@firefox-beta-windows-latest`
⚠️ [firefox-library] › library/browsercontext-network-event.spec.ts:21 › BrowserContext.Events.Request `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/hit-target.spec.ts:244 › should not click iframe overlaying the target `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/video.spec.ts:202 › screencast › should expose video path blank page `@firefox-headed-windows-latest`
⚠️ [firefox-page] › page/page-add-locator-handler.spec.ts:212 › should work when owner frame detaches `@firefox-headed-windows-latest`
⚠️ [firefox-page] › page/page-emulate-media.spec.ts:144 › should keep reduced motion and color emulation after reload `@firefox-ubuntu-24.04`
⚠️ [firefox-library] › library/beforeunload.spec.ts:20 › should close browser with beforeunload page `@firefox-macos-26-large`
⚠️ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:161 › should have passed URL when launching with ignoreDefaultArgs: true `@firefox-macos-26-large`
⚠️ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:227 › should connect to a browser with the default page `@firefox-macos-26-large`
⚠️ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:245 › user agent is up to date `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-aria.spec.ts:41 › should generate regex in aria snapshot `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:43 › should print the correct context options for custom settings `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:153 › should print load/save storageState `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:202 › should not print context options method override in mstest if no options were passed `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:208 › should print context options method override in mstest if options were passed `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:208 › should print context options method override in xunit if options were passed `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-java.spec.ts:40 › should print the correct context options for custom settings `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-javascript.spec.ts:84 › should save the codegen output to a file if specified `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-python-async.spec.ts:80 › should save the codegen output to a file if specified `@firefox-macos-26-large`
⚠️ [firefox-library] › library/proxy.spec.ts:252 › should bypass proxy for localhost when localhost is in bypass list `@firefox-macos-26-large`
⚠️ [firefox-library] › library/proxy.spec.ts:333 › should use SOCKS proxy for websocket requests `@firefox-macos-26-large`
⚠️ [firefox-library] › library/proxy.spec.ts:368 › should use http proxy for websocket requests `@firefox-macos-26-large`
⚠️ [firefox-library] › library/trace-viewer.spec.ts:96 › should show empty trace viewer `@firefox-macos-26-large`
⚠️ [firefox-page] › page/page-click-timeout-3.spec.ts:20 › should fail when element jumps during hit testing `@firefox-macos-26-large`
⚠️ [firefox-page] › page/page-click.spec.ts:39 › should issue clicks in parallel in page and popup `@firefox-macos-26-large`
⚠️ [firefox-page] › page/page-screenshot.spec.ts:37 › page screenshot › should not capture blinking caret by default `@firefox-macos-26-large`
⚠️ [firefox-page] › page/page-leaks.spec.ts:85 › click should not leak `@firefox-beta-macos-latest`
⚠️ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:267 › exposes browser `@firefox-macos-15-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-python-async.spec.ts:80 › should save the codegen output to a file if specified `@firefox-macos-15-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-test.spec.ts:20 › should print the correct imports and context options `@firefox-macos-15-large`
⚠️ [firefox-page] › page/page-click-timeout-4.spec.ts:36 › should click for the second time after first timeout `@firefox-macos-15-large`
⚠️ [firefox-page] › page/page-event-request.spec.ts:385 › should return last requests `@firefox-macos-15-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-3.spec.ts:224 › cli codegen › should generate frame locators (4) `@firefox-windows-latest`
⚠️ [firefox-page] › page/page-goto.spec.ts:839 › should return when navigation is committed if commit is specified `@firefox-windows-latest`
⚠️ [webkit-library] › library/browsertype-connect.spec.ts:723 › launchServer › should upload large file `@webkit-macos-26-large`
⚠️ [webkit-library] › library/inspector/cli-codegen-3.spec.ts:979 › cli codegen › should record when manual popover with fullscreen backdrop is open `@webkit-macos-26-large`
⚠️ [webkit-library] › library/inspector/pause.spec.ts:496 › pause › should not prevent key events `@webkit-macos-26-large`
⚠️ [webkit-library] › library/role-utils.spec.ts:38 › wpt accname #2 `@webkit-macos-26-large`
⚠️ [webkit-library] › library/route-web-socket.spec.ts:149 › no-mock › should work with error after successful open `@webkit-macos-26-large`
⚠️ [webkit-library] › library/screencast-actions.spec.ts:37 › should render annotation styles `@webkit-macos-26-large`
⚠️ [webkit-library] › library/selector-generator.spec.ts:46 › selector generator › should prefer button over inner span `@webkit-macos-26-large`
⚠️ [webkit-library] › library/beforeunload.spec.ts:79 › should access page after beforeunload `@webkit-headed-ubuntu-24.04`
⚠️ [webkit-library] › library/browsertype-connect.spec.ts:535 › launchServer › should name video file after page guid when connecting to remote browser with artifactsDir `@webkit-headed-ubuntu-24.04`
⚠️ [webkit-library] › library/inspector/cli-codegen-csharp.spec.ts:202 › should not print context options method override in nunit if no options were passed `@webkit-headed-ubuntu-24.04`
⚠️ [webkit-library] › library/defaultbrowsercontext-2.spec.ts:56 › should support contrast option `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/inspector/cli-codegen-csharp.spec.ts:100 › should print the correct context options when using a device and additional options `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/inspector/cli-codegen-csharp.spec.ts:202 › should not print context options method override in nunit if no options were passed `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/inspector/cli-codegen-csharp.spec.ts:231 › should work with --save-har and --save-har-glob in nunit `@webkit-headed-windows-latest`
⚠️ [webkit-page] › page/page-set-input-files.spec.ts:38 › should upload a folder `@tracing-webkit`
⚠️ [webkit-page] › page/page-request-fallback.spec.ts:221 › post data › should amend post data `@webkit-macos-15-large`

269870 passed, 11325 skipped, 3644 did not run

---

Merge workflow run.