Commit afbaa42
committed
docs(baseline): capture real Playwright chromium pass rate (33/131)
With the webServer wiring in place + system deps installed via
`sudo npx playwright install-deps chromium`, ran the full chromium
project (19.2 min wall time). Results:
33 passed / 94 failed / 4 skipped
Huge jump from the "0 passed / 575 failed" baseline — the 575 was the
sum across 7 Playwright projects (4 browsers × many responsive
breakpoints), and all of it was caused by not having a backend. With
a live backend against the spring-petclinic fixture, a third of the
chromium suite passes.
The remaining 94 failures are NOT environmental; they're genuine test
↔ UI divergence:
- expect(locator).toBeVisible / element(s) not found — selectors
targeting UI elements that don't render in the current build
(component/CSS-class renames).
- strict mode violations on `getByText(/0/)` — tests assume unique
stat values; spring-petclinic's 691-node graph produces many
zero-valued cards, so the match resolves to 8+ elements.
- toHaveLength mismatches — expected N list items, got different count.
- "Button has no aria-label" in accessibility.spec.ts — real a11y
regressions, not a test bug.
- 30s timeouts on locator.focus / locator.boundingBox — elements
that never appear.
Treating the chromium 33/94/4 split as the honest Phase A baseline.
Test-suite maintenance (update selectors to match current UI, or
generate a deterministic fixture) is scoped out of Phase A.1 parent 123de51 commit afbaa42
1 file changed
Lines changed: 13 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
222 | 222 | | |
223 | 223 | | |
224 | 224 | | |
225 | | - | |
| 225 | + | |
| 226 | + | |
| 227 | + | |
| 228 | + | |
| 229 | + | |
| 230 | + | |
| 231 | + | |
| 232 | + | |
| 233 | + | |
| 234 | + | |
| 235 | + | |
| 236 | + | |
| 237 | + | |
226 | 238 | | |
227 | 239 | | |
228 | 240 | | |
| |||
0 commit comments