Skip to content

[Bug]: Generated Aria snapshots can fail in some circumstances because they are not deep equal #40079

@lukpsaxo

Description

@lukpsaxo

Version

1.59

Steps to reproduce

  1. clone repo: https://github.com/lukpsaxo/pw-snapshot-repro
  2. install playwright - npm install
  3. run npx playwright test --update-snapshots

This creates a empty snapshot that cannot be applied

  1. run npx playwright test

Tests fail.

Note that deleting and regenerating from scratch generates the same snapshot that fails.

Note 2 - The bug is more visible with the new children: 'deep-equal' option as without it the generated snapshot will pass. If I add a manual children: deep-equal then the generated snapshot just removes the children deep-equal line

Expected behavior

I expect the generated snapshot to pass.

Actual behavior

the test fails with a generated snapshot

Additional context

this specific html fails

Environment

System:
    OS: Linux 5.15 Ubuntu 24.04.4 LTS 24.04.4 LTS (Noble Numbat)
    CPU: (32) x64 Intel(R) Core(TM) i9-14900
    Memory: 40.90 GB / 62.64 GB
    Container: Yes
  Binaries:
    Node: 22.14.0 - /home/dev/.nvm/versions/node/v22.14.0/bin/node
    Yarn: 1.22.22 - /mnt/c/npm/prefix/yarn
    npm: 10.9.2 - /home/dev/.nvm/versions/node/v22.14.0/bin/npm
  IDEs:
    VSCode: 1.114.0 - /home/dev/.vscode-server/bin/e7fb5e96c0730b9deb70b33781f98e2f35975036/bin/remote-cli/code
    opencode: 1.2.27 - /usr/bin/opencode
  Languages:
    Bash: 5.2.21 - /usr/bin/bash
  npmPackages:
    @playwright/test: 1.59.1 => 1.59.1

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions