Bug 1733592 [wpt PR 30862] - Fix flaky coop reporting tests., a=testonly
commit8de558dacfacae5297e5c8b972d34f82abe59bf6
authorBlink WPT Bot <blink-w3c-test-autoroller@chromium.org>
Mon, 4 Oct 2021 23:18:48 +0000 (4 23:18 +0000)
committermoz-wptsync-bot <wptsync@mozilla.com>
Tue, 5 Oct 2021 12:49:10 +0000 (5 12:49 +0000)
treec4223f241d3e5da2c0899bed7ed7f8fa9a7f5455
parent57d0c6d216406a51a7610a0dc0a0875c4b7eeee9
Bug 1733592 [wpt PR 30862] - Fix flaky coop reporting tests., a=testonly

Automatic update from web-platform-tests
Fix flaky coop reporting tests. (#30862)

Previously coop reporting tests written using the
runNavigationReportingTest helper shared the same report endpoints.
This is problematic as wpt tests are executed in parallel and all
reports are sent to the same python handler. When multiple tests
uploaded coop reports and subsequently queried the handler, they
sometimes gets back reports uploaded by other tests.
Moreover, after a coop test completes the page uploads another report
for navigating away from the test webpage if a COOP policy is set. This
causes a problem for subsequent invocation of the same test as the
reports are persisted on the python handler.

This CL uses a unique reportID for each test's reporting endpoint and
uses WPT pipe substitution to pass it to test helper function. It also
resets the python handler's stored reports for that unique reportID
before a test is run so that running the tests multiple times yield the
same PASS every time.

Bug: 1249043
Change-Id: Ib5679d0d8e5da5421ac5225cc9e87029c0ffca89
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/3156345
Commit-Queue: Rodney Ding <rodneyding@google.com>
Reviewed-by: Ian Clelland <iclelland@chromium.org>
Cr-Commit-Position: refs/heads/main@{#924310}

Co-authored-by: Rodney Ding <rodneyding@google.com>
--

wpt-commits: 9c8389ed7bf078b82a750dbf7775c8aa59b6927e
wpt-pr: 30862
19 files changed:
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/access-reporting/property-opener-set.https.html
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/report-only-four-reports.https.html
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/report-only-four-reports.https.html.sub.headers
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/report-only-same-origin-report-to.https.html
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/report-only-same-origin-report-to.https.html.sub.headers
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-coop-navigated-popup.https.html
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-coop-navigated-popup.https.html.sub.headers
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-same-origin-allow-popups-report-to.https.html
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-same-origin-allow-popups-report-to.https.html.sub.headers
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-same-origin-coep-report-to.https.html
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-same-origin-coep-report-to.https.html.sub.headers
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-same-origin-report-to.https.html
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-same-origin-report-to.https.html.sub.headers
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-unsafe-none-report-to.https.html
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-unsafe-none-report-to.https.html.sub.headers
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/resources/reporting-common.js
testing/web-platform/tests/html/cross-origin-opener-policy/reporting/resources/test-access-property.js
testing/web-platform/tests/reporting/resources/README.md
testing/web-platform/tests/reporting/resources/report.py