Open Bug 1784963 Opened 2 years ago Updated 2 days ago

Intermittent dom/tests/mochitest/beacon/test_beaconFrame.html | single tracking bug

Categories

(Core :: DOM: Networking, defect, P3)

Product:
Core
Component:
DOM: Networking
Type:
defect

Tracking

()

Status:
REOPENED

People

(Reporter: jmaher, Assigned: valentin)

References

(Blocks 1 open bug)

Details

(Keywords: intermittent-failure, intermittent-testcase, Whiteboard: [necko-triaged])

Attachments

(2 files, 1 obsolete file)

Bug 1784963 - Run beacon tests sequentially to avoid shared state in beacon-handler.sjs r=#necko
48 bytes, text/x-phabricator-request
Details | Review
Bug 1784963 - Clear beacon state after each test r=#necko
48 bytes, text/x-phabricator-request
Details | Review
No description provided.

Additional information about this bug failures and frequency patterns can be found by running: ./mach test-info failure-report --bug 1784963

Severity: normal → S3

Update:
There have been 31 failures within the last 7 days:
• 3 failures on Android 7.0 x86-64 Lite WebRender opt
• 7 failures on Android 7.0 x86-64 WebRender opt
• 8 failures on Android 7.0 x86-64 WebRender debug
• 1 failures on Android 7.0 x86-64 Lite WebRender Shippable opt
• 2 failures on Linux 18.04 x64 WebRender asan opt
• 3 failures on Linux 18.04 x64 WebRender opt
• 2 failures on Linux 18.04 x64 WebRender Shippable opt
• 1 failures on Linux 22.04 x64 Wayland opt
• 1 failures on OS X 10.15 WebRender opt
• 1 failures on Windows 11 x86 22H2 WebRender Shippable opt
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=447407401&repo=autoland&lineNumber=4282

[task 2024-02-15T18:21:55.528Z] 18:21:55     INFO - TEST-START | dom/tests/mochitest/beacon/test_beaconFrame.html
[task 2024-02-15T18:21:55.664Z] 18:21:55     INFO - TEST-INFO | started process screentopng
[task 2024-02-15T18:21:56.183Z] 18:21:56     INFO - TEST-INFO | screentopng: exit 0
[task 2024-02-15T18:21:56.184Z] 18:21:56     INFO - Buffered messages logged at 18:21:55
[task 2024-02-15T18:21:56.185Z] 18:21:56     INFO - TEST-PASS | dom/tests/mochitest/beacon/test_beaconFrame.html | Beacon was not sent 
[task 2024-02-15T18:21:56.185Z] 18:21:56     INFO - Buffered messages finished
[task 2024-02-15T18:21:56.187Z] 18:21:56     INFO - TEST-UNEXPECTED-FAIL | dom/tests/mochitest/beacon/test_beaconFrame.html | Beacon status should match expected.  is: bacon would have been a better name than beacon should be: hi! - got "bacon would have been a better name than beacon", expected "hi!"
[task 2024-02-15T18:21:56.187Z] 18:21:56     INFO -     SimpleTest.is@SimpleTest/SimpleTest.js:509:14
[task 2024-02-15T18:21:56.188Z] 18:21:56     INFO -     beaconSent/<@dom/tests/mochitest/beacon/test_beaconFrame.html:65:11
[task 2024-02-15T18:21:56.188Z] 18:21:56     INFO -     getBeaconServerStatus/request.onload@dom/tests/mochitest/beacon/test_beaconFrame.html:30:21
[task 2024-02-15T18:21:56.188Z] 18:21:56     INFO -     EventHandlerNonNull*getBeaconServerStatus@dom/tests/mochitest/beacon/test_beaconFrame.html:28:5
[task 2024-02-15T18:21:56.188Z] 18:21:56     INFO -     beaconSent@dom/tests/mochitest/beacon/test_beaconFrame.html:61:26
[task 2024-02-15T18:21:56.188Z] 18:21:56     INFO -     sendBeacon@dom/tests/mochitest/beacon/beacon-frame.html:16:19
[task 2024-02-15T18:21:56.188Z] 18:21:56     INFO -     setTimeout handler*SimpleTest_setTimeoutShim@SimpleTest/SimpleTest.js:922:41
[task 2024-02-15T18:21:56.188Z] 18:21:56     INFO -     @dom/tests/mochitest/beacon/beacon-frame.html:19:56
[task 2024-02-15T18:21:56.188Z] 18:21:56     INFO -     EventListener.handleEvent*@dom/tests/mochitest/beacon/beacon-frame.html:19:8
[task 2024-02-15T18:21:56.189Z] 18:21:56     INFO - TEST-PASS | dom/tests/mochitest/beacon/test_beaconFrame.html | Beacon mimetype should match expected.  is: text/plain;charset=UTF-8 should be: text/plain;charset=UTF-8
Whiteboard: [stockwell needswork:owner]

Hi Masayuki! Can you please take a look at this? Maybe help us assign this to someone.
Thank you!

Flags: needinfo?(masayuki)

I really don't know about networking.

Component: DOM: Core & HTML → DOM: Networking
Flags: needinfo?(masayuki)
Whiteboard: [stockwell needswork:owner] → [necko-triaged]

It seems there's a race between this test and https://searchfox.org/mozilla-central/rev/c26f7461fc2a51196b7f517c7f98a1e271dc9ec0/dom/tests/mochitest/beacon/test_beaconContentPolicy.html#96 (based on the message).

I think the bug stems from https://searchfox.org/mozilla-central/source/dom/tests/mochitest/beacon/beacon-handler.sjs

For example here:
https://treeherder.mozilla.org/logviewer?job_id=446409130&repo=autoland&lineNumber=4033

[task 2024-02-07T20:55:05.878Z] 20:55:05     INFO -  Buffered messages finished
[task 2024-02-07T20:55:05.879Z] 20:55:05  WARNING -  TEST-UNEXPECTED-FAIL | dom/tests/mochitest/beacon/test_beaconFrame.html | Beacon status should match expected.  is: bacon would have been a better name than beacon should be: hi! - got "bacon would have been a better name than beacon", expected "hi!"
[task 2024-02-07T20:55:05.879Z] 20:55:05     INFO -      SimpleTest.is@SimpleTest/SimpleTest.js:509:14
[task 2024-02-07T20:55:05.879Z] 20:55:05     INFO -      beaconSent/<@dom/tests/mochitest/beacon/test_beaconFrame.html?currentTestURL=dom%2Ftests%2Fmochitest%2Fbeacon%2Ftest_beaconFrame.html&closeWhenDone=1&showTestReport=false&expected=pass:65:11
[task 2024-02-07T20:55:05.879Z] 20:55:05     INFO -      getBeaconServerStatus/request.onload@dom/tests/mochitest/beacon/test_beaconFrame.html?currentTestURL=dom%2Ftests%2Fmochitest%2Fbeacon%2Ftest_beaconFrame.html&closeWhenDone=1&showTestReport=false&expected=pass:30:21
[task 2024-02-07T20:55:05.879Z] 20:55:05     INFO -      EventHandlerNonNull*getBeaconServerStatus@dom/tests/mochitest/beacon/test_beaconFrame.html?currentTestURL=dom%2Ftests%2Fmochitest%2Fbeacon%2Ftest_beaconFrame.html&closeWhenDone=1&showTestReport=false&expected=pass:28:5
[task 2024-02-07T20:55:05.880Z] 20:55:05     INFO -      beaconSent@dom/tests/mochitest/beacon/test_beaconFrame.html?currentTestURL=dom%2Ftests%2Fmochitest%2Fbeacon%2Ftest_beaconFrame.html&closeWhenDone=1&showTestReport=false&expected=pass:61:26
[task 2024-02-07T20:55:05.880Z] 20:55:05     INFO -      sendBeacon@dom/tests/mochitest/beacon/beacon-frame.html:16:19
[task 2024-02-07T20:55:05.880Z] 20:55:05     INFO -      setTimeout handler*SimpleTest_setTimeoutShim@SimpleTest/SimpleTest.js:922:41
[task 2024-02-07T20:55:05.880Z] 20:55:05     INFO -      @dom/tests/mochitest/beacon/beacon-frame.html:19:56
[task 2024-02-07T20:55:05.880Z] 20:55:05     INFO -      EventListener.handleEvent*@dom/tests/mochitest/beacon/beacon-frame.html:19:8
[task 2024-02-07T20:55:05.880Z] 20:55:05     INFO -  TEST-PASS | dom/tests/mochitest/beacon/test_beaconFrame.html | Beacon mimetype should match expected.  is: text/plain;charset=UTF-8 should be: text/plain;charset=UTF-8
[task 2024-02-07T20:55:05.880Z] 20:55:05     INFO -  TEST-PASS | dom/tests/mochitest/beacon/test_beaconFrame.html | Beacon was not sent
[task 2024-02-07T20:55:05.881Z] 20:55:05  WARNING -  TEST-UNEXPECTED-FAIL | dom/tests/mochitest/beacon/test_beaconFrame.html | Beacon status should match expected.  is: hi! should be: 123 - got "hi!", expected "123"
[task 2024-02-07T20:55:05.881Z] 20:55:05     INFO -      SimpleTest.is@SimpleTest/SimpleTest.js:509:14
[task 2024-02-07T20:55:05.881Z] 20:55:05     INFO -      beaconSent/<@dom/tests/mochitest/beacon/test_beaconFrame.html?currentTestURL=dom%2Ftests%2Fmochitest%2Fbeacon%2Ftest_beaconFrame.html&closeWhenDone=1&showTestReport=false&expected=pass:65:11
[task 2024-02-07T20:55:05.881Z] 20:55:05     INFO -      getBeaconServerStatus/request.onload@dom/tests/mochitest/beacon/test_beaconFrame.html?currentTestURL=dom%2Ftests%2Fmochitest%2Fbeacon%2Ftest_beaconFrame.html&closeWhenDone=1&showTestReport=false&expected=pass:30:21
[task 2024-02-07T20:55:05.881Z] 20:55:05     INFO -      EventHandlerNonNull*getBeaconServerStatus@dom/tests/mochitest/beacon/test_beaconFrame.html?currentTestURL=dom%2Ftests%2Fmochitest%2Fbeacon%2Ftest_beaconFrame.html&closeWhenDone=1&showTestReport=false&expected=pass:28:5
[task 2024-02-07T20:55:05.882Z] 20:55:05     INFO -      beaconSent@dom/tests/mochitest/beacon/test_beaconFrame.html?currentTestURL=dom%2Ftests%2Fmochitest%2Fbeacon%2Ftest_beaconFrame.html&closeWhenDone=1&showTestReport=false&expected=pass:61:26
[task 2024-02-07T20:55:05.882Z] 20:55:05     INFO -      sendBeacon@dom/tests/mochitest/beacon/beacon-frame.html:16:19
[task 2024-02-07T20:55:05.882Z] 20:55:05     INFO -      setTimeout handler*SimpleTest_setTimeoutShim@SimpleTest/SimpleTest.js:922:41
[task 2024-02-07T20:55:05.882Z] 20:55:05     INFO -      @dom/tests/mochitest/beacon/beacon-frame.html:19:56
[task 2024-02-07T20:55:05.882Z] 20:55:05     INFO -      EventListener.handleEvent*@dom/tests/mochitest/beacon/beacon-frame.html:19:8
[task 2024-02-07T20:55:05.882Z] 20:55:05  WARNING -  TEST-UNEXPECTED-FAIL | dom/tests/mochitest/beacon/test_beaconFrame.html | Beacon mimetype should match expected.  is: text/plain;charset=UTF-8 should be:  - got "text/plain;charset=UTF-8", expected ""
[task 2024-02-07T20:55:05.882Z] 20:55:05     INFO -      SimpleTest.is@SimpleTest/SimpleTest.js:509:14
[task 2024-02-07T20:55:05.883Z] 20:55:05     INFO -      beaconSent/<@dom/tests/mochitest/beacon/test_beaconFrame.html?currentTestURL=dom%2Ftests%2Fmochitest%2Fbeacon%2Ftest_beaconFrame.html&closeWhenDone=1&showTestReport=false&expected=pass:66:11
[task 2024-02-07T20:55:05.883Z] 20:55:05     INFO -      getBeaconServerStatus/request.onload@dom/tests/mochitest/beacon/test_beaconFrame.html?currentTestURL=dom%2Ftests%2Fmochitest%2Fbeacon%2Ftest_beaconFrame.html&closeWhenDone=1&showTestReport=false&expected=pass:30:21
[task 2024-02-07T20:55:05.883Z] 20:55:05     INFO -      EventHandlerNonNull*getBeaconServerStatus@dom/tests/mochitest/beacon/test_beaconFrame.html?currentTestURL=dom%2Ftests%2Fmochitest%2Fbeacon%2Ftest_beaconFrame.html&closeWhenDone=1&showTestReport=false&expected=pass:28:5
[task 2024-02-07T20:55:05.883Z] 20:55:05     INFO -      beaconSent@dom/tests/mochitest/beacon/test_beaconFrame.html?currentTestURL=dom%2Ftests%2Fmochitest%2Fbeacon%2Ftest_beaconFrame.html&closeWhenDone=1&showTestReport=false&expected=pass:61:26
[task 2024-02-07T20:55:05.883Z] 20:55:05     INFO -      sendBeacon@dom/tests/mochitest/beacon/beacon-frame.html:16:19
[task 2024-02-07T20:55:05.883Z] 20:55:05     INFO -      setTimeout handler*SimpleTest_setTimeoutShim@SimpleTest/SimpleTest.js:922:41
[task 2024-02-07T20:55:05.883Z] 20:55:05     INFO -      @dom/tests/mochitest/beacon/beacon-frame.html:19:56
[task 2024-02-07T20:55:05.884Z] 20:55:05     INFO -      EventListener.handleEvent*@dom/tests/mochitest/beacon/beacon-frame.html:19:8

all of the data is offset by one.

Attachment #9385069 - Attachment is obsolete: true
Assignee: nobody → valentin.gosu
Status: NEW → ASSIGNED
Pushed by valentin.gosu@gmail.com:
https://hg.mozilla.org/integration/autoland/rev/4efe70b5f05d
Run beacon tests sequentially to avoid shared state in beacon-handler.sjs r=necko-reviewers,jesup

https://hg.mozilla.org/mozilla-central/rev/4efe70b5f05d

Status: ASSIGNED → RESOLVED
Closed: 1 month ago
status-firefox128: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 128 Branch

This is still happening as seen here

Status: RESOLVED → REOPENED
status-firefox128: fixed → ---
Resolution: FIXED → ---
Target Milestone: 128 Branch → ---
Pushed by valentin.gosu@gmail.com:
https://hg.mozilla.org/integration/autoland/rev/42e1983d8cae
Clear beacon state after each test r=sunil

Backed out for causing mochitest failures in test_beaconContentPolicy.html

  • Backout link
  • Push with failures
  • Failure Log
  • Failure line: TEST-UNEXPECTED-FAIL | dom/tests/mochitest/beacon/test_beaconContentPolicy.html | Cleanup promise rejected: TypeError: NetworkError when attempting to fetch resource.
Flags: needinfo?(valentin.gosu)
Flags: needinfo?(valentin.gosu)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: