Open Bug 1831695 Opened 1 year ago Updated 4 months ago

Intermittent dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html | single tracking bug

Categories

(Core :: WebRTC: Audio/Video, defect, P5)

Product:
Core
Component:
WebRTC: Audio/Video
Type:
defect

Tracking

()

Tracking Flags:
Tracking Status
firefox-esr102 --- unaffected
firefox113 --- unaffected
firefox114 --- unaffected
firefox115 --- affected

People

(Reporter: intermittent-bug-filer, Assigned: jhlin, NeedInfo)

References

(Depends on 1 open bug, Regression)

Details

(4 keywords, Whiteboard: [stockwell disabled][stockwell unknown])

Attachments

(1 file, 1 obsolete file)

Bug 1831695 - disable test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html on win for causing frequent failures. r=#intermittent-reviewers
48 bytes, text/x-phabricator-request
Details | Review

Filed by: jolin [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=414443791&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/T9sW7iA0R06YeVRhi1Q4vw/runs/0/artifacts/public/logs/live_backing.log

Enabling WMF software H.264 encoder causes some intermittent WebRTC stats test failures. This bug is filed to track it.
Assignee: nobody → jolin

Set release status flags based on info from the regressing bug 1818567

status-firefox113: --- → unaffected
status-firefox114: --- → unaffected
status-firefox115: --- → affected
status-firefox-esr102: --- → unaffected

There have been 43total failures in the last 7 days.
There are:

  • 3 failures on windows11-32-2009-qr opt and debug
  • 1 failure on windows11-32-2009-shippable-qr opt
  • 25 failures on windows11-64-2009-asan-qr opt
  • 10 failures on windows11-64-2009-qr opt and debug
  • 4 failures on windows11-64-2009-shippable-qr opt

Recent failure log.

Jan, as the owner of this component, can you help us assign the bug to someone? Thank you.

Flags: needinfo?(jib)
Whiteboard: [stockwell needswork:owner]

John is already assigned on the bug.
Removing Jan's needinfo.

Flags: needinfo?(jib)

There have been 58 total failures in the last 7 days.
There are:

  • 35 failures on Windows 11 x64 22H2 asan WebRender opt
  • 5 failures on Windows 11 x64 22H2 WebRender Shippable opt
  • 5 failures on Windows 11 x64 22H2 WebRender debug
  • 4 failures on Windows 11 x86 22H2 WebRender Shippable opt
  • 4 failures on Windows 11 x86 22H2 WebRender debug
  • 3 failures on Windows 11 x86 22H2 WebRender opt
  • 1 failure on Windows 11 x64 22H2 WebRender opt
  • 1 failure on Windows 11 x64 22H2 CCov WebRender opt

Recent failure log.

[task 2023-06-18T01:05:43.450Z] 01:05:43     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html | outbound-rtp.pliCount is a sane number for a short video test. value=0 
[task 2023-06-18T01:05:43.450Z] 01:05:43     INFO - Buffered messages finished
[task 2023-06-18T01:05:43.451Z] 01:05:43     INFO - TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html | outbound-rtp.qpSum is at least 0 video test. value=0 
[task 2023-06-18T01:05:43.451Z] 01:05:43     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:424:16
[task 2023-06-18T01:05:43.451Z] 01:05:43     INFO - pedanticChecks/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:498:13
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - pedanticChecks@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:353:10
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - @https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html:105:19
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - async*runNetworkTest/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2492:11
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - async*runTestWhenReady@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:503:11
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - async*runNetworkTest@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2489:9
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - async*@https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html:19:17
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html | outbound-rtp.packetsSent is a sane number for a short video test. value=79

John, any updates on this one? It is on the disable recommended list with 183 total failures, all on windows: https://treeherder.mozilla.org/intermittent-failures/bugdetails?startday=2023-05-24&endday=2023-06-23&tree=trunk&failurehash=all&bug=1831695

Flags: needinfo?(jolin)

This bug has 194 total failures in the last 30 days and made a disable patch until there's a fix in place.

Whiteboard: [stockwell disable-recommended] → [stockwell disable-recommended][stockwell needswork:owner]
Pushed by sstanca@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/7c2054186233
disable test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html on win for causing frequent failures. r=intermittent-reviewers,MasterWayZ
Keywords: leave-open
Whiteboard: [stockwell disable-recommended][stockwell needswork:owner] → [stockwell disabled][stockwell needswork:owner]
Depends on: 1847093

If this is just because of bug 1847093, we ought to be able to re-enable this test if we pref off the platform encoder.

Update

There have been 33 total failures wihtin the last 7 days:

  • 14 failures on OS X 10.15 WebRender debug
  • 7 failures on Linux 18.04 x64 WebRender Shippable opt
  • 9 failures on Linux 18.04 x64 WebRender opt
  • 1 failure on Linux 18.04 x64 CCov WebRender opt
  • 2 failures on Linux 18.04 x64 WebRender asan opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=441301885&repo=autoland&lineNumber=75389

[task 2023-12-24T14:44:01.158Z] 14:44:01     INFO - Buffered messages logged at 14:44:00
[task 2023-12-24T14:44:01.158Z] 14:44:01     INFO - Drawing color 0,255,0,1
[task 2023-12-24T14:44:01.158Z] 14:44:01     INFO - Drawing color 255,0,0,1
[task 2023-12-24T14:44:01.159Z] 14:44:01     INFO - Buffered messages finished
[task 2023-12-24T14:44:01.159Z] 14:44:01     INFO - TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html | Test timed out. - 
[task 2023-12-24T14:44:01.592Z] 14:44:01     INFO - Drawing color 0,255,0,1
[task 2023-12-24T14:44:02.206Z] 14:44:02     INFO - GECKO(4560) | MEMORY STAT | vsize 6890MB | residentFast 191MB | heapAllocated 21MB
[task 2023-12-24T14:44:02.207Z] 14:44:02     INFO - Drawing color 255,0,0,1
[task 2023-12-24T14:44:02.287Z] 14:44:02     INFO - TEST-OK | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html | took 318035ms

John, are there any updates?
Thank you.

Whiteboard: [stockwell disabled][stockwell unknown] → [stockwell disabled][stockwell needswork:owner]
Depends on: 1872495
Attachment #9384773 - Attachment is obsolete: true
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: