Bug 105483 - [CI][SHARDS] igt@perf@oa-exponents - fail - Test assertion failure function test_oa_exponents - Failed assertion: n_timer_reports - 3 <= matches - error: 27 > 26
Summary: [CI][SHARDS] igt@perf@oa-exponents - fail - Test assertion failure function t...
Status: NEW
Alias: None
Product: DRI
Classification: Unclassified
Component: DRM/Intel (show other bugs)
Version: DRI git
Hardware: Other All
: medium normal
Assignee: Lionel Landwerlin
QA Contact: Intel GFX Bugs mailing list
URL:
Whiteboard: ReadyForDev
Keywords:
Depends on:
Blocks:
 
Reported: 2018-03-13 12:03 UTC by Marta Löfstedt
Modified: 2019-11-04 21:34 UTC (History)
1 user (show)

See Also:
i915 platform: BDW, BXT, GLK, KBL, SKL
i915 features: Perf/OA


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Marta Löfstedt 2018-03-13 12:03:33 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3916/shard-glkb2/igt@perf@oa-exponents.html

(perf:1569) CRITICAL: Test assertion failure function test_oa_exponents, file ../tests/perf.c:1783:
(perf:1569) CRITICAL: Failed assertion: n_timer_reports - 3 <= matches
(perf:1569) CRITICAL: error: 27 > 26
Subtest oa-exponents failed.
Comment 1 Lionel Landwerlin 2018-03-14 17:32:53 UTC
Yep, that's the one failure I have no explanation for :(
Comment 2 Marta Löfstedt 2018-03-16 08:27:30 UTC
Here is one from when we run the shards testlist on all BAT machines. The overview of the results are here:
https://intel-gfx-ci.01.org/tree/drm-tip/drmtip.html

https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_1/fi-skl-6770hq/igt@perf@oa-exponents.html
Comment 3 Marta Löfstedt 2018-03-19 15:12:40 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_4/fi-skl-gvtdvm/igt@perf@oa-exponents.html
https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_4/fi-bsw-n3050/igt@perf@oa-exponents.html

(perf:1521) CRITICAL: Test assertion failure function test_oa_exponents, file ../tests/perf.c:1783:
(perf:1521) CRITICAL: Failed assertion: n_timer_reports - 3 <= matches
(perf:1521) CRITICAL: error: 27 > 26
Subtest oa-exponents failed.
Comment 4 Lionel Landwerlin 2018-03-19 15:15:30 UTC
Thanks, I sent out a patch to improve the test a bit further for this particular issue : https://lists.freedesktop.org/archives/igt-dev/2018-March/001806.html

Waiting for review.
Comment 5 Marta Löfstedt 2018-03-20 10:35:18 UTC
(In reply to Lionel Landwerlin from comment #4)
> Thanks, I sent out a patch to improve the test a bit further for this
> particular issue :
> https://lists.freedesktop.org/archives/igt-dev/2018-March/001806.html
> 
> Waiting for review.

Since this was reproduced on drmtip runs, i.e. the shards testlist run on BAT machines. I would require an IGT hack patch bringing in the affected tests to tests/intel-ci/fast-feedback.testlist to get the tests run on the BAT machines.
Comment 6 Marta Löfstedt 2018-04-03 12:58:24 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_11/fi-bxt-j4205/igt@perf@oa-exponents.html	

(perf:1839) CRITICAL: Test assertion failure function test_oa_exponents, file ../tests/perf.c:1783:
(perf:1839) CRITICAL: Failed assertion: n_timer_reports - 3 <= matches
(perf:1839) CRITICAL: error: 27 > 26
Subtest oa-exponents failed.
Comment 7 Martin Peres 2018-07-23 15:30:25 UTC
Also seen on KBL: https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_76/fi-kbl-7560u/igt@perf@oa-exponents.html

(perf:2665) CRITICAL: Test assertion failure function test_oa_exponents, file ../tests/perf.c:1785:
(perf:2665) CRITICAL: Failed assertion: n_timer_reports - 3 <= matches
(perf:2665) CRITICAL: error: 27 > 26
Subtest oa-exponents failed.
Comment 8 Martin Peres 2018-10-16 07:56:01 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_128/fi-apl-guc/igt@perf@oa-exponents.html

Starting subtest: oa-exponents
(perf:1345) CRITICAL: Test assertion failure function test_oa_exponents, file ../tests/perf.c:1799:
(perf:1345) CRITICAL: Failed assertion: n_timer_reports - 3 <= matches
(perf:1345) CRITICAL: error: 27 > 25
Subtest oa-exponents failed.
Comment 9 Martin Peres 2018-10-26 14:58:19 UTC
Also seen in BDW
https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_133/fi-bdw-gvtdvm/igt@perf@oa-
exponents.html

	
Starting subtest: oa-exponents
(perf:1112) CRITICAL: Test assertion failure function test_oa_exponents, file ../tests/perf.c:1799:
(perf:1112) CRITICAL: Failed assertion: n_timer_reports - 3 <= matches
(perf:1112) CRITICAL: error: 27 > 25
Subtest oa-exponents failed.
Comment 10 CI Bug Log 2019-10-22 16:09:40 UTC
A CI Bug Log filter associated to this bug has been updated:

{- BSW BDW SKL BXT APL KBL GLK: igt@perf@oa-exponents - Failed assertion: n_timer_reports - 3 &lt;= matches -}
{+ BSW BDW SKL BXT APL KBL GLK: igt@perf@oa-exponents - Failed assertion: n_timer_reports - 3 &lt;= matches +}


  No new failures caught with the new filter
Comment 11 umesh 2019-11-04 21:34:21 UTC
The test verifies different sample rates to capture reports into the OA buffer. Rates range approx. from 3.33 us to 109 ms. Every iteration is double the previous rate. Once 30 reports are captures, the timestamp delta between reports is expected to be equal to the sample rate. A tolerance of 3 errors in timestamp deltas (in a total of 29 deltas collected) is allowed.

A quick repro on APL suggests that the tolerance of 3 error deltas is a magic number. Changing it to 4 increases the tolerance for the mismatches on platforms like APL and allows the test to pass.

Machines: apl
Overall Repro rate: 22%

User Impact: None
Severity: Low
Pririty: Low


Use of freedesktop.org services, including Bugzilla, is subject to our Code of Conduct. How we collect and use information is described in our Privacy Policy.