Bug 103191 - [CI] igt@kms_pipe_crc_basic@* - fail - CRC mismatch
Summary: [CI] igt@kms_pipe_crc_basic@* - fail - CRC mismatch
Status: ASSIGNED
Alias: None
Product: DRI
Classification: Unclassified
Component: DRM/Intel (show other bugs)
Version: DRI git
Hardware: Other All
: highest normal
Assignee: harish.chegondi
QA Contact: Intel GFX Bugs mailing list
URL:
Whiteboard: ReadyForDev
Keywords:
: 107362 (view as bug list)
Depends on:
Blocks: 103167 103184 103925 105978 110038
  Show dependency treegraph
 
Reported: 2017-10-10 10:54 UTC by Marta Löfstedt
Modified: 2019-04-22 21:25 UTC (History)
3 users (show)

See Also:
i915 platform: BXT, BYT, KBL, SKL
i915 features: display/Other


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Marta Löfstedt 2017-10-10 10:54:58 UTC
CI_DRM_3196 APL-shards igt@kms_pipe_crc_basic@hang-read-crc-pipe-C fail on CRC mismatch.

(kms_pipe_crc_basic:1550) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:346:
(kms_pipe_crc_basic:1550) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:1550) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest hang-read-crc-pipe-C failed.

https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3196/shard-apl2/igt@kms_pipe_crc_basic@hang-read-crc-pipe-C.html
Comment 2 Marta Löfstedt 2017-10-31 12:40:30 UTC
new subtest:
CI_DRM_3300 shard-apl1 igt@kms_pipe_crc_basic@suspend-read-crc-pipe-C.

(kms_pipe_crc_basic:2340) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:346:
(kms_pipe_crc_basic:2340) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:2340) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest suspend-read-crc-pipe-C failed.

https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3300/shard-apl1/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-C.html
Comment 4 Marta Löfstedt 2017-11-27 07:05:35 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4014/fi-skl-6700k/igt@kms_pipe_crc_basic@read-crc-pipe-a-frame-sequence.html

(kms_pipe_crc_basic:4413) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:4413) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4413) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest read-crc-pipe-A-frame-sequence failed.
Comment 5 Marta Löfstedt 2017-11-29 09:23:52 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3404/fi-skl-6700k/igt@kms_pipe_crc_basic@read-crc-pipe-b.html

(kms_pipe_crc_basic:4708) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:4708) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4708) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest read-crc-pipe-B failed.
Comment 6 Marta Löfstedt 2017-12-05 06:46:36 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4034/fi-skl-6700k/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-a.html
	

(kms_pipe_crc_basic:4731) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:4731) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4731) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest suspend-read-crc-pipe-A failed.
Comment 7 Marta Löfstedt 2017-12-07 14:39:30 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3474/fi-skl-6700k/igt@kms_pipe_crc_basic@nonblocking-crc-pipe-b-frame-sequence.html

(kms_pipe_crc_basic:4794) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:4794) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4794) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest nonblocking-crc-pipe-B-frame-sequence failed.
Comment 8 Marta Löfstedt 2018-01-02 10:23:45 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4073/fi-skl-6700k2/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-a.html


(kms_pipe_crc_basic:4638) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:4638) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4638) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest suspend-read-crc-pipe-A failed.
Comment 9 Marta Löfstedt 2018-01-30 12:47:55 UTC
Also, on the skl-guc machine:
https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3697/fi-skl-guc/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-a.html

(kms_pipe_crc_basic:3945) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:3945) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:3945) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest suspend-read-crc-pipe-A failed.
Comment 10 Marta Löfstedt 2018-02-13 07:12:42 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4249/fi-skl-guc/igt@kms_pipe_crc_basic@read-crc-pipe-b-frame-sequence.html

(kms_pipe_crc_basic:4034) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:4034) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4034) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest read-crc-pipe-B-frame-sequence failed.
Comment 11 Marta Löfstedt 2018-02-23 06:34:09 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3826/fi-skl-6700k2/igt@kms_pipe_crc_basic@read-crc-pipe-a.html

(kms_pipe_crc_basic:4341) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:370:
(kms_pipe_crc_basic:4341) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4341) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest read-crc-pipe-A failed.
Comment 12 Marta Löfstedt 2018-02-26 07:12:37 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4294/fi-skl-6700k2/igt@kms_pipe_crc_basic@nonblocking-crc-pipe-c.html

(kms_pipe_crc_basic:4550) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:370:
(kms_pipe_crc_basic:4550) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4550) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest nonblocking-crc-pipe-C failed.
Comment 13 Marta Löfstedt 2018-03-09 06:28:55 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3898/shard-apl7/igt@kms_pipe_crc_basic@nonblocking-crc-pipe-b.html

(kms_pipe_crc_basic:1701) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:370:
(kms_pipe_crc_basic:1701) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:1701) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest nonblocking-crc-pipe-B failed.
Comment 14 Marta Löfstedt 2018-03-22 06:36:12 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4375/fi-skl-guc/igt@kms_pipe_crc_basic@hang-read-crc-pipe-a.html

(kms_pipe_crc_basic:3973) igt_debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file ../lib/igt_debugfs.c:370:
(kms_pipe_crc_basic:3973) igt_debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:3973) igt_debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest hang-read-crc-pipe-A failed.
Comment 15 Francesco Balestrieri 2018-07-03 11:59:53 UTC
Mika, anything to update?
Comment 16 Mika Kahola 2018-07-03 12:42:06 UTC
Not really. These crc !mismatch errors occurs on multiple tests. I had an kernel patch that I tried but on shard runs another kms_* test was failing so no breakthrough yet, I'm afraid.

There is somethign fishy going on while we read out pipe crc's. I just haven't figured out that yet.
Comment 17 Martin Peres 2018-07-24 08:37:50 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_4530/fi-byt-clapper/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-b.html

(kms_pipe_crc_basic:3458) igt_debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file ../lib/igt_debugfs.c:370:
(kms_pipe_crc_basic:3458) igt_debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:3458) igt_debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest suspend-read-crc-pipe-B failed.
Comment 18 Martin Peres 2018-09-14 12:20:27 UTC
https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_110/fi-icl-u/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-b.html

Starting subtest: suspend-read-crc-pipe-B
(kms_pipe_crc_basic:1214) igt_debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file ../lib/igt_debugfs.c:392:
(kms_pipe_crc_basic:1214) igt_debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:1214) igt_debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest suspend-read-crc-pipe-B failed.
Comment 19 CI Bug Log 2019-04-02 11:56:46 UTC
The CI Bug Log issue associated to this bug has been archived.

New failures matching the above filters will not be associated to this bug anymore.
Comment 20 Martin Peres 2019-04-02 12:07:23 UTC
(In reply to CI Bug Log from comment #19)
> The CI Bug Log issue associated to this bug has been archived.
> 
> New failures matching the above filters will not be associated to this bug
> anymore.

This issue was for shard-apl, CNL and ICL, where the issue was last seen 1.5 months ago after failing every single run.

Now, this bug is still happening a lot, mostly on BYT, but also randomly on gen9 platforms.

Failures in this test are completely unacceptable because it verifies that CRCs are stable across pipes, colors, suspend, and hang. If we cannot get these problems fixed, automated KMS testing on the affected platforms will not be reliable and cannot be used for CI.

Bumping the priority to highest because of this issue.
Comment 21 harish.chegondi 2019-04-09 04:43:38 UTC
Some of the recent tests show a different failure signature:

https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_5890/fi-whl-u/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-a.html

Starting subtest: suspend-read-crc-pipe-A
(kms_pipe_crc_basic:2862) igt_core-WARNING: [cmd] rtcwake: write error
(kms_pipe_crc_basic:2862) igt_aux-WARNING: rtcwake failed with 1
Check dmesg for further details.
(kms_pipe_crc_basic:2862) igt_aux-CRITICAL: Test assertion failure function suspend_via_rtcwake, file ../lib/igt_aux.c:792:
(kms_pipe_crc_basic:2862) igt_aux-CRITICAL: Failed assertion: ret == 0
(kms_pipe_crc_basic:2862) igt_aux-CRITICAL: error: 1 != 0
Subtest suspend-read-crc-pipe-A failed.
Comment 22 Martin Peres 2019-04-09 12:14:43 UTC
(In reply to harish.chegondi from comment #21)
> Some of the recent tests show a different failure signature:
> 
> https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_5890/fi-whl-u/
> igt@kms_pipe_crc_basic@suspend-read-crc-pipe-a.html
> 
> Starting subtest: suspend-read-crc-pipe-A
> (kms_pipe_crc_basic:2862) igt_core-WARNING: [cmd] rtcwake: write error
> (kms_pipe_crc_basic:2862) igt_aux-WARNING: rtcwake failed with 1
> Check dmesg for further details.
> (kms_pipe_crc_basic:2862) igt_aux-CRITICAL: Test assertion failure function
> suspend_via_rtcwake, file ../lib/igt_aux.c:792:
> (kms_pipe_crc_basic:2862) igt_aux-CRITICAL: Failed assertion: ret == 0
> (kms_pipe_crc_basic:2862) igt_aux-CRITICAL: error: 1 != 0
> Subtest suspend-read-crc-pipe-A failed.

This failure is unrelated. Test results are not consistent across runs, as multiple bugs impact their results.

Please use CI Bug Log to find occurrences of this actual bug :)
Comment 23 CI Bug Log 2019-04-10 14:05:15 UTC
A CI Bug Log filter associated to this bug has been updated:

{- BYT SKL KBL APL: Failed assertion: !mismatch -}
{+ BYT BXT SKL APL KBL WHL: igt@kms_pipe_crc_basic@* - fail - Failed assertion: !mismatch +}

 No new failures caught with the new filter
Comment 24 Martin Peres 2019-04-10 14:06:03 UTC
*** Bug 107362 has been marked as a duplicate of this bug. ***
Comment 25 CI Bug Log 2019-04-10 14:11:12 UTC
A CI Bug Log filter associated to this bug has been updated:

{- BYT BXT SKL APL KBL WHL: igt@kms_pipe_crc_basic@* - fail - Failed assertion: !mismatch -}
{+ BYT BXT SKL APL KBL GLK WHL: igt@kms_pipe_crc_basic@* - fail - Failed assertion: !mismatch +}

New failures caught by the filter:

* https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4939/fi-glk-dsi/igt@kms_pipe_crc_basic@nonblocking-crc-pipe-b-frame-sequence.html
* https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_5893/fi-glk-dsi/igt@kms_pipe_crc_basic@nonblocking-crc-pipe-b-frame-sequence.html
* https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4934/fi-glk-dsi/igt@kms_pipe_crc_basic@nonblocking-crc-pipe-a-frame-sequence.html
Comment 26 Lakshmi 2019-04-15 12:19:23 UTC
@Harish, Any further updates on this bug? As you see this issue blocks few other bugs :).
Comment 27 harish.chegondi 2019-04-16 18:10:04 UTC
(In reply to Lakshmi from comment #26)
> @Harish, Any further updates on this bug? As you see this issue blocks few
> other bugs :).

Lakshmi,

I am trying to setup a BYT sqwaks chromebook to run CI tests to reproduce this issue. I couldn't find any BYT machines on RIL. In an IRC Chat, Ville mentioned that there are some known cxsr related issues on gmch machines which could be related to this issue. He had some commits on his branch:

<vsyrjala> git://github.com/vsyrjala/linux.git g4x_fixes_4

I have been going through his patches to understand them and once I complete CI test setup on a BYT Sqwaks chromebook, I will rebase and test his patches.
Comment 28 Martin Peres 2019-04-16 18:18:21 UTC
(In reply to harish.chegondi from comment #27)
> (In reply to Lakshmi from comment #26)
> > @Harish, Any further updates on this bug? As you see this issue blocks few
> > other bugs :).
> 
> Lakshmi,
> 
> I am trying to setup a BYT sqwaks chromebook to run CI tests to reproduce
> this issue. I couldn't find any BYT machines on RIL. In an IRC Chat, Ville
> mentioned that there are some known cxsr related issues on gmch machines
> which could be related to this issue. He had some commits on his branch:
> 
> <vsyrjala> git://github.com/vsyrjala/linux.git g4x_fixes_4
> 
> I have been going through his patches to understand them and once I complete
> CI test setup on a BYT Sqwaks chromebook, I will rebase and test his patches.

+1 for using CI's trybot as a development tool! You just leveled up!
Comment 29 harish.chegondi 2019-04-22 21:25:44 UTC
(In reply to harish.chegondi from comment #27)
> (In reply to Lakshmi from comment #26)
> > @Harish, Any further updates on this bug? As you see this issue blocks few
> > other bugs :).
> 
> Lakshmi,
> 
> I am trying to setup a BYT sqwaks chromebook to run CI tests to reproduce
> this issue. I couldn't find any BYT machines on RIL. In an IRC Chat, Ville
> mentioned that there are some known cxsr related issues on gmch machines
> which could be related to this issue. He had some commits on his branch:
> 
> <vsyrjala> git://github.com/vsyrjala/linux.git g4x_fixes_4
> 
> I have been going through his patches to understand them and once I complete
> CI test setup on a BYT Sqwaks chromebook, I will rebase and test his patches.

Submitted most of Ville's patches (except the ones that add tracing) to trybot:
https://patchwork.freedesktop.org/series/59739/

The CI  results are : https://intel-gfx-ci.01.org/tree/drm-tip/Trybot_4186/

While the CI tests didn't run on the BYT Squawks Chromebook as I wanted, on a different BYT platform: fi-byt-clapper, the test kms_pipe_crc_basic@suspend-read-crc-pipe-a failed with a similar signature.


Use of freedesktop.org services, including Bugzilla, is subject to our Code of Conduct. How we collect and use information is described in our Privacy Policy.