https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3266/shard-apl5/igt@kms_pipe_crc_basic@read-crc-pipe-C.html

new subtest:
CI_DRM_3300 shard-apl1 igt@kms_pipe_crc_basic@suspend-read-crc-pipe-C.

(kms_pipe_crc_basic:2340) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:346:
(kms_pipe_crc_basic:2340) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:2340) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest suspend-read-crc-pipe-C failed.

https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3300/shard-apl1/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-C.html

Adding:
https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_6988/fi-skl-6700k/igt@kms_pipe_crc_basic@hang-read-crc-pipe-b.html

https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4014/fi-skl-6700k/igt@kms_pipe_crc_basic@read-crc-pipe-a-frame-sequence.html

(kms_pipe_crc_basic:4413) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:4413) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4413) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest read-crc-pipe-A-frame-sequence failed.

https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3404/fi-skl-6700k/igt@kms_pipe_crc_basic@read-crc-pipe-b.html

(kms_pipe_crc_basic:4708) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:4708) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4708) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest read-crc-pipe-B failed.

https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4034/fi-skl-6700k/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-a.html
	

(kms_pipe_crc_basic:4731) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:4731) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4731) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest suspend-read-crc-pipe-A failed.

https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3474/fi-skl-6700k/igt@kms_pipe_crc_basic@nonblocking-crc-pipe-b-frame-sequence.html

(kms_pipe_crc_basic:4794) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:4794) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4794) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest nonblocking-crc-pipe-B-frame-sequence failed.

https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4073/fi-skl-6700k2/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-a.html


(kms_pipe_crc_basic:4638) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:4638) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4638) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest suspend-read-crc-pipe-A failed.

Also, on the skl-guc machine:
https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3697/fi-skl-guc/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-a.html

(kms_pipe_crc_basic:3945) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:3945) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:3945) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest suspend-read-crc-pipe-A failed.

https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4249/fi-skl-guc/igt@kms_pipe_crc_basic@read-crc-pipe-b-frame-sequence.html

(kms_pipe_crc_basic:4034) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:356:
(kms_pipe_crc_basic:4034) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4034) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest read-crc-pipe-B-frame-sequence failed.

https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3826/fi-skl-6700k2/igt@kms_pipe_crc_basic@read-crc-pipe-a.html

(kms_pipe_crc_basic:4341) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:370:
(kms_pipe_crc_basic:4341) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4341) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest read-crc-pipe-A failed.

https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4294/fi-skl-6700k2/igt@kms_pipe_crc_basic@nonblocking-crc-pipe-c.html

(kms_pipe_crc_basic:4550) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:370:
(kms_pipe_crc_basic:4550) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:4550) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest nonblocking-crc-pipe-C failed.

https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_3898/shard-apl7/igt@kms_pipe_crc_basic@nonblocking-crc-pipe-b.html

(kms_pipe_crc_basic:1701) igt-debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file igt_debugfs.c:370:
(kms_pipe_crc_basic:1701) igt-debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:1701) igt-debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest nonblocking-crc-pipe-B failed.

https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4375/fi-skl-guc/igt@kms_pipe_crc_basic@hang-read-crc-pipe-a.html

(kms_pipe_crc_basic:3973) igt_debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file ../lib/igt_debugfs.c:370:
(kms_pipe_crc_basic:3973) igt_debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:3973) igt_debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest hang-read-crc-pipe-A failed.

Mika, anything to update?

Not really. These crc !mismatch errors occurs on multiple tests. I had an kernel patch that I tried but on shard runs another kms_* test was failing so no breakthrough yet, I'm afraid.

There is somethign fishy going on while we read out pipe crc's. I just haven't figured out that yet.

https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_4530/fi-byt-clapper/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-b.html

(kms_pipe_crc_basic:3458) igt_debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file ../lib/igt_debugfs.c:370:
(kms_pipe_crc_basic:3458) igt_debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:3458) igt_debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest suspend-read-crc-pipe-B failed.

https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_110/fi-icl-u/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-b.html

Starting subtest: suspend-read-crc-pipe-B
(kms_pipe_crc_basic:1214) igt_debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file ../lib/igt_debugfs.c:392:
(kms_pipe_crc_basic:1214) igt_debugfs-CRITICAL: Failed assertion: !mismatch
(kms_pipe_crc_basic:1214) igt_debugfs-CRITICAL: Last errno: 9, Bad file descriptor
Subtest suspend-read-crc-pipe-B failed.

The CI Bug Log issue associated to this bug has been archived.

New failures matching the above filters will not be associated to this bug anymore.

(In reply to CI Bug Log from comment #19)
> The CI Bug Log issue associated to this bug has been archived.
> 
> New failures matching the above filters will not be associated to this bug
> anymore.

This issue was for shard-apl, CNL and ICL, where the issue was last seen 1.5 months ago after failing every single run.

Now, this bug is still happening a lot, mostly on BYT, but also randomly on gen9 platforms.

Failures in this test are completely unacceptable because it verifies that CRCs are stable across pipes, colors, suspend, and hang. If we cannot get these problems fixed, automated KMS testing on the affected platforms will not be reliable and cannot be used for CI.

Bumping the priority to highest because of this issue.

Some of the recent tests show a different failure signature:

https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_5890/fi-whl-u/igt@kms_pipe_crc_basic@suspend-read-crc-pipe-a.html

Starting subtest: suspend-read-crc-pipe-A
(kms_pipe_crc_basic:2862) igt_core-WARNING: [cmd] rtcwake: write error
(kms_pipe_crc_basic:2862) igt_aux-WARNING: rtcwake failed with 1
Check dmesg for further details.
(kms_pipe_crc_basic:2862) igt_aux-CRITICAL: Test assertion failure function suspend_via_rtcwake, file ../lib/igt_aux.c:792:
(kms_pipe_crc_basic:2862) igt_aux-CRITICAL: Failed assertion: ret == 0
(kms_pipe_crc_basic:2862) igt_aux-CRITICAL: error: 1 != 0
Subtest suspend-read-crc-pipe-A failed.

(In reply to harish.chegondi from comment #21)
> Some of the recent tests show a different failure signature:
> 
> https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_5890/fi-whl-u/
> igt@kms_pipe_crc_basic@suspend-read-crc-pipe-a.html
> 
> Starting subtest: suspend-read-crc-pipe-A
> (kms_pipe_crc_basic:2862) igt_core-WARNING: [cmd] rtcwake: write error
> (kms_pipe_crc_basic:2862) igt_aux-WARNING: rtcwake failed with 1
> Check dmesg for further details.
> (kms_pipe_crc_basic:2862) igt_aux-CRITICAL: Test assertion failure function
> suspend_via_rtcwake, file ../lib/igt_aux.c:792:
> (kms_pipe_crc_basic:2862) igt_aux-CRITICAL: Failed assertion: ret == 0
> (kms_pipe_crc_basic:2862) igt_aux-CRITICAL: error: 1 != 0
> Subtest suspend-read-crc-pipe-A failed.

This failure is unrelated. Test results are not consistent across runs, as multiple bugs impact their results.

Please use CI Bug Log to find occurrences of this actual bug :)

A CI Bug Log filter associated to this bug has been updated:

{- BYT SKL KBL APL: Failed assertion: !mismatch -}
{+ BYT BXT SKL APL KBL WHL: igt@kms_pipe_crc_basic@* - fail - Failed assertion: !mismatch +}

 No new failures caught with the new filter

*** Bug 107362 has been marked as a duplicate of this bug. ***

A CI Bug Log filter associated to this bug has been updated:

{- BYT BXT SKL APL KBL WHL: igt@kms_pipe_crc_basic@* - fail - Failed assertion: !mismatch -}
{+ BYT BXT SKL APL KBL GLK WHL: igt@kms_pipe_crc_basic@* - fail - Failed assertion: !mismatch +}

New failures caught by the filter:

* https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4939/fi-glk-dsi/igt@kms_pipe_crc_basic@nonblocking-crc-pipe-b-frame-sequence.html
* https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_5893/fi-glk-dsi/igt@kms_pipe_crc_basic@nonblocking-crc-pipe-b-frame-sequence.html
* https://intel-gfx-ci.01.org/tree/drm-tip/IGT_4934/fi-glk-dsi/igt@kms_pipe_crc_basic@nonblocking-crc-pipe-a-frame-sequence.html

@Harish, Any further updates on this bug? As you see this issue blocks few other bugs :).

(In reply to Lakshmi from comment #26)
> @Harish, Any further updates on this bug? As you see this issue blocks few
> other bugs :).

Lakshmi,

I am trying to setup a BYT sqwaks chromebook to run CI tests to reproduce this issue. I couldn't find any BYT machines on RIL. In an IRC Chat, Ville mentioned that there are some known cxsr related issues on gmch machines which could be related to this issue. He had some commits on his branch:

<vsyrjala> git://github.com/vsyrjala/linux.git g4x_fixes_4

I have been going through his patches to understand them and once I complete CI test setup on a BYT Sqwaks chromebook, I will rebase and test his patches.

(In reply to harish.chegondi from comment #27)
> (In reply to Lakshmi from comment #26)
> > @Harish, Any further updates on this bug? As you see this issue blocks few
> > other bugs :).
> 
> Lakshmi,
> 
> I am trying to setup a BYT sqwaks chromebook to run CI tests to reproduce
> this issue. I couldn't find any BYT machines on RIL. In an IRC Chat, Ville
> mentioned that there are some known cxsr related issues on gmch machines
> which could be related to this issue. He had some commits on his branch:
> 
> <vsyrjala> git://github.com/vsyrjala/linux.git g4x_fixes_4
> 
> I have been going through his patches to understand them and once I complete
> CI test setup on a BYT Sqwaks chromebook, I will rebase and test his patches.

+1 for using CI's trybot as a development tool! You just leveled up!

(In reply to harish.chegondi from comment #27)
> (In reply to Lakshmi from comment #26)
> > @Harish, Any further updates on this bug? As you see this issue blocks few
> > other bugs :).
> 
> Lakshmi,
> 
> I am trying to setup a BYT sqwaks chromebook to run CI tests to reproduce
> this issue. I couldn't find any BYT machines on RIL. In an IRC Chat, Ville
> mentioned that there are some known cxsr related issues on gmch machines
> which could be related to this issue. He had some commits on his branch:
> 
> <vsyrjala> git://github.com/vsyrjala/linux.git g4x_fixes_4
> 
> I have been going through his patches to understand them and once I complete
> CI test setup on a BYT Sqwaks chromebook, I will rebase and test his patches.

Submitted most of Ville's patches (except the ones that add tracing) to trybot:
https://patchwork.freedesktop.org/series/59739/

The CI  results are : https://intel-gfx-ci.01.org/tree/drm-tip/Trybot_4186/

While the CI tests didn't run on the BYT Squawks Chromebook as I wanted, on a different BYT platform: fi-byt-clapper, the test kms_pipe_crc_basic@suspend-read-crc-pipe-a failed with a similar signature.