systemd-udevd is loading a module that gets stuck. Could be a broken driver (though we have no trace suggesting a hang there) or a deadlock in the async domains used for the modprobe and suspend...

https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_132/fi-snb-2600/igt@gem_exec_suspend@basic-s3-devices.html

Starting subtest: basic-S3-devices
(gem_exec_suspend:1218) igt_aux-CRITICAL: Test assertion failure function suspend_via_sysfs, file ../lib/igt_aux.c:794:
(gem_exec_suspend:1218) igt_aux-CRITICAL: Failed assertion: igt_sysfs_set(power_dir, "state", suspend_state_name[state])
(gem_exec_suspend:1218) igt_aux-CRITICAL: Last errno: 16, Device or resource busy
Subtest basic-S3-devices failed.

https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_132/fi-whl-u/igt@kms_draw_crc@draw-method-rgb565-blt-ytiled.html

Starting subtest: draw-method-rgb565-blt-ytiled
(kms_draw_crc:1370) igt_debugfs-CRITICAL: Test assertion failure function igt_assert_crc_equal, file ../lib/igt_debugfs.c:392:
(kms_draw_crc:1370) igt_debugfs-CRITICAL: Failed assertion: !mismatch
Subtest draw-method-rgb565-blt-ytiled failed.

(In reply to Chris Wilson from comment #1)
> systemd-udevd is loading a module that gets stuck. Could be a broken driver
> (though we have no trace suggesting a hang there) or a deadlock in the async
> domains used for the modprobe and suspend...

Boot log has already

<5>[    2.919662] scsi 4:0:0:0: Direct-Access     Multiple Card  Reader     1.00 PQ: 0 ANSI: 0
<1>[    2.920615] BUG: unable to handle kernel NULL pointer dereference at 0000000000000000
<6>[    2.920631] PGD 0 P4D 0 
<4>[    2.920639] Oops: 0000 [#1] PREEMPT SMP PTI
<4>[    2.920647] CPU: 6 PID: 193 Comm: usb-storage Not tainted 4.19.0-rc3-g5fd5d0c19c4a-drmtip_109+ #1
<4>[    2.920659] Hardware name: Hewlett-Packard HP Pro 3500 Series/2ABF, BIOS 8.11 10/24/2012
<4>[    2.920673] RIP: 0010:sbitmap_any_bit_set+0xb/0x40
<4>[    2.920681] Code: 45 0f 46 c8 83 c2 01 45 89 ca 4c 89 54 01 08 48 8b 4f 10 2b 74 01 08 39 57 08 77 d8 f3 c3 90 8b 57 08 85 d2 74 2a 48 8b 47 10 <48> 83 38 00 75 23 83 ea 01 48 83 c0 40 48 c1 e2 06 48 01 c2 eb 0b
<4>[    2.920702] RSP: 0018:ffffbdb44038fdc0 EFLAGS: 00010202
<4>[    2.920711] RAX: 0000000000000000 RBX: ffff9df08baecfb8 RCX: 051bc07c00000000
<4>[    2.920720] RDX: 0000000000000001 RSI: ffffffff96080db0 RDI: ffff9df08baed108
<4>[    2.920729] RBP: 0000000000000001 R08: 0000000078233d04 R09: 0000000000000002
<4>[    2.920739] R10: ffffbdb44038fd30 R11: ffffffff96246be0 R12: 0000000000000001
<4>[    2.920748] R13: ffff9df0d7535d70 R14: 0000000000000000 R15: ffff9df08b8f5470
<4>[    2.920758] FS:  0000000000000000(0000) GS:ffff9df0db980000(0000) knlGS:0000000000000000
<4>[    2.920768] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4>[    2.920776] CR2: 0000000000000000 CR3: 000000010d210001 CR4: 00000000001606e0
<4>[    2.920785] Call Trace:
<4>[    2.920793]  blk_mq_run_hw_queue+0xa4/0xf0
<4>[    2.920801]  blk_mq_run_hw_queues+0x35/0x50
<4>[    2.920810]  scsi_end_request+0x1d2/0x1e0
<4>[    2.920820]  ? fill_inquiry_response+0x10/0x10
<4>[    2.920827]  scsi_io_completion+0x7c/0x600
<4>[    2.920836]  ? fill_inquiry_response+0x10/0x10
<4>[    2.920843]  blk_mq_complete_request+0xaa/0x130
<4>[    2.920852]  usb_stor_control_thread+0x27f/0x2f0
<4>[    2.920861]  ? _raw_spin_unlock_irqrestore+0x39/0x60
<4>[    2.920871]  ? __kthread_parkme+0x57/0x80
<4>[    2.920878]  kthread+0x119/0x130
<4>[    2.920885]  ? kthread_park+0x80/0x80
<4>[    2.920893]  ret_from_fork+0x3a/0x50

A CI Bug Log filter associated to this bug has been updated:

{- SNB CFL: igt@gem_exec_suspend@basic-s3-devices - fail - Failed assertion: igt_sysfs_set(power_dir, "state", suspend_state_name[state]), Last errno: 16 -}
{+ SNB BYT BSW CFL: igt@gem_exec_suspend@basic-s[34]-devices - fail - Failed assertion: igt_sysfs_set(power_dir, "state", suspend_state_name[state]), Last errno:16 +}

New failures caught by the filter:

* https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_5449_144/fi-bsw-n3050/igt@gem_exec_suspend@basic-s4-devices.html
* https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_5449_144/fi-byt-j1900/igt@gem_exec_suspend@basic-s4-devices.html
* https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_5449_144/fi-byt-n2820/igt@gem_exec_suspend@basic-s4-devices.html

A CI Bug Log filter associated to this bug has been updated:

{- IVB: igt@gem_eio@suspend - fail - Failed assertion: igt_sysfs_set(power_dir, "state", suspend_state_name[state]) -}
{+ IVB: igt@gem_eio@suspend|hibernate - fail - Failed assertion: igt_sysfs_set(power_dir, "state", suspend_state_name[state]) +}

New failures caught by the filter:

* https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_243/fi-snb-2600/igt@gem_eio@hibernate.html

A CI Bug Log filter associated to this bug has been updated:

{- SNB BYT BSW CFL: igt@gem_exec_suspend@basic-s[34]-devices - fail - Failed assertion: igt_sysfs_set(power_dir, "state", suspend_state_name[state]), Last errno:16 -}
{+ SNB BYT BSW CFL: igt@gem_exec_suspend@basic-s[34]-devices - fail - Failed assertion: igt_sysfs_set(power_dir, "state", suspend_state_name[state]), Last errno:16 +}

New failures caught by the filter:

  * https://intel-gfx-ci.01.org/tree/drm-tip/drmtip_393/fi-cfl-guc/igt@gem_exec_suspend@basic-s3-devices.html

A CI Bug Log filter associated to this bug has been updated:

{- SNB BYT BSW CFL: igt@gem_exec_suspend@basic-s[34]-devices - fail - Failed assertion: igt_sysfs_set(power_dir, "state", suspend_state_name[state]), Last errno:16 -}
{+ SNB BYT BSW CFL: igt@gem_exec_suspend@basic-s[34]-devices - fail - Failed assertion: igt_sysfs_set(power_dir, "state", suspend_state_name[state]) +}


  No new failures caught with the new filter