Jan 27 18:01:57 phobos kernel: gmc_v8_0_process_interrupt: 13 callbacks suppressed
Jan 27 18:01:57 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:01:57 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:01:57 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:01:57 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC0' (0x54433000) (8)
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06004001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC1' (0x54433100) (4)
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06080001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06008001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04080001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04080001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E084001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:02:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:02:45 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:02:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:02:45 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:02:58 phobos kernel: gmc_v8_0_process_interrupt: 21 callbacks suppressed
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A000001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A080001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A040001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A084001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A000001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A084001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A000001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A040001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A008001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A040001
Jan 27 18:02:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:03:47 phobos kernel: gmc_v8_0_process_interrupt: 39 callbacks suppressed
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04401
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04044001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC7' (0x54433700) (68)
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04088001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050906, read from 'TC9' (0x54433900) (136)
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04401
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02044001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC7' (0x54433700) (68)
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050872, read from 'TC8' (0x54433800) (64)
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00801
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050906, read from 'TC0' (0x54433000) (8)
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050872, read from 'TC6' (0x54433600) (72)
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00801
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050906, read from 'TC0' (0x54433000) (8)
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04401
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050872, read from 'TC2' (0x54433200) (0)
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04401
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08044001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC7' (0x54433700) (68)
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00801
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048001
Jan 27 18:03:47 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050872, read from 'TC6' (0x54433600) (72)
Jan 27 18:03:54 phobos kernel: gmc_v8_0_process_interrupt: 150 callbacks suppressed
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad0c401
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C4001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC4' (0x54433400) (196)
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad0c801
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C8001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC3' (0x54433300) (200)
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c0c001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C0001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050872, read from 'TC5' (0x54433500) (192)
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c0c801
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E044001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050872, read from 'TC7' (0x54433700) (68)
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00401
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E004001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC1' (0x54433100) (4)
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c0c801
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C8001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC3' (0x54433300) (200)
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c00801
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050872, read from 'TC0' (0x54433000) (8)
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c00001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C8001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC3' (0x54433300) (200)
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c00801
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050872, read from 'TC0' (0x54433000) (8)
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c00001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:03:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050872, read from 'TC2' (0x54433200) (0)
Jan 27 18:04:03 phobos kernel: gmc_v8_0_process_interrupt: 243 callbacks suppressed
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC0' (0x54433000) (8)
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08801
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02088001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC9' (0x54433900) (136)
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04801
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC6' (0x54433600) (72)
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C0001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC5' (0x54433500) (192)
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02080001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC11' (0x54433131) (128)
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC8' (0x54433800) (64)
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC0' (0x54433000) (8)
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC8' (0x54433800) (64)
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A2473B
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02080002
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 1) at page 10635067, read from 'TC11' (0x54433131) (128)
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:04:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC0' (0x54433000) (8)
Jan 27 18:04:30 phobos kernel: gmc_v8_0_process_interrupt: 47 callbacks suppressed
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C4001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C080001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C080001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C084001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C0001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C008001
Jan 27 18:04:30 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:04:40 phobos kernel: gmc_v8_0_process_interrupt: 501 callbacks suppressed
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C4001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C0001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050906, read from 'TC5' (0x54433500) (192)
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08801
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08088001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC9' (0x54433900) (136)
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08084001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C4001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050906, read from 'TC6' (0x54433600) (72)
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08080001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08801
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:04:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050906, read from 'TC0' (0x54433000) (8)
Jan 27 18:04:45 phobos kernel: gmc_v8_0_process_interrupt: 675 callbacks suppressed
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02080001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C0001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08801
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02088001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC9' (0x54433900) (136)
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08801
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02088001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC9' (0x54433900) (136)
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C0001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C0001
Jan 27 18:04:45 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:04:50 phobos kernel: gmc_v8_0_process_interrupt: 226 callbacks suppressed
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E080001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E004001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC1' (0x54433100) (4)
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04401
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E044001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC7' (0x54433700) (68)
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E084001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E084001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:04:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:37 phobos kernel: gmc_v8_0_process_interrupt: 142 callbacks suppressed
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:05:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:42 phobos kernel: gmc_v8_0_process_interrupt: 248 callbacks suppressed
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:05:42 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:49 phobos kernel: gmc_v8_0_process_interrupt: 369 callbacks suppressed
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A008001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A000001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A000001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A004001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC1' (0x54433100) (4)
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A000001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A048001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A000001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A048001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A048001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A048001
Jan 27 18:05:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:54 phobos kernel: gmc_v8_0_process_interrupt: 234 callbacks suppressed
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A048001
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A008001
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A048001
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A048001
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af88401
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A084001
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050911, read from 'TC10' (0x54433130) (132)
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A000001
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A008001
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A048001
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af88401
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A084001
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050911, read from 'TC10' (0x54433130) (132)
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A048001
Jan 27 18:05:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:06:04 phobos kernel: gmc_v8_0_process_interrupt: 117 callbacks suppressed
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08801
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08088001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC9' (0x54433900) (136)
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24738
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048002
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 4) at page 10635064, read from 'TC6' (0x54433600) (72)
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04801
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C048001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154092282, read from 'TC6' (0x54433600) (72)
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C004001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C080001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154092282, read from 'TC11' (0x54433131) (128)
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C004001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C040001
Jan 27 18:06:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:06:09 phobos kernel: gmc_v8_0_process_interrupt: 1208 callbacks suppressed
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C4001
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00000000
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 0, read from 'TC6' (0x54433600) (72)
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04401
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A4470C
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E088002
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 7) at page 10766092, read from 'TC9' (0x54433900) (136)
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C0001
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24719
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E044002
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 7) at page 10635033, read from 'TC7' (0x54433700) (68)
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24728
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008002
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 7) at page 10635048, read from 'TC0' (0x54433000) (8)
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C0001
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04401
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00000000
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E004001
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 0, read from 'TC1' (0x54433100) (4)
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24720
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048002
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 7) at page 10635040, read from 'TC6' (0x54433600) (72)
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C0001
Jan 27 18:06:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:06:14 phobos kernel: gmc_v8_0_process_interrupt: 2989 callbacks suppressed
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04401
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00000000
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 0, read from 'TC0' (0x54433000) (8)
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c801
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C8001
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC3' (0x54433300) (200)
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A44704
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C8002
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 4) at page 10766084, read from 'TC3' (0x54433300) (200)
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24728
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C8002
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 4) at page 10635048, read from 'TC3' (0x54433300) (200)
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C0001
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00000000
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C8001
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 0, read from 'TC3' (0x54433300) (200)
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A44704
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000002
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 4) at page 10766084, read from 'TC2' (0x54433200) (0)
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08084001
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08004001
Jan 27 18:06:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154091770, read from 'TC1' (0x54433100) (4)
Jan 27 18:06:19 phobos kernel: gmc_v8_0_process_interrupt: 1635 callbacks suppressed
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C008001
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C4001
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08801
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00000000
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000002
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 6) at page 0, read from 'TC2' (0x54433200) (0)
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C088001
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC9' (0x54433900) (136)
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08001
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C080001
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC11' (0x54433131) (128)
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08801
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C0001
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08801
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00000000
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C008001
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 0, read from 'TC0' (0x54433000) (8)
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08001
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C080001
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC11' (0x54433131) (128)
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C004001
Jan 27 18:06:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC1' (0x54433100) (4)
Jan 27 18:07:46 phobos kernel: gmc_v8_0_process_interrupt: 261 callbacks suppressed
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04048001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04048001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:07:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:07:51 phobos kernel: gmc_v8_0_process_interrupt: 501 callbacks suppressed
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:07:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:08:21 phobos kernel: gmc_v8_0_process_interrupt: 274 callbacks suppressed
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC5' (0x54433500) (192)
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC5' (0x54433500) (192)
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04080001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC11' (0x54433131) (128)
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04080001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC11' (0x54433131) (128)
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00801
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A44704
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000002
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 2) at page 10766084, read from 'TC2' (0x54433200) (0)
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:08:21 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:08:29 phobos kernel: gmc_v8_0_process_interrupt: 326 callbacks suppressed
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04044001
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24728
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0002
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 2) at page 10635048, read from 'TC5' (0x54433500) (192)
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C8001
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC3' (0x54433300) (200)
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A44704
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04084002
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 2) at page 10766084, read from 'TC10' (0x54433130) (132)
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC0' (0x54433000) (8)
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC0' (0x54433000) (8)
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC2' (0x54433200) (0)
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04080001
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC11' (0x54433131) (128)
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040001
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A2472A
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040002
Jan 27 18:08:29 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 2) at page 10635050, read from 'TC8' (0x54433800) (64)
Jan 27 18:08:35 phobos kernel: gmc_v8_0_process_interrupt: 149 callbacks suppressed
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E044001
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C8001
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154091770, read from 'TC3' (0x54433300) (200)
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:08:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154091770, read from 'TC0' (0x54433000) (8)
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154091770, read from 'TC8' (0x54433800) (64)
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08801
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E088001
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154091770, read from 'TC9' (0x54433900) (136)
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C0001
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154091770, read from 'TC5' (0x54433500) (192)
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:08:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:08:40 phobos kernel: gmc_v8_0_process_interrupt: 541 callbacks suppressed
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EB0FA
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154054906, read from 'TC2' (0x54433200) (0)
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04801
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EB0FA
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048001
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154054906, read from 'TC6' (0x54433600) (72)
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EB0FA
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08080001
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154054906, read from 'TC11' (0x54433131) (128)
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EB0FA
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154054906, read from 'TC0' (0x54433000) (8)
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EB0FA
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08004001
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154054906, read from 'TC1' (0x54433100) (4)
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EB0FA
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08004001
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154054906, read from 'TC1' (0x54433100) (4)
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EB0FA
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154054906, read from 'TC0' (0x54433000) (8)
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EB0FA
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08044001
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154054906, read from 'TC7' (0x54433700) (68)
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EB0FA
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08044001
Jan 27 18:08:40 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154054906, read from 'TC7' (0x54433700) (68)
Jan 27 18:08:41 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:08:41 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EB0FA
Jan 27 18:08:41 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08044001
Jan 27 18:08:41 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154054906, read from 'TC7' (0x54433700) (68)
Jan 27 18:10:02 phobos kernel: gmc_v8_0_process_interrupt: 337 callbacks suppressed
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04801
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A048001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC6' (0x54433600) (72)
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A044001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050872, read from 'TC7' (0x54433700) (68)
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00401
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A004001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC1' (0x54433100) (4)
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A008001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050872, read from 'TC0' (0x54433000) (8)
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00000000
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A088002
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 5) at page 0, read from 'TC9' (0x54433900) (136)
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A080001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC11' (0x54433131) (128)
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08801
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A0C4001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050872, read from 'TC4' (0x54433400) (196)
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04801
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A048001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC6' (0x54433600) (72)
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A040001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050872, read from 'TC8' (0x54433800) (64)
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A044001
Jan 27 18:10:02 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:10:07 phobos kernel: gmc_v8_0_process_interrupt: 815 callbacks suppressed
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC0' (0x54433000) (8)
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04801
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC6' (0x54433600) (72)
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04401
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC6' (0x54433600) (72)
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04401
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E044001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC7' (0x54433700) (68)
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:10:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC6' (0x54433600) (72)
Jan 27 18:10:12 phobos kernel: gmc_v8_0_process_interrupt: 463 callbacks suppressed
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E004001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E004001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E004001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C8001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC3' (0x54433300) (200)
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04801
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC6' (0x54433600) (72)
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C0001
Jan 27 18:10:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154091770, read from 'TC5' (0x54433500) (192)
Jan 27 18:10:17 phobos kernel: gmc_v8_0_process_interrupt: 342 callbacks suppressed
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC8' (0x54433800) (64)
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04044001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC0' (0x54433000) (8)
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A2471B
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0002
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 2) at page 10635035, read from 'TC5' (0x54433500) (192)
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC2' (0x54433200) (0)
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C4001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC4' (0x54433400) (196)
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:10:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:11:23 phobos kernel: gmc_v8_0_process_interrupt: 74 callbacks suppressed
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC5' (0x54433500) (192)
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04044001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC0' (0x54433000) (8)
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC5' (0x54433500) (192)
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC5' (0x54433500) (192)
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C4001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC4' (0x54433400) (196)
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04801
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04048001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC6' (0x54433600) (72)
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24728
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04088002
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 2) at page 10635048, read from 'TC9' (0x54433900) (136)
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04801
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04048001
Jan 27 18:11:23 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC6' (0x54433600) (72)
Jan 27 18:11:28 phobos kernel: gmc_v8_0_process_interrupt: 414 callbacks suppressed
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04801
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04048001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC6' (0x54433600) (72)
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04004001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04801
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04048001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC6' (0x54433600) (72)
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C8001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC3' (0x54433300) (200)
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC0' (0x54433000) (8)
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC0' (0x54433000) (8)
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC5' (0x54433500) (192)
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC5' (0x54433500) (192)
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:11:28 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:12:43 phobos kernel: gmc_v8_0_process_interrupt: 197 callbacks suppressed
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08004001
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A44704
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08084002
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 4) at page 10766084, read from 'TC10' (0x54433130) (132)
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08044001
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A44704
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048002
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 4) at page 10766084, read from 'TC6' (0x54433600) (72)
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08080001
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC11' (0x54433131) (128)
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A44705
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008002
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 4) at page 10766085, read from 'TC0' (0x54433000) (8)
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08401
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08084001
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC10' (0x54433130) (132)
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C0001
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC5' (0x54433500) (192)
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A4470C
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08040002
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 4) at page 10766092, read from 'TC8' (0x54433800) (64)
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08080001
Jan 27 18:12:43 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC11' (0x54433131) (128)
Jan 27 18:12:48 phobos kernel: gmc_v8_0_process_interrupt: 678 callbacks suppressed
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08080001
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC11' (0x54433131) (128)
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C4001
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC4' (0x54433400) (196)
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08044001
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C8001
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC3' (0x54433300) (200)
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048001
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08080001
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC11' (0x54433131) (128)
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08004001
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08044001
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08044001
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08401
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08084001
Jan 27 18:12:48 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC10' (0x54433130) (132)
Jan 27 18:12:53 phobos kernel: gmc_v8_0_process_interrupt: 563 callbacks suppressed
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06040001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x060C0001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154092282, read from 'TC5' (0x54433500) (192)
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06000001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x060C8001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154092282, read from 'TC3' (0x54433300) (200)
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06000001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154092282, read from 'TC2' (0x54433200) (0)
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06008001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06088001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050906, read from 'TC9' (0x54433900) (136)
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06000001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00801
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06004001
Jan 27 18:12:53 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:12:58 phobos kernel: gmc_v8_0_process_interrupt: 707 callbacks suppressed
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C8001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC3' (0x54433300) (200)
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02044001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC6' (0x54433600) (72)
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A4470C
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02044002
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 1) at page 10766092, read from 'TC7' (0x54433700) (68)
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:12:58 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:14:19 phobos kernel: gmc_v8_0_process_interrupt: 135 callbacks suppressed
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04084001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:14:19 phobos systemd[1]: Starting Cleanup of Temporary Directories...
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04004001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC1' (0x54433100) (4)
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04084001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04044001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC7' (0x54433700) (68)
Jan 27 18:14:19 phobos systemd[1]: Started Cleanup of Temporary Directories.
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050906, read from 'TC8' (0x54433800) (64)
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04044001
Jan 27 18:14:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC7' (0x54433700) (68)
Jan 27 18:14:49 phobos kernel: gmc_v8_0_process_interrupt: 208 callbacks suppressed
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06004001
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C4001
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC4' (0x54433400) (196)
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C4001
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC4' (0x54433400) (196)
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C8001
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC3' (0x54433300) (200)
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C4001
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC4' (0x54433400) (196)
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C4001
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC4' (0x54433400) (196)
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A4470C
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04088002
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 2) at page 10766092, read from 'TC9' (0x54433900) (136)
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC5' (0x54433500) (192)
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C4001
Jan 27 18:14:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC4' (0x54433400) (196)
Jan 27 18:14:54 phobos kernel: gmc_v8_0_process_interrupt: 525 callbacks suppressed
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c00401
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E004001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050872, read from 'TC1' (0x54433100) (4)
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04801
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad0c401
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C4001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC4' (0x54433400) (196)
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c00001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC0' (0x54433000) (8)
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c00801
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E044001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC7' (0x54433700) (68)
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04801
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad0c801
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C8001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC3' (0x54433300) (200)
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c04801
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050906, read from 'TC0' (0x54433000) (8)
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c00001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:14:54 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:14:59 phobos kernel: gmc_v8_0_process_interrupt: 2585 callbacks suppressed
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad0c401
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A0C4001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC4' (0x54433400) (196)
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad0c001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A000001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c0c001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A080001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c0c801
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A0C8001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050872, read from 'TC3' (0x54433300) (200)
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A008001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC0' (0x54433000) (8)
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c04001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A084001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050872, read from 'TC10' (0x54433130) (132)
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04801
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A008001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad0c401
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A0C4001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC4' (0x54433400) (196)
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c00401
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A000001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c00001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A040001
Jan 27 18:14:59 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:15:04 phobos kernel: gmc_v8_0_process_interrupt: 1666 callbacks suppressed
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C0001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c801
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08044001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050906, read from 'TC7' (0x54433700) (68)
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02088001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050872, read from 'TC9' (0x54433900) (136)
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C4001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02088001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050872, read from 'TC9' (0x54433900) (136)
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C4001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08401
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050872, read from 'TC0' (0x54433000) (8)
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C0001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c801
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:15:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050872, read from 'TC0' (0x54433000) (8)
Jan 27 18:17:01 phobos CRON[1800]: pam_unix(cron:session): session opened for user root by (uid=0)
Jan 27 18:17:01 phobos CRON[1801]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Jan 27 18:17:01 phobos CRON[1800]: pam_unix(cron:session): session closed for user root
Jan 27 18:17:03 phobos kernel: gmc_v8_0_process_interrupt: 114 callbacks suppressed
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A044001
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02044001
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02004001
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24729
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02084002
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 1) at page 10635049, read from 'TC10' (0x54433130) (132)
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02080001
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC11' (0x54433131) (128)
Jan 27 18:17:03 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24738
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040002
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 1) at page 10635064, read from 'TC8' (0x54433800) (64)
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02080001
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC11' (0x54433131) (128)
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02044001
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC7' (0x54433700) (68)
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC0' (0x54433000) (8)
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:17:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC0' (0x54433000) (8)
Jan 27 18:17:09 phobos kernel: gmc_v8_0_process_interrupt: 293 callbacks suppressed
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C4001
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154092282, read from 'TC4' (0x54433400) (196)
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24721
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048002
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 4) at page 10635041, read from 'TC6' (0x54433600) (72)
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02044001
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC7' (0x54433700) (68)
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24738
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040002
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 1) at page 10635064, read from 'TC8' (0x54433800) (64)
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC0' (0x54433000) (8)
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08801
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06088001
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154091770, read from 'TC9' (0x54433900) (136)
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08401
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06084001
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154092282, read from 'TC10' (0x54433130) (132)
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06008001
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154092282, read from 'TC0' (0x54433000) (8)
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06004001
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24729
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06044002
Jan 27 18:17:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 3) at page 10635049, read from 'TC7' (0x54433700) (68)
Jan 27 18:17:14 phobos kernel: gmc_v8_0_process_interrupt: 1631 callbacks suppressed
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C0001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC5' (0x54433500) (192)
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C080001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08801
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C044001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC7' (0x54433700) (68)
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C088001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154091770, read from 'TC9' (0x54433900) (136)
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C084001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08801
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C040001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C004001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24720
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C080002
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 6) at page 10635040, read from 'TC11' (0x54433131) (128)
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C080001
Jan 27 18:17:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:17:19 phobos kernel: gmc_v8_0_process_interrupt: 2842 callbacks suppressed
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad0c801
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C8001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050906, read from 'TC3' (0x54433300) (200)
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c08001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c08801
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04004001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050906, read from 'TC1' (0x54433100) (4)
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c04001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04044001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050906, read from 'TC7' (0x54433700) (68)
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad0c401
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04084001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad0c001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04004001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC1' (0x54433100) (4)
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c00401
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00000000
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04088002
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 2) at page 0, read from 'TC9' (0x54433900) (136)
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050906, read from 'TC8' (0x54433800) (64)
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad0c401
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050906, read from 'TC0' (0x54433000) (8)
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x09c0c001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04004001
Jan 27 18:17:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050906, read from 'TC1' (0x54433100) (4)
Jan 27 18:18:26 phobos kernel: gmc_v8_0_process_interrupt: 1046 callbacks suppressed
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06040001
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06008001
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06008001
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:18:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:19:04 phobos kernel: gmc_v8_0_process_interrupt: 407 callbacks suppressed
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08401
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A084001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154092282, read from 'TC10' (0x54433130) (132)
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A0C4001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154092282, read from 'TC4' (0x54433400) (196)
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A4470C
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A0C8002
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 5) at page 10766092, read from 'TC3' (0x54433300) (200)
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C4001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC4' (0x54433400) (196)
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04401
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04044001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC7' (0x54433700) (68)
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x01c84001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA039
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050617, read from 'TC8' (0x54433800) (64)
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x01c84001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA039
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050617, read from 'TC8' (0x54433800) (64)
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x01c8c001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA039
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050617, read from 'TC5' (0x54433500) (192)
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x01c88801
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA039
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04088001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050617, read from 'TC9' (0x54433900) (136)
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x01c80001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA039
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:19:04 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050617, read from 'TC2' (0x54433200) (0)
Jan 27 18:19:09 phobos kernel: gmc_v8_0_process_interrupt: 1207 callbacks suppressed
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00801
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C008001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC0' (0x54433000) (8)
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08801
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C4001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC4' (0x54433400) (196)
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C080001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC11' (0x54433131) (128)
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C4001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC4' (0x54433400) (196)
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08801
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C088001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC9' (0x54433900) (136)
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08401
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C084001
Jan 27 18:19:09 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC10' (0x54433130) (132)
Jan 27 18:19:14 phobos kernel: gmc_v8_0_process_interrupt: 505 callbacks suppressed
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C0001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08801
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C088001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050872, read from 'TC9' (0x54433900) (136)
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C0001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08801
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C0001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050906, read from 'TC5' (0x54433500) (192)
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c801
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C8001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC3' (0x54433300) (200)
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050872, read from 'TC2' (0x54433200) (0)
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c801
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C8001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC3' (0x54433300) (200)
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C008001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050872, read from 'TC0' (0x54433000) (8)
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C4001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad08401
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:19:14 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050872, read from 'TC2' (0x54433200) (0)
Jan 27 18:19:19 phobos kernel: gmc_v8_0_process_interrupt: 1010 callbacks suppressed
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A0C4001
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A004001
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC1' (0x54433100) (4)
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A080001
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08801
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A008001
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC0' (0x54433000) (8)
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A0C4001
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A0C0001
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC5' (0x54433500) (192)
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A0C0001
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A084001
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08801
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A088001
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC9' (0x54433900) (136)
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c801
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A004001
Jan 27 18:19:19 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050906, read from 'TC1' (0x54433100) (4)
Jan 27 18:19:24 phobos kernel: gmc_v8_0_process_interrupt: 1165 callbacks suppressed
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A008001
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154091770, read from 'TC0' (0x54433000) (8)
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A080001
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154091770, read from 'TC11' (0x54433131) (128)
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07c0c801
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F30F8
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A0C8001
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154087672, read from 'TC3' (0x54433300) (200)
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A080001
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154091770, read from 'TC11' (0x54433131) (128)
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08001
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A080001
Jan 27 18:19:24 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154091770, read from 'TC11' (0x54433131) (128)
Jan 27 18:19:25 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07c00001
Jan 27 18:19:25 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F30F8
Jan 27 18:19:25 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A000001
Jan 27 18:19:25 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154087672, read from 'TC2' (0x54433200) (0)
Jan 27 18:19:25 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:19:25 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:19:25 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A0C4001
Jan 27 18:19:25 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154091770, read from 'TC4' (0x54433400) (196)
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154091770, read from 'TC5' (0x54433500) (192)
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C8001
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC3' (0x54433300) (200)
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04801
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24728
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C8002
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 1) at page 10635048, read from 'TC3' (0x54433300) (200)
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02004001
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC0' (0x54433000) (8)
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08401
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24720
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040002
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 1) at page 10635040, read from 'TC8' (0x54433800) (64)
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02004001
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24710
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C8002
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 1) at page 10635024, read from 'TC3' (0x54433300) (200)
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:20:35 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:20:49 phobos kernel: gmc_v8_0_process_interrupt: 130 callbacks suppressed
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E004001
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC0' (0x54433000) (8)
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154091770, read from 'TC0' (0x54433000) (8)
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08801
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E088001
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154091770, read from 'TC9' (0x54433900) (136)
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24721
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E044002
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 7) at page 10635041, read from 'TC7' (0x54433700) (68)
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C8001
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC3' (0x54433300) (200)
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E088001
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC9' (0x54433900) (136)
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00401
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E004001
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154092282, read from 'TC1' (0x54433100) (4)
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04801
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24718
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E088002
Jan 27 18:20:49 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 7) at page 10635032, read from 'TC9' (0x54433900) (136)
Jan 27 18:22:17 phobos kernel: gmc_v8_0_process_interrupt: 219 callbacks suppressed
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E084001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E084001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E080001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C4001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c801
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C8001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC3' (0x54433300) (200)
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C0001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:22:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:22:22 phobos kernel: gmc_v8_0_process_interrupt: 458 callbacks suppressed
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C4001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C4001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x080C4001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:22:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:23:07 phobos kernel: gmc_v8_0_process_interrupt: 51 callbacks suppressed
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00401
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02004001
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050906, read from 'TC1' (0x54433100) (4)
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04401
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050872, read from 'TC0' (0x54433000) (8)
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00001
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050906, read from 'TC2' (0x54433200) (0)
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00401
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050872, read from 'TC8' (0x54433800) (64)
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04001
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050906, read from 'TC8' (0x54433800) (64)
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04801
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02044001
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050872, read from 'TC7' (0x54433700) (68)
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00401
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154092282, read from 'TC2' (0x54433200) (0)
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00401
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02004001
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050906, read from 'TC1' (0x54433100) (4)
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad04401
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA138
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050872, read from 'TC0' (0x54433000) (8)
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0ad00801
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00000000
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C8001
Jan 27 18:23:07 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 0, read from 'TC3' (0x54433300) (200)
Jan 27 18:23:12 phobos kernel: gmc_v8_0_process_interrupt: 467 callbacks suppressed
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C048001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C040001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C048001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C040001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C048001
Jan 27 18:23:12 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:23:17 phobos kernel: gmc_v8_0_process_interrupt: 383 callbacks suppressed
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C8001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC3' (0x54433300) (200)
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C8001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC3' (0x54433300) (200)
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d08801
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04088001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC9' (0x54433900) (136)
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC8' (0x54433800) (64)
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC5' (0x54433500) (192)
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC5' (0x54433500) (192)
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C8001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC3' (0x54433300) (200)
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC0' (0x54433000) (8)
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c401
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F42FA
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C4001
Jan 27 18:23:17 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154092282, read from 'TC4' (0x54433400) (196)
Jan 27 18:23:26 phobos kernel: gmc_v8_0_process_interrupt: 280 callbacks suppressed
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC8' (0x54433800) (64)
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC2' (0x54433200) (0)
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04801
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC6' (0x54433600) (72)
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C8001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC3' (0x54433300) (200)
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C0001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC5' (0x54433500) (192)
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c801
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C8001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC3' (0x54433300) (200)
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d04001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC8' (0x54433800) (64)
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A24730
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008002
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 1) at page 10635056, read from 'TC0' (0x54433000) (8)
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d0c001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092F40FA
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C0001
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154091770, read from 'TC5' (0x54433500) (192)
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x07d00801
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x00A2471B
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02080002
Jan 27 18:23:26 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x02, vmid 1) at page 10635035, read from 'TC11' (0x54433131) (128)
Jan 27 18:26:38 phobos kernel: gmc_v8_0_process_interrupt: 117 callbacks suppressed
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:26:38 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:26:44 phobos kernel: gmc_v8_0_process_interrupt: 314 callbacks suppressed
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08040001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08040001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08040001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:26:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:27:37 phobos kernel: gmc_v8_0_process_interrupt: 228 callbacks suppressed
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06040001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06008001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06040001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06008001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06040001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06040001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06040001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06040001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06040001
Jan 27 18:27:37 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:29:28 phobos smartd[661]: Device: /dev/sda [SAT], SMART Prefailure Attribute: 1 Raw_Read_Error_Rate changed from 107 to 109
Jan 27 18:29:28 phobos smartd[661]: Device: /dev/sda [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 24 to 26
Jan 27 18:31:46 phobos kernel: gmc_v8_0_process_interrupt: 188 callbacks suppressed
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0A008001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 5) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06008001
Jan 27 18:31:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:31:51 phobos kernel: gmc_v8_0_process_interrupt: 414 callbacks suppressed
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C048001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C048001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C040001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C008001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C040001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C008001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C040001
Jan 27 18:31:51 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:38:36 phobos kernel: gmc_v8_0_process_interrupt: 40 callbacks suppressed
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08008001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08040001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08040001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08048001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08000001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08040001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x08040001
Jan 27 18:38:36 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 4) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:39:34 phobos kernel: gmc_v8_0_process_interrupt: 424 callbacks suppressed
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06040001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06000001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06040001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06040001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06000001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06000001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06000001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06048001
Jan 27 18:39:34 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:39:39 phobos kernel: gmc_v8_0_process_interrupt: 484 callbacks suppressed
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04048001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c801
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C8001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC3' (0x54433300) (200)
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04084001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08801
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04088001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC9' (0x54433900) (136)
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04048001
Jan 27 18:39:39 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:39:46 phobos kernel: gmc_v8_0_process_interrupt: 428 callbacks suppressed
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af80401
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E004001
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC1' (0x54433100) (4)
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E084001
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E004001
Jan 27 18:39:46 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC1' (0x54433100) (4)
Jan 27 18:42:50 phobos kernel: gmc_v8_0_process_interrupt: 251 callbacks suppressed
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af88401
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E084001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC10' (0x54433130) (132)
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:42:50 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:42:55 phobos kernel: gmc_v8_0_process_interrupt: 524 callbacks suppressed
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06000001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06008001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06084001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06000001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c801
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x060C8001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC3' (0x54433300) (200)
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06000001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06000001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06000001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06004001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC1' (0x54433100) (4)
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x06080001
Jan 27 18:42:55 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 3) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:43:00 phobos kernel: gmc_v8_0_process_interrupt: 666 callbacks suppressed
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C0001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C004001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC1' (0x54433100) (4)
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C4001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C0C0001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C004001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC1' (0x54433100) (4)
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C004001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC1' (0x54433100) (4)
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00401
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C004001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC1' (0x54433100) (4)
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C040001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0C000001
Jan 27 18:43:00 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 6) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:43:05 phobos kernel: gmc_v8_0_process_interrupt: 635 callbacks suppressed
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x020C4001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC4' (0x54433400) (196)
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:43:05 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:43:10 phobos kernel: gmc_v8_0_process_interrupt: 463 callbacks suppressed
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:43:10 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:43:15 phobos kernel: gmc_v8_0_process_interrupt: 518 callbacks suppressed
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E084001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04801
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E048001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC6' (0x54433600) (72)
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C4001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E0C0001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E008001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E080001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC11' (0x54433131) (128)
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E000001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af04001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x0E040001
Jan 27 18:43:15 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 7) at page 154050910, read from 'TC8' (0x54433800) (64)
Jan 27 18:43:22 phobos kernel: gmc_v8_0_process_interrupt: 443 callbacks suppressed
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c801
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C8001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC3' (0x54433300) (200)
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04008001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C4001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C4001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c401
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C4001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC4' (0x54433400) (196)
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04084001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af08401
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04084001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC10' (0x54433130) (132)
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04000001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c801
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15A
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x04040001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050906, read from 'TC8' (0x54433800) (64)
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af0c001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x040C0001
Jan 27 18:43:22 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 2) at page 154050910, read from 'TC5' (0x54433500) (192)
Jan 27 18:45:44 phobos kernel: gmc_v8_0_process_interrupt: 164 callbacks suppressed
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00801
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02008001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC0' (0x54433000) (8)
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af00001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15E
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02000001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050910, read from 'TC2' (0x54433200) (0)
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84801
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02048001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC6' (0x54433600) (72)
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: GPU fault detected: 147 0x0af84001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_ADDR   0x092EA15F
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0:   VM_CONTEXT1_PROTECTION_FAULT_STATUS 0x02040001
Jan 27 18:45:44 phobos kernel: amdgpu 0000:01:00.0: VM fault (0x01, vmid 1) at page 154050911, read from 'TC8' (0x54433800) (64)
Jan 27 18:53:24 phobos kernel: sysrq: SysRq : Emergency Sync
Jan 27 18:53:24 phobos kernel: Emergency Sync complete
Jan 27 18:53:24 phobos kernel: sysrq: SysRq : Emergency Sync
Jan 27 18:53:24 phobos kernel: Emergency Sync complete
Jan 27 18:53:24 phobos kernel: sysrq: SysRq : Emergency Sync
Jan 27 18:53:24 phobos kernel: Emergency Sync complete
Jan 27 18:53:24 phobos kernel: sysrq: SysRq : Emergency Sync
Jan 27 18:53:24 phobos kernel: Emergency Sync complete
Jan 27 18:53:25 phobos kernel: sysrq: SysRq : Emergency Remount R/O