Bug 107111

What it is telling us is that the GPU is never utilised enough for it to upclock by itself -- Kodi should not need more power to deliver the frames on time, and that boosting is overkill.

One thing to confirm is which boost Kodi is depending on. So try just reverting the intel_display chunk so that it always boost after the vblank miss.

diff --git a/drivers/gpu/drm/i915/intel_display.c b/drivers/gpu/drm/i915/intel_display.c
index 681e0710a467..0d4c61e53a6c 100644
--- a/drivers/gpu/drm/i915/intel_display.c
+++ b/drivers/gpu/drm/i915/intel_display.c
@@ -12913,7 +12913,8 @@ static int do_rps_boost(struct wait_queue_entry *_wait,
         * is reasonable to assume that it will complete before the next
         * vblank without our intervention, so leave RPS alone.
         */
-       if (!i915_request_started(rq))
+       if (!i915_request_started(rq) ||
+           rq != i915_gem_active_peek(&rq->timeline->last_request))
                gen6_rps_boost(rq, NULL);
        i915_request_put(rq);
 
might be an interesting compromise. But what I think is that we want is more of a nudge.

Created attachment 140462 [details] [review]
nudge

Created attachment 140463 [details] [review]
nudge2

Since it's not the vblank waitboosting in effect here, it must be the i915_gem_object_wait (used by glFinish et al): try the second nudge on top of the first.

Apologies for the delay in responding, I've been collecting information.

I produced 4 test builds for users that are experiencing the visual stutter. These builds are based on 4.17.4 where e9af4ea2b9e7 is not reverted:

#0703b, includes patch "reverting the intel_display chunk so that it always boost after the vblank miss."[1]
#0703c, includes patch "might be an interesting compromise"[2]
#0703d, includes patch "nudge"[3]
#0703e, includes patches "nudge"[3] + "nudge2"[4]

Results (from 2 users)[5]:

#0703b: visual stutter still present
#0703c: no visual stutter, but audio issues (both users) - delayed and/or stuttering audio
#0703d: no visual stutter and no audio issues
#0703e: no visual stutter and no audio issues

Regarding the audio issues, one user hasn't been able to reproduce[6] and the other won't be able to test for a while[7], so this could be a red herring.

Hopefully this information is useful when deciding in which direction to go!


1. http://ix.io/1fYp
2. http://ix.io/1fYI
3. https://bugs.freedesktop.org/attachment.cgi?id=140462
4. http://ix.io/1fYX (4.17.4 compatible version of id=140463)
5. https://forum.kodi.tv/showthread.php?tid=298462&pid=2749048#pid2749048
6. https://forum.kodi.tv/showthread.php?tid=298462&pid=2749440#pid2749440
7. https://forum.kodi.tv/showthread.php?tid=298462&pid=2749557#pid2749557

Created attachment 140513 [details] [review]
Tidier nudge

Same nudge as before (v1), but with a bugfix so worth double checking that fixing the bug didn't bring the problem back.

Thanks Chris. I've posted a new #0708b build[1] with "Tidier nudge" and will post again once I have feedback.

With #0708b on a Skylake NUC when playing 30 seconds of the Elysium 4K video, I see the GPU boosting frequently throughout playback[2] (sampling i915_rps_boost_info every 0.05 seconds). Other less "stressful" videos (eg. 1080p HEVC) barely boost at all.

The GPU also boosts while navigating the Kodi GUI, so fingers crossed.

1. https://forum.kodi.tv/showthread.php?tid=298462&pid=2749894#pid2749894
2. http://ix.io/1gwH

If anyone also has a wattsup/killawatt or other power meter, I would be interested in knowing the total power consumed with waitboost-vs-nudge.

kodi can measure the GPU power used by using perf + rapl, e.g. https://cgit.freedesktop.org/drm/igt-gpu-tools/tree/overlay/power.c which I think might be of interest.

> Same nudge as before (v1), but with a bugfix so worth double checking that fixing the bug didn't bring the problem back.

I added "Tidier nudge" in test build #0708b and received confirmation[1,2] that it is working well.

1. https://forum.kodi.tv/showthread.php?tid=298462&pid=2750248#pid2750248
2> https://forum.kodi.tv/showthread.php?tid=298462&pid=2750649#pid2750649

commit 60548c554be2830d29d2533dad0ac8133347ee51 (HEAD -> drm-intel-next-queued, drm-intel/for-linux-next, drm-intel/drm-intel-next-queued)
Author: Chris Wilson <chris@chris-wilson.co.uk>
Date:   Tue Jul 31 14:26:29 2018 +0100

    drm/i915: Interactive RPS mode
    
    RPS provides a feedback loop where we use the load during the previous
    evaluation interval to decide whether to up or down clock the GPU
    frequency. Our responsiveness is split into 3 regimes, a high and low
    plateau with the intent to keep the gpu clocked high to cover occasional
    stalls under high load, and low despite occasional glitches under steady
    low load, and inbetween. However, we run into situations like kodi where
    we want to stay at low power (video decoding is done efficiently
    inside the fixed function HW and doesn't need high clocks even for high
    bitrate streams), but just occasionally the pipeline is more complex
    than a video decode and we need a smidgen of extra GPU power to present
    on time. In the high power regime, we sample at sub frame intervals with
    a bias to upclocking, and conversely at low power we sample over a few
    frames worth to provide what we consider to be the right levels of
    responsiveness respectively. At low power, we more or less expect to be
    kicked out to high power at the start of a busy sequence by waitboosting.
    
    Prior to commit e9af4ea2b9e7 ("drm/i915: Avoid waitboosting on the active
    request") whenever we missed the frame or stalled, we would immediate go
    full throttle and upclock the GPU to max. But in commit e9af4ea2b9e7, we
    relaxed the waitboosting to only apply if the pipeline was deep to avoid
    over-committing resources for a near miss. Sadly though, a near miss is
    still a miss, and perceptible as jitter in the frame delivery.
    
    To try and prevent the near miss before having to resort to boosting
    after the fact, we use the pageflip queue as an indication that we are
    in an "interactive" regime and so should sample the load more frequently
    to provide power before the frame misses it vblank. This will make us
    more favorable to providing a small power increase (one or two bins) as
    required rather than going all the way to maximum and then having to
    work back down again. (We still keep the waitboosting mechanism around
    just in case a dramatic change in system load requires urgent uplocking,
    faster than we can provide in a few evaluation intervals.)
    
    v2: Reduce rps_set_interactive to a boolean parameter to avoid the
    confusion of what if they wanted a new power mode after pinning to a
    different mode (which to choose?)
    v3: Only reprogram RPS while the GT is awake, it will be set when we
    wake the GT, and while off warns about being used outside of rpm.
    v4: Fix deferred application of interactive mode
    v5: s/state/interactive/
    v6: Group the mutex with its principle in a substruct
    
    Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=107111
    Fixes: e9af4ea2b9e7 ("drm/i915: Avoid waitboosting on the active request")
    Signed-off-by: Chris Wilson <chris@chris-wilson.co.uk>
    Cc: Joonas Lahtinen <joonas.lahtinen@linux.intel.com>
    Cc: Tvrtko Ursulin <tvrtko.ursulin@intel.com>
    Cc: Radoslaw Szwichtenberg <radoslaw.szwichtenberg@intel.com>
    Cc: Ville Syrjälä <ville.syrjala@linux.intel.com>
    Reviewed-by: Joonas Lahtinen <joonas.lahtinen@linux.intel.com>
    Link: https://patchwork.freedesktop.org/patch/msgid/20180731132629.3381-1-chris@chris-wilson.co.uk

Reporter, can you verify that the issue is resolved for you on latest drm-tip?

I'll have to get back to you on that, as I've just today had a report of stutter from a user after they upgraded from 4.17.14 to 4.18.4 (both kernels include this fix). I'm trying to get more information.

I don't normally build with drm-tip, is testing with 4.18.y sufficient?

(In reply to freedesktop from comment #11)

> I don't normally build with drm-tip, is testing with 4.18.y sufficient?

Currently this commit is not available in 4.18.4 yet, but you can get it from Linus T mainline. Most likely this change would be available from 4.19.

> Currently this commit is not available in 4.18.4 yet

Yes, we've been including the v4 commit on top of the stable kernel releases in the LibreELEC build system[1] since it was initially proposed - we're currently creating test builds based on 4.18.4 (now 4.18.5, actually)[2].

> Most likely this change would be available from 4.19.

It looks like the commit (or a variation of it[3]) is now included in 4.19-rc1. I'll produce a 4.19-rc1 test build of LibreELEC and Kodi later this week.

So far I've only had one user refer to ongoing "stutter" issues which makes me suspect it may not be related to this issue, and I'm happy for this issue to be closed as "resolved". If necessary I'll reopen at a later date should it be necessary (hopefully not!)

Many thanks to everyone involved.

1. https://github.com/LibreELEC/LibreELEC.tv/blob/master/packages/linux/patches/default/linux-999-drm_i915-interactive-rps-mode.patch
2. https://github.com/LibreELEC/LibreELEC.tv/pull/2908
3. https://github.com/torvalds/linux/commit/027063b1606fea6df15c270e5f2a072d1dfa8fef

Reporter, were you able to reproduce this? Can you confirm if I can close this bug?

No feedback for more than a month.
I assume this bug has been fixed. Closing this bug.