Bug 109264 - Tests intermittently excluded from execution
Summary: Tests intermittently excluded from execution
Status: RESOLVED MOVED
Alias: None
Product: piglit
Classification: Unclassified
Component: infrastructure (show other bugs)
Version: unspecified
Hardware: Other All
: medium normal
Assignee: Dylan Baker
QA Contact: Piglit Mailing List
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2019-01-09 20:33 UTC by Mark Janes
Modified: 2019-03-06 15:47 UTC (History)
0 users

See Also:
i915 platform:
i915 features:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Mark Janes 2019-01-09 20:33:35 UTC
At build time, some tests may not be included in quick_shader.xml.gz

subsets of tests in piglit.spec.arb_vertex_attrib_64bit.execution.vs_in have been found to be included, dependent on the compilation of piglit.  the shader tests are there, but are not executed because they are not in the quick_shader suite.

Based on results from Mesa CI, we are skipping ~200 tests on a regular basis.  Platforms where these tests fail are unusable in CI due to the noise.
Comment 1 Mark Janes 2019-01-09 20:37:04 UTC
Correction: the test result count varies by ~200 tests, but CI data shows that 2 different sets of tests are included in runs.  The excluded test sets have different sizes, but the total number of tests that may/may not run is ~5k.
Comment 2 GitLab Migration User 2019-03-06 15:47:23 UTC
-- GitLab Migration Automatic Message --

This bug has been migrated to freedesktop.org's GitLab instance and has been closed from further activity.

You can subscribe and participate further through the new bug through this link to our GitLab instance: https://gitlab.freedesktop.org/mesa/piglit/issues/10.


Use of freedesktop.org services, including Bugzilla, is subject to our Code of Conduct. How we collect and use information is described in our Privacy Policy.