Bug 109264 - Tests intermittently excluded from execution
Summary: Tests intermittently excluded from execution
Status: NEW
Alias: None
Product: piglit
Classification: Unclassified
Component: infrastructure (show other bugs)
Version: unspecified
Hardware: Other All
: medium normal
Assignee: Dylan Baker
QA Contact: Piglit Mailing List
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2019-01-09 20:33 UTC by Mark Janes
Modified: 2019-01-09 20:37 UTC (History)
0 users

See Also:
i915 platform:
i915 features:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Mark Janes 2019-01-09 20:33:35 UTC
At build time, some tests may not be included in quick_shader.xml.gz

subsets of tests in piglit.spec.arb_vertex_attrib_64bit.execution.vs_in have been found to be included, dependent on the compilation of piglit.  the shader tests are there, but are not executed because they are not in the quick_shader suite.

Based on results from Mesa CI, we are skipping ~200 tests on a regular basis.  Platforms where these tests fail are unusable in CI due to the noise.
Comment 1 Mark Janes 2019-01-09 20:37:04 UTC
Correction: the test result count varies by ~200 tests, but CI data shows that 2 different sets of tests are included in runs.  The excluded test sets have different sizes, but the total number of tests that may/may not run is ~5k.


Use of freedesktop.org services, including Bugzilla, is subject to our Code of Conduct. How we collect and use information is described in our Privacy Policy.