Bug 109264

Summary:	Tests intermittently excluded from execution
Product:	piglit	Reporter:	Mark Janes <mark.a.janes>
Component:	infrastructure	Assignee:	Dylan Baker <baker.dylan.c>
Status:	RESOLVED MOVED	QA Contact:	Piglit Mailing List <piglit>
Severity:	normal
Priority:	medium
Version:	unspecified
Hardware:	Other
OS:	All
Whiteboard:
i915 platform:		i915 features:

Description Mark Janes 2019-01-09 20:33:35 UTC

At build time, some tests may not be included in quick_shader.xml.gz

subsets of tests in piglit.spec.arb_vertex_attrib_64bit.execution.vs_in have been found to be included, dependent on the compilation of piglit.  the shader tests are there, but are not executed because they are not in the quick_shader suite.

Based on results from Mesa CI, we are skipping ~200 tests on a regular basis.  Platforms where these tests fail are unusable in CI due to the noise.

Comment 1 Mark Janes 2019-01-09 20:37:04 UTC

Correction: the test result count varies by ~200 tests, but CI data shows that 2 different sets of tests are included in runs.  The excluded test sets have different sizes, but the total number of tests that may/may not run is ~5k.

Comment 2 GitLab Migration User 2019-03-06 15:47:23 UTC

-- GitLab Migration Automatic Message --

This bug has been migrated to freedesktop.org's GitLab instance and has been closed from further activity.

You can subscribe and participate further through the new bug through this link to our GitLab instance: https://gitlab.freedesktop.org/mesa/piglit/issues/10.

Use of freedesktop.org services, including Bugzilla, is subject to our Code of Conduct. How we collect and use information is described in our Privacy Policy.