Bug 96637

Summary:	Failing test
Product:	cairo	Reporter:	Paul Menzel <pmenzel+bugs.freedesktop.org>
Component:	general	Assignee:	Chris Wilson <chris>
Status:	RESOLVED INVALID	QA Contact:	cairo-bugs mailing list <cairo-bugs>
Severity:	normal
Priority:	medium	CC:	darxus
Version:	unspecified
Hardware:	Other
OS:	All
Whiteboard:
i915 platform:		i915 features:
Attachments:	Test suite log file

Description Paul Menzel 2016-06-22 15:19:18 UTC

Created attachment 124667 [details]
Test suite log file

With latest master, one test fails on my system.


$ git describe --tags
1.15.2-30-g1272db9
$ make check
[…]
make  check-TESTS
make[5]: Entering directory '/home/joey/src/cairo/test'
make[6]: Entering directory '/home/joey/src/cairo/test'
FAIL: cairo-test-suite
============================================================================
Testsuite summary for cairo 1.15.2
============================================================================
# TOTAL: 1
# PASS:  0
# SKIP:  0
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 0
============================================================================
See test/test-suite.log
Please report to http://bugs.freedesktop.org/enter_bug.cgi?product=cairo
============================================================================
Makefile:8374: recipe for target 'test-suite.log' failed
make[6]: *** [test-suite.log] Error 1
make[6]: Leaving directory '/home/joey/src/cairo/test'
Makefile:8480: recipe for target 'check-TESTS' failed
make[5]: *** [check-TESTS] Error 2
make[5]: Leaving directory '/home/joey/src/cairo/test'
Makefile:8567: recipe for target 'check-am' failed
make[4]: *** [check-am] Error 2
make[4]: Leaving directory '/home/joey/src/cairo/test'
Makefile:8267: recipe for target 'check-recursive' failed
make[3]: *** [check-recursive] Error 1
make[3]: Leaving directory '/home/joey/src/cairo/test'
Makefile:8570: recipe for target 'check' failed
make[2]: *** [check] Error 2
make[2]: Leaving directory '/home/joey/src/cairo/test'
Makefile:904: recipe for target 'check-recursive' failed
make[1]: *** [check-recursive] Error 1
make[1]: Leaving directory '/home/joey/src/cairo'
Makefile:1353: recipe for target 'check' failed
make: *** [check] Error 2

Comment 1 Darxus 2016-08-18 18:42:41 UTC

If you "See test/test-suite.log", I expect you will find an awful lot of tests have failed.  This is what it looks like when anything in the test suite has failed, even if thousands of tests have failed.

https://www.phoronix.com/scan.php?page=news_item&px=Cairo-Tests-Failing

While it concerns me, I don't think having a bug open saying that tests fail without any details is very useful.  

I've been opening more specific bugs, like these:
https://bugs.freedesktop.org/show_bug.cgi?id=97400
https://bugs.freedesktop.org/show_bug.cgi?id=97401

And I'm working on updating the test/README to reflect this situation:
https://lists.cairographics.org/archives/cairo/2016-August/027716.html

Use of freedesktop.org services, including Bugzilla, is subject to our Code of Conduct. How we collect and use information is described in our Privacy Policy.