Bug 6376

Summary: cairo-1.04: 5 of 61 tests failed
Product: cairo Reporter: Joseph E. Sacco, Ph.D. <jsacco>
Component: generalAssignee: Carl Worth <cworth>
Status: RESOLVED WONTFIX QA Contact: cairo-bugs mailing list <cairo-bugs>
Severity: normal    
Priority: high    
Version: 1.0.3   
Hardware: PowerPC   
OS: Linux (All)   
Whiteboard:
i915 platform: i915 features:
Attachments: tarball containing *diff.png files generated by running 'make check'

Description Joseph E. Sacco, Ph.D. 2006-03-25 02:31:29 UTC
System: 
* G4 PowerMac
* YDL-4.1 [FC4 clone]
* xorg-6.8.2-37
* garnome-2.14.x

Built cairo-1.04 using glitz-0.5.3:  5 of 61 tests failed. Output shown below.

-Joseph

================================================================
make  check-TESTS
make[2]: Entering directory
`/usr/local/src/GARNOME/2.14/garnome-2.14.x/src/sandbox/freedesktop/cairo/work/main.d/cairo-1.0.4/test'

a8-mask is expected to fail:
        image backend fails because libpixman only handles (stride %
sizeof(pixman_bits) == 0)
a8-mask-image:  XFAIL
a8-mask-xlib:   PASS
XFAIL: a8-mask

caps-joins-image:       PASS
caps-joins-xlib:        PASS
PASS: caps-joins

caps-sub-paths-image:   PASS
caps-sub-paths-xlib:    PASS
PASS: caps-sub-paths

clip-all-image: PASS
clip-all-xlib:  PASS
PASS: clip-all

clip-nesting-image:     PASS
clip-nesting-xlib:      PASS
PASS: clip-nesting

clip-operator-image:    PASS
clip-operator-xlib:     FAIL
FAIL: clip-operator

clip-twice-image:       PASS
clip-twice-xlib:        PASS
PASS: clip-twice

composite-integer-translate-source-image:       PASS
composite-integer-translate-source-xlib:        PASS
PASS: composite-integer-translate-source

composite-integer-translate-over-image: PASS
composite-integer-translate-over-xlib:  PASS
PASS: composite-integer-translate-over

composite-integer-translate-over-repeat-image:  PASS
composite-integer-translate-over-repeat-xlib:   PASS
PASS: composite-integer-translate-over-repeat

create-from-png-image:  PASS
create-from-png-xlib:   PASS
PASS: create-from-png

create-from-png-stream-image:   PASS
create-from-png-stream-xlib:    PASS
PASS: create-from-png-stream

dash-caps-joins-image:  PASS
dash-caps-joins-xlib:   PASS
PASS: dash-caps-joins

dash-offset-negative-image:     PASS
dash-offset-negative-xlib:      PASS
PASS: dash-offset-negative

fill-and-stroke-image:  PASS
fill-and-stroke-xlib:   PASS
PASS: fill-and-stroke

fill-rule-image:        PASS
fill-rule-xlib: PASS
PASS: fill-rule

filter-nearest-offset is expected to fail:
        wrong sampling location for nearest-neighbor filter in libpixman and Render
filter-nearest-offset-image:    XFAIL
filter-nearest-offset-xlib:     XFAIL
XFAIL: filter-nearest-offset

get-and-set-image:      PASS
get-and-set-xlib:       PASS
PASS: get-and-set

gradient-alpha-image:   PASS
gradient-alpha-xlib:    PASS
PASS: gradient-alpha

leaky-polygon-image:    PASS
leaky-polygon-xlib:     PASS
PASS: leaky-polygon

line-width-image:       PASS
line-width-xlib:        PASS
PASS: line-width

linear-gradient-image:  PASS
linear-gradient-xlib:   FAIL
FAIL: linear-gradient

mask-image:     PASS
mask-xlib:      PASS
PASS: mask

mask-ctm-image: PASS
mask-ctm-xlib:  PASS
PASS: mask-ctm

mask-surface-ctm-image: PASS
mask-surface-ctm-xlib:  PASS
PASS: mask-surface-ctm

move-to-show-surface-image:     PASS
move-to-show-surface-xlib:      PASS
PASS: move-to-show-surface

nil-surface-image:      PASS
nil-surface-xlib:       PASS
PASS: nil-surface

operator-clear-image:   PASS
operator-clear-xlib:    PASS
PASS: operator-clear

operator-source-image:  PASS
operator-source-xlib:   FAIL
FAIL: operator-source

paint-image:    PASS
paint-xlib:     PASS
PASS: paint

paint-with-alpha-image: PASS
paint-with-alpha-xlib:  PASS
PASS: paint-with-alpha

path-data-image:        PASS
path-data-xlib: PASS
PASS: path-data

pixman-rotate is expected to fail:
        known off-by-one bug when rotating a pixman image
pixman-rotate-image:    XFAIL
pixman-rotate-xlib:     XFAIL
XFAIL: pixman-rotate

rectangle-rounding-error-image: PASS
rectangle-rounding-error-xlib:  PASS
PASS: rectangle-rounding-error

scale-source-surface-paint-image:       PASS
scale-source-surface-paint-xlib:        PASS
PASS: scale-source-surface-paint

select-font-no-show-text-image: PASS
select-font-no-show-text-xlib:  PASS
PASS: select-font-no-show-text

self-copy-image:        PASS
self-copy-xlib: PASS
PASS: self-copy

self-intersecting is expected to fail:
        Self-intersecting strokes are wrong due to incremental trapezoidization.
self-intersecting-image:        XFAIL
self-intersecting-xlib: XFAIL
XFAIL: self-intersecting

set-source-image:       PASS
set-source-xlib:        PASS
PASS: set-source

show-glyphs-many-image: PASS
show-glyphs-many-xlib:  PASS
PASS: show-glyphs-many

show-text-current-point-image:  PASS
show-text-current-point-xlib:   PASS
PASS: show-text-current-point

source-clip-image:      PASS
source-clip-xlib:       PASS
PASS: source-clip

source-surface-scale-paint-image:       PASS
source-surface-scale-paint-xlib:        PASS
PASS: source-surface-scale-paint

surface-finish-twice-image:     PASS
surface-finish-twice-xlib:      PASS
PASS: surface-finish-twice

surface-pattern-image:  PASS
surface-pattern-xlib:   PASS
PASS: surface-pattern

text-antialias-gray-image:      PASS
text-antialias-gray-xlib:       PASS
PASS: text-antialias-gray

text-antialias-none-image:      PASS
text-antialias-none-xlib:       PASS
PASS: text-antialias-none

text-antialias-subpixel-image:  PASS
text-antialias-subpixel-xlib:   PASS
PASS: text-antialias-subpixel

text-cache-crash-image: PASS
text-cache-crash-xlib:  PASS
PASS: text-cache-crash

text-pattern-image:     PASS
text-pattern-xlib:      PASS
PASS: text-pattern

text-rotate is expected to fail:
        minor bugs in positioning rotated glyphs
text-rotate-image:      XFAIL
text-rotate-xlib:       XFAIL
XFAIL: text-rotate

transforms-image:       PASS
transforms-xlib:        PASS
PASS: transforms

translate-show-surface-image:   PASS
translate-show-surface-xlib:    PASS
PASS: translate-show-surface

trap-clip-image:        PASS
trap-clip-xlib: FAIL
FAIL: trap-clip

unantialiased-shapes-image:     PASS
unantialiased-shapes-xlib:      FAIL
FAIL: unantialiased-shapes

unbounded-operator-image:       PASS
unbounded-operator-xlib:        PASS
PASS: unbounded-operator
PASS: user-data

rel-path-image: PASS
rel-path-xlib:  PASS
PASS: rel-path
PASS: pthread-show-text

ft-font-create-for-ft-face-image:       PASS
ft-font-create-for-ft-face-xlib:        PASS
PASS: ft-font-create-for-ft-face

PASS: xlib-surface
========================================================================
5 of 61 tests failed
Please report to http://bugs.freedesktop.org/enter_bug.cgi?product=cairo
========================================================================
Comment 1 Carl Worth 2006-03-25 04:06:22 UTC
This could be NOTABUG and just a limitation of our currently over-strict test rig.

See the following note from cairo/INSTALL:

   When cairo is compiled, you can also run some automated tests of
   cairo with:

        make check

   NOTE: Some versions of X servers will cause the -xlib tests to
   report failures in make check even when cairo is working just
   fine. If you see failures in nothing but -xlib tests, please
   examine the corresponding -xlib-out.png images and compare them to
   the -ref.png reference images (the -xlib-diff.png images might also
   be useful). If the results seem "close enough" please do not report
   a bug against cairo as the "failures" you are seeing are just due
   to subtle variations in X server implementations.

Can you follow those instructions and report back?

(And if someone can figure out a way to get that printed when the test suite
fails, that would be great.)

-Carl
Comment 2 Joseph E. Sacco, Ph.D. 2006-03-25 04:50:18 UTC
Carl,

Will do.... 

BTW, I love your last comment [:-)]


-Joseph
Comment 3 Joseph E. Sacco, Ph.D. 2006-03-25 05:13:46 UTC
Created attachment 5045 [details]
tarball containing *diff.png files generated by running 'make check'

Carl,

A picture is worth one thousand words.	This attachment contains the *diff.png
files generated by running 'make check'.

-Joseph
Comment 4 Chris Wilson 2008-10-08 06:29:54 UTC
Doing a mass close of old make check failures. Thank you for taking the time to build and test cairo on your platform, it is most appreciated. So much has changed in the few years since these reports have been filed (and so little - we've still to integrate fonts within the test suite, though we do now have a viable alternative) that acting upon the information contained within is difficult. We have bold plans during the next development phase to improve the test suite further, which I hope will lead to more timely identification of failures and regressions (possibly even pinpointing bad patches). Again, thanks and please do let us know if we can improve cairo for you.

Use of freedesktop.org services, including Bugzilla, is subject to our Code of Conduct. How we collect and use information is described in our Privacy Policy.