| Subject: | image comparison test are too fragile to be useful |
On a freshly checked-out and built GD 2.56:
$ GDIMAGETYPE=gd prove -bv t/GD.t
t/GD.t ..
1..11
ok 1 - use GD;
ok 2 - use GD::Simple;
# Testing using gd support.
ok 3 - image comparison test 1
ok 4 - image comparison test 2
ok 5 - image comparison test 3
ok 6 - image comparison test 4
ok 7 - image comparison test 5
ok 8 - image comparison test 6
not ok 9 - image comparison test 7
# Failed test 'image comparison test 7'
# at t/GD.t line 249.
ok 10 - round trip gd
ok 11 - round trip gd2
# Looks like you failed 1 test of 11.
$ GDIMAGETYPE=gd2 prove -bv t/GD.t
t/GD.t ..
1..11
ok 1 - use GD;
ok 2 - use GD::Simple;
# Testing using gd2 support.
ok 3 - image comparison test 1
ok 4 - image comparison test 2
ok 5 - image comparison test 3
ok 6 - image comparison test 4
ok 7 - image comparison test 5
ok 8 - image comparison test 6
not ok 9 - image comparison test 7
# Failed test 'image comparison test 7'
# at t/GD.t line 249.
ok 10 - round trip gd
ok 11 - round trip gd2
# Looks like you failed 1 test of 11.
$ GDIMAGETYPE=gif prove -bv t/GD.t
t/GD.t ..
1..11
ok 1 - use GD;
ok 2 - use GD::Simple;
# Testing using gif support.
ok 3 - image comparison test 1
not ok 4 - image comparison test 2
# Failed test 'image comparison test 2'
# at t/GD.t line 249.
not ok 5 - image comparison test 3
# Failed test 'image comparison test 3'
# at t/GD.t line 249.
ok 6 - image comparison test 4
not ok 7 - image comparison test 5
# Failed test 'image comparison test 5'
# at t/GD.t line 249.
ok 8 - image comparison test 6
not ok 9 - image comparison test 7
# Failed test 'image comparison test 7'
# at t/GD.t line 249.
ok 10 - round trip gd
ok 11 - round trip gd2
# Looks like you failed 4 tests of 11.
$ GDIMAGETYPE=png prove -bv t/GD.t
t/GD.t ..
1..11
ok 1 - use GD;
ok 2 - use GD::Simple;
# Testing using png support.
ok 3 - image comparison test 1
not ok 4 - image comparison test 2
# Failed test 'image comparison test 2'
# at t/GD.t line 249.
ok 5 - image comparison test 3
ok 6 - image comparison test 4
ok 7 - image comparison test 5
ok 8 - image comparison test 6
not ok 9 - image comparison test 7
# Failed test 'image comparison test 7'
# at t/GD.t line 249.
ok 10 - round trip gd
ok 11 - round trip gd2
# Looks like you failed 2 tests of 11.
$ GDIMAGETYPE=jpeg prove -bv t/GD.t
t/GD.t ..
1..11
ok 1 - use GD;
ok 2 - use GD::Simple;
# Testing using jpeg support.
not ok 3 - image comparison test 1
# Failed test 'image comparison test 1'
# at t/GD.t line 249.
not ok 4 - image comparison test 2
# Failed test 'image comparison test 2'
# at t/GD.t line 249.
not ok 5 - image comparison test 3
# Failed test 'image comparison test 3'
# at t/GD.t line 249.
not ok 6 - image comparison test 4
# Failed test 'image comparison test 4'
# at t/GD.t line 249.
not ok 7 - image comparison test 5
# Failed test 'image comparison test 5'
# at t/GD.t line 249.
not ok 8 - image comparison test 6
# Failed test 'image comparison test 6'
# at t/GD.t line 249.
not ok 9 - image comparison test 7
# Failed test 'image comparison test 7'
# at t/GD.t line 249.
ok 10 - round trip gd
ok 11 - round trip gd2
# Looks like you failed 7 tests of 11.
Looking at cpantesters, I can see that many people are having similar problems.