| Subject: | 0.03_07 send pass reports regardless of actual smoke results |
I downloaded 0.03_07 to see whether that corrected some of the problems I've been encountering. I started smoking some modules and noticed that even if tests fail, C::Y dutifully records a 'pass' result.
from the audit log (and I'm not sure what the No such file or directory message is doing there):
[CP_MSG] [Wed Oct 5 11:28:53 2005] cp lib/File/SAUCE.pm blib/lib/File/SAUCE.pm
Manifying blib/man3/File::SAUCE.3
[CP_ERROR] [Wed Oct 5 11:28:57 2005] MAKE TEST failed: No such file or directory PERL_DL_NONLAZY=1 /usr/local/bin/p581 "-MExtUtils::Command::MM" "-e" "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t
t/01-use...................ok
t/02-defaults..............ok
t/03-getset................ok
t/10.1-read_exception......skipped
all skipped: Test::Exception required
t/10.2-read_bogus..........Can't locate object method "binmode" via package "FileHandle" at /home/cpan/plus/5.8.1/build/File-SAUCE-0.2/blib/lib/File/SAUCE.pm line 654.
# Looks like you planned 12 tests but only ran 2.
# Looks like your test died just after 2.
dubious
Test returned status 255 (wstat 65280, 0xff00)
DIED. FAILED tests 3-12
Failed 10/12 tests, 16.67% okay
t/10.3-read................Can't locate object method "binmode" via package "FileHandle" at /home/cpan/plus/5.8.1/build/File-SAUCE-0.2/blib/lib/File/SAUCE.pm line 654.
# Looks like you planned 168 tests but only ran 2.
# Looks like your test died just after 2.
dubious
Test returned status 255 (wstat 65280, 0xff00)
DIED. FAILED tests 3-168
Failed 166/168 tests, 1.19% okay
t/11.1-remove_exception....skipped
all skipped: Test::Warn required
t/11.2-remove_bogus........Can't locate object method "binmode" via package "FileHandle" at /home/cpan/plus/5.8.1/build/File-SAUCE-0.2/blib/lib/File/SAUCE.pm line 654.
# Looks like you planned 20 tests but only ran 2.
# Looks like your test died just after 2.
dubious
Test returned status 255 (wstat 65280, 0xff00)
DIED. FAILED tests 3-20
Failed 18/20 tests, 10.00% okay
t/11.3-remove_spoon........Can't locate object method "binmode" via package "FileHandle" at /home/cpan/plus/5.8.1/build/File-SAUCE-0.2/blib/lib/File/SAUCE.pm line 654.
# Looks like you planned 11 tests but only ran 2.
# Looks like your test died just after 2.
dubious
Test returned status 255 (wstat 65280, 0xff00)
DIED. FAILED tests 3-11
Failed 9/11 tests, 18.18% okay
t/11.4-remove..............Can't locate object method "binmode" via package "FileHandle" at /home/cpan/plus/5.8.1/build/File-SAUCE-0.2/blib/lib/File/SAUCE.pm line 654.
# Looks like you planned 20 tests but only ran 2.
# Looks like your test died just after 2.
dubious
Test returned status 255 (wstat 65280, 0xff00)
DIED. FAILED tests 3-20
Failed 18/20 tests, 10.00% okay
t/12-as_string.............Can't locate object method "binmode" via package "FileHandle" at /home/cpan/plus/5.8.1/build/File-SAUCE-0.2/blib/lib/File/SAUCE.pm line 654.
# Looks like you planned 9 tests but only ran 5.
# Looks like your test died just after 5.
dubious
Test returned status 255 (wstat 65280, 0xff00)
DIED. FAILED tests 6-9
Failed 4/9 tests, 55.56% okay
t/13-write.................Can't locate object method "binmode" via package "FileHandle" at /home/cpan/plus/5.8.1/build/File-SAUCE-0.2/blib/lib/File/SAUCE.pm line 654.
# Looks like you planned 168 tests but only ran 1.
# Looks like your test died just after 1.
dubious
Test returned status 255 (wstat 65280, 0xff00)
DIED. FAILED tests 2-168
Failed 167/168 tests, 0.60% okay
t/14-print.................skipped
all skipped: IO::Capture::Stdout required
t/98-pod_coverage..........ok
t/99-pod...................ok
Failed 7/15 test scripts, 53.33% okay. 392/502 subtests failed, 21.91% okay.
Failed Test Stat Wstat Total Fail Failed List of Failed
-------------------------------------------------------------------------------
t/10.2-read_bogus.t 255 65280 12 20 166.67% 3-12
t/10.3-read.t 255 65280 168 332 197.62% 3-168
t/11.2-remove_bogus.t 255 65280 20 36 180.00% 3-20
t/11.3-remove_spoon.t 255 65280 11 18 163.64% 3-11
t/11.4-remove.t 255 65280 20 36 180.00% 3-20
t/12-as_string.t 255 65280 9 8 88.89% 6-9
t/13-write.t 255 65280 168 334 198.81% 2-168
3 tests skipped.
*** Error code 25
Stop in /home/cpan/plus/5.8.1/build/File-SAUCE-0.2.
[CP_MSG] [Wed Oct 5 11:29:25 2005] Successfully sent 'pass' report for 'File-SAUCE-0.2'
Report Grade for File-SAUCE-0.2 is PASS