Skip Menu |

This queue is for tickets about the Test-Harness CPAN distribution.

Report information
The Basics
Id: 30603
Status: resolved
Priority: 0/
Queue: Test-Harness

People
Owner: andy [...] hexten.net
Requestors: ANDK [...] cpan.org
Cc:
AdminCc:

Bug Information
Severity: Normal
Broken in: 3.00
Fixed in: (no value)



Subject: T:H 3.0 breaks POE
If this is a POE bug, I'm ready to report it over there, but until 3.00 POE had no FAILs for me and the diagnostics do not look as if they did something wrong. T:H 3.00 summarizes: Test Summary Report ------------------- t/30_loops/10_select/all_errors.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output t/30_loops/10_select/comp_tcp.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output t/30_loops/10_select/comp_tcp_concurrent.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output t/30_loops/20_poll/all_errors.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output t/30_loops/20_poll/comp_tcp.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output t/30_loops/20_poll/comp_tcp_concurrent.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output t/30_loops/30_event/all_errors.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output t/30_loops/30_event/comp_tcp.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output t/30_loops/30_event/comp_tcp_concurrent.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output t/30_loops/50_tk/all_errors.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output t/30_loops/50_tk/comp_tcp.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output t/30_loops/50_tk/comp_tcp_concurrent.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output Files=181, Tests=4427, 286 wallclock secs ( 2.10 usr 0.31 sys + 57.68 cusr 6.90 csys = 66.99 CPU) Result: FAIL Failed 12/181 test programs. 0/4427 subtests failed. If I run only one of these: $ make test TEST_FILES=t/30_loops/10_select/all_errors.t TEST_VERBOSE=1 PERL_DL_NONLAZY=1 /home/src/perl/repoperls/installed-perls/perl/pJ7IBk0/perl-5.8.0@32244/bin/perl "-MExtUtils::Command::MM" "-e" "test_harness(1, 'blib/lib', 'blib/arch')" t/30_loops/10_select/all_errors.t t/30_loops/10_select/all_errors...... 1..0 # most of these should move into other test files No subtests run Test Summary Report ------------------- t/30_loops/10_select/all_errors.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output Files=1, Tests=0, 0 wallclock secs ( 0.02 usr 0.00 sys + 0.06 cusr 0.01 csys = 0.09 CPU) Result: NOTESTS Failed 1/1 test programs. 0/0 subtests failed. If I combine this NOTESTS with a succeeding one: $ make test TEST_FILES=t/30_loops/10_select/all_errors.t\ t/10_units/01_pod/01_pod.t PERL_DL_NONLAZY=1 /home/src/perl/repoperls/installed-perls/perl/pJ7IBk0/perl-5.8.0@32244/bin/perl "-MExtUtils::Command::MM" "-e" "test_harness(0, 'blib/lib', 'blib/arch')" t/30_loops/10_select/all_errors.t t/10_units/01_pod/01_pod.t t/10_units/01_pod/01_pod.............ok t/30_loops/10_select/all_errors...... No subtests run Test Summary Report ------------------- t/30_loops/10_select/all_errors.t (Wstat: 0 Tests: 0 Failed: 0) Parse errors: No plan found in TAP output Files=2, Tests=54, 1 wallclock secs ( 0.03 usr 0.01 sys + 1.06 cusr 0.04 csys = 1.14 CPU) Result: FAIL Failed 1/2 test programs. 0/54 subtests failed. make: *** [test_dynamic] Fehler 255 Looks very much like a bug in TH3, right?
No, it's a big in POE's test suite. Those tests generate malformed TAP. According to BinGOs it'll be fixed in POE 1.0.
CC: ANDK [...] cpan.org
Subject: Re: [rt.cpan.org #30603] T:H 3.0 breaks POE
Date: Sun, 11 Nov 2007 21:07:07 +0100
To: bug-Test-Harness [...] rt.cpan.org
From: andreas.koenig.7os6VVqR [...] franz.ak.mind.de (Andreas J. Koenig)
Show quoted text
>>>>> On Sun, 11 Nov 2007 14:57:45 -0500, "Andy Armstrong via RT" <bug-Test-Harness@rt.cpan.org> said:
Show quoted text
Show quoted text
> No, it's a big in POE's test suite. Those tests generate malformed TAP. According to BinGOs it'll > be fixed in POE 1.0.
Come on, Andy, in all fairness. Please show the world what exactly the bug in POE's testsuite is. -- andreas
RT-Send-CC: tapx-dev [...] hexten.net
On Sun Nov 11 21:40:27 2007, andreas.koenig.7os6VVqR@franz.ak.mind.de wrote: Show quoted text
> Come on, Andy, in all fairness. Please show the world what exactly the > bug in POE's testsuite is.
Ah, sorry Andreas. You're quite right. I wasn't being terse on purpose - just replied in a hurry. The bug is that when POE wants to skip all its tests it emits something like 1..0 # not going to run these tests The accepted TAP syntax for that is 1..0 # SKIP not going to run these tests In the case where we're parsing TAP version 12 or earlier (i.e. we see no version line) we currently relax the rules to allow things like 1..0 # skipping merrily away but we still barf if there's nothing resembling 'skip' at all. We certainly could allow 1..0 # anything for older TAP because we have the TAP version 13 line to trigger strict mode. I didn't make the change on POE's account though because, having spoken to Chris about it in Vienna I got the impression that they'd be fixing it in POE's test suite. Given that Ovid's just taken me to task for breaking POE too (I guess it's like sticking needles in a little effigy given that they're namesakes :) I'm quite happy to release T::H 3.01 with a fix.
On Mon Nov 12 08:08:44 2007, ANDYA wrote: Show quoted text
> Given that Ovid's just taken me to task for breaking POE too (I guess > it's like sticking needles > in a little effigy given that they're namesakes :) I'm quite happy to > release T::H 3.01 with a > fix.
3.01 is out. POE tests pass :)