| Subject: | 1.43 incorrectly reporting passes |
My perl smokes starting failing yesterday, but are being reported as
PASSes. My last successful smoke was v5.13.2-246-gd024465[1].
My first fail (v5.13.2-251-gd4e225a[2]) reported:
Show quoted text
> Automated smoke report for 5.13.2 patch
d4e225aa1c5074230edc5791bd95fac33d97f8d4 v5.13.2-251-gd4e225a
Show quoted text> zippy: AMD Athlon(tm) Dual Core Processor 5050e (AuthenticAMD
2614MHz) (x86_64/2 cpu)
Show quoted text> on linux - 2.6.26-2-amd64 [debian]
> using cc version 4.4.4
> smoketime 4 hours 48 minutes (average 18 minutes 3 seconds)
>
> Summary: PASS
>
> O = OK F = Failure(s), extended report at the bottom
> X = Failure(s) under TEST but not under harness
> ? = still running or test results not (yet) available
> Build failures during: - = unknown or N/A
> c = Configure, m = make, M = make (after miniperl), t = make test-prep
>
> v5.13.2-251-gd4e225a Configuration (common) none
> ----------- ---------------------------------------------------------
> O - O -
> O - O - -Duse64bitint
> O - O - -Duselongdouble
> O - O - -Dusemorebits
> O - O - -Duseithreads
> O - O - -Duseithreads -Duse64bitint
> O - O - -Duseithreads -Duselongdouble
> O - O - -Duseithreads -Dusemorebits
> | | | +----- PERLIO = perlio -DDEBUGGING
> | | +------- PERLIO = stdio -DDEBUGGING
> | +--------- PERLIO = perlio
> +----------- PERLIO = stdio
[snip]
This morning I started with an empty directory and a clean install of
Test::Smoke. Using a minimal perlcurrent_config (only one
configuration to test) I got these results:
Show quoted text> Automated smoke report for 5.13.2 patch
6f56ac39f60976727952f47f417ee5d00a7b359d v5.13.2-255-g6f56ac3
Show quoted text> zippy: AMD Athlon(tm) Dual Core Processor 5050e (AuthenticAMD 2614MHz)
(x86_64/2 cpu)
Show quoted text> on linux - 2.6.26-2-amd64 [debian]
> using cc version 4.4.4
> smoketime 17 minutes 24 seconds (average 17 minutes 24 seconds)
>
> Summary: PASS
>
> O = OK F = Failure(s), extended report at the bottom
> X = Failure(s) under TEST but not under harness
> ? = still running or test results not (yet) available
> Build failures during: - = unknown or N/A
> c = Configure, m = make, M = make (after miniperl), t = make test-prep
>
> v5.13.2-255-g6f56ac3 Configuration (common) none
> ----------- ---------------------------------------------------------
> O - - -
> | | | +----- PERLIO = perlio -DDEBUGGING
> | | +------- PERLIO = stdio -DDEBUGGING
> | +--------- PERLIO = perlio
> +----------- PERLIO = stdio
[snip]
Note there is no result for PERLIO = perlio, yet it is reported as a PASS.
The last few lines of perlcurrent.log do show an error (although its
for PERLIO = stdio):
Show quoted text> Tests start here:
> TSTENV = stdio echo >&2 The _test target is deprecated. Please
upgrade your smoker
Show quoted text> The _test target is deprecated. Please upgrade your smoker
> PERL=./perl ./runtests choose
> Having no space between pattern and following word is deprecated at
TEST line 32.
Show quoted text> Bareword found where operator expected at TEST line 32, near "'../cpan"
> (Might be a runaway multi-line // string starting on line 31)
> (Missing operator before an?)
> syntax error at TEST line 32, near "'../cpan"
> Bad name after Tar' at TEST line 32.
> make: *** [_test] Error 255
>
> Error while reading test-results: 2 at /home/bri/smoke.t/Test/Smoke.pm
line 193
Show quoted text>
> TSTENV = perlio echo >&2 The _test target is deprecated. Please
upgrade your smoker
Show quoted text> The _test target is deprecated. Please upgrade your smoker
> PERL=./perl ./runtests choose
> # ## COMPILE TIME ##
> # ## RUN TIME ##
> All tests successful.
> u=5.86 s=1.52 cu=384.06 cs=45.45 scripts=1710 tests=355495
>
> OK, archive results ...
> Finished smoking 6f56ac39f60976727952f47f417ee5d00a7b359d
v5.13.2-255-g6f56ac3
Show quoted text> Reading smokeresult from /home/bri/perl-current/mktest.out
> Processing []
> Processing [-DDEBUGGING]
> Writing report to '/home/bri/perl-current/mktest.rpt':Locally applied
patches from '/home/bri/perl-current/pa$
Show quoted text> Patches:
'uncommitted-changes;SMOKE6f56ac39f60976727952f47f417ee5d00a7b359d'
Show quoted text> Looking for cc messages: 'gcc'
> Reading logfile '/home/bri/smoke.t/smokecurrent.log'
> Pattern(gcc): /(^(?-s:.+?):(?: In function .+?:$|(?: undefined
reference to .+?$)|\d+(?:\:\d+)?: (?:warning:|$
Show quoted text> OK
> Skipping mailrpt
[EOF]
My FreeBSD smoker is seeing the same symptoms (v5.13.2-254-gefdecbb[3]).
I have not been able to replicate these failures manually.
Distro: Test-Smoke-1.43
Perls: 5.10.1 & 5.12.1 on Debian, 5.8.9 on FreeBSD
uname: Linux zippy 2.6.26-2-amd64 #1 SMP Tue Jan 12 22:12:20 UTC 2010
x86_64 GNU/Linux
[1]
http://www.nntp.perl.org/group/perl.daily-build.reports/2010/07/msg83402.html
[2]
http://www.nntp.perl.org/group/perl.daily-build.reports/2010/07/msg83407.html
[3]
http://www.nntp.perl.org/group/perl.daily-build.reports/2010/07/msg83421.html