Bug #27388 for Test-Smoke: Anomalous test count problem

Sat Jun 02 09:58:00 2007 jdhedden [...] cpan.org - Ticket created

Since blead change 31262, the threads::shared test file t/waithires.t has only 57 tests: BEGIN { $| = 1; print("1..57\n"); ### Number of tests that will be run ### }; However, the following smoke test report: http://www.nntp.perl.org/group/perl.daily-build.reports/2007/06/msg48143.html erroneously reports the wrong number of tests for t/waithires.t: Failures: (common-args) -Dgccansipedantic [en_US.utf8] -DDEBUGGING -Duseithreads Inconsistent test results (between TEST and harness): ../ext/threads/shared/t/waithires.t.....FAILED--expected test 33, saw test 63 [perlio] -DDEBUGGING -Duseithreads -Dusemorebits ../ext/threads/shared/t/waithires.t.....FAILED 33-45 58-75 This sort of problem can also be seen in these reports: http://www.nntp.perl.org/group/perl.daily-build.reports/2007/05/msg48026.html http://www.nntp.perl.org/group/perl.daily-build.reports/2007/05/msg47955.html http://www.nntp.perl.org/group/perl.daily-build.reports/2007/05/msg47984.html

Sat Jun 02 10:09:08 2007 jdhedden [...] cpan.org - Subject changed from (no value) to 'Anomalous test count problem'

Sat Jun 02 11:36:42 2007 abeltje [...] cpan.org - Taken

Sat Jun 02 11:43:32 2007 abeltje [...] cpan.org - Correspondence added

On Sat Jun 02 09:58:00 2007, JDHEDDEN wrote: Show quoted text

> Since blead change 31262, the threads::shared test file t/waithires.t > has only 57 tests:

[snip] Show quoted text

> http://www.nntp.perl.org/group/perl.daily- > build.reports/2007/06/msg48143.html > erroneously reports the wrong number of tests for t/waithires.t: > > Failures: (common-args) -Dgccansipedantic > [en_US.utf8] -DDEBUGGING -Duseithreads > Inconsistent test results (between TEST and harness): > ../ext/threads/shared/t/waithires.t.....FAILED--expected test 33, > saw test 63

This is the output from t/TEST (as used by 'make test'). Test::Smoke doesn't do any bookkeeping for individual tests it just parses the output of make test and tries to get more information by running "failed" tests with t/harness. Show quoted text

> [perlio] -DDEBUGGING -Duseithreads -Dusemorebits > ../ext/threads/shared/t/waithires.t.....FAILED 33-45 58-75

You will have to ask the individual smoker to check the logfile for that smoke and see if they can come up with more info. For the moment I'm inclined to put this as 'not a bug' in Test::Smoke. If you have the logfile of such a smoke and it clearly shows different messages, please open a new bug with the logfile attached. HTH, -- Abe.

Sat Jun 02 11:43:33 2007 The RT System itself - Status changed from 'new' to 'open'

Sat Jun 02 11:43:34 2007 abeltje [...] cpan.org - Status changed from 'open' to 'rejected'