Bug #120692 for Async-Simple-Pool: Random test failures

Wed Mar 22 14:56:22 2017 SREZIC [...] cpan.org - Ticket created

Subject:

Random test failures

On my smoker systems I observe random passes and fails. For example: # Failed test 'async done work time = 0.23 sec' # at t/06-pool.t line 226. # Failed test 'run: do not wait anything, just run the jobs' # at t/06-pool.t line 235. # got: '18' # expected: '10' # Failed test 'async done work time = 0.52 sec' # at t/06-pool.t line 238. # Looks like you failed 3 tests of 65. t/06-pool.t .......... Dubious, test returned 3 (wstat 768, 0x300) Failed 3/65 subtests Another different one: t/05-task-fork.t (Wstat: 0 Tests: 21 Failed: 1) Failed test: 20 Parse errors: Tests out of sequence. Found (2) but expected (3) Tests out of sequence. Found (3) but expected (4) Tests out of sequence. Found (4) but expected (5) Tests out of sequence. Found (5) but expected (6) Tests out of sequence. Found (6) but expected (7)

Wed Mar 22 15:12:56 2017 SREZIC [...] cpan.org - Correspondence added

On 2017-03-22 14:56:22, SREZIC wrote: Show quoted text

> On my smoker systems I observe random passes and fails. > > For example: > > # Failed test 'async done work time = 0.23 sec' > # at t/06-pool.t line 226. > > # Failed test 'run: do not wait anything, just run the jobs' > # at t/06-pool.t line 235. > # got: '18' > # expected: '10' > > # Failed test 'async done work time = 0.52 sec' > # at t/06-pool.t line 238. > # Looks like you failed 3 tests of 65. > t/06-pool.t .......... > Dubious, test returned 3 (wstat 768, 0x300) > Failed 3/65 subtests > > > Another different one: > > t/05-task-fork.t (Wstat: 0 Tests: 21 Failed: 1) > Failed test: 20 > Parse errors: Tests out of sequence. Found (2) but expected (3) > Tests out of sequence. Found (3) but expected (4) > Tests out of sequence. Found (4) but expected (5) > Tests out of sequence. Found (5) but expected (6) > Tests out of sequence. Found (6) but expected (7)

Also, I observe hanging tests on some smokers.

Fri Mar 24 05:19:07 2017 ANTONC [...] cpan.org - Correspondence added

Срд Мар 22 15:12:56 2017, SREZIC писал: Show quoted text

> On 2017-03-22 14:56:22, SREZIC wrote:

> > On my smoker systems I observe random passes and fails. > > > > For example: > > > > # Failed test 'async done work time = 0.23 sec' > > # at t/06-pool.t line 226. > > > > # Failed test 'run: do not wait anything, just run the jobs' > > # at t/06-pool.t line 235. > > # got: '18' > > # expected: '10' > > > > # Failed test 'async done work time = 0.52 sec' > > # at t/06-pool.t line 238. > > # Looks like you failed 3 tests of 65. > > t/06-pool.t .......... > > Dubious, test returned 3 (wstat 768, 0x300) > > Failed 3/65 subtests > > > > > > Another different one: > > > > t/05-task-fork.t (Wstat: 0 Tests: 21 Failed: 1) > > Failed test: 20 > > Parse errors: Tests out of sequence. Found (2) but expected (3) > > Tests out of sequence. Found (3) but expected (4) > > Tests out of sequence. Found (4) but expected (5) > > Tests out of sequence. Found (5) but expected (6) > > Tests out of sequence. Found (6) but expected (7)

> > > Also, I observe hanging tests on some smokers.

Thank you for reporting! I think, that random fails are fixed in version 0.04. The problem of hanging tests is still under investigation. It is not reproduced on by system, so it takes some time to find out the reason.

Fri Mar 24 05:19:07 2017 The RT System itself - Status changed from 'new' to 'open'

Sat Mar 25 18:15:45 2017 SREZIC [...] cpan.org - Broken in 0.04 added

Sun Mar 26 01:48:08 2017 SREZIC [...] cpan.org - Broken in 0.05 added

Sun Mar 26 05:34:19 2017 ANTONC [...] cpan.org - Correspondence added

Срд Мар 22 15:12:56 2017, SREZIC писал: Show quoted text

> On 2017-03-22 14:56:22, SREZIC wrote:

> > On my smoker systems I observe random passes and fails. > > > > For example: > > > > # Failed test 'async done work time = 0.23 sec' > > # at t/06-pool.t line 226. > > > > # Failed test 'run: do not wait anything, just run the jobs' > > # at t/06-pool.t line 235. > > # got: '18' > > # expected: '10' > > > > # Failed test 'async done work time = 0.52 sec' > > # at t/06-pool.t line 238. > > # Looks like you failed 3 tests of 65. > > t/06-pool.t .......... > > Dubious, test returned 3 (wstat 768, 0x300) > > Failed 3/65 subtests > > > > > > Another different one: > > > > t/05-task-fork.t (Wstat: 0 Tests: 21 Failed: 1) > > Failed test: 20 > > Parse errors: Tests out of sequence. Found (2) but expected (3) > > Tests out of sequence. Found (3) but expected (4) > > Tests out of sequence. Found (4) but expected (5) > > Tests out of sequence. Found (5) but expected (6) > > Tests out of sequence. Found (6) but expected (7)

> > > Also, I observe hanging tests on some smokers.

I guess that hangs on was on the Windows only, and have disabled Windows in version 0.05. If you still see failues, please provide me more information about this. Thanks!

Fri Apr 21 03:24:41 2017 SREZIC [...] cpan.org - Correspondence added

On 2017-03-26 05:34:19, ANTONC wrote: Show quoted text

> Срд Мар 22 15:12:56 2017, SREZIC писал:

> > On 2017-03-22 14:56:22, SREZIC wrote:

> > > On my smoker systems I observe random passes and fails. > > > > > > For example: > > > > > > # Failed test 'async done work time = 0.23 sec' > > > # at t/06-pool.t line 226. > > > > > > # Failed test 'run: do not wait anything, just run the jobs' > > > # at t/06-pool.t line 235. > > > # got: '18' > > > # expected: '10' > > > > > > # Failed test 'async done work time = 0.52 sec' > > > # at t/06-pool.t line 238. > > > # Looks like you failed 3 tests of 65. > > > t/06-pool.t .......... > > > Dubious, test returned 3 (wstat 768, 0x300) > > > Failed 3/65 subtests > > > > > > > > > Another different one: > > > > > > t/05-task-fork.t (Wstat: 0 Tests: 21 Failed: 1) > > > Failed test: 20 > > > Parse errors: Tests out of sequence. Found (2) but expected (3) > > > Tests out of sequence. Found (3) but expected (4) > > > Tests out of sequence. Found (4) but expected (5) > > > Tests out of sequence. Found (5) but expected (6) > > > Tests out of sequence. Found (6) but expected (7)

> > > > > > Also, I observe hanging tests on some smokers.

> > I guess that hangs on was on the Windows only, and have disabled > Windows in version 0.05. > If you still see failues, please provide me more information about > this.

Yes, I see still failures. A fresh one on a CentOS7 system: ... t/05-task-fork.t ..... All 20 subtests passed ... Test Summary Report ------------------- t/05-task-fork.t (Wstat: 0 Tests: 30 Failed: 10) Failed tests: 11-20 Parse errors: Tests out of sequence. Found (2) but expected (12) Tests out of sequence. Found (3) but expected (13) Tests out of sequence. Found (4) but expected (14) Tests out of sequence. Found (5) but expected (15) Tests out of sequence. Found (6) but expected (16) ...

Fri Jun 23 06:09:59 2017 ANTONC [...] cpan.org - Correspondence added

Птн Апр 21 03:24:41 2017, SREZIC писал: Show quoted text

> On 2017-03-26 05:34:19, ANTONC wrote:

> > Срд Мар 22 15:12:56 2017, SREZIC писал:

> > > On 2017-03-22 14:56:22, SREZIC wrote:

> > > > On my smoker systems I observe random passes and fails. > > > > > > > > For example: > > > > > > > > # Failed test 'async done work time = 0.23 sec' > > > > # at t/06-pool.t line 226. > > > > > > > > # Failed test 'run: do not wait anything, just run the jobs' > > > > # at t/06-pool.t line 235. > > > > # got: '18' > > > > # expected: '10' > > > > > > > > # Failed test 'async done work time = 0.52 sec' > > > > # at t/06-pool.t line 238. > > > > # Looks like you failed 3 tests of 65. > > > > t/06-pool.t .......... > > > > Dubious, test returned 3 (wstat 768, 0x300) > > > > Failed 3/65 subtests > > > > > > > > > > > > Another different one: > > > > > > > > t/05-task-fork.t (Wstat: 0 Tests: 21 Failed: 1) > > > > Failed test: 20 > > > > Parse errors: Tests out of sequence. Found (2) but expected (3) > > > > Tests out of sequence. Found (3) but expected (4) > > > > Tests out of sequence. Found (4) but expected (5) > > > > Tests out of sequence. Found (5) but expected (6) > > > > Tests out of sequence. Found (6) but expected (7)

> > > > > > > > > Also, I observe hanging tests on some smokers.

> > > > I guess that hangs on was on the Windows only, and have disabled > > Windows in version 0.05. > > If you still see failues, please provide me more information about > > this.

> > Yes, I see still failures. A fresh one on a CentOS7 system: > > ... > t/05-task-fork.t ..... > All 20 subtests passed > ... > Test Summary Report > ------------------- > t/05-task-fork.t (Wstat: 0 Tests: 30 Failed: 10) > Failed tests: 11-20 > Parse errors: Tests out of sequence. Found (2) but expected (12) > Tests out of sequence. Found (3) but expected (13) > Tests out of sequence. Found (4) but expected (14) > Tests out of sequence. Found (5) but expected (15) > Tests out of sequence. Found (6) but expected (16) > ...

Thank's for reporting. Issue has been fixed since 0.07

Fri Jun 23 06:10:04 2017 ANTONC [...] cpan.org - Status changed from 'open' to 'resolved'

Fri Jun 23 06:10:14 2017 ANTONC [...] cpan.org - Taken

Fri Jun 23 06:10:15 2017 ANTONC [...] cpan.org - Fixed in 0.07 added