Bug #39680 for Test-Group: test skipping

Mon Sep 29 06:44:08 2008 CJONES [...] cpan.org - Ticket created

Subject:

test skipping

When using Test::Group's "begin_skipping_tests" function, the most recent version of Test::Harness does not report the number of tests skipped. I've only been able to compare Test::Group v0.07 and v0.14, together with Test::Harness v2.42 and v3.12. Seems that Test::Harness v2.42 did report the number of skipped tests but v3.12 doesn't, independent of the version of Test::Group.

Tue Sep 30 13:07:35 2008 domq [...] google.com - Correspondence added

Subject:	Re: [rt.cpan.org #39680] test skipping
Date:	Tue, 30 Sep 2008 19:07:13 +0200
To:	bug-Test-Group [...] rt.cpan.org
From:	"Dominique Quatravaux" <domq [...] google.com>

Thanks Christopher for your bug report, I'm working on it now. Are you able to provide assistance, for instance a .t file demonstrating the problem with a description of wanted and actual behavior? -- Dominique Quatravaux +41 79 609 40 72

Tue Sep 30 13:07:37 2008 The RT System itself - Status changed from 'new' to 'open'

Tue Sep 30 17:11:48 2008 c.jones [...] ucl.ac.uk - Correspondence added

Subject:	Re: [rt.cpan.org #39680] test skipping
Date:	Tue, 30 Sep 2008 22:11:04 +0100
To:	bug-Test-Group [...] rt.cpan.org
From:	Christopher Jones <c.jones [...] ucl.ac.uk>

Hi Dominique, Sure, I'll dig out an old version from cvs for you. I actually found that with the most recent version of Test::Harness not even Test::More SKIP:{ } blocks would be mentioned in the test report, so I've reverted to using diag() to tell me when tests are skipped. I could be doing something wrong - but if I am its not obvious! Chris On 30 Sep 2008, at 18:07, Dominique Quatravaux via RT wrote: Show quoted text

> <URL: http://rt.cpan.org/Ticket/Display.html?id=39680 > > > Thanks Christopher for your bug report, I'm working on it now. Are you > able to provide assistance, for instance a .t file demonstrating the > problem with a description of wanted and actual behavior? > > -- > Dominique Quatravaux > +41 79 609 40 72 >

----------------------- Gynaecological Research Laboratories, UCL EGA Institute for Women's Health, University College London, Paul O'Gorman Building, 72 Huntley Street, London WC1E 6DD United Kingdom Telephone; 020 3108 2007 Fax; 020 3108 2010

Wed Oct 01 03:04:30 2008 domq [...] google.com - Correspondence added

CC:	undisclosed-recipients [...] google.com
Subject:	Re: [rt.cpan.org #39680] test skipping
Date:	Wed, 1 Oct 2008 09:04:06 +0200
To:	bug-Test-Group [...] rt.cpan.org
From:	"Dominique Quatravaux" <domq [...] google.com>

On Tue, Sep 30, 2008 at 11:11 PM, Christopher Jones via RT <bug-Test-Group@rt.cpan.org> wrote: Show quoted text

> Hi Dominique, > > Sure, I'll dig out an old version from cvs for you.

Thanks! Screenshots or session transcripts "before" (working) and "after" (not working) are also helpful. Show quoted text

> I actually found > that with the most recent version of Test::Harness not even Test::More > SKIP:{ } blocks would be mentioned in the test report,

In this case, the problem might lie in the upstream Test::Harness and Test::Builder modules instead of Test::Group. Send the test case anyway, and we'll figure it out. Cheers, -- Dominique Quatravaux +41 79 609 40 72

Fri Dec 04 21:12:25 2009 NCLEATON [...] cpan.org - Correspondence added

Chris wrote: Show quoted text

> On 25 Nov 2009, at 05:23, Nick Cleaton wrote: >

>> We have an open Test::Group ticket in RT from you from a year ago: >> >> https://rt.cpan.org/Ticket/Display.html?id=39680 >> >> ... which seems to have stalled waiting for your input. Is this >> still >> an issue for you, or should we close the ticket ? >>

> > Sorry for the delay getting back to you. > > With regard to the lack of skip warnings, I have installed the > latest versions of Test::More, Test::Group, Test::Differences and > Test::Harness, and found that this problem still exists for me. I'm > running Perl v5.8.6 on Mac v10.4.11, and v5.8.8 on Mac v10.5.8. > > I identified this problem in the test script for my DBIx::Compare > module. There are a few SKIP blocks in this script with the normal > skip warnings, but none of these are displayed. (If you look at the > script, I inserted diag() statements instead, and these are the > warnings that are displayed - not the skip warnings). > > > I should add, in case it wasn't obvious, that this problem only > occurs when running the test under 'make test'. There's no issue > when running it as a standalone script.

OK, this appears to be a change in behaviour in Test::Harness, somewhere between version 2.64 and version 3.17. The following reduced version of DBIx-Compare-1.7/t/DBIx_Compare.t shows the skip under "make test" with Test::Harness 2.64 but not with Test::Harness 3.17: use strict; use warnings; use Test::More tests=>1; my $to_test = 0; SKIP: { skip("Could not create the test databases", 1) unless ($to_test); ok 0, "foo"; } ... so this is definitely not a Test::Group issue.

Tue Dec 08 12:25:29 2009 NCLEATON [...] cpan.org - Correspondence added

not a test::group issue, closing.

Tue Dec 08 12:25:31 2009 NCLEATON [...] cpan.org - Status changed from 'open' to 'resolved'