Bug #103337 for Flickr-API2: Almost no pass reports in 2015

Mon Apr 06 07:50:12 2015 SREZIC [...] cpan.org - Ticket created

Subject:

Almost no pass reports in 2015

See http://matrix.cpantesters.org/?dist=Flickr-API2%202.10;reports=1#sl=7,1 for a datetime-sorted list of cpantesters reports.

Mon Apr 06 20:33:40 2015 TJC [...] cpan.org - Correspondence added

Hi, So a problem here is: The tests still pass for me. So, what changed in the CPAN testing system in late 2014? Looking at a handful of the failures, it seems like the live tests to the Flickr API are failing. Are those likely to be blocked/firewalled by the testing servers? Toby

Mon Apr 06 20:33:40 2015 The RT System itself - Status changed from 'new' to 'open'

Mon Apr 06 20:33:41 2015 TJC [...] cpan.org - Taken

Tue Apr 07 02:51:13 2015 SREZIC [...] cpan.org - Correspondence added

On 2015-04-06 20:33:40, TJC wrote: Show quoted text

> Hi, > So a problem here is: The tests still pass for me. > > So, what changed in the CPAN testing system in late 2014?

There's no "CPAN testing system". Usually these are "normal" system with test output capturing turned on. So it's likely that normal users see the problem, too. Show quoted text

> Looking at a handful of the failures, it seems like the live tests to > the Flickr API are failing. Are those likely to be blocked/firewalled > by the testing servers?

Another idea: problems with certificate verification. I now remember that Flickr::API also has similar problems, and I fixed this by downgrading Mozilla::CA to an older version. Unfortunately in the case of Flickr::API2 it's difficult to tell from the error message, as it just says "500". Maybe more diagnostics here would be helpful. For the Mozilla::CA issue, see https://rt.cpan.org/Ticket/Display.html?id=101908 https://github.com/gisle/mozilla-ca/pull/5

Tue Apr 07 02:57:27 2015 TJC [...] cpan.org - Correspondence added

On Tue Apr 07 02:51:13 2015, SREZIC wrote: Show quoted text

> > Looking at a handful of the failures, it seems like the live tests to > > the Flickr API are failing. Are those likely to be blocked/firewalled > > by the testing servers?

> > Another idea: problems with certificate verification. I now remember > that Flickr::API also has similar problems, and I fixed this by > downgrading Mozilla::CA to an older version. Unfortunately in the case > of Flickr::API2 it's difficult to tell from the error message, as it > just says "500". Maybe more diagnostics here would be helpful. > > For the Mozilla::CA issue, see > > https://rt.cpan.org/Ticket/Display.html?id=101908 > https://github.com/gisle/mozilla-ca/pull/5

Well, snap! I upgraded Mozilla::CA on my machines to the latest version, and now I'm seeing test failures. The release date of Mozilla::CA coincides with when all the failures started happening, too - Dec 2014.

Tue Jul 28 13:05:46 2015 AARONRP [...] cpan.org - Correspondence added

Show quoted text

> The release date of Mozilla::CA coincides with when all the failures > started happening, too - Dec 2014.

I installed the latest version of Mozilla::CA and it failed. I then uninstalled it and installed ABH/Mozilla-CA-20120823.tar.gz and the tests pass. I have no clue whatsoever about what this means or why it worked.