Skip Menu |

This queue is for tickets about the OAI-Harvester CPAN distribution.

Report information
The Basics
Id: 68960
Status: resolved
Priority: 0/
Queue: OAI-Harvester

People
Owner: Nobody in particular
Requestors: justincase [...] yopmail.com
Cc:
AdminCc:

Bug Information
Severity: (no value)
Broken in: (no value)
Fixed in: (no value)



Subject: t/003.error.t results in excessive memory usage
When trying to run tests, t/003.error.t consumes 500+MB of memory causing my machine to thrash.
On Mon Jun 20 16:59:12 2011, justincase wrote: Show quoted text
> When trying to run tests, t/003.error.t consumes 500+MB of memory > causing my machine to thrash.
I have no clue what might happen there: Admittedly t/003.error.t loads a page which definitely is not XML and unfortunately has some kind of randomness and is sized about 140kB. Memory usage with this page will depend on the parser but IMHO should not exceed 20 or 30 MB. Can you be more specific with respect to what version of N-O-H you tested and what OS and Perl version? Thanks in advance Thomas Berger
From: justincase [...] yopmail.com
On Mon Jun 20 19:16:39 2011, THB wrote: Show quoted text
> On Mon Jun 20 16:59:12 2011, justincase wrote:
> > When trying to run tests, t/003.error.t consumes 500+MB of memory > > causing my machine to thrash.
> > I have no clue what might happen there: Admittedly t/003.error.t loads a > page which definitely is not XML and unfortunately has some kind of > randomness and is sized about 140kB. Memory usage with this page will > depend on the parser but IMHO should not exceed 20 or 30 MB. > > Can you be more specific with respect to what version of N-O-H you > tested and what OS and Perl version?
$ uname -prsv Darwin 10.8.0 Darwin Kernel Version 10.8.0: Tue Jun 7 16:33:36 PDT 2011; root:xnu-1504.15.3~1/RELEASE_I386 i386 $ perl -Ilib -MNet::OAI::Harvester -E 'say $Net::OAI::Harvester::VERSION' 1.14 $ perl -E 'say $^V' v5.14.1 $ perl -MXML::SAX -MData::Dump=dd -E 'dd(XML::SAX->parsers)' [ { Features => { "http://xml.org/sax/features/namespaces" => 1 }, Name => "XML::SAX::PurePerl", }, { Features => { "http://xml.org/sax/features/namespaces" => 1 }, Name => "XML::LibXML::SAX::Parser", }, { Features => { "http://xml.org/sax/features/namespaces" => 1 }, Name => "XML::LibXML::SAX", }, ] $ perl -MXML::LibXML -E 'say $XML::LibXML::VERSION' 1.75 $ port installed | grep -e libxml2 libxml2 @2.7.8_0 (active) I wonder if this might be related: https://rt.cpan.org/Public/Bug/Display.html?id=60836 After looking at your Makefile.PL I installed XML::SAX::ExpatXS and the test succeeded without incident, so that's further evidence the fault is with XML::LibXML. I would report this upstream, but I think they would prefer a simpler test case (hint, hint ;-)
Show quoted text
> $ perl -Ilib -MNet::OAI::Harvester -E 'say $Net::OAI::Harvester::VERSION' > 1.14 > > $ perl -E 'say $^V' > v5.14.1
[...] Show quoted text
> $ perl -MXML::LibXML -E 'say $XML::LibXML::VERSION' > 1.75 > > $ port installed | grep -e libxml2 > libxml2 @2.7.8_0 (active) > > I wonder if this might be related: > https://rt.cpan.org/Public/Bug/Display.html?id=60836 > > After looking at your Makefile.PL I installed XML::SAX::ExpatXS and the > test succeeded without incident, so that's further evidence the fault is > with XML::LibXML. I would report this upstream, but I think they would > prefer a simpler test case (hint, hint ;-)
There is another report for Perl 5.14.1 and LibXML: http://www.cpantesters.org/cpan/report/890499de-94bf-11e0-a6c7-998c1862f3fa Generally, on other platforms the tests with XML::LibXML::SAX also (always?) complain about this Error::as_string recursion, but do not have the out-of-memory issue: http://www.cpantesters.org/cpan/report/c0467d22-8c59-11e0-bf0c-ff7a4b218b54
From: justincase [...] yopmail.com
On Thu Jun 30 03:34:42 2011, THB wrote: Show quoted text
> > $ perl -Ilib -MNet::OAI::Harvester -E 'say
$Net::OAI::Harvester::VERSION' Show quoted text
> > 1.14 > > > > $ perl -E 'say $^V' > > v5.14.1
> [...]
> > $ perl -MXML::LibXML -E 'say $XML::LibXML::VERSION' > > 1.75 > > > > $ port installed | grep -e libxml2 > > libxml2 @2.7.8_0 (active) > > > > I wonder if this might be related: > > https://rt.cpan.org/Public/Bug/Display.html?id=60836 > > > > After looking at your Makefile.PL I installed XML::SAX::ExpatXS and the > > test succeeded without incident, so that's further evidence the fault is > > with XML::LibXML. I would report this upstream, but I think they would > > prefer a simpler test case (hint, hint ;-)
> > There is another report for Perl 5.14.1 and LibXML: >
http://www.cpantesters.org/cpan/report/890499de-94bf-11e0-a6c7-998c1862f3fa Show quoted text
> > Generally, on other platforms the tests with XML::LibXML::SAX also > (always?) complain about this Error::as_string recursion, but do not > have the out-of-memory issue: > >
http://www.cpantesters.org/cpan/report/c0467d22-8c59-11e0-bf0c-ff7a4b218b54 Show quoted text
>
It's now been officially reported by somebody else: https://rt.cpan.org/Public/Bug/Display.html?id=63449
The mentioned bug #63449 of XML::LibXML has been resolved (1.77?). Closing it here, too.