Bug #67900 for BackPAN-Index: BackPAN::Index fails tests due to OOM building the database

Mon May 02 13:07:58 2011 chm [...] cpan.org - Ticket created

Subject:

BackPAN::Index fails tests due to OOM building the database

This is with cygwin/XP perl. I recently tried to build BackPAN::Index via
the cpan shell in order to find some modules on backpan.

I was unable to complete the build and install because the cygwin
process ran out of memory in the "download database and build the index"
stage. Cygwin processes can run out of memory quickly due to the
constraints of the how MSWin32 system.

If the build index/database were done out of memory, I believe it would
have completed successfully.

Mon May 09 20:42:04 2011 schwern [...] pobox.com - Correspondence added

Subject:	Re: [rt.cpan.org #67900] BackPAN::Index fails tests due to OOM building the database
Date:	Tue, 10 May 2011 10:41:50 +1000
To:	bug-BackPAN-Index [...] rt.cpan.org
From:	Michael G Schwern <schwern [...] pobox.com>

On 2011.5.3 3:07 AM, Chris Marshall via RT wrote: Show quoted text

> This is with cygwin/XP perl. I recently tried to build BackPAN::Index via > the cpan shell in order to find some modules on backpan. > > I was unable to complete the build and install because the cygwin > process ran out of memory in the "download database and build the index" > stage. Cygwin processes can run out of memory quickly due to the > constraints of the how MSWin32 system. > > If the build index/database were done out of memory, I believe it would > have completed successfully.

That's odd. There's nothing obvious that should be consuming memory. The database is all in SQLite and BackPAN::Index doesn't slurp everything into memory that I can see. Though I have had problems running it on Dreamhost. Could be SQLite doing something naff. Setup is a bit of a pig and could use some love if you're offering. -- 3. Not allowed to threaten anyone with black magic. -- The 213 Things Skippy Is No Longer Allowed To Do In The U.S. Army http://skippyslist.com/list/

Mon May 09 20:42:06 2011 The RT System itself - Status changed from 'new' to 'open'

Sat May 14 14:59:57 2011 chm [...] alum.mit.edu - Correspondence added

CC:	chm [...] cpan.org
Subject:	Re: [rt.cpan.org #67900] BackPAN::Index fails tests due to OOM building the database
Date:	Sat, 14 May 2011 14:59:46 -0400
To:	bug-BackPAN-Index [...] rt.cpan.org
From:	Chris Marshall <chm [...] alum.mit.edu>

On 5/9/2011 8:42 PM, Michael G Schwern via RT wrote: Show quoted text

> <URL: http://rt.cpan.org/Ticket/Display.html?id=67900> > > On 2011.5.3 3:07 AM, Chris Marshall via RT wrote:

>> This is with cygwin/XP perl. I recently tried to build BackPAN::Index via >> the cpan shell in order to find some modules on backpan. >> >> I was unable to complete the build and install because the cygwin >> process ran out of memory in the "download database and build the index" >> stage. Cygwin processes can run out of memory quickly due to the >> constraints of the how MSWin32 system. >> >> If the build index/database were done out of memory, I believe it would >> have completed successfully.

> > That's odd. There's nothing obvious that should be consuming memory. The > database is all in SQLite and BackPAN::Index doesn't slurp everything into > memory that I can see. Though I have had problems running it on Dreamhost. > Could be SQLite doing something naff.

Maybe the issues is one with SQLite on cygwin. I'll keep that in mind the next chance I get to look at the BackPAN::Index build again. Show quoted text

> Setup is a bit of a pig and could use some love if you're offering.

Its on the queue. I'm not sure when a round tuit will be delivered. --Chris

Mon Dec 31 12:54:27 2012 mschwern [...] cpan.org - Correspondence added

Ping? Has this been resolved?

Mon Dec 31 12:54:47 2012 mschwern [...] cpan.org - Status changed from 'open' to 'stalled'

Mon Dec 31 16:51:41 2012 devel.chm.01 [...] gmail.com - Correspondence added

Subject:	Re: [rt.cpan.org #67900] BackPAN::Index fails tests due to OOM building the database
Date:	Mon, 31 Dec 2012 16:51:31 -0500
To:	bug-BackPAN-Index [...] rt.cpan.org
From:	Chris Marshall <devel.chm.01 [...] gmail.com>

BackPAN-Index-0.42.tar.gz builds, tests, and installs on win7+cygwin. Thanks for following up. --Chris On Mon, Dec 31, 2012 at 12:54 PM, Michael G Schwern via RT <bug-BackPAN-Index@rt.cpan.org> wrote: Show quoted text

> <URL: https://rt.cpan.org/Ticket/Display.html?id=67900 > > > Ping? Has this been resolved? >

Mon Dec 31 16:51:42 2012 The RT System itself - Status changed from 'stalled' to 'open'

Wed Oct 16 09:34:00 2013 SREZIC [...] cpan.org - Correspondence added

On 2012-12-31 12:54:27, MSCHWERN wrote: Show quoted text

> Ping? Has this been resolved?

Sometimes I see a similar problem on a FreeBSD system with memory limit set to 500MB (which should usually be sufficient). More information (and maybe even patches) will come later. Regards, Slaven

Mon Nov 10 19:24:52 2014 mschwern [...] cpan.org - Correspondence added

Been a year, calling it done. Please report a problem on Github if you're still running out of memory.
https://github.com/book/BackPAN-Index/issues

Mon Nov 10 19:24:53 2014 mschwern [...] cpan.org - Status changed from 'open' to 'resolved'