Bug #40843 for CPAN: Couldn't untar CPAN-1.9301.tar

Tue Nov 11 20:54:42 2008 bitcard [...] gmail.com - Ticket created

Subject:

Couldn't untar CPAN-1.9301.tar

When attempting to do a CPAN upgrade using the following command "/usr/local/bin/perl -MCPAN -e 'install CPAN' " I get the error message "Couldn't untar CPAN-1.9301.tar" What I have been able to prove is the file "authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar" as extracted from the CPAN tar should actually be "CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar.gz" The 'tar' file actually appears to be the valid 'gz', based on signature and checksum. As a work around until the distro is updated it is possible to: - mv CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar.gz - do manual build

Tue Nov 11 21:57:29 2008 ANDK [...] cpan.org - Correspondence added

This is from the "real" CPAN: % ls -l /home/ftp/pub/PAUSE/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar.gz -rw-rw-r-- 1 root root 1965 2008-04-14 07:47:39 /home/ftp/pub/PAUSE/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar.gz % md5sum /home/ftp/pub/PAUSE/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar.gz 706a88c3c6a2b86f4e2034710a768f99 /home/ftp/pub/PAUSE/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar.gz It would be interesting to find out how you got this file as CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar. I have no theory.

Tue Nov 11 21:57:33 2008 The RT System itself - Status changed from 'new' to 'open'

Tue Nov 11 23:10:42 2008 bitcard [...] gmail.com - Correspondence added

Subject:	Re: [rt.cpan.org #40843] Couldn't untar CPAN-1.9301.tar
Date:	Wed, 12 Nov 2008 14:10:30 +1000
To:	bug-CPAN [...] rt.cpan.org
From:	"Mick M" <bitcard [...] gmail.com>

Andreas, I have had this happen on two Solaris boxes over the last couple of days. Solaris 8 running "v5.8.8 built for sun4-solaris" Solaris 10 running "v5.8.7 built for sun4-solaris" The md on the downloaded CPAN is as follows. bash-3.00# /opt/SUNBEmd5/md5-sparc CPAN-1.9301.tar.gz MD5 (CPAN-1.9301.tar.gz) = 291ef4d76121718d6ebad25fcde40395 Please understand I'm not explicitly downloading "CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar.gz" it is being extracted from " CPAN-1.9301.tar.gz". That said I did download it once explicitly to compare against the included file. As far as theory goes - I'm at a loss as well. On Wed, Nov 12, 2008 at 12:57 PM, Andreas Koenig via RT < bug-CPAN@rt.cpan.org> wrote: Show quoted text

> <URL: http://rt.cpan.org/Ticket/Display.html?id=40843 > > > This is from the "real" CPAN: > > % ls -l > > /home/ftp/pub/PAUSE/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar.gz > > -rw-rw-r-- 1 root root 1965 2008-04-14 07:47:39 > > /home/ftp/pub/PAUSE/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar.gz > > > % md5sum > > /home/ftp/pub/PAUSE/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar.gz > > 706a88c3c6a2b86f4e2034710a768f99 > > /home/ftp/pub/PAUSE/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar.gz > > > It would be interesting to find out how you got this file as > CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar. I have no theory. > > >

Tue Nov 18 21:47:00 2008 bitcard [...] gmail.com - Correspondence added

From:

bitcard [...] gmail.com

On Tue Nov 11 23:10:42 2008, mtm2 wrote: I have found and verified the issue - finding the best way forward is up to you. Essentially the core issue is Solaris TAR and GNU Tar handle long filenames and paths differently. Essentially GNU TAR does it in accordance to RFC and Sun does in .... well in accordance to Sun. That said they don't seem to have complete consistency in what they do w.r.t. to man pages etc. One thing is for sure, you will start experiencing issues when the path and filename exceeds 100 characters .... which is what it is in our case. In our case it strips of characters 101-103 '.gz' I have also confirmed the following: Solaris 8 broken when extracting the CPAN tar Solaris 9 broken when extracting the CPAN tar Solaris 10 broken when extracting the CPAN tar Linux ok Perl Archive::Tar ok (in fact this is how I'm currently now doing my deployment - not ideal but it works) Interesting Solaris TAR does provide a little hit ( if I had rigorously read the log of a manual extraction - I might have seen it .... probably not, but did once I had worked out what was wrong it was easy to spot) <cut> ---------- 0/0 104 Jan 1 00:00 1970 ././@LongLink -rw-r--r-- 1000/1000 1965 Apr 24 05:52 2008 CPAN-1.9301/t/CPAN/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar </cut> As far as fixing it I would strongly suggest that no CPAN tar balls should ever have any files with a f.q.p.n. exceeding 100 characters. catcha Mick

Tue Nov 18 22:23:05 2008 andreas.koenig.7os6VVqR [...] franz.ak.mind.de - Correspondence added

Subject:	Re: [rt.cpan.org #40843] Couldn't untar CPAN-1.9301.tar
Date:	Wed, 19 Nov 2008 04:22:52 +0100
To:	bug-CPAN [...] rt.cpan.org
From:	andreas.koenig.7os6VVqR [...] franz.ak.mind.de (Andreas J. Koenig)

Show quoted text

>>>>> On Tue, 18 Nov 2008 21:47:02 -0500, "mtm2 via RT" <bug-CPAN@rt.cpan.org> said:

Show quoted text

> One thing is for sure, you will start experiencing issues when the path > and filename exceeds 100 characters .... which is what it is in our case.

Wow, nice detective work! The fix isn't yet clear to me. The long path results from the fact that I must mimick the original CPAN directory structure, otherwise the CHECKSUMS files will not match, and I cannot create new CHECKSUMS files because they are signed... -- andreas

Tue Nov 18 22:51:26 2008 bitcard [...] gmail.com - Correspondence added

From:

bitcard [...] gmail.com

I have also verified the Sunfreeware version on TAR (which is GNU based) works ok. So that is another option .... that is instead of installing Archive::Tar one can install Sunfreeware Tar and configure cpan tar options to be "/usr/local/bin/tar".

Tue Apr 14 00:50:35 2009 ANDK [...] cpan.org - Correspondence added

Thanks again for the report. This will be fixed in 1.93_53 with a suggestion by MST in ticket #43813: tarball has been renamed to .tgz which shaves off 3 bytes and shortens the path from 103 to 100. Stay tuned:)

Tue Apr 14 00:50:37 2009 ANDK [...] cpan.org - Status changed from 'open' to 'resolved'

Tue May 05 10:15:55 2009 dolmen [...] cpan.org - Ticket #45734: Ticket created

Subject:

Invalid 1.93_53 release

This on HP-UX B.11.23 Show quoted text

> gzip -dc CPAN-1.93_53.tar.gz | tar tvf - | grep -v CPAN

--------- 0/0 102 Jan 1 01:00 1970 ././@LongLink Show quoted text

> cpan ANDK/CPAN-1.93_53.tar.gz

Going to read /home/nagios/CPAN/.cpan/sources/authors/01mailrc.txt.gz CPAN: Compress::Zlib loaded ok (v1.41) ............................................................................DONE Going to read /home/nagios/CPAN/.cpan/sources/modules/02packages.details.txt.gz Database was generated on Tue, 05 May 2009 00:26:59 GMT CPAN: HTTP::Date loaded ok (v1.47) ............................................................................DONE Going to read /home/nagios/CPAN/.cpan/sources/modules/03modlist.data.gz ............................................................................DONE CPAN: Storable loaded ok (v2.15) Going to write /home/nagios/CPAN/.cpan/Metadata CPAN: YAML loaded ok (v0.68) CPAN: CPAN::Kwalify loaded ok (v5.50) Running make for A/AN/ANDK/CPAN-1.93_53.tar.gz [...] x CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Make-CircDepeOne-1.00.tar.gz, 1893 bytes, 4 tape blocks x ././@LongLink, 102 bytes, 1 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.05.tg, 1992 bytes, 4 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/cpantestdummies/CHECKSUMS, 1267 bytes, 3 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-BuildOrMake-1.02.tar.gz, 1773 bytes, 4 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Make-UnsatPrereq-1.00.tar.gz, 1598 bytes, 4 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CHECKSUMS.2nd, 19587 bytes, 39 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Make-CircDepeThree-1.00.tar.gz, 1897 bytes, 4 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Make-Failearly-1.02.tar.gz, 1856 bytes, 4 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Make-Zip-1.03.zip, 4916 bytes, 10 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Make-CircDepeTwo-1.00.tar.gz, 1895 bytes, 4 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/NotInChecksums-0.000.tar.gz, 136 bytes, 1 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CHECKSUMS, 33031 bytes, 65 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/AN/CHECKSUMS, 1614 bytes, 4 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/A/CHECKSUMS, 1246 bytes, 3 tape blocks x CPAN-1.93_53/t/CPAN/authors/id/CHECKSUMS, 18264 bytes, 36 tape blocks x CPAN-1.93_53/t/CPAN/TestConfig.pm, 2470 bytes, 5 tape blocks x CPAN-1.93_53/t/CPAN/TestPatch.txt, 584 bytes, 2 tape blocks x CPAN-1.93_53/t/00signature.t, 1489 bytes, 3 tape blocks x CPAN-1.93_53/t/01loadme.t, 175 bytes, 1 tape blocks x CPAN-1.93_53/t/02nox.t, 1073 bytes, 3 tape blocks x CPAN-1.93_53/t/50pod.t, 152 bytes, 1 tape blocks x CPAN-1.93_53/t/10version.t, 2690 bytes, 6 tape blocks x CPAN-1.93_53/t/41distribution.t, 3884 bytes, 8 tape blocks x CPAN-1.93_53/t/52podcover.t, 1194 bytes, 3 tape blocks x CPAN-1.93_53/t/13tarzip.t, 768 bytes, 2 tape blocks x CPAN-1.93_53/t/12cpan.t, 7392 bytes, 15 tape blocks x CPAN-1.93_53/t/70_critic.t, 526 bytes, 2 tape blocks x CPAN-1.93_53/t/perlcriticrc, 560 bytes, 2 tape blocks x CPAN-1.93_53/t/30shell.coverage, 21300 bytes, 42 tape blocks x CPAN-1.93_53/t/43distroprefspref.t, 1904 bytes, 4 tape blocks x CPAN-1.93_53/t/51pod.t, 1206 bytes, 3 tape blocks x CPAN-1.93_53/SIGNATURE, 37571 bytes, 74 tape blocks CPAN: File::Temp loaded ok (v0.16) Package contains both files[@LongLink] and directories[CPAN-1.93_53]; not recognized as a perl package, giving up Package contains both files[@LongLink] and directories[CPAN-1.93_53]; not recognized as a perl package, giving up, won't make Running make test Make had some problems, won't test Running make install Make had some problems, won't install

Tue May 05 10:22:34 2009 dolmen [...] cpan.org - Ticket #45734: Correspondence added

Le Mar. Mai. 05 10:15:55 2009, DOLMEN a écrit : Show quoted text

> This on HP-UX B.11.23 >

> > gzip -dc CPAN-1.93_53.tar.gz | tar tvf - | grep -v CPAN

> --------- 0/0 102 Jan 1 01:00 1970 ././@LongLink

The content of @LongLink is: CPAN-1.9304/t/CPAN/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.04.tar.gz So I suppose that this is a (GNU?) TAR extension that is not known to the HP-UX TAR. Release 1.9304 has the same problem. However I had not seen it because I installed using an older CPAN which did not the archive content check.

Tue May 05 10:22:35 2009 dolmen [...] cpan.org - Ticket #45734: Status changed from 'new' to 'open'

Tue May 05 14:13:13 2009 ANDK [...] cpan.org - Ticket #45734: Correspondence added

Rats. I suppose this will not be a problem when I release this tarball as 1.94 because then the path will by three bytes shorter again. There are tar implementations that have issues with paths longer than ~100 bytes. I need to make more room free for them so that dev releases fit into the corset. Thanks for the report!

Tue May 12 05:29:36 2009 dolmen [...] cpan.org - Ticket #45734: Correspondence added

Le Mar. Mai. 05 14:13:13 2009, ANDK a écrit : Show quoted text

> There are tar implementations that have issues with paths longer than > ~100 bytes. I need to make more room free for them so that dev releases > fit into the corset.

I'm confirming. It looks like it would be better to avoid file paths longer than 100 characters. This is the case for CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.05.tar.gz Here is an extract of the output of 'gzip -dc CPAN-1.93_53.tar.gz | tar tvf -': rw-r--r-- 1000/1000 1643 Mar 13 17:59 2009 CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Build-DepeFails-1.02.tar.gz rw-r--r-- 1000/1000 2323 Mar 13 17:59 2009 CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Make-Expect-1.00.tar.gz rw-r--r-- 1000/1000 1893 Mar 13 17:59 2009 CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Make-CircDepeOne-1.00.tar.gz rwxr-xr-x 1000/1000 0 May 4 08:05 2009 CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/cpantestdummies/ --------- 0/0 102 Jan 1 01:00 1970 ././@LongLink rw-r--r-- 1000/1000 1992 Apr 14 06:48 2009 CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/cpantestdummies/CPAN-Test-Dummy-Perl5-Make-Features-1.05.tg rw-r--r-- 1000/1000 1267 Apr 14 06:48 2009 CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/cpantestdummies/CHECKSUMS rw-r--r-- 1000/1000 1773 Mar 13 17:59 2009 CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-BuildOrMake-1.02.tar.gz rw-r--r-- 1000/1000 1598 Mar 13 17:59 2009 CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Make-UnsatPrereq-1.00.tar.gz rw-r--r-- 1000/1000 19587 Mar 13 17:59 2009 CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CHECKSUMS.2nd rw-r--r-- 1000/1000 1897 Mar 13 17:59 2009 CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Make-CircDepeThree-1.00.tar.gz rw-r--r-- 1000/1000 1856 Mar 13 17:59 2009 CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Make-Failearly-1.02.tar.gz rw-r--r-- 1000/1000 4916 Mar 13 17:59 2009 CPAN-1.93_53/t/CPAN/authors/id/A/AN/ANDK/CPAN-Test-Dummy-Perl5-Make-Zip-1.03.zip

Tue May 12 05:32:40 2009 dolmen [...] cpan.org - Ticket #45734: Subject changed from 'Invalid 1.93_53 release' to 'Invalid 1.93_53 release : path longer than 100 in archive'

Tue May 12 10:28:14 2009 dolmen [...] cpan.org - Ticket #45734: Merged into ticket #40843

Tue May 12 10:28:14 2009 dolmen [...] cpan.org - Merged into ticket #40843