Skip Menu |

This queue is for tickets about the Text-CSV_XS CPAN distribution.

Report information
The Basics
Id: 89327
Status: rejected
Priority: 0/
Queue: Text-CSV_XS

People
Owner: Nobody in particular
Requestors: sisyphus [...] cpan.org
Cc:
AdminCc:

Bug Information
Severity: (no value)
Broken in: (no value)
Fixed in: (no value)



Subject: Text-CSV_XS-1.01.tgz on CPAN is corrupted
Hi, I can download http://search.cpan.org/CPAN/authors/id/H/HM/HMBRAND/Text-CSV_XS-1.01.tgz but it's not a valid tar archive and can't be extracted. It's actually 10 bytes larger than the Text-CSV_XS-1.01 tarball that's available from backpan. (The backpan version is a valid tar archive and extracts fine.) It's the same problem on both Windows and Ubuntu ... and it's the same problem as I have with Tree-DAG_Node-1.18.tgz which, significantly, is the only other source tarball on CPAN (that I know of) whose filename doesn't terminate with '.tar.gz'. Cheers, Rob
Subject: Re: [rt.cpan.org #89327] Text-CSV_XS-1.01.tgz on CPAN is corrupted
Date: Tue, 8 Oct 2013 11:57:27 +0200
To: bug-Text-CSV_XS [...] rt.cpan.org
From: "H.Merijn Brand" <h.m.brand [...] xs4all.nl>
On Tue, 8 Oct 2013 04:49:12 -0400, "Sisyphus via RT" <bug-Text-CSV_XS@rt.cpan.org> wrote: Show quoted text
> I can download > http://search.cpan.org/CPAN/authors/id/H/HM/HMBRAND/Text-CSV_XS-1.01.tgz > > but it's not a valid tar archive and can't be extracted. It's actually 10 bytes larger than the Text-CSV_XS-1.01 tarball that's available from backpan. (The backpan version is a valid tar archive and extracts fine.) > > It's the same problem on both Windows and Ubuntu ... and it's the same problem as I have with Tree-DAG_Node-1.18.tgz which, significantly, is the only other source tarball on CPAN (that I know of) whose filename doesn't terminate with '.tar.gz'.
I expect that to be a problem in the available version of tar. The .tgz files do have to be created with --format=ustar when using a modern GNU tar. Read http://www.perlmonks.org/?node_id=1004571 for the reasons Using a very old non-GNU tar: $ wget http://search.cpan.org/CPAN/authors/id/H/HM/HMBRAND/Text-CSV_XS-1.01.tgz ... 11:47:22 (803.93 KB/s) - `Text-CSV_XS-1.01.tgz' saved [123288] $ gzip -d <Text-CSV_XS-1.01.tgz | tar tvf - rwxr-xr-x 203/20 0 Jun 17 09:23 2013 Text-CSV_XS-1.01/ rwxr-xr-x 203/20 0 Jun 17 09:23 2013 Text-CSV_XS-1.01/examples/ rwxr-xr-x 203/20 1966 Jan 13 17:14 2013 Text-CSV_XS-1.01/examples/parser-xs.pl rw-r--r-- 203/20 2567 Mar 30 14:08 2013 Text-CSV_XS-1.01/examples/speed.pl rwxr-xr-x 203/20 5846 Jan 13 17:14 2013 Text-CSV_XS-1.01/examples/csv2xls rwxr-xr-x 203/20 3733 Mar 8 12:27 2012 Text-CSV_XS-1.01/examples/csvdiff rwxr-xr-x 203/20 4043 Jan 13 17:14 2013 Text-CSV_XS-1.01/examples/csv-check rw-r--r-- 203/20 23549 Jun 16 20:40 2013 Text-CSV_XS-1.01/ChangeLog rw-r--r-- 203/20 719 Jun 17 09:23 2013 Text-CSV_XS-1.01/META.yml rw-r--r-- 203/20 1788 Jun 17 09:23 2013 Text-CSV_XS-1.01/MANIFEST rw-r--r-- 203/20 180260 May 19 17:46 2013 Text-CSV_XS-1.01/ppport.h rw-r--r-- 203/20 3134 Jan 14 15:04 2013 Text-CSV_XS-1.01/Makefile.PL rw-r--r-- 203/20 44588 Jun 16 20:36 2013 Text-CSV_XS-1.01/CSV_XS.xs rwxr-xr-x 203/20 0 Jun 17 09:23 2013 Text-CSV_XS-1.01/files/ rw-r--r-- 203/20 931 Dec 20 10:24 2008 Text-CSV_XS-1.01/files/macosx.csv rw-r--r-- 203/20 12 Jun 4 12:52 2008 Text-CSV_XS-1.01/files/utf8.csv rw-r--r-- 203/20 1827 Jun 13 13:00 2013 Text-CSV_XS-1.01/README rw-r--r-- 203/20 1459 Jun 17 09:23 2013 Text-CSV_XS-1.01/META.json rwxr-xr-x 203/20 0 Jun 17 09:23 2013 Text-CSV_XS-1.01/t/ rw-r--r-- 203/20 5379 Jun 16 10:36 2012 Text-CSV_XS-1.01/t/46_eol_si.t rw-r--r-- 203/20 4341 Jun 16 19:55 2012 Text-CSV_XS-1.01/t/20_file.t rw-r--r-- 203/20 1925 Jun 14 20:13 2012 Text-CSV_XS-1.01/t/76_magic.t rw-r--r-- 203/20 544 Jun 7 15:08 2012 Text-CSV_XS-1.01/t/81_subclass.t rw-r--r-- 203/20 489 Jun 9 12:39 2007 Text-CSV_XS-1.01/t/util.pl rw-r--r-- 203/20 1705 Jun 7 15:07 2012 Text-CSV_XS-1.01/t/40_misc.t rw-r--r-- 203/20 26345 Jun 13 13:28 2013 Text-CSV_XS-1.01/t/70_rt.t rw-r--r-- 203/20 4929 Dec 3 10:00 2012 Text-CSV_XS-1.01/t/22_scalario.t rw-r--r-- 203/20 4374 Jun 16 19:56 2012 Text-CSV_XS-1.01/t/21_lexicalio.t rw-r--r-- 203/20 2110 Jun 16 20:35 2013 Text-CSV_XS-1.01/t/77_getall.t rw-r--r-- 203/20 6543 Mar 30 15:58 2013 Text-CSV_XS-1.01/t/12_acc.t rw-r--r-- 203/20 175 Jun 7 15:07 2012 Text-CSV_XS-1.01/t/00_pod.t rw-r--r-- 203/20 782 Jun 7 15:08 2012 Text-CSV_XS-1.01/t/60_samples.t rw-r--r-- 203/20 245 Jun 7 15:07 2012 Text-CSV_XS-1.01/t/01_pod.t rw-r--r-- 203/20 4967 Jan 13 17:10 2013 Text-CSV_XS-1.01/t/75_hashref.t rw-r--r-- 203/20 13498 Dec 4 17:56 2012 Text-CSV_XS-1.01/t/65_allow.t rw-r--r-- 203/20 4247 Jun 13 13:28 2013 Text-CSV_XS-1.01/t/50_utf8.t rw-r--r-- 203/20 2022 Jun 16 10:30 2012 Text-CSV_XS-1.01/t/41_null.t rw-r--r-- 203/20 1702 Jun 15 15:57 2012 Text-CSV_XS-1.01/t/30_types.t rw-r--r-- 203/20 4607 Jun 13 16:39 2013 Text-CSV_XS-1.01/t/51_utf8.t rw-r--r-- 203/20 4069 Mar 18 17:52 2013 Text-CSV_XS-1.01/t/10_base.t rw-r--r-- 203/20 2333 Jun 7 15:08 2012 Text-CSV_XS-1.01/t/55_combi.t rw-r--r-- 203/20 5546 Jun 3 13:22 2013 Text-CSV_XS-1.01/t/80_diag.t rw-r--r-- 203/20 7711 Jun 16 10:30 2012 Text-CSV_XS-1.01/t/45_eol.t rw-r--r-- 203/20 10320 Jun 7 15:07 2012 Text-CSV_XS-1.01/t/15_flags.t rw-r--r-- 203/20 59064 Jun 13 20:08 2013 Text-CSV_XS-1.01/CSV_XS.pm $ what `path tar` /usr/bin/tar: $Revision: 78.5.1.6 $ PATCH_10_20: tar.o 98/05/19 $ Using perl-5.16.2 + Archive::Tar-1.92 (output of modules used traced with Devel::TraceUse added below): $ ptar -tvf Text-CSV_XS-1.01.tgz Text-CSV_XS-1.01/ Text-CSV_XS-1.01/examples/ Text-CSV_XS-1.01/examples/parser-xs.pl Text-CSV_XS-1.01/examples/speed.pl Text-CSV_XS-1.01/examples/csv2xls Text-CSV_XS-1.01/examples/csvdiff Text-CSV_XS-1.01/examples/csv-check Text-CSV_XS-1.01/ChangeLog Text-CSV_XS-1.01/META.yml Text-CSV_XS-1.01/MANIFEST Text-CSV_XS-1.01/ppport.h Text-CSV_XS-1.01/Makefile.PL Text-CSV_XS-1.01/CSV_XS.xs Text-CSV_XS-1.01/files/ Text-CSV_XS-1.01/files/macosx.csv Text-CSV_XS-1.01/files/utf8.csv Text-CSV_XS-1.01/README Text-CSV_XS-1.01/META.json Text-CSV_XS-1.01/t/ Text-CSV_XS-1.01/t/46_eol_si.t Text-CSV_XS-1.01/t/20_file.t Text-CSV_XS-1.01/t/76_magic.t Text-CSV_XS-1.01/t/81_subclass.t Text-CSV_XS-1.01/t/util.pl Text-CSV_XS-1.01/t/40_misc.t Text-CSV_XS-1.01/t/70_rt.t Text-CSV_XS-1.01/t/22_scalario.t Text-CSV_XS-1.01/t/21_lexicalio.t Text-CSV_XS-1.01/t/77_getall.t Text-CSV_XS-1.01/t/12_acc.t Text-CSV_XS-1.01/t/00_pod.t Text-CSV_XS-1.01/t/60_samples.t Text-CSV_XS-1.01/t/01_pod.t Text-CSV_XS-1.01/t/75_hashref.t Text-CSV_XS-1.01/t/65_allow.t Text-CSV_XS-1.01/t/50_utf8.t Text-CSV_XS-1.01/t/41_null.t Text-CSV_XS-1.01/t/30_types.t Text-CSV_XS-1.01/t/51_utf8.t Text-CSV_XS-1.01/t/10_base.t Text-CSV_XS-1.01/t/55_combi.t Text-CSV_XS-1.01/t/80_diag.t Text-CSV_XS-1.01/t/45_eol.t Text-CSV_XS-1.01/t/15_flags.t Text-CSV_XS-1.01/CSV_XS.pm Modules used: Archive::Tar 1.92 Archive::Tar::Constant 1.92 Archive::Tar::File 1.92 AutoLoader 5.73 bytes 1.04 Carp 1.32 Compress::Raw::Bzip2 2.062 Compress::Raw::Zlib 2.062 Compress::Zlib 2.062 Config Config_git.pl Config_heavy.pl constant 1.27 Cwd 3.40 Data::Dumper 2.145 Exporter 5.68 Exporter::Heavy 5.68 Fcntl 1.11 feature 1.27 File::Basename 2.84 File::Find 1.20 File::Glob 1.17 File::GlobMapper 1.000 File::Path 2.09 File::Spec 3.40 File::Spec::Unix 3.40 Getopt::Std 1.07 IO 1.25_06 IO::Compress::Adapter::Bzip2 2.062 IO::Compress::Adapter::Deflate 2.062 IO::Compress::Base 2.062 IO::Compress::Base::Common 2.062 IO::Compress::Bzip2 2.062 IO::Compress::Gzip 2.062 IO::Compress::Gzip::Constants 2.062 IO::Compress::RawDeflate 2.062 IO::Compress::Zlib::Extra 2.062 IO::File 1.16 IO::Handle 1.33 IO::Seekable 1.1 IO::String 1.08 IO::Uncompress::Adapter::Bunzip2 2.062 IO::Uncompress::Adapter::Inflate 2.062 IO::Uncompress::Base 2.062 IO::Uncompress::Bunzip2 2.062 IO::Uncompress::Gunzip 2.062 IO::Uncompress::RawInflate 2.062 IO::Zlib 1.10 List::Util 1.32 overload 1.18 overloading 0.02 Package::Constants 0.02 Scalar::Util 1.32 SelectSaver 1.02 strict 1.07 Symbol 1.07 Tie::Handle 4.2 Tie::StdHandle 4.2 utf8 1.09 vars 1.02 warnings 1.13 warnings::register 1.02 XSLoader 0.16 I am closing this as not-a-bug: upgrade your tar or use ptar from Archive tar. I bet that if you go looking, there will be *a lot* of archives that you cannot use in your environment. -- H.Merijn Brand http://tux.nl Perl Monger http://amsterdam.pm.org/ using perl5.00307 .. 5.19 porting perl5 on HP-UX, AIX, and openSUSE http://mirrors.develooper.com/hpux/ http://www.test-smoke.org/ http://qa.perl.org http://www.goldmark.org/jeff/stupid-disclaimers/
Windows 7 Pro + Strawberry-perl 5.12.1 + Archive::Tar 1.84: S:\Tmp>ptar tvf Text-CSV_XS-1.01.tgz Text-CSV_XS-1.01/ Text-CSV_XS-1.01/examples/ Text-CSV_XS-1.01/examples/parser-xs.pl Text-CSV_XS-1.01/examples/speed.pl Text-CSV_XS-1.01/examples/csv2xls Text-CSV_XS-1.01/examples/csvdiff
Subject: Re: [rt.cpan.org #89327] Text-CSV_XS-1.01.tgz on CPAN is corrupted
Date: Wed, 9 Oct 2013 22:41:45 +1100
To: <bug-Text-CSV_XS [...] rt.cpan.org>
From: <sisyphus1 [...] optusnet.com.au>
Show quoted text
-----Original Message----- From: h.m.brand@xs4all.nl via RT
> I expect that to be a problem in the available version of tar. The .tgz > files do have to be created with --format=ustar when using a modern GNU > tar.
So this problem does apply *only* to .tgz files ? If so - no drama; I now know I just have to go to backpan if I want to get a usable source distro of a '.tgz' CPAN source tarball. (I think that the metacpan source might also be usable with the old GNU tar installations that I have ... I haven't properly tested that hypothesis ... don't even know what "metacpan" is :-) Just checked that a module I uploaded to CPAN a few days ago (a '.tar.gz' file) does not suffer from this abomination ... and, thankfully, it doesn't. Cheers, Rob
Subject: Re: [rt.cpan.org #89327] Text-CSV_XS-1.01.tgz on CPAN is corrupted
Date: Wed, 9 Oct 2013 14:08:00 +0200
To: bug-Text-CSV_XS [...] rt.cpan.org
From: "H.Merijn Brand" <h.m.brand [...] xs4all.nl>
On Wed, 9 Oct 2013 07:42:43 -0400, "sisyphus1@optusnet.com.au via RT" <bug-Text-CSV_XS@rt.cpan.org> wrote: Show quoted text
> > I expect that to be a problem in the available version of tar. The .tgz > > files do have to be created with --format=ustar when using a modern GNU > > tar.
> > So this problem does apply *only* to .tgz files ?
No, to all files created with a GNU tar that has a different default format than older tar versions. FWIW GNU-tar-1.27' NEWS file does not mention any change in this regard at all. I consider the change a tar bug. Archive format selection: -H, --format=FORMAT create archive of the given format FORMAT is one of the following: gnu GNU tar 1.13.x format oldgnu GNU format as per tar <= 1.12 pax POSIX 1003.1-2001 (pax) format posix same as pax ustar POSIX 1003.1-1988 (ustar) format v7 old V7 tar format The manual pages of GNU tar do NOT mention anywhere what the default is :( Show quoted text
> If so - no drama; I now know I just have to go to backpan if I want to get a > usable source distro of a '.tgz' CPAN source tarball. (I think that the > metacpan source might also be usable with the old GNU tar installations that > I have ... I haven't properly tested that hypothesis ... don't even know > what "metacpan" is :-) > > Just checked that a module I uploaded to CPAN a few days ago (a '.tar.gz' > file) does not suffer from this abomination ... and, thankfully, it doesn't.
What tar did you use to create it? On what OS? Show quoted text
> Cheers, > Rob
-- H.Merijn Brand http://tux.nl Perl Monger http://amsterdam.pm.org/ using perl5.00307 .. 5.19 porting perl5 on HP-UX, AIX, and openSUSE http://mirrors.develooper.com/hpux/ http://www.test-smoke.org/ http://qa.perl.org http://www.goldmark.org/jeff/stupid-disclaimers/
Subject: Re: [rt.cpan.org #89327] Text-CSV_XS-1.01.tgz on CPAN is corrupted
Date: Thu, 10 Oct 2013 00:30:18 +1100
To: <bug-Text-CSV_XS [...] rt.cpan.org>, <sisyphus [...] cpan.org>
From: <sisyphus1 [...] optusnet.com.au>
Show quoted text
-----Original Message----- From: h.m.brand@xs4all.nl via RT
>> Just checked that a module I uploaded to CPAN a few days ago (a '.tar.gz' >> file) does not suffer from this abomination ... and, thankfully, it >> doesn't.
> What tar did you use to create it? On what OS?
############################## C:\sisyphusion>tar --version tar (GNU tar) 1.23 Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>. This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Written by John Gilmore and Jay Fenlason. ############################## That's on MS windows. Would a more recent version of tar perhaps have produced the anomaly ? (If so, I'll be sure to not update :-) I mean ........... the thing I find unpalatable is that: http://search.cpan.org/CPAN/authors/id/H/HM/HMBRAND/Text-CSV_XS-1.01.tgz and http://backpan.perl.org/authors/id/H/HM/HMBRAND/Text-CSV_XS-1.01.tgz are different files. (By my reckoning, their sizes differ by 10 bytes for a start.) IMO they should be identical ... or did you somehow upload 2 different files ? (BTW, I currently agree that this is *not* a Text-CSV_XS-1.01 bug.) Cheers, Rob
Subject: Re: [rt.cpan.org #89327] Text-CSV_XS-1.01.tgz on CPAN is corrupted
Date: Wed, 9 Oct 2013 16:33:13 +0200
To: bug-Text-CSV_XS [...] rt.cpan.org
From: "H.Merijn Brand" <h.m.brand [...] xs4all.nl>
On Wed, 9 Oct 2013 09:31:28 -0400, "sisyphus1@optusnet.com.au via RT" <bug-Text-CSV_XS@rt.cpan.org> wrote: Show quoted text
> > What tar did you use to create it? On what OS?
… tar version info snipped … Show quoted text
> That's on MS windows. > > Would a more recent version of tar perhaps have produced the anomaly ? (If > so, I'll be sure to not update :-)
It proves not to be tar that is to blame, but more likely the way you got the file. Show quoted text
> I mean ........... the thing I find unpalatable is that: > > http://search.cpan.org/CPAN/authors/id/H/HM/HMBRAND/Text-CSV_XS-1.01.tgz > and > http://backpan.perl.org/authors/id/H/HM/HMBRAND/Text-CSV_XS-1.01.tgz > > are different files. (By my reckoning, their sizes differ by 10 bytes for a > start.) > IMO they should be identical ... or did you somehow upload 2 different files > ?
They ought to be identical, and when I fetch with wget, they *are* identical. Mithaldu (irc.perl.org/6667#toolchain) did some tests for me on Windows. See http://www.perlmonks.org/?node_id=1057556 for where things might go wrong Show quoted text
> (BTW, I currently agree that this is *not* a Text-CSV_XS-1.01 bug.)
Thank you -- H.Merijn Brand http://tux.nl Perl Monger http://amsterdam.pm.org/ using perl5.00307 .. 5.19 porting perl5 on HP-UX, AIX, and openSUSE http://mirrors.develooper.com/hpux/ http://www.test-smoke.org/ http://qa.perl.org http://www.goldmark.org/jeff/stupid-disclaimers/
Subject: Re: [rt.cpan.org #89327] Text-CSV_XS-1.01.tgz on CPAN is corrupted
Date: Thu, 10 Oct 2013 14:20:28 +1100
To: <bug-Text-CSV_XS [...] rt.cpan.org>, <sisyphus [...] cpan.org>
From: <sisyphus1 [...] optusnet.com.au>
Show quoted text
-----Original Message----- From: h.m.brand@xs4all.nl via RT
> They ought to be identical, and when I fetch with wget, they *are* > identical. Mithaldu (irc.perl.org/6667#toolchain) did some tests for me > on Windows. See http://www.perlmonks.org/?node_id=1057556 for where > things might go wrong
Ah ! ... that's the post I needed to read. So it's a bug in the web browser, not in tar. Those browsers should be making an exact copy of the file that's being downloaded - not rewriting it !! And it's not just Windows where this problem arises - my IceWeasel on Debian wheezy and my Firefox on Ubuntu-12.04LTS commit the very same sin. (I did wonder whether a browser might do such a thing but, with 3 different browsers doing the same thing on 3 different systems on 3 different processors, I thought "nah ".) I'll reply to that 1057556 perlmonks post and add those 2 browsers to mithaldu's list. Cheers, Rob