Bug #125893 for Math-Pari: The automatic downloading of pari tarball *always* fails as of now.

Fri Jul 20 02:58:40 2018 GUGOD [...] cpan.org - Ticket created

Subject:

The automatic downloading of pari tarball *always* fails as of now.

It appears to me that the ftp site of pari has be altered recently (a day or two before this comment) and the "OLD" directory is moved one level up. From `cpanm --verbose Math::Pari`, I can see that the installer is doing some discovering of tgz files from: ftp://megrez.math.u-bordeaux.fr/pub/pari/unix/OLD/2.3/ Which is actully now located at: ftp://megrez.math.u-bordeaux.fr/pub/pari/OLD/2.3/ For this reason, that cpanm command always fails.

Fri Jul 20 03:42:53 2018 GUGOD [...] cpan.org - Correspondence added

Attached a quick fix that can make it download pari-2.1.7.tgz

Subject:

pari-url.patch

diff --git a/utils/Math/PariBuild.pm b/utils/Math/PariBuild.pm index da269a9..fc09e87 100644 --- a/utils/Math/PariBuild.pm +++ b/utils/Math/PariBuild.pm @@ -309,7 +309,7 @@ sub finish_download_pari ($$$$;$) { sub download_pari { my ($srcfile, $force) = (shift, shift); my $host = 'megrez.math.u-bordeaux.fr'; - my $dir = '/pub/pari/unix/'; + my $dir = '/pub/pari/'; my($ftp, $ua, $base_url); print "Did not find GP/PARI build directory around.\n" unless defined $srcfile;

Sat Jul 21 19:50:58 2018 nospam-abuse [...] ilyaz.org - Correspondence added

CC:	;
Subject:	Re: [rt.cpan.org #125893] The automatic downloading of pari tarball always fails as of now.
Date:	Sat, 21 Jul 2018 16:50:42 -0700
To:	Kang-min Liu via RT <bug-Math-Pari [...] rt.cpan.org>
From:	Ilya Zakharevich <nospam-abuse [...] ilyaz.org>

On Fri, Jul 20, 2018 at 03:42:53AM -0400, Kang-min Liu via RT wrote: Show quoted text

> Queue: Math-Pari > Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=125893 > > > Attached a quick fix that can make it download pari-2.1.7.tgz

Sorry, I do not know when I will be able to allocate a time slot for this. In the previous years, the PARI/GP team would agree to make symlinks to fix such problems… Yours, Ilya

Sat Jul 21 19:50:59 2018 The RT System itself - Status changed from 'new' to 'open'

Mon Aug 06 12:18:55 2018 jonasbn [...] cpan.org - Correspondence added

On Sat Jul 21 19:50:58 2018, nospam-abuse@ilyaz.org wrote: Show quoted text

> On Fri, Jul 20, 2018 at 03:42:53AM -0400, Kang-min Liu via RT wrote:

> > Queue: Math-Pari > > Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=125893 > > > > > Attached a quick fix that can make it download pari-2.1.7.tgz

> > Sorry, I do not know when I will be able to allocate a time slot for > this. In the previous years, the PARI/GP team would agree to make > symlinks to fix such problems… > > Yours, > Ilya

The OLD folder is not longer located in /pub/pari/unix but in /pub/pari I have made a patch: ──────────────────────────────────────────────────────────────────────────────────────────────────────────────── modified: utils/Math/PariBuild.pm ──────────────────────────────────────────────────────────────────────────────────────────────────────────────── @ PariBuild.pm:197 @ sub ll_ftp () { # All Perl download failures I saw are on Linux and BSD. open OF, '> ftp-cmd' or die "Can't open `ftp-cmd' for write: $!"; print OF <<'EOF'; # XXXX Hardwired version! user anonymous auto-download-Math-Pari@cpan.org cd /pub/pari/unix/ cd /pub/pari/ dir cd OLD/2.1 dir @ PariBuild.pm:269 @ sub finish_download_pari ($$$$;$) { my($base_url, $dir, $_archive, $ftp, $ua) = (shift, shift, shift, shift, shift); my %archive = %$_archive; my ($type, %have, %types, $best, %latest_version, %latest_file); for $type (qw(alpha beta golden)) { if ($archive{$type}) { @ PariBuild.pm:389 @ EOP my $ans = <STDIN>; if ($ans !~ /y/i) { if ($ans !~ /[^\n\r]/ and not $ENV{PERL_MATHPARI_TRUST_MANUAL} and (defined $ENV{PERL5_CPAN_IS_RUNNING} and (defined $ENV{PERL5_CPAN_IS_RUNNING} or ($ENV{PERL_EXTUTILS_AUTOINSTALL}||0) =~ /\bdefaultdeps\b/) ) { print <<'EOP'; Hmm, did not you read the prompt? Anyway, since $ENV{PERL5_CPAN_IS_RUNNING} is set Anyway, since $ENV{PERL5_CPAN_IS_RUNNING} is set (or $ENV{PERL_EXTUTILS_AUTOINSTALL} contains defaultdeps), I assume unattended build, and consider NO ANSWER as agreement... (If this is not what you wanted, set PERL_MATHPARI_TRUST_MANUAL to TRUE.) @ PariBuild.pm:563 @ sub patches_for ($) { 'patches/diff_2.1.7_restart'], '2.3.5' => [ ($^O =~ /^MSWin32\b/ ? 'patches/diff_2.3.5_mingw-w64' : ()), 'patches/diff_2.3.5_stderr_clobber'], 'patches/diff_2.3.5_stderr_clobber'], ); print "Looking for patches for $v...\n"; my @p = $patches{$v} ? @{$patches{$v}} : (); ¯\_(ツ)_/¯ [jonasbn:~/develop/github-forks/Math-Pari] ftp_directory_change 1h57m50s ± Ref: https://github.com/jonasbn/Math-Pari/commit/75f314b09a5da33be3e2e35518f332be88fc2d1a#diff-f344bce65b09a563be1a6bf03e05b3d1L197 jonasbn

Subject:

pub-pari-unix.png

Download pub-pari-unix.png
image/png 249.6k

Subject:

pub-pari.png

Download pub-pari.png
image/png 168.1k

Mon Aug 06 12:40:37 2018 jonasbn [...] cpan.org - Correspondence added

Gugod, Have you observed infinite loop / resource hugging with the HTTP download? When the FTP server is not available, which it occasionally is or as observed with this issue the FTP download is unsuccessful, the installation fails over to HTTP. This does not seem to work as expected and I observed this part break the installation on Docker images and in our CI environment (Jenkins), On another note Jenkins is incredibly bad at handling this resource hugging and crashes, where the Docker build just complains and stops. On Fri Jul 20 02:58:40 2018, GUGOD wrote: Show quoted text

> It appears to me that the ftp site of pari has be altered recently (a > day or two before this comment) and the "OLD" directory is moved one > level up. From `cpanm --verbose Math::Pari`, I can see that the > installer is doing some discovering of tgz files from: > > ftp://megrez.math.u-bordeaux.fr/pub/pari/unix/OLD/2.3/ > > Which is actully now located at: > > ftp://megrez.math.u-bordeaux.fr/pub/pari/OLD/2.3/ > > > For this reason, that cpanm command always fails.

Mon Aug 06 16:05:28 2018 nospam-abuse [...] ilyaz.org - Correspondence added

CC:	;
Subject:	Re: [rt.cpan.org #125893] The automatic downloading of pari tarball always fails as of now.
Date:	Mon, 6 Aug 2018 13:05:09 -0700
To:	"Jonas B. Nielsen via RT" <bug-Math-Pari [...] rt.cpan.org>
From:	Ilya Zakharevich <nospam-abuse [...] ilyaz.org>

On Mon, Aug 06, 2018 at 12:40:38PM -0400, Jonas B. Nielsen via RT wrote: Show quoted text

> Queue: Math-Pari > Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=125893 > > > Gugod, > > Have you observed infinite loop / resource hugging with the HTTP download? > > When the FTP server is not available, which it occasionally is or as observed with this issue the FTP download is unsuccessful, the installation fails over to HTTP. This does not seem to work as expected and I observed this part break the installation on Docker images and in our CI environment (Jenkins), On another note Jenkins is incredibly bad at handling this resource hugging and crashes, where the Docker build just complains and stops.

No, it is the first time I’ve heard something like this. Could you cook a way for me to reproduce it? (Like disabling Net::FTP via environment variable…) Thanks, Ilya