Skip Menu |

This queue is for tickets about the Net-SFTP-Foreign CPAN distribution.

Report information
The Basics
Id: 57386
Status: rejected
Worked: 16.2 hours (970 min)
Priority: 0/
Queue: Net-SFTP-Foreign
People
Owner: salva [...] cpan.org
Requestors: Heather.Fischer [...] nisc.coop
Cc:
AdminCc:
Bug Information
Severity: (no value)
Broken in: (no value)
Fixed in: (no value)
Attachments
net_sftp_resume_test_1.58_03.doc
nisc.gif
secfiletrans052710-orig.out.gz
secfiletrans052710-resume.out.gz

History Show all quoted text
  Tue May 11 15:00:28 2010 Heather.Fischer [...] nisc.coop - Ticket created
CC: Heather Fischer <Heather.Fischer [...] nisc.coop>
Subject: Net-SFTP-Foreign Bug
Date: Tue, 11 May 2010 14:00:42 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Hello, I'm receiving the following error when attempting to get a file with the module: print() on closed filehandle $fh at /usr/lib/perl5/site_perl/5.8.3/Net/SFTP/Foreign.pm line 1585. This error occured when I added the "get" option "resume => 1". The error does not occur without the "resume" option included in the code. Perl Module Version: Net-SFTP-Foreign-1.55.tar.gz OS Version: tedev1:/pro/work/hfischer:# uname -a Linux tedev1 2.6.5-7.282-smp #1 SMP Tue Aug 29 10:40:40 UTC 2006 x86_64 x86_64 x86_64 GNU/Linux Per version: tedev1:/pro/work/hfischer:# perl -v This is perl, v5.8.3 built for x86_64-linux-thread-multi Copyright 1987-2003, Larry Wall Perl may be copied only under the terms of either the Artistic License or the GNU General Public License, which may be found in the Perl 5 source kit. Complete documentation for Perl, including FAQ lists, should be found on this system using `man perl' or `perldoc perl'. If you have access to the Internet, point your browser at http://www.perl.com/, the Perl Home Page. <http://www.nisc.coop/> Heather Fischer___________________ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop <mailto:heather.fischer@nisc.coop> **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776
Download nisc.gif
image/gif 5.2k
nisc.gif
  Wed May 12 03:52:53 2010 salva [...] cpan.org - Correspondence added 10 min
I am unable to reproduce your problem. Could you post the program that's failing (or better, a minimal version of it that still triggers the error). Include also a full listing of the remote and local directories. Could you try installing the current development version of the module, there have been significative changes since version 1.55 and the problem may be already resolved.
  Wed May 12 03:52:53 2010 The RT System itself - Status changed from 'new' to 'open'
  Wed May 12 03:52:54 2010 salva [...] cpan.org - Given to SALVA
  Wed May 12 09:58:19 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: "heather.fischer [...] nisc.coop" <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Wed, 12 May 2010 08:58:30 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Thank you for writing this module. I found it very useful and it works well. This is the first issue I've had with it. The program is attached. The resume code is removed but changed $sftp->get("$tranfle","$ldir/$tmplclfle"); To $sftp->get("$tranfle","$ldir/$tmplclfle", resume=>1); To test the resume option that caused the error. It appears the file handle $fh is closed when it's trying to print to it on line 1585. I did download and install the 1.57 version yesterday, but yielded the same results when the "resume => 1" option was added. Syntax used to call script: /pro/work/hfischer/secfiletrans.pl --flow get --protocol sftp --rhost teconv --user hfischer --password ****** --rdir /pro/work/hfischer/test/outgoing --ldir /pro/work/hfischer/test --filename 'tbills*.zip' Local directory listing; tedev1:/pro/work/hfischer/test:# ls -la total 9 drw-rw-rw- 5 hfischer domain 120 May 11 12:24 ./ drwxr-xr-x 25 hfischer admn 9024 May 12 08:50 ../ drwxrwxrwx 2 hfischer domain 152 May 6 12:42 archive/ drwxrwxrwx 2 hfischer domain 272 Mar 11 2009 done/ drwxr-xr-x 2 root root 48 Mar 23 11:26 temp/ Remote directory listing: teconv:~/test/outgoing:-> ls -la total 658851 drwxrwxrwx 3 hfischer domain 432 May 11 11:39 ./ drwxrwxrwx 5 hfischer domain 240 May 7 08:00 ../ drwxr-xr-x 2 root root 80 May 7 14:16 META-INF/ -rw-rw-rw- 1 hfischer domain 181 May 7 09:11 heathertest.tar.gz -rw-rw-rw- 1 hfischer domain 181 May 7 11:11 heathertest.tgz -rw-rw-rw- 1 hfischer domain 427 May 7 09:11 heathertest2.zip -rw-rw-rw- 1 root root 586 May 7 12:01 heathertest3.jar -rw-rw-rw- 1 hfischer domain 673961453 May 11 09:48 tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.zip -rw-rw-rw- 1 hfischer domain 15 May 7 09:09 test1 -rw-rw-rw- 1 hfischer domain 39 May 7 09:09 test1.gz -rw-rw-rw- 1 hfischer domain 15 May 7 09:09 test2 -rw-rw-rw- 1 hfischer domain 345 May 7 09:09 test2.gpg -rw-rw-rw- 1 hfischer domain 15 May 7 09:10 test3 -rw-rw-rw- 1 hfischer domain 8 May 7 11:31 test4 Heather Fischer___________________ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Salvador Fandino Garcia via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Wednesday, May 12, 2010 2:53 AM To: Heather Fischer Subject: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 > I am unable to reproduce your problem. Could you post the program that's failing (or better, a minimal version of it that still triggers the error). Include also a full listing of the remote and local directories. Could you try installing the current development version of the module, there have been significative changes since version 1.55 and the problem may be already resolved.
  Thu May 13 13:02:24 2010 salva [...] cpan.org - Correspondence added
I am still unable to reproduce the problem. Set $Net::SFTP::Foreign=-1 in the script, run it again (both with and with our resume) and send me the (compressed) output so I can see what is going on. A capture at the OS level with strace would probably also help. (take care to not use files with sensible information as its contents will appear on the debugging output and to remove passwords or to use dummy ones)
  Thu May 13 15:29:36 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: "heather.fischer [...] nisc.coop" <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 13 May 2010 14:29:40 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Where exactly do I put "$Net::SFTP::Foreign=-1". It's erroring where I put it. Heather Fischer___________________ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Salvador Fandino Garcia via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Thursday, May 13, 2010 12:02 PM To: Heather Fischer Subject: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 > I am still unable to reproduce the problem. Set $Net::SFTP::Foreign=-1 in the script, run it again (both with and with our resume) and send me the (compressed) output so I can see what is going on. A capture at the OS level with strace would probably also help. (take care to not use files with sensible information as its contents will appear on the debugging output and to remove passwords or to use dummy ones)
  Thu May 13 15:39:57 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: Heather Fischer <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 13 May 2010 14:40:10 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
How should the "resume" option be used? Should it be specified in a transfer only when you are trying to resume a previously failed file transfer? In which case resume, will start the file transfer where it left off? Or can it be used for all file transfers, which include new and ones we want to resume? I am really curious how and if this works reliably or if I am misunderstanding it's function. Heather Fischer___________________ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Heather Fischer Sent: Thursday, May 13, 2010 2:30 PM To: bug-Net-SFTP-Foreign@rt.cpan.org Cc: heather.fischer@nisc.coop Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug Where exactly do I put "$Net::SFTP::Foreign=-1". It's erroring where I put it. Heather Fischer___________________ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776
-----Original Message----- From: Salvador Fandino Garcia via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Thursday, May 13, 2010 12:02 PM To: Heather Fischer Subject: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 > I am still unable to reproduce the problem. Set $Net::SFTP::Foreign=-1 in the script, run it again (both with and with our resume) and send me the (compressed) output so I can see what is going on. A capture at the OS level with strace would probably also help. (take care to not use files with sensible information as its contents will appear on the debugging output and to remove passwords or to use dummy ones)
  Thu May 13 16:14:44 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 13 May 2010 13:14:32 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
Show quoted text
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, May 13, 2010 9:29:37 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Where exactly
> do I put "$Net::SFTP::Foreign=-1". It's erroring where I
put
> it.
oops, it should say $Net::SFTP::Foreign::debug = -1; and has to be placed at the begining of the script before the module is used. Heather Fischer___________________ Senior
> Systems Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Salvador Fandino
> Garcia via RT
[mailto:
> href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org] >
Sent: Thursday, May 13, 2010 12:02 PM To: Heather Fischer Subject: [
> target="_blank" href="http://rt.cpan.org">rt.cpan.org #57386] > Net-SFTP-Foreign Bug
<URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
I am still
> unable to reproduce the problem.
Set
> $Net::SFTP::Foreign=-1
in the script, run it again (both with and with
> our resume) and send me
the (compressed) output so I can see what is going
> on.
A capture at the OS level with strace would probably also
> help.
(take care to not use files with sensible information as its
> contents
will appear on the debugging output and to remove passwords or to
> use
dummy ones)
  Thu May 13 16:30:07 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 13 May 2010 13:29:54 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
Show quoted text
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, May 13, 2010 9:39:57 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> http://rt.cpan.org/Ticket/Display.html?id=57386 >
> How should the > "resume" option be used? Should it be specified in a > transfer only when > you are trying to resume a previously failed file > transfer? In which > case resume, will start the file transfer where it > left off? Or can it > be used for all file transfers, which include new > and ones we want to > resume?
> I am really curious how and if this works reliably or if I > am > misunderstanding it's function.
when "resume => 1" is used with "get", if the local file already exists only the missing bits will be copied, otherwise the full file will be transferred. if "resume => 'auto'" is used, it will also check the timestamps of both files and resume the transfer only when the local file is newer than the remote one, otherwise, the local file will be deleted and the full remote file copied. This operation is reliable as far as no other process modifies the partially transferred files. But no checksum or other means to corroborate the integrity of the local file is performed as these kind of operations are not supported by the SFTP protocol. If you have weak networks, and your SSH connections break from time to time (for instance, when connecting through a mobile network link, or a VPN) using resume is a safe operation. It can be also used to incrementally transfer files that are written in append mode as for instance log files. Hope that helps, Cheers, - Salva Heather
> Fischer___________________
Senior Systems Specialist National Information
> Solutions Cooperative
3201 Nygren Drive Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Heather Fischer
>
Sent: Thursday, May 13, 2010 2:30 PM To:
> ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org
Cc:
> > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
Subject:
> RE: [rt.cpan.org #57386] > Net-SFTP-Foreign Bug
Where exactly do I put
> "$Net::SFTP::Foreign=-1". It's erroring where I
put it.
> Heather Fischer___________________
Senior Systems
> Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Salvador Fandino
> Garcia via RT
[mailto:
> href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org]
Sent:
> Thursday, May 13, 2010 12:02 PM
To: Heather Fischer Subject: [rt.cpan.org
> #57386] Net-SFTP-Foreign Bug
<URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
I am still
> unable to reproduce the problem.
Set
> $Net::SFTP::Foreign=-1
in the script, run it again (both with and with
> our resume) and send me
the (compressed) output so I can see what is going
> on.
A capture at the OS level with strace would probably also
> help.
(take care to not use files with sensible information as its
> contents
will appear on the debugging output and to remove passwords or to
> use
dummy ones)
  Thu May 13 16:35:23 2010 Heather.Fischer [...] nisc.coop - Correspondence added
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 13 May 2010 15:35:37 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Thank you. That is exactly what we are looking for. I'm still working on testing to produce the output you requested. Heather Fischer___________________ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Thursday, May 13, 2010 3:30 PM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 >
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, May 13, 2010 9:39:57 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> http://rt.cpan.org/Ticket/Display.html?id=57386 >
> How should the > "resume" option be used? Should it be specified in a transfer only > when you are trying to resume a previously failed file transfer? In > which case resume, will start the file transfer where it left off? Or > can it be used for all file transfers, which include new and ones we > want to resume?
> I am really curious how and if this works reliably or if I am > misunderstanding it's function.
when "resume => 1" is used with "get", if the local file already exists only the missing bits will be copied, otherwise the full file will be transferred. if "resume => 'auto'" is used, it will also check the timestamps of both files and resume the transfer only when the local file is newer than the remote one, otherwise, the local file will be deleted and the full remote file copied. This operation is reliable as far as no other process modifies the partially transferred files. But no checksum or other means to corroborate the integrity of the local file is performed as these kind of operations are not supported by the SFTP protocol. If you have weak networks, and your SSH connections break from time to time (for instance, when connecting through a mobile network link, or a VPN) using resume is a safe operation. It can be also used to incrementally transfer files that are written in append mode as for instance log files. Hope that helps, Cheers, - Salva Heather
> Fischer___________________
Senior Systems Specialist National Information
> Solutions Cooperative
3201 Nygren Drive Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Heather Fischer
>
Sent: Thursday, May 13, 2010 2:30 PM To:
> ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt > .cpan.org
Cc:
> > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
Subject:
> RE: [rt.cpan.org #57386] > Net-SFTP-Foreign Bug
Where exactly do I put
> "$Net::SFTP::Foreign=-1". It's erroring where I
put it.
> Heather Fischer___________________
Senior Systems
> Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Salvador Fandino
> Garcia via RT
[mailto:
> href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt > .cpan.org]
Sent:
> Thursday, May 13, 2010 12:02 PM
To: Heather Fischer Subject: [rt.cpan.org
> #57386] Net-SFTP-Foreign Bug
<URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
I am still
> unable to reproduce the problem.
Set
> $Net::SFTP::Foreign=-1
in the script, run it again (both with and with
> our resume) and send me
the (compressed) output so I can see what is going
> on.
A capture at the OS level with strace would probably also
> help.
(take care to not use files with sensible information as its
> contents
will appear on the debugging output and to remove passwords or to
> use
dummy ones)
  Fri May 14 09:42:02 2010 Heather.Fischer [...] nisc.coop - Correspondence added
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Fri, 14 May 2010 08:42:24 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Well, this is strange. It now appears to be working with the 1.55 and 1.57 Foreign.pm! I tested it and the resume works as well. Wonderful. I'm so sorry to have bothered you and wasted your time. I could not get it to work when I opened the ticket as I was getting the error below. print() on closed filehandle $fh at /usr/lib/perl5/site_perl/5.8.3/Net/SFTP/Foreign.pm line 1585. Thanks again for writing this module. I love it. Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Thursday, May 13, 2010 3:30 PM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 >
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, May 13, 2010 9:39:57 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> http://rt.cpan.org/Ticket/Display.html?id=57386 >
> How should the > "resume" option be used? Should it be specified in a transfer only > when you are trying to resume a previously failed file transfer? In > which case resume, will start the file transfer where it left off? Or > can it be used for all file transfers, which include new and ones we > want to resume?
> I am really curious how and if this works reliably or if I am > misunderstanding it's function.
when "resume => 1" is used with "get", if the local file already exists only the missing bits will be copied, otherwise the full file will be transferred. if "resume => 'auto'" is used, it will also check the timestamps of both files and resume the transfer only when the local file is newer than the remote one, otherwise, the local file will be deleted and the full remote file copied. This operation is reliable as far as no other process modifies the partially transferred files. But no checksum or other means to corroborate the integrity of the local file is performed as these kind of operations are not supported by the SFTP protocol. If you have weak networks, and your SSH connections break from time to time (for instance, when connecting through a mobile network link, or a VPN) using resume is a safe operation. It can be also used to incrementally transfer files that are written in append mode as for instance log files. Hope that helps, Cheers, - Salva Heather
> Fischer___________________
Senior Systems Specialist National Information
> Solutions Cooperative
3201 Nygren Drive Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Heather Fischer
>
Sent: Thursday, May 13, 2010 2:30 PM To:
> ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt > .cpan.org
Cc:
> > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
Subject:
> RE: [rt.cpan.org #57386] > Net-SFTP-Foreign Bug
Where exactly do I put
> "$Net::SFTP::Foreign=-1". It's erroring where I
put it.
> Heather Fischer___________________
Senior Systems
> Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Salvador Fandino
> Garcia via RT
[mailto:
> href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt > .cpan.org]
Sent:
> Thursday, May 13, 2010 12:02 PM
To: Heather Fischer Subject: [rt.cpan.org
> #57386] Net-SFTP-Foreign Bug
<URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
I am still
> unable to reproduce the problem.
Set
> $Net::SFTP::Foreign=-1
in the script, run it again (both with and with
> our resume) and send me
the (compressed) output so I can see what is going
> on.
A capture at the OS level with strace would probably also
> help.
(take care to not use files with sensible information as its
> contents
will appear on the debugging output and to remove passwords or to
> use
dummy ones)
  Fri May 14 15:43:13 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: Heather Fischer <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Fri, 14 May 2010 14:43:05 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Hi, Has the resume option been tested with encrypted files? For the "gets", resume works well for .tar, .zip and encrypted files. However, for "put"s, the files encrypted with GPG are corrupt when resume is used to finish a partial download. The resume "put" option works good for the .tar and .zip files. Should I open a different bug for this put, resume, encrypted file issue? Decrypt and tar commands showing corruption. ndftp:/home/sftptest/incoming:# gpg --homedir /.gnupg -o tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar --decrypt tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar.gpg gpg: WARNING: unsafe enclosing directory permissions on configuration file `/.gnupg/options' gpg: encrypted with 1024-bit ELG-E key, ID 1EA8814A, created 2001-06-25 "NISC ND (NISC GnuPG Key) <nisc@nisc.cc>" gpg: [don't know]: invalid packet (ctb=20) gpg: [don't know]: invalid packet (ctb=72) gpg: WARNING: encrypted message has been manipulated! gpg: [don't know]: invalid packet (ctb=66) ndftp:/home/sftptest/incoming:# ls -la total 3553654 drwxr-xr-x 2 sftptest sftponly 576 May 14 12:20 ./ drwxr-xr-x 6 root root 144 Apr 29 09:26 ../ -rw-r--r-- 1 root root 86128640 May 14 11:25 18599.bills.tar -rw-rw-rw- 1 sftptest sftponly 10490759 May 14 11:24 18599.bills.tar.gz.gpg -rw-rw-rw- 1 sftptest sftponly 468663 May 14 09:54 28513110.cab.tar.gpg -rw-r--r-- 1 sftptest sftponly 353 May 12 09:55 extract.d.gpg -rw-r--r-- 1 root root 842522690 May 14 12:20 tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar -rw-rw-rw- 1 sftptest sftponly 675455638 May 14 11:55 tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar.gpg -rw-r--r-- 1 root root 675455639 May 14 11:48 tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar.gpg.good -rw-r--r-- 1 root root 673974299 May 14 11:35 tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar.gz -rw-rw-rw- 1 sftptest sftponly 670869440 May 14 08:51 tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.zip.gpg.bad ndftp:/home/sftptest/incoming:# tar tvf tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar -rw-rw-rw- hfischer/domain 6249 2010-04-24 02:14:58 B26561013553.rpt -rw-rw-rw- hfischer/domain 39776 2010-04-24 02:14:58 B26561013600.rpt -rw-rw-rw- hfischer/domain 53965 2010-04-24 02:14:58 B2656101err.rpt -rw-rw-rw- hfischer/domain 8452 2010-04-24 02:14:58 B2656101group.rpt -rw-rw-rw- hfischer/domain 60689 2010-04-24 02:14:58 B2656101man.rpt -rw-rw-rw- hfischer/domain 10141 2010-04-24 02:14:58 B2656101piece.rpt -rw-rw-rw- hfischer/domain 159362 2010-04-24 02:15:06 B2656101preports.pdf -rw-rw-rw- hfischer/domain 20228 2010-04-24 02:14:58 B2656101sort.rpt -rw-rw-rw- hfischer/domain 137864 2010-04-24 02:15:06 B2656101tray.rpt -rw-rw-rw- hfischer/domain 1079024152 2010-04-24 02:16:54 B26561_01.ps tar: Read 6210 bytes from tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar tar: Unexpected EOF in archive tar: Error is not recoverable: exiting now ndftp:/home/sftptest/incoming:# tar xvf tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar B26561013553.rpt B26561013600.rpt B2656101err.rpt B2656101group.rpt B2656101man.rpt B2656101piece.rpt B2656101preports.pdf B2656101sort.rpt B2656101tray.rpt B26561_01.ps tar: Read 6210 bytes from tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar tar: Unexpected EOF in archive tar: Unexpected EOF in archive tar: Error is not recoverable: exiting now ndftp:/home/sftptest/incoming:# ls -la total 4377241 drwxr-xr-x 2 sftptest sftponly 920 May 14 12:26 ./ drwxr-xr-x 6 root root 144 Apr 29 09:26 ../ -rw-r--r-- 1 root root 86128640 May 14 11:25 18599.bills.tar -rw-rw-rw- 1 sftptest sftponly 10490759 May 14 11:24 18599.bills.tar.gz.gpg -rw-rw-rw- 1 sftptest sftponly 468663 May 14 09:54 28513110.cab.tar.gpg -rw-rw-rw- 1 hfischer 1513 6249 Apr 24 02:14 B26561013553.rpt -rw-rw-rw- 1 hfischer 1513 39776 Apr 24 02:14 B26561013600.rpt -rw-rw-rw- 1 hfischer 1513 53965 Apr 24 02:14 B2656101err.rpt -rw-rw-rw- 1 hfischer 1513 8452 Apr 24 02:14 B2656101group.rpt -rw-rw-rw- 1 hfischer 1513 60689 Apr 24 02:14 B2656101man.rpt -rw-rw-rw- 1 hfischer 1513 10141 Apr 24 02:14 B2656101piece.rpt -rw-rw-rw- 1 hfischer 1513 159362 Apr 24 02:15 B2656101preports.pdf -rw-rw-rw- 1 hfischer 1513 20228 Apr 24 02:14 B2656101sort.rpt -rw-rw-rw- 1 hfischer 1513 137864 Apr 24 02:15 B2656101tray.rpt -rw-rw-rw- 1 root root 842018304 May 14 12:27 B26561_01.ps -rw-r--r-- 1 sftptest sftponly 353 May 12 09:55 extract.d.gpg -rw-r--r-- 1 root root 842522690 May 14 12:20 tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar -rw-rw-rw- 1 sftptest sftponly 675455638 May 14 11:55 tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar.gpg -rw-r--r-- 1 root root 675455639 May 14 11:48 tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar.gpg.good -rw-r--r-- 1 root root 673974299 May 14 11:35 tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.tar.gz -rw-rw-rw- 1 sftptest sftponly 670869440 May 14 08:51 tbillsdoc1B26561_01_201005_201004_26561_00114_PRD.zip.gpg.bad ndftp:/home/sftptest/incoming:# Heather Fischer___________________ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Heather Fischer Sent: Friday, May 14, 2010 8:42 AM To: 'bug-Net-SFTP-Foreign@rt.cpan.org' Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug Well, this is strange. It now appears to be working with the 1.55 and 1.57 Foreign.pm! I tested it and the resume works as well. Wonderful. I'm so sorry to have bothered you and wasted your time. I could not get it to work when I opened the ticket as I was getting the error below. print() on closed filehandle $fh at /usr/lib/perl5/site_perl/5.8.3/Net/SFTP/Foreign.pm line 1585. Thanks again for writing this module. I love it. Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Thursday, May 13, 2010 3:30 PM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 >
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, May 13, 2010 9:39:57 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> http://rt.cpan.org/Ticket/Display.html?id=57386 >
> How should the > "resume" option be used? Should it be specified in a transfer only > when you are trying to resume a previously failed file transfer? In > which case resume, will start the file transfer where it left off? Or > can it be used for all file transfers, which include new and ones we > want to resume?
> I am really curious how and if this works reliably or if I am > misunderstanding it's function.
when "resume => 1" is used with "get", if the local file already exists only the missing bits will be copied, otherwise the full file will be transferred. if "resume => 'auto'" is used, it will also check the timestamps of both files and resume the transfer only when the local file is newer than the remote one, otherwise, the local file will be deleted and the full remote file copied. This operation is reliable as far as no other process modifies the partially transferred files. But no checksum or other means to corroborate the integrity of the local file is performed as these kind of operations are not supported by the SFTP protocol. If you have weak networks, and your SSH connections break from time to time (for instance, when connecting through a mobile network link, or a VPN) using resume is a safe operation. It can be also used to incrementally transfer files that are written in append mode as for instance log files. Hope that helps, Cheers, - Salva Heather
> Fischer___________________
Senior Systems Specialist National Information
> Solutions Cooperative
3201 Nygren Drive Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Heather Fischer
>
Sent: Thursday, May 13, 2010 2:30 PM To:
> ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt > .cpan.org
Cc:
> > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
Subject:
> RE: [rt.cpan.org #57386] > Net-SFTP-Foreign Bug
Where exactly do I put
> "$Net::SFTP::Foreign=-1". It's erroring where I
put it.
> Heather Fischer___________________
Senior Systems
> Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Salvador Fandino
> Garcia via RT
[mailto:
> href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt > .cpan.org]
Sent:
> Thursday, May 13, 2010 12:02 PM
To: Heather Fischer Subject: [rt.cpan.org
> #57386] Net-SFTP-Foreign Bug
<URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
I am still
> unable to reproduce the problem.
Set
> $Net::SFTP::Foreign=-1
in the script, run it again (both with and with
> our resume) and send me
the (compressed) output so I can see what is going
> on.
A capture at the OS level with strace would probably also
> help.
(take care to not use files with sensible information as its
> contents
will appear on the debugging output and to remove passwords or to
> use
dummy ones)
  Fri May 14 16:48:32 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Fri, 14 May 2010 13:48:14 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
Show quoted text
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Fri, May 14, 2010 9:43:14 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hi, Has
> the resume option been tested with encrypted files? For the "gets", resume > works well for .tar, .zip and encrypted files. However, for "put"s, the files > encrypted with GPG are corrupt when resume is used to finish a partial > download. The resume "put" option works good for the .tar and .zip > files.
I guess the problem is more related to some other property of the file than to being encrypted as the module does not process the file contents in anyway, it just sees raw data.
> Should I open a different bug for this put, resume, encrypted file > issue?
just try to reproduce the problem with $Net::SFTP::Foreign::debug = -1 And send me the output. It seems that one byte has been lost in the "resumed" file transfer... I would investigate where the problem can be. Cheers - Salva
  Fri May 14 16:48:48 2010 Heather.Fischer [...] nisc.coop - Correspondence added
Subject: Out of Office AutoReply: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Fri, 14 May 2010 15:49:02 -0500
To: Salvador \"Fandiño\" via RT <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
I am currently out of the office and am unable to repond to your message at this time. I will return to the office on Tuesday, May 18th. If you need immediate assistance, please email tele-tech@nisc.coop. Thank you. Heather
  Tue May 18 11:51:52 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: "heather.fischer [...] nisc.coop" <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Tue, 18 May 2010 10:51:31 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Good morning, Attached is the debug information for the *.zip.gpg file listed below that was resumed after the initial transmission was killed part way thru the ftp. The *.zip.gpg below is the file ftped with resume after the first transmission aborted partially thru the ftp process. Not that it is one byte smaller than the good file. ndftp:/home/sftptest/incoming:# ls -ltr total 696 -rw-rw-rw- 1 sftptest sftponly 356053 May 18 10:08 ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg.good -rw-rw-rw- 1 sftptest sftponly 356052 May 18 10:37 ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg Decryption failed: ndftp:/home/sftptest/incoming:# gpg --homedir /.gnupg -o ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip --decrypt ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg gpg: WARNING: unsafe enclosing directory permissions on configuration file `/.gnupg/options' gpg: encrypted with 1024-bit ELG-E key, ID 1EA8814A, created 2001-06-25 "NISC ND (NISC GnuPG Key) <nisc@nisc.cc>" gpg: fatal: zlib inflate problem: invalid code lengths set secmem usage: 2112/2368 bytes in 4/7 blocks of pool 3456/32768 ndftp:/home/sftptest/incoming:# mv ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg ttbillsdoc1B01528_02_201005_201005_88888_0204_TST.zip.gpg.bad The ".zip.gpg.good" file was ftped normally with no interruption in transmission so resume was not used. The good file decrypts successfully. ndftp:/home/sftptest/incoming:# gpg --homedir /.gnupg -o ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip --decrypt ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg.good gpg: WARNING: unsafe enclosing directory permissions on configuration file `/.gnupg/options' gpg: encrypted with 1024-bit ELG-E key, ID 1EA8814A, created 2001-06-25 "NISC ND (NISC GnuPG Key) <nisc@nisc.cc>" ndftp:/home/sftptest/incoming:# ls -ltr total 1048 -rw-rw-rw- 1 sftptest sftponly 356053 May 18 10:08 ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg.good -rw-rw-rw- 1 sftptest sftponly 356052 May 18 10:37 ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg.bad -rw-r--r-- 1 root root 360136 May 18 10:39 ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip ndftp:/home/sftptest/incoming:# unzip -l ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip Archive: ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip Length Date Time Name -------- ---- ---- ---- 6219 05-17-10 20:49 B01528023553.rpt 3649 05-17-10 20:49 B0152802err.rpt 5424 05-17-10 20:49 B0152802group.rpt 5355 05-17-10 20:49 B0152802piece.rpt 204552 05-17-10 20:49 B01528_02_201005_88888p.pdf 416 05-17-10 20:49 B01528_02_201005_88888p.sni 1490697 05-17-10 20:49 B01528_02.ps -------- ------- 1716312 7 files ndftp:/home/sftptest/incoming:# Please let me know what you find. We would really like to use the resume option to ftp very large encrypted disaster management files to our sftp server. Thank you. Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Friday, May 14, 2010 3:49 PM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: http://rt.cpan.org/Ticket/Display.html?id=57386 >
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Fri, May 14, 2010 9:43:14 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hi, Has
> the resume option been tested with encrypted files? For the "gets", resume > works well for .tar, .zip and encrypted files. However, for "put"s, the files > encrypted with GPG are corrupt when resume is used to finish a partial > download. The resume "put" option works good for the .tar and .zip > files.
I guess the problem is more related to some other property of the file than to being encrypted as the module does not process the file contents in anyway, it just sees raw data.
> Should I open a different bug for this put, resume, encrypted file > issue?
just try to reproduce the problem with $Net::SFTP::Foreign::debug = -1 And send me the output. It seems that one byte has been lost in the "resumed" file transfer... I would investigate where the problem can be. Cheers - Salva
  Thu May 20 13:15:09 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 20 May 2010 10:14:58 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
Some questions: 1) Can you deterministically reproduce the error or it just happens from time to time? 2) Does it happen for any gpg compressed file or just for some specific one? 3) If it is deterministic and happens for some specific file can you try repeating your tests with a newer perl as perl 5.8.9? I have been running tests here trying to reproduce the problem without success and I am unable to see any problem in the module logic just looking at the code either. My only guess at the moment is that it could be related to some unicode bug in your old perl version 5.8.3... though, that would not explain why it fails when resuming only. Anyway, I am adding some more debugging to the resume feature and will send you a new version of the module soon that would allow me to find where the missing byte is dropped. Cheers, - Salva Show quoted text
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Tue, May 18, 2010 5:52:14 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> http://rt.cpan.org/Ticket/Display.html?id=57386 >
Good
> morning,
Attached is the debug information for the *.zip.gpg file listed
> below that was resumed after the initial transmission was killed part way thru > the ftp.
The *.zip.gpg below is the file ftped with resume after the
> first transmission aborted partially thru the ftp process. Not that it is > one byte smaller than the good file.
ndftp:/home/sftptest/incoming:# ls
> -ltr
total 696 -rw-rw-rw- 1 sftptest sftponly 356053 May 18 10:08
> ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg.good
-rw-rw-rw- 1
> sftptest sftponly 356052 May 18 10:37 > ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg
Decryption
> failed:
ndftp:/home/sftptest/incoming:# gpg --homedir /.gnupg -o
> ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip --decrypt > ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg
gpg: WARNING:
> unsafe enclosing directory permissions on configuration file > `/.gnupg/options'
gpg: encrypted with 1024-bit ELG-E key, ID 1EA8814A,
> created 2001-06-25
"NISC ND (NISC GnuPG Key) <
> ymailto="mailto:nisc@nisc.cc" > href="mailto:nisc@nisc.cc">nisc@nisc.cc>"
gpg: fatal: zlib inflate
> problem: invalid code lengths set
secmem usage: 2112/2368 bytes in 4/7 blocks
> of pool 3456/32768
ndftp:/home/sftptest/incoming:# mv
> ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg > ttbillsdoc1B01528_02_201005_201005_88888_0204_TST.zip.gpg.bad
The
> ".zip.gpg.good" file was ftped normally with no interruption in transmission so > resume was not used. The good file decrypts > successfully.
ndftp:/home/sftptest/incoming:# gpg --homedir /.gnupg
> -o ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip --decrypt > ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg.good
gpg: WARNING:
> unsafe enclosing directory permissions on configuration file > `/.gnupg/options'
gpg: encrypted with 1024-bit ELG-E key, ID 1EA8814A,
> created 2001-06-25
"NISC ND (NISC GnuPG Key) <
> ymailto="mailto:nisc@nisc.cc" > href="mailto:nisc@nisc.cc">nisc@nisc.cc>"
ndftp:/home/sftptest/incoming:#
> ls -ltr
total 1048 -rw-rw-rw- 1 sftptest sftponly 356053 May 18 10:08
> ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg.good
-rw-rw-rw- 1
> sftptest sftponly 356052 May 18 10:37 > ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg.bad
-rw-r--r-- 1
> root root 360136 May 18 10:39 > ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip
ndftp:/home/sftptest/incoming:#
> unzip -l > ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip
Archive:
> ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip
Length
> Date Time Name
-------- ----
> ---- ----
6219 05-17-10 20:49
> B01528023553.rpt
3649 05-17-10 20:49
> B0152802err.rpt
5424 05-17-10 20:49
> B0152802group.rpt
5355 05-17-10 20:49
> B0152802piece.rpt
204552 05-17-10 20:49
> B01528_02_201005_88888p.pdf
416 05-17-10
> 20:49 B01528_02_201005_88888p.sni
1490697 05-17-10
> 20:49 B01528_02.ps
--------
> -------
1716312
> 7 files
ndftp:/home/sftptest/incoming:#
>
Please let me know what you find. We would really like to use
> the resume option to ftp very large encrypted disaster management files to our > sftp server.
Thank you. Heather Fischer Senior Systems
> Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Salvador
> \"Fandiño\" via RT [mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org] >
Sent: Friday, May 14, 2010 3:49 PM To: Heather Fischer Subject: Re:
> [rt.cpan.org #57386] > Net-SFTP-Foreign Bug
<URL:
> href="http://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >http://rt.cpan.org/Ticket/Display.html?id=57386 > >
----- Original Message ----
> From: Heather > Fischer via RT < > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org> > > Sent: Fri, May 14, 2010 9:43:14 PM > Subject: RE: [rt.cpan.org #57386] > Net-SFTP-Foreign Bug > > Queue: > Net-SFTP-Foreign
Ticket <URL:
> href=" > href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
>
> > > >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hi, Has
> > the resume option been tested with encrypted files? For the > "gets", resume > works well for .tar, .zip and encrypted files. However, > for "put"s, the files > encrypted with GPG are corrupt when resume is > used to finish a partial > download. The resume "put" option works > good for the .tar and .zip > files.
I guess the problem is more
> related to some other property of the file than to being encrypted as the module > does not process the file contents in anyway, it just sees raw data.
> > Should I open a different bug for this put, resume, encrypted file > > issue?
just try to reproduce the problem with
> $Net::SFTP::Foreign::debug = -1
And send me the output. It seems
> that one byte has been lost in the "resumed" file transfer... I would > investigate where the problem can be.
Cheers - Salva
  Thu May 20 16:07:38 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: "heather.fischer [...] nisc.coop" <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 20 May 2010 15:07:52 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Hello Salva, Responses: 1. Everytime with gpg encrypted files. Tried .tar, .zip and .pdf encrypted files. 2. Tried several different files and file types to verify before reporting bug to you. 3. Do you still need me to dot his? Thank you for looking into this issue and your professionalism. Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Thursday, May 20, 2010 12:15 PM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 > Some questions: 1) Can you deterministically reproduce the error or it just happens from time to time? 2) Does it happen for any gpg compressed file or just for some specific one? 3) If it is deterministic and happens for some specific file can you try repeating your tests with a newer perl as perl 5.8.9? I have been running tests here trying to reproduce the problem without success and I am unable to see any problem in the module logic just looking at the code either. My only guess at the moment is that it could be related to some unicode bug in your old perl version 5.8.3... though, that would not explain why it fails when resuming only. Anyway, I am adding some more debugging to the resume feature and will send you a new version of the module soon that would allow me to find where the missing byte is dropped. Cheers, - Salva
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Tue, May 18, 2010 5:52:14 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> http://rt.cpan.org/Ticket/Display.html?id=57386 >
Good
> morning,
Attached is the debug information for the *.zip.gpg file listed
> below that was resumed after the initial transmission was killed part > way thru the ftp.
The *.zip.gpg below is the file ftped with resume after the
> first transmission aborted partially thru the ftp process. Not that > it is one byte smaller than the good file.
ndftp:/home/sftptest/incoming:# ls
> -ltr
total 696 -rw-rw-rw- 1 sftptest sftponly 356053 May 18 10:08
> ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg.good
-rw-rw-rw- 1
> sftptest sftponly 356052 May 18 10:37 > ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg
Decryption
> failed:
ndftp:/home/sftptest/incoming:# gpg --homedir /.gnupg -o
> ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip --decrypt > ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg
gpg: WARNING:
> unsafe enclosing directory permissions on configuration file > `/.gnupg/options'
gpg: encrypted with 1024-bit ELG-E key, ID 1EA8814A,
> created 2001-06-25
"NISC ND (NISC GnuPG Key) <
> ymailto="mailto:nisc@nisc.cc" > href="mailto:nisc@nisc.cc">nisc@nisc.cc>"
gpg: fatal: zlib inflate
> problem: invalid code lengths set
secmem usage: 2112/2368 bytes in 4/7 blocks
> of pool 3456/32768
ndftp:/home/sftptest/incoming:# mv
> ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg > ttbillsdoc1B01528_02_201005_201005_88888_0204_TST.zip.gpg.bad
The
> ".zip.gpg.good" file was ftped normally with no interruption in transmission so > resume was not used. The good file decrypts > successfully.
ndftp:/home/sftptest/incoming:# gpg --homedir /.gnupg
> -o ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip --decrypt > ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg.good
gpg: WARNING:
> unsafe enclosing directory permissions on configuration file > `/.gnupg/options'
gpg: encrypted with 1024-bit ELG-E key, ID 1EA8814A,
> created 2001-06-25
"NISC ND (NISC GnuPG Key) <
> ymailto="mailto:nisc@nisc.cc" > href="mailto:nisc@nisc.cc">nisc@nisc.cc>"
ndftp:/home/sftptest/incoming:#
> ls -ltr
total 1048 -rw-rw-rw- 1 sftptest sftponly 356053 May 18 10:08
> ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg.good
-rw-rw-rw- 1
> sftptest sftponly 356052 May 18 10:37 > ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip.gpg.bad
-rw-r--r-- 1
> root root 360136 May 18 10:39 > ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip
ndftp:/home/sftptest/incoming:#
> unzip -l > ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip
Archive:
> ttbillsdoc1B01528_02_201005_201005_88888_02042_TST.zip
Length
> Date Time Name
-------- ----
> ---- ----
6219 05-17-10 20:49
> B01528023553.rpt
3649 05-17-10 20:49
> B0152802err.rpt
5424 05-17-10 20:49
> B0152802group.rpt
5355 05-17-10 20:49
> B0152802piece.rpt
204552 05-17-10 20:49
> B01528_02_201005_88888p.pdf
416 05-17-10
> 20:49 B01528_02_201005_88888p.sni
1490697 05-17-10
> 20:49 B01528_02.ps
--------
> -------
1716312
> 7 files
ndftp:/home/sftptest/incoming:#
>
Please let me know what you find. We would really like to use
> the resume option to ftp very large encrypted disaster management files to our > sftp server.
Thank you. Heather Fischer Senior Systems
> Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Salvador
> \"Fandiño\" via RT [mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org] >
Sent: Friday, May 14, 2010 3:49 PM To: Heather Fischer Subject: Re:
> [rt.cpan.org #57386] > Net-SFTP-Foreign Bug
<URL:
> href="http://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >http://rt.cpan.org/Ticket/Display.html?id=57386 > >
----- Original Message ----
> From: Heather > Fischer via RT < > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org> > > Sent: Fri, May 14, 2010 9:43:14 PM > Subject: RE: [rt.cpan.org #57386] > Net-SFTP-Foreign Bug > > Queue: > Net-SFTP-Foreign
Ticket <URL:
> href=" > href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
>
> > > >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hi, Has
> > the resume option been tested with encrypted files? For the > "gets", resume > works well for .tar, .zip and encrypted files. However, > for "put"s, the files > encrypted with GPG are corrupt when resume is > used to finish a partial > download. The resume "put" option works > good for the .tar and .zip > files.
I guess the problem is more
> related to some other property of the file than to being encrypted as the module > does not process the file contents in anyway, it just sees raw data.
> > Should I open a different bug for this put, resume, encrypted file > > issue?
just try to reproduce the problem with
> $Net::SFTP::Foreign::debug = -1
And send me the output. It seems
> that one byte has been lost in the "resumed" file transfer... I would > investigate where the problem can be.
Cheers - Salva
  Sat May 22 04:32:10 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Sat, 22 May 2010 01:32:00 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
Hi, Show quoted text
> Responses: > 1. Everytime with gpg encrypted files. Tried .tar, > .zip and .pdf encrypted files. > 2. Tried several different files and file > types to verify before reporting bug to you. > 3. Do you still need me to dot > his?
Can you try the new version of the module available from CPAN (1.58_02)? It generates more useful debugging info for the put method. Also, it contains a testing script, samples/resume_put.pl that creates random pgp files and simulates resumed transfers. Run it for a while to see if it breaks on your system (I have been running it here for several hours without a single failure). If it breaks then send me the generated debugging file Net-SFTP-Foreign.debug (compressed, please :-) ) You can run the script from the unpacked module directory (no need to install it) as follows: $ perl -Ilib samples/resume_put.pl 1000000 some-pgp-id@foo.com - Salva
  Sat May 22 04:36:28 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Sat, 22 May 2010 01:36:19 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
BTW, which OS are you using? From the kernel version I guess it is SLES 9, right?
  Tue May 25 17:27:32 2010 Heather.Fischer [...] nisc.coop - Correspondence added
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Tue, 25 May 2010 13:53:39 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Yes. Heather Fischer___________________ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Saturday, May 22, 2010 3:36 AM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 > BTW, which OS are you using? From the kernel version I guess it is SLES 9, right?
  Wed May 26 09:20:44 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: "heather.fischer [...] nisc.coop" <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Wed, 26 May 2010 08:20:05 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Also, would you please remove my script from CPAN bug report page, which copyrighted property of NISC? Heather Fischer___________________ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Heather Fischer Sent: Tuesday, May 25, 2010 1:59 PM To: bug-Net-SFTP-Foreign@rt.cpan.org Cc: 'heather.fischer@nisc.coop' Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug Where exactly is the link to the new version? I'm not seeing it on: http://search.cpan.org/~salva/Net-SFTP-Foreign/lib/Net/SFTP/Foreign.pm Heather Fischer___________________ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Saturday, May 22, 2010 3:32 AM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 > Hi,
> Responses: > 1. Everytime with gpg encrypted files. Tried .tar, .zip and .pdf > encrypted files. > 2. Tried several different files and file types to verify before > reporting bug to you. > 3. Do you still need me to dot > his?
Can you try the new version of the module available from CPAN (1.58_02)? It generates more useful debugging info for the put method. Also, it contains a testing script, samples/resume_put.pl that creates random pgp files and simulates resumed transfers. Run it for a while to see if it breaks on your system (I have been running it here for several hours without a single failure). If it breaks then send me the generated debugging file Net-SFTP-Foreign.debug (compressed, please :-) ) You can run the script from the unpacked module directory (no need to install it) as follows: $ perl -Ilib samples/resume_put.pl 1000000 some-pgp-id@foo.com - Salva
  Wed May 26 12:29:37 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Wed, 26 May 2010 09:29:28 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
Show quoted text
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Wed, May 26, 2010 3:20:45 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> http://rt.cpan.org/Ticket/Display.html?id=57386 >
> Also, would you please remove my script from CPAN bug report page, which copyrighted property of > NISC?
I don't have the required permissions, you would have to ask to the RT administrators to do it: rt-cpan-admin@bestpractical.com The latest version of the module is available from http://search.cpan.org/CPAN/authors/id/S/SA/SALVA/Net-SFTP-Foreign-1.58_02.tar.gz Though I have already tried running the test script under SLES 9 for i386 (not x86_64) and it didn't fail. Would you be able to provide me with some of the PGP files that are failing (with out the PGP keys)? - Salva
  Wed May 26 15:05:43 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: "heather.fischer [...] nisc.coop" <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Wed, 26 May 2010 14:05:18 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Hello, I installed the new version on our test server. Do you have a very large test file I could test with? All of the large files I have are customer related data that I cannot run tests on to prevent the data going to the debug output. I need a large file so I have time to check for upload progress and kill the ftp before the ftp completes. Do you have a better idea how to partially upload a file to test the resume? Thank you. Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Wednesday, May 26, 2010 11:30 AM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 >
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Wed, May 26, 2010 3:20:45 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> http://rt.cpan.org/Ticket/Display.html?id=57386 >
> Also, would you please remove my script from CPAN bug report page, > which copyrighted property of NISC?
I don't have the required permissions, you would have to ask to the RT administrators to do it: rt-cpan-admin@bestpractical.com The latest version of the module is available from http://search.cpan.org/CPAN/authors/id/S/SA/SALVA/Net-SFTP-Foreign-1.58_02.tar.gz Though I have already tried running the test script under SLES 9 for i386 (not x86_64) and it didn't fail. Would you be able to provide me with some of the PGP files that are failing (with out the PGP keys)? - Salva
  Wed May 26 17:07:03 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: Heather Fischer <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Wed, 26 May 2010 16:06:41 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
I found a large test file on the Internet to work with. With the new module installed, the "resume" didn't even resume the transfer. It restarted it as you can see by the bytes size on the file when it went from 295516160 bytes to 16977048 bytes in my "ls -ltr" when the transmission was restarted instead of continuing on where it left off. I need to redo and capture the proper debug output for you. This is all I have for today. teconv:~/test:-> ls -ltr total 1338766 drwxrwxrwx 2 hfischer domain 80 Apr 16 14:57 incoming/ drwxrwxrwx 3 hfischer domain 424 May 7 09:11 archive/ drwxrwxrwx 3 hfischer domain 352 May 19 13:05 outgoing/ -rw-rw-rw- 1 hfischer domain 537166134 May 26 15:41 512MB.zip.gpg.good -rw-rw-rw- 1 hfischer domain 536870912 May 26 15:43 512MB.zip.good -rw-rw-rw- 1 hfischer domain 295516160 May 26 16:01 tmp.512MB.zip.gpg.tmp teconv:~/test:-> ls -ltr total 1338766 drwxrwxrwx 2 hfischer domain 80 Apr 16 14:57 incoming/ drwxrwxrwx 3 hfischer domain 424 May 7 09:11 archive/ drwxrwxrwx 3 hfischer domain 352 May 19 13:05 outgoing/ -rw-rw-rw- 1 hfischer domain 537166134 May 26 15:41 512MB.zip.gpg.good -rw-rw-rw- 1 hfischer domain 536870912 May 26 15:43 512MB.zip.good -rw-rw-rw- 1 hfischer domain 295516160 May 26 16:01 tmp.512MB.zip.gpg.tmp teconv:~/test:-> ls -ltr total 1338766 drwxrwxrwx 2 hfischer domain 80 Apr 16 14:57 incoming/ drwxrwxrwx 3 hfischer domain 424 May 7 09:11 archive/ drwxrwxrwx 3 hfischer domain 352 May 19 13:05 outgoing/ -rw-rw-rw- 1 hfischer domain 537166134 May 26 15:41 512MB.zip.gpg.good -rw-rw-rw- 1 hfischer domain 536870912 May 26 15:43 512MB.zip.good -rw-rw-rw- 1 hfischer domain 295516160 May 26 16:01 tmp.512MB.zip.gpg.tmp teconv:~/test:-> ls -ltr total 1066488 drwxrwxrwx 2 hfischer domain 80 Apr 16 14:57 incoming/ drwxrwxrwx 3 hfischer domain 424 May 7 09:11 archive/ drwxrwxrwx 3 hfischer domain 352 May 19 13:05 outgoing/ -rw-rw-rw- 1 hfischer domain 537166134 May 26 15:41 512MB.zip.gpg.good -rw-rw-rw- 1 hfischer domain 536870912 May 26 15:43 512MB.zip.good -rw-rw-rw- 1 hfischer domain 16977048 May 26 16:02 tmp.512MB.zip.gpg.tmp teconv:~/test:-> ls -ltr total 1185300 drwxrwxrwx 2 hfischer domain 80 Apr 16 14:57 incoming/ drwxrwxrwx 3 hfischer domain 424 May 7 09:11 archive/ drwxrwxrwx 3 hfischer domain 352 May 19 13:05 outgoing/ -rw-rw-rw- 1 hfischer domain 537166134 May 26 15:41 512MB.zip.gpg.good -rw-rw-rw- 1 hfischer domain 536870912 May 26 15:43 512MB.zip.good -rw-rw-rw- 1 hfischer domain 138469624 May 26 16:02 tmp.512MB.zip.gpg.tmp teconv:~/test:-> ls -ltr total 1355310 drwxrwxrwx 2 hfischer domain 80 Apr 16 14:57 incoming/ drwxrwxrwx 3 hfischer domain 424 May 7 09:11 archive/ drwxrwxrwx 3 hfischer domain 352 May 19 13:05 outgoing/ -rw-rw-rw- 1 hfischer domain 537166134 May 26 15:41 512MB.zip.gpg.good -rw-rw-rw- 1 hfischer domain 536870912 May 26 15:43 512MB.zip.good -rw-rw-rw- 1 hfischer domain 312442880 May 26 16:02 tmp.512MB.zip.gpg.tmp teconv:~/test:-> ls -ltr total 1427124 drwxrwxrwx 2 hfischer domain 80 Apr 16 14:57 incoming/ drwxrwxrwx 3 hfischer domain 424 May 7 09:11 archive/ drwxrwxrwx 3 hfischer domain 352 May 19 13:05 outgoing/ -rw-rw-rw- 1 hfischer domain 537166134 May 26 15:41 512MB.zip.gpg.good -rw-rw-rw- 1 hfischer domain 536870912 May 26 15:43 512MB.zip.good -rw-rw-rw- 1 hfischer domain 385900536 May 26 16:02 tmp.512MB.zip.gpg.tmp teconv:~/test:-> ls -ltr total 1500912 drwxrwxrwx 2 hfischer domain 80 Apr 16 14:57 incoming/ drwxrwxrwx 3 hfischer domain 424 May 7 09:11 archive/ drwxrwxrwx 3 hfischer domain 352 May 19 13:05 outgoing/ -rw-rw-rw- 1 hfischer domain 537166134 May 26 15:41 512MB.zip.gpg.good -rw-rw-rw- 1 hfischer domain 536870912 May 26 15:43 512MB.zip.good -rw-rw-rw- 1 hfischer domain 461353056 May 26 16:02 tmp.512MB.zip.gpg.tmp teconv:~/test:-> ls -ltr total 1574984 drwxrwxrwx 2 hfischer domain 80 Apr 16 14:57 incoming/ drwxrwxrwx 3 hfischer domain 424 May 7 09:11 archive/ drwxrwxrwx 3 hfischer domain 352 May 19 13:05 outgoing/ -rw-rw-rw- 1 hfischer domain 537166134 May 26 15:41 512MB.zip.gpg.good -rw-rw-rw- 1 hfischer domain 536870912 May 26 15:43 512MB.zip.good -rw-rw-rw- 1 hfischer domain 537166134 May 26 16:02 512MB.zip.gpg teconv:~/test:-> ls -ltr total 1574984 drwxrwxrwx 2 hfischer domain 80 Apr 16 14:57 incoming/ drwxrwxrwx 3 hfischer domain 424 May 7 09:11 archive/ drwxrwxrwx 3 hfischer domain 352 May 19 13:05 outgoing/ -rw-rw-rw- 1 hfischer domain 537166134 May 26 15:41 512MB.zip.gpg.good -rw-rw-rw- 1 hfischer domain 536870912 May 26 15:43 512MB.zip.good -rw-rw-rw- 1 hfischer domain 537166134 May 26 16:02 512MB.zip.gpg teconv:~/test:-> Heather Fischer___________________ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Heather Fischer Sent: Wednesday, May 26, 2010 2:05 PM To: bug-Net-SFTP-Foreign@rt.cpan.org Cc: 'heather.fischer@nisc.coop' Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug Hello, I installed the new version on our test server. Do you have a very large test file I could test with? All of the large files I have are customer related data that I cannot run tests on to prevent the data going to the debug output. I need a large file so I have time to check for upload progress and kill the ftp before the ftp completes. Do you have a better idea how to partially upload a file to test the resume? Thank you. Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Wednesday, May 26, 2010 11:30 AM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 >
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Wed, May 26, 2010 3:20:45 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> http://rt.cpan.org/Ticket/Display.html?id=57386 >
> Also, would you please remove my script from CPAN bug report page, > which copyrighted property of NISC?
I don't have the required permissions, you would have to ask to the RT administrators to do it: rt-cpan-admin@bestpractical.com The latest version of the module is available from http://search.cpan.org/CPAN/authors/id/S/SA/SALVA/Net-SFTP-Foreign-1.58_02.tar.gz Though I have already tried running the test script under SLES 9 for i386 (not x86_64) and it didn't fail. Would you be able to provide me with some of the PGP files that are failing (with out the PGP keys)? - Salva
  Wed May 26 18:43:31 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Wed, 26 May 2010 15:43:22 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
Show quoted text
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Wed, May 26, 2010 11:07:04 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
I found a
> large test file on the Internet to work with. With the new module > installed, the "resume" didn't even resume the transfer. It restarted it > as you can see by the bytes size on the file when it went from 295516160 bytes > to 16977048 bytes in my "ls -ltr" when the transmission was restarted instead of > continuing on where it left off.
This looks like a completely different issue. Are you using the resume => 'auto' feature? Are you using NTP or any other mean to keep the times on your machines synchronized? Also, "ls -ltr" does not show the modification time of the file but the creation time, next time use "ls -clrt" instead. I have uploaded a new development version of the module that also generates debugging info for the auto-resume feature. You can get it from http://search.cpan.org/CPAN/authors/id/S/SA/SALVA/Net-SFTP-Foreign-1.58_03.tar.gz - Salva
  Thu May 27 09:25:50 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: "heather.fischer [...] nisc.coop" <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 27 May 2010 08:25:49 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Hello Salva, I am using "resume => 1" as before, which is why I reported this to you. This version 1.58_02 is not behaving as it did with the 1.55 version did. 1.55 would resume all file transfers, but only corrupted the Gnupg encrypted files. Now with the 1.58_02 version, the resume isn't even working. $sftp->put("$ldir/$tranfle", "$tmplclfle", resume => 1); The time on our servers are synchronized. I verified between the two servers I'm testing on, but is irrelevant since I'm not using "resume => auto". I will be happy to capture the debug output you requested, but need a version where the resume works for "resume => 1" and includes the additional debugging you added. Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Wednesday, May 26, 2010 5:44 PM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: http://rt.cpan.org/Ticket/Display.html?id=57386 >
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Wed, May 26, 2010 11:07:04 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
I found a
> large test file on the Internet to work with. With the new module > installed, the "resume" didn't even resume the transfer. It restarted it > as you can see by the bytes size on the file when it went from 295516160 bytes > to 16977048 bytes in my "ls -ltr" when the transmission was restarted instead of > continuing on where it left off.
This looks like a completely different issue. Are you using the resume => 'auto' feature? Are you using NTP or any other mean to keep the times on your machines synchronized? Also, "ls -ltr" does not show the modification time of the file but the creation time, next time use "ls -clrt" instead. I have uploaded a new development version of the module that also generates debugging info for the auto-resume feature. You can get it from http://search.cpan.org/CPAN/authors/id/S/SA/SALVA/Net-SFTP-Foreign-1.58_03.tar.gz - Salva
  Thu May 27 10:43:56 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 27 May 2010 07:43:48 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
Show quoted text
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, May 27, 2010 3:25:51 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hello
> Salva,
I am using "resume => 1" as before, which is why I reported
> this to you. This version 1.58_02 is not behaving as it did with the 1.55 > version did. 1.55 would resume all file transfers, but only corrupted the > Gnupg encrypted files. Now with the 1.58_02 version, the resume isn't even > working.
$sftp->put("$ldir/$tranfle", "$tmplclfle", resume => 1);
>
The time on our servers are synchronized. I verified between the
> two servers I'm testing on, but is irrelevant since I'm not using "resume => > auto".
> I will be happy to capture the debug output you requested, but > need a version where the resume works for "resume => 1" and includes the > additional debugging you added.
1.58_03 works for me. Could you install it, set in your tests $Net::SFTP::Foreign::debug = 20643; and run them? it will show why it is not resuming and maybe also why the transfer gets corrupted. - Salva
  Thu May 27 10:47:54 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: "heather.fischer [...] nisc.coop" <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 27 May 2010 09:47:38 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Ignore my last message. I was ftping the file and not sftping to it was using the Net::FTP module and not yours. Sorry for the confusion. I'll do as you suggested below and send the debug info. Heather Fischer_ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Thursday, May 27, 2010 9:44 AM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 >
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, May 27, 2010 3:25:51 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hello
> Salva,
I am using "resume => 1" as before, which is why I reported
> this to you. This version 1.58_02 is not behaving as it did with the 1.55 > version did. 1.55 would resume all file transfers, but only corrupted the > Gnupg encrypted files. Now with the 1.58_02 version, the resume isn't even > working.
$sftp->put("$ldir/$tranfle", "$tmplclfle", resume => 1);
>
The time on our servers are synchronized. I verified between the
> two servers I'm testing on, but is irrelevant since I'm not using "resume => > auto".
> I will be happy to capture the debug output you requested, but > need a version where the resume works for "resume => 1" and includes the > additional debugging you added.
1.58_03 works for me. Could you install it, set in your tests $Net::SFTP::Foreign::debug = 20643; and run them? it will show why it is not resuming and maybe also why the transfer gets corrupted. - Salva
  Thu May 27 11:48:56 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: Heather Fischer <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 27 May 2010 10:48:00 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Hi Salva, Attached is a document that contains some notes. Also attached are the debug logs. The "orig" is the debug from the first put that was killed during transmission. The "resume" log is when the transfer is resumed and file transmissions completes. Please let me know if you have any questions. Thank you. Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Heather Fischer Sent: Thursday, May 27, 2010 9:48 AM To: bug-Net-SFTP-Foreign@rt.cpan.org Cc: 'heather.fischer@nisc.coop' Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug Ignore my last message. I was ftping the file and not sftping to it was using the Net::FTP module and not yours. Sorry for the confusion. I'll do as you suggested below and send the debug info. Heather Fischer_ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Thursday, May 27, 2010 9:44 AM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 >
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, May 27, 2010 3:25:51 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hello
> Salva,
I am using "resume => 1" as before, which is why I reported
> this to you. This version 1.58_02 is not behaving as it did with the > 1.55 version did. 1.55 would resume all file transfers, but only > corrupted the Gnupg encrypted files. Now with the 1.58_02 version, > the resume isn't even working.
$sftp->put("$ldir/$tranfle", "$tmplclfle", resume => 1);
>
The time on our servers are synchronized. I verified between the
> two servers I'm testing on, but is irrelevant since I'm not using > "resume => auto".
> I will be happy to capture the debug output you requested, but need a > version where the resume works for "resume => 1" and includes the > additional debugging you added.
1.58_03 works for me. Could you install it, set in your tests $Net::SFTP::Foreign::debug = 20643; and run them? it will show why it is not resuming and maybe also why the transfer gets corrupted. - Salva
Download net_sftp_resume_test_1.58_03.doc
application/msword 31k

Message body not shown because it is not plain text.

Download secfiletrans052710-orig.out.gz
application/x-gzip 271.3k

Message body not shown because it is not plain text.

Download secfiletrans052710-resume.out.gz
application/x-gzip 594.5k

Message body not shown because it is not plain text.

  Wed Jun 02 13:01:06 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: Heather Fischer <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Wed, 2 Jun 2010 12:01:04 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
From: Heather Fischer Sent: Wednesday, June 02, 2010 11:56 AM To: 'salva@cpan.org' Cc: Heather Fischer Subject: Copy_perm Option Hi Salva, I encountered this same issue trying to upload a file to a WS_FTP-SSH_1.1 server. I tried your suggestion and it worked. I am very thankful I found this issue and solution on Google otherwise I was thinking it was my script's issue. Are there any consequences to turning this option off for all other transfers? http://www.perlmonks.org/?node_id=717506 Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Heather Fischer Sent: Thursday, May 27, 2010 10:48 AM To: 'bug-Net-SFTP-Foreign@rt.cpan.org' Cc: Heather Fischer Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug Hi Salva, Attached is a document that contains some notes. Also attached are the debug logs. The "orig" is the debug from the first put that was killed during transmission. The "resume" log is when the transfer is resumed and file transmissions completes. Please let me know if you have any questions. Thank you. Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776
-----Original Message----- From: Heather Fischer Sent: Thursday, May 27, 2010 9:48 AM To: bug-Net-SFTP-Foreign@rt.cpan.org Cc: 'heather.fischer@nisc.coop' Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug Ignore my last message. I was ftping the file and not sftping to it was using the Net::FTP module and not yours. Sorry for the confusion. I'll do as you suggested below and send the debug info. Heather Fischer_ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Thursday, May 27, 2010 9:44 AM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 >
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, May 27, 2010 3:25:51 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hello
> Salva,
I am using "resume => 1" as before, which is why I reported
> this to you. This version 1.58_02 is not behaving as it did with the > 1.55 version did. 1.55 would resume all file transfers, but only > corrupted the Gnupg encrypted files. Now with the 1.58_02 version, > the resume isn't even working.
$sftp->put("$ldir/$tranfle", "$tmplclfle", resume => 1);
>
The time on our servers are synchronized. I verified between the
> two servers I'm testing on, but is irrelevant since I'm not using > "resume => auto".
> I will be happy to capture the debug output you requested, but need a > version where the resume works for "resume => 1" and includes the > additional debugging you added.
1.58_03 works for me. Could you install it, set in your tests $Net::SFTP::Foreign::debug = 20643; and run them? it will show why it is not resuming and maybe also why the transfer gets corrupted. - Salva
  Thu Jun 10 16:01:08 2010 Heather.Fischer [...] nisc.coop - Correspondence added
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 10 Jun 2010 15:01:17 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Any luck with this? Heather Fischer___________________ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Heather Fischer Sent: Thursday, May 27, 2010 10:48 AM To: 'bug-Net-SFTP-Foreign@rt.cpan.org' Cc: Heather Fischer Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug Hi Salva, Attached is a document that contains some notes. Also attached are the debug logs. The "orig" is the debug from the first put that was killed during transmission. The "resume" log is when the transfer is resumed and file transmissions completes. Please let me know if you have any questions. Thank you. Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776
-----Original Message----- From: Heather Fischer Sent: Thursday, May 27, 2010 9:48 AM To: bug-Net-SFTP-Foreign@rt.cpan.org Cc: 'heather.fischer@nisc.coop' Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug Ignore my last message. I was ftping the file and not sftping to it was using the Net::FTP module and not yours. Sorry for the confusion. I'll do as you suggested below and send the debug info. Heather Fischer_ Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Thursday, May 27, 2010 9:44 AM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 >
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, May 27, 2010 3:25:51 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hello
> Salva,
I am using "resume => 1" as before, which is why I reported
> this to you. This version 1.58_02 is not behaving as it did with the > 1.55 version did. 1.55 would resume all file transfers, but only > corrupted the Gnupg encrypted files. Now with the 1.58_02 version, > the resume isn't even working.
$sftp->put("$ldir/$tranfle", "$tmplclfle", resume => 1);
>
The time on our servers are synchronized. I verified between the
> two servers I'm testing on, but is irrelevant since I'm not using > "resume => auto".
> I will be happy to capture the debug output you requested, but need a > version where the resume works for "resume => 1" and includes the > additional debugging you added.
1.58_03 works for me. Could you install it, set in your tests $Net::SFTP::Foreign::debug = 20643; and run them? it will show why it is not resuming and maybe also why the transfer gets corrupted. - Salva
  Thu Jun 10 17:13:28 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 10 Jun 2010 14:13:19 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
Not really. I am still unable to reproduce the problem and the logs you sent did not show any error. Where you able to run the resume_put.pl script from the samples directory? - Salva Show quoted text
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, June 10, 2010 10:01:08 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Any luck with
> this?
Heather
> Fischer___________________
Senior Systems Specialist National Information
> Solutions Cooperative
3201 Nygren Drive Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Heather Fischer
>
Sent: Thursday, May 27, 2010 10:48 AM To: '
> ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org'
Cc:
> Heather Fischer
Subject: RE: [
> href="http://rt.cpan.org">rt.cpan.org #57386] Net-SFTP-Foreign Bug
Hi
> Salva,
Attached is a document that contains some notes. Also
> attached are the debug logs. The "orig" is the debug from the first put > that was killed during transmission. The "resume" log is when the transfer is > resumed and file transmissions completes. Please let me know if you have > any questions.
Thank you. Heather Fischer Senior Systems
> Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Heather
> Fischer
Sent: Thursday, May 27, 2010 9:48 AM To:
> ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org
Cc:
> ' > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop'
Subject:
> RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Ignore my last
> message. I was ftping the file and not sftping to it was using the > Net::FTP module and not yours. Sorry for the confusion. I'll do as you suggested > below and send the debug info.
Heather Fischer_ Senior Systems
> Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Salvador
> \"Fandiño\" via RT [mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org]
Sent:
> Thursday, May 27, 2010 9:44 AM
To: Heather Fischer Subject: Re:
> [rt.cpan.org #57386] Net-SFTP-Foreign Bug
<URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 > >
----- Original Message ----
> From: Heather > Fischer via RT < > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org> > > Sent: Thu, May 27, 2010 3:25:51 PM > Subject: RE: [rt.cpan.org #57386] > Net-SFTP-Foreign Bug > > Queue: > Net-SFTP-Foreign
Ticket <URL:
> href=" > href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
>
> > > >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hello
> > Salva,
I am using "resume => 1" as before, which is why I reported
> > this to you. This version 1.58_02 is not behaving as it did with > the > 1.55 version did. 1.55 would resume all file transfers, but > only > corrupted the Gnupg encrypted files. Now with the 1.58_02 > version, > the resume isn't even > working.
$sftp->put("$ldir/$tranfle", "$tmplclfle", resume => 1);
> >
The time on our servers are synchronized. I verified
> between the > two servers I'm testing on, but is irrelevant since I'm not > using > "resume => auto".
> I will be happy to capture the > debug output you requested, but need a > version where the resume works > for "resume => 1" and includes the > additional debugging you > added.
1.58_03 works for me. Could you install it, set in your
> tests
$Net::SFTP::Foreign::debug = 20643; and run
> them?
it will show why it is not resuming and maybe also why the transfer
> gets corrupted.
- Salva
  Thu Jun 10 17:17:27 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Thu, 10 Jun 2010 14:17:16 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
Show quoted text
----- Original Message ----
> From: "Salvador \"Fandiño\" via RT" <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, June 10, 2010 11:13:28 PM > Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Where you able to run the resume_put.pl script from the samples > directory?
oops, I meant, *were* you able to...
  Fri Jun 11 13:19:20 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: "heather.fischer [...] nisc.coop" <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Fri, 11 Jun 2010 12:19:17 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Hi, I have not run the script as I'm not comfortable running a script someone else wrote on our system. I took a look at it, but your code is above my level of Perl understanding. What exactly does the script do? Looks like it needs two parameters of what appear to be the file length and gpg id. Not sure what the gpg needs to be as I've never used that option and what about the file length. Is that in bytes or record count or something else? Is the file just renaming on the local server as I don't see any login credential code? Thanks. Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 Show quoted text
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Thursday, June 10, 2010 4:13 PM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 > Not really. I am still unable to reproduce the problem and the logs you sent did not show any error. Where you able to run the resume_put.pl script from the samples directory? - Salva
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Thu, June 10, 2010 10:01:08 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Any luck with
> this?
Heather
> Fischer___________________
Senior Systems Specialist National Information
> Solutions Cooperative
3201 Nygren Drive Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Heather Fischer
>
Sent: Thursday, May 27, 2010 10:48 AM To: '
> ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org'
Cc:
> Heather Fischer
Subject: RE: [
> href="http://rt.cpan.org">rt.cpan.org #57386] Net-SFTP-Foreign Bug
Hi
> Salva,
Attached is a document that contains some notes. Also
> attached are the debug logs. The "orig" is the debug from the first put > that was killed during transmission. The "resume" log is when the transfer is > resumed and file transmissions completes. Please let me know if you have > any questions.
Thank you. Heather Fischer Senior Systems
> Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Heather
> Fischer
Sent: Thursday, May 27, 2010 9:48 AM To:
> ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org
Cc:
> ' > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop'
Subject:
> RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Ignore my last
> message. I was ftping the file and not sftping to it was using the > Net::FTP module and not yours. Sorry for the confusion. I'll do as you suggested > below and send the debug info.
Heather Fischer_ Senior Systems
> Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Salvador
> \"Fandiño\" via RT [mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org]
Sent:
> Thursday, May 27, 2010 9:44 AM
To: Heather Fischer Subject: Re:
> [rt.cpan.org #57386] Net-SFTP-Foreign Bug
<URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 > >
----- Original Message ----
> From: Heather > Fischer via RT < > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org> > > Sent: Thu, May 27, 2010 3:25:51 PM > Subject: RE: [rt.cpan.org #57386] > Net-SFTP-Foreign Bug > > Queue: > Net-SFTP-Foreign
Ticket <URL:
> href=" > href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
>
> > > >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hello
> > Salva,
I am using "resume => 1" as before, which is why I reported
> > this to you. This version 1.58_02 is not behaving as it did with > the > 1.55 version did. 1.55 would resume all file transfers, but > only > corrupted the Gnupg encrypted files. Now with the 1.58_02 > version, > the resume isn't even > working.
$sftp->put("$ldir/$tranfle", "$tmplclfle", resume => 1);
> >
The time on our servers are synchronized. I verified
> between the > two servers I'm testing on, but is irrelevant since I'm not > using > "resume => auto".
> I will be happy to capture the > debug output you requested, but need a > version where the resume works > for "resume => 1" and includes the > additional debugging you > added.
1.58_03 works for me. Could you install it, set in your
> tests
$Net::SFTP::Foreign::debug = 20643; and run
> them?
it will show why it is not resuming and maybe also why the transfer
> gets corrupted.
- Salva
  Fri Jun 11 16:52:32 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Fri, 11 Jun 2010 13:52:24 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
Show quoted text
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Fri, June 11, 2010 7:19:21 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hi,
> I have not run the script as I'm not comfortable running a script someone else > wrote on our system.
You are already running my code on your system! Do you think that being it an script or a module makes any difference?
> I took a look at it, but your code is above my level > of Perl understanding.
> What exactly does the script do?
It repeatedly creates random files, encrypts them using pgp and simulates a resumed put operation checking for errors.
> Looks like > it needs two parameters of what appear to be the file length and gpg id. > Not sure what the gpg needs to be as I've never used that option and what about > the file length. Is that in bytes or record count or something else?
Yes, the first argument is the maximum length of the generated files. The second argument is the id of the pgp public key (and email address) used for encrypting the file. $ perl -Ilib samples/resume_put.pl 1000000 some-pgp-id@foo.com You can create one pgp key running... $ gpg --gen-key It will ask you some questions, you can just accept the defaults when given. At some point it would ask for a name and and email, the email is the id you should to the put-resume.pl script later.
> Is the file just renaming on the local server as I don't see any login credential > code?
It connects to localhost and expects to have public keys authentication configured in order to not require passwords, though you could modify it to use passwords if you prefer it that way. - Salva
  Fri Jun 11 16:52:44 2010 Heather.Fischer [...] nisc.coop - Correspondence added
Subject: Out of Office AutoReply: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Fri, 11 Jun 2010 15:53:00 -0500
To: Salvador \"Fandiño\" via RT <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
I am currently out of the office and am unable to repond to your message at this time. I will return to the office on Tuesday, June 15th. If you need immediate assistance, please email tele-tech@nisc.coop. Thank you. Heather
  Fri Jun 11 16:56:49 2010 sfandino [...] yahoo.com - Correspondence added
Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Fri, 11 Jun 2010 13:56:41 -0700 (PDT)
To: bug-Net-SFTP-Foreign [...] rt.cpan.org
From: Salvador Fandino <sfandino [...] yahoo.com>
Just one question: Are you encrypting the file with pgp again before resuming the transfer? I mean, are you doing this: 1) encrypt the file 2) partial put 3) encrypt the file again 4) resume the put operation ? - Salva Show quoted text
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Fri, June 11, 2010 7:19:21 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hi, I
> have not run the script as I'm not comfortable running a script someone else > wrote on our system.
I took a look at it, but your code is above my level
> of Perl understanding.
What exactly does the script do? Looks like
> it needs two parameters of what appear to be the file length and gpg id. > Not sure what the gpg needs to be as I've never used that option and what about > the file length. Is that in bytes or record count or something else?
Is
> the file just renaming on the local server as I don't see any login credential > code?
Thanks. Heather Fischer Senior Systems
> Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Salvador
> \"Fandiño\" via RT [mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org] >
Sent: Thursday, June 10, 2010 4:13 PM To: Heather Fischer Subject: Re:
> [rt.cpan.org #57386] > Net-SFTP-Foreign Bug
<URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Not
> really.
I am still unable to reproduce the problem and the logs you sent
> did not show any error.
Where you able to run the
> href="http://resume_put.pl">resume_put.pl script from the samples > directory?
- Salva
----- Original Message ----
> > From: Heather Fischer via RT < > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org> > > Sent: Thu, June 10, 2010 10:01:08 PM > Subject: RE: [rt.cpan.org #57386] > Net-SFTP-Foreign Bug > > Queue: > Net-SFTP-Foreign
Ticket <URL:
> href=" > href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
>
> > > >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Any luck with
> > this?
Heather
> > Fischer___________________
Senior Systems Specialist National Information
> > Solutions Cooperative
3201 Nygren Drive Mandan, ND
> 58554
**Email:
> ymailto="mailto: > ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop" > > href="mailto: > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop"> > ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> > 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
> >
-----Original Message----- From: Heather
> Fischer >
Sent: Thursday, May 27, 2010 10:48 AM To: '
> > ymailto="mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org" > > href="mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org"> > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org'
Cc:
> > Heather Fischer
Subject: RE: [
> > href="http://rt.cpan.org">rt.cpan.org #57386] Net-SFTP-Foreign Bug
Hi
> > Salva,
Attached is a document that contains some notes.
> Also > attached are the debug logs. The "orig" is the debug from > the first put > that was killed during transmission. The "resume" log is > when the transfer is > resumed and file transmissions completes. > Please let me know if you have > any questions.
Thank you.
>
Heather Fischer Senior Systems
> Specialist
National
> Information Solutions Cooperative
3201 Nygren
> Drive
Mandan, ND
> 58554
**Email:
> ymailto="mailto: > ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop" > > href="mailto: > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop"> > ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> > 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
> >
-----Original Message----- From: Heather
> > Fischer
Sent: Thursday, May 27, 2010 9:48 AM To:
> > ymailto="mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org" > > href="mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org"> > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org
Cc:
> > ' > href="mailto: > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop"> > ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop'
Subject:
> > RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Ignore my last
> > message. I was ftping the file and not sftping to it was using > the > Net::FTP module and not yours. Sorry for the confusion. I'll do as > you suggested > below and send the debug info.
Heather
> Fischer_
Senior Systems
> Specialist
National Information Solutions
> Cooperative
3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> > ymailto="mailto: > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop" > > href="mailto: > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop"> > ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> > 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
> >
-----Original Message----- From: Salvador
> > \"Fandiño\" via RT [mailto: > href="mailto: > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org"> > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org]
Sent:
> > Thursday, May 27, 2010 9:44 AM
To: Heather Fischer Subject: Re:
> > [rt.cpan.org #57386] Net-SFTP-Foreign Bug
<URL:
> > href="
> >https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
>
> > > >https://rt.cpan.org/Ticket/Display.html?id=57386
>
> >
----- Original Message ----
> From: Heather > > Fischer via RT < > href="mailto: > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org"> > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org> > > > Sent: Thu, May 27, 2010 3:25:51 PM > Subject: RE: [rt.cpan.org > #57386] > Net-SFTP-Foreign Bug > > > Queue: > Net-SFTP-Foreign
Ticket <URL:
> > href=" > href=" > target=_blank >https://rt.cpan.org/Ticket/Display.html?id=57386" > target=_blank
> >
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >
> > > >
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hello
> > > Salva,
I am using "resume => 1" as before, which is why I
> reported > > this to you. This version 1.58_02 is not > behaving as it did with > the > 1.55 version did. 1.55 would > resume all file transfers, but > only > corrupted the Gnupg > encrypted files. Now with the 1.58_02 > version, > the > resume isn't even > working.
$sftp->put("$ldir/$tranfle",
> "$tmplclfle", resume => 1); > >
The time on our servers
> are synchronized. I verified > between the > two servers I'm > testing on, but is irrelevant since I'm not > using > "resume > => auto".
> I will be happy to capture the > debug output > you requested, but need a > version where the resume works > for > "resume => 1" and includes the > additional debugging you > > added.
1.58_03 works for me. Could you install it, set in your
> > tests
$Net::SFTP::Foreign::debug = 20643; and run
> > them?
it will show why it is not resuming and maybe also why the
> transfer > gets corrupted.
- Salva
  Fri Jun 11 17:09:34 2010 Heather.Fischer [...] nisc.coop - Correspondence added
CC: "heather.fischer [...] nisc.coop" <Heather.Fischer [...] nisc.coop>
Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Date: Fri, 11 Jun 2010 16:09:31 -0500
To: <bug-Net-SFTP-Foreign [...] rt.cpan.org>
From: Heather Fischer <Heather.Fischer [...] nisc.coop>
Yes. I bet that is the problem since the same file encrypted can have slightly different byte sizes encrypted due to the way encryption works. I set it up that way so that the encrypted file that failed to send is cleaned up on the local server when the script exits. I'm assuming that the sftp::foreign resume option will not work in this case? This also explains why resume worked when getting encrypted files because the file on the remote server stayed in the original encrypted state. So in order for the resume to work for putting encrypted files, I need to leave the original sftp attempted encrypted file on disk and not clean it up and create a new one on the second attempt. I will see if this will fit into the logic of what we want to accomplish. Thank you. Heather Fischer Senior Systems Specialist National Information Solutions Cooperative 3201 Nygren Drive Mandan, ND 58554 **Email: heather.fischer@nisc.coop **Phone: 866.WWW.NISC (866.999.6472) ext 6776 **Direct: 701-667-6776 P Please consider the environment before printing this email. Show quoted text
-----Original Message----- From: Salvador \"Fandiño\" via RT [mailto:bug-Net-SFTP-Foreign@rt.cpan.org] Sent: Friday, June 11, 2010 3:57 PM To: Heather Fischer Subject: Re: [rt.cpan.org #57386] Net-SFTP-Foreign Bug <URL: https://rt.cpan.org/Ticket/Display.html?id=57386 > Just one question: Are you encrypting the file with pgp again before resuming the transfer? I mean, are you doing this: 1) encrypt the file 2) partial put 3) encrypt the file again 4) resume the put operation ? - Salva
----- Original Message ----
> From: Heather Fischer via RT <bug-Net-SFTP-Foreign@rt.cpan.org> > Sent: Fri, June 11, 2010 7:19:21 PM > Subject: RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug > > Queue: Net-SFTP-Foreign
Ticket <URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hi, I
> have not run the script as I'm not comfortable running a script someone else > wrote on our system.
I took a look at it, but your code is above my level
> of Perl understanding.
What exactly does the script do? Looks like
> it needs two parameters of what appear to be the file length and gpg id. > Not sure what the gpg needs to be as I've never used that option and what about > the file length. Is that in bytes or record count or something else?
Is
> the file just renaming on the local server as I don't see any login credential > code?
Thanks. Heather Fischer Senior Systems
> Specialist
National Information Solutions Cooperative 3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
>
-----Original Message----- From: Salvador
> \"Fandiño\" via RT [mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org] >
Sent: Thursday, June 10, 2010 4:13 PM To: Heather Fischer Subject: Re:
> [rt.cpan.org #57386] > Net-SFTP-Foreign Bug
<URL:
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Not
> really.
I am still unable to reproduce the problem and the logs you sent
> did not show any error.
Where you able to run the
> href="http://resume_put.pl">resume_put.pl script from the samples > directory?
- Salva
----- Original Message ----
> > From: Heather Fischer via RT < > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org> > > Sent: Thu, June 10, 2010 10:01:08 PM > Subject: RE: [rt.cpan.org #57386] > Net-SFTP-Foreign Bug > > Queue: > Net-SFTP-Foreign
Ticket <URL:
> href=" > href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
>
> > > >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Any luck with
> > this?
Heather
> > Fischer___________________
Senior Systems Specialist National Information
> > Solutions Cooperative
3201 Nygren Drive Mandan, ND
> 58554
**Email:
> ymailto="mailto: > ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop" > > href="mailto: > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop"> > ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> > 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
> >
-----Original Message----- From: Heather
> Fischer >
Sent: Thursday, May 27, 2010 10:48 AM To: '
> > ymailto="mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org" > > href="mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org"> > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org'
Cc:
> > Heather Fischer
Subject: RE: [
> > href="http://rt.cpan.org">rt.cpan.org #57386] Net-SFTP-Foreign Bug
Hi
> > Salva,
Attached is a document that contains some notes.
> Also > attached are the debug logs. The "orig" is the debug from > the first put > that was killed during transmission. The "resume" log is > when the transfer is > resumed and file transmissions completes. > Please let me know if you have > any questions.
Thank you.
>
Heather Fischer Senior Systems
> Specialist
National
> Information Solutions Cooperative
3201 Nygren
> Drive
Mandan, ND
> 58554
**Email:
> ymailto="mailto: > ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop" > > href="mailto: > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop"> > ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> > 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
> >
-----Original Message----- From: Heather
> > Fischer
Sent: Thursday, May 27, 2010 9:48 AM To:
> > ymailto="mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org" > > href="mailto: > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org"> > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org
Cc:
> > ' > href="mailto: > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop"> > ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop'
Subject:
> > RE: [rt.cpan.org #57386] Net-SFTP-Foreign Bug
Ignore my last
> > message. I was ftping the file and not sftping to it was using > the > Net::FTP module and not yours. Sorry for the confusion. I'll do as > you suggested > below and send the debug info.
Heather
> Fischer_
Senior Systems
> Specialist
National Information Solutions
> Cooperative
3201 Nygren
> Drive
Mandan, ND 58554 **Email:
> > ymailto="mailto: > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop" > > href="mailto: > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop"> > ymailto="mailto:heather.fischer@nisc.coop" > href="mailto:heather.fischer@nisc.coop">heather.fischer@nisc.coop
**Phone:
> > 866.WWW.NISC (866.999.6472) ext 6776
**Direct: 701-667-6776
> >
-----Original Message----- From: Salvador
> > \"Fandiño\" via RT [mailto: > href="mailto: > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org"> > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org]
Sent:
> > Thursday, May 27, 2010 9:44 AM
To: Heather Fischer Subject: Re:
> > [rt.cpan.org #57386] Net-SFTP-Foreign Bug
<URL:
> > href="
> >https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
>
> > > >https://rt.cpan.org/Ticket/Display.html?id=57386
>
> >
----- Original Message ----
> From: Heather > > Fischer via RT < > href="mailto: > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org"> > ymailto="mailto:bug-Net-SFTP-Foreign@rt.cpan.org" > href="mailto:bug-Net-SFTP-Foreign@rt.cpan.org">bug-Net-SFTP-Foreign@rt.cpan.org> > > > Sent: Thu, May 27, 2010 3:25:51 PM > Subject: RE: [rt.cpan.org > #57386] > Net-SFTP-Foreign Bug > > > Queue: > Net-SFTP-Foreign
Ticket <URL:
> > href=" > href=" > target=_blank >https://rt.cpan.org/Ticket/Display.html?id=57386" > target=_blank
> >
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >
> > > >
> href="https://rt.cpan.org/Ticket/Display.html?id=57386" target=_blank
> >https://rt.cpan.org/Ticket/Display.html?id=57386 >
Hello
> > > Salva,
I am using "resume => 1" as before, which is why I
> reported > > this to you. This version 1.58_02 is not > behaving as it did with > the > 1.55 version did. 1.55 would > resume all file transfers, but > only > corrupted the Gnupg > encrypted files. Now with the 1.58_02 > version, > the > resume isn't even > working.
$sftp->put("$ldir/$tranfle",
> "$tmplclfle", resume => 1); > >
The time on our servers
> are synchronized. I verified > between the > two servers I'm > testing on, but is irrelevant since I'm not > using > "resume > => auto".
> I will be happy to capture the > debug output > you requested, but need a > version where the resume works > for > "resume => 1" and includes the > additional debugging you > > added.
1.58_03 works for me. Could you install it, set in your
> > tests
$Net::SFTP::Foreign::debug = 20643; and run
> > them?
it will show why it is not resuming and maybe also why the
> transfer > gets corrupted.
- Salva
  Fri Jun 11 18:46:07 2010 salva [...] cpan.org - TimeWorked changed from '10' to '970'
  Fri Jun 11 18:46:07 2010 salva [...] cpan.org - Status changed from 'open' to 'rejected'