Bug #50017 for libnet: WIN to MAINFRAME ftp bug

Graham, This is the trace for the process. The problem is not on the mainframe since all other data (first 301bytes) was correctly translated using Ascii and represented on the mainframe. Net::FTP>>> Net::FTP(2.77) Net::FTP>>> Exporter(5.60) Net::FTP>>> Net::Cmd(2.27) Net::FTP>>> IO::Socket::INET(1.31) Net::FTP>>> IO::Socket(1.30) Net::FTP>>> IO::Handle(1.27) Net::FTP=GLOB(0x1836038)<<< 220-FTPDJ1 IBM FTP CS V1R8 at NETTCPJ, 14:30:10 on 2009-09-25. Net::FTP=GLOB(0x1836038)<<< 220 Connection will close if idle for more than 5 minutes. Net::FTP=GLOB(0x1836038)>>> USER JFBLL Net::FTP=GLOB(0x1836038)<<< 331 Send password please. Net::FTP=GLOB(0x1836038)>>> PASS .... Net::FTP=GLOB(0x1836038)<<< 230 XXXXX is logged on. Working directory is "XXXXX.". Net::FTP=GLOB(0x1836038)>>> TYPE A Net::FTP=GLOB(0x1836038)<<< 200 Representation type is Ascii NonPrint Net::FTP=GLOB(0x1836038)>>> SITE quote RECFM=FB LRECL=302 BLKSIZE=27784 CYL PRI=10 SEC=1 Net::FTP=GLOB(0x1836038)<<< 200 SITE command was accepted Net::FTP=GLOB(0x1836038)>>> ALLO 101248 Net::FTP=GLOB(0x1836038)<<< 202 ALLO not necessary, you may proceed Net::FTP=GLOB(0x1836038)>>> PASV Net::FTP=GLOB(0x1836038)<<< 227 Entering Passive Mode (149,83,3,21,15,122) Net::FTP=GLOB(0x1836038)>>> STOR 'USER.TEST' Net::FTP=GLOB(0x1836038)<<< 125 Storing data set USER.TEST Net::FTP=GLOB(0x1836038)<<< 250 Transfer completed successfully. Net::FTP=GLOB(0x1836038)>>> QUIT Net::FTP=GLOB(0x1836038)<<< 221 Quit command received. Goodbye. The last byte on mainframe has value of space -9----+----0--- ************** 00000000000 This is NET:FTP problem since I was able to transfer the same data using from DOS prompt and it's looks good on the mainframe F:\>ftp Show quoted text
Connected to 111.11.1.11. 220-FTPDJ1 IBM FTP CS V1R8 at NETTCPJ, 14:41:14 on 2009-09- 220 Connection will close if idle for more than 5 minutes. User (111.11.1.11:(none)): xxxxxl 331 Send password please. Password: 230 xxxxx is logged on. Working directory is "xxxxx.". Show quoted text
200 Port request OK. 125 Storing data set USER.TEST 250 Transfer completed (data was truncated) ftp: 132201 bytes sent in 0.25Seconds 528.80Kbytes/sec. Show quoted text
The last byte on mainframe has value of '0' -9----+----0--- ************** 000000000000 Regards, Bruce Lis Global Operations Technology work. 201-761-7645 "Graham Barr via RT" <bug-libnet@rt.cpan.org> 09/25/2009 10:11 AM Please respond to bug-libnet@rt.cpan.org To BLis@Jefferies.com cc Subject Re: [rt.cpan.org #50017] WIN to MAINFRAME ftp bug <URL: http://rt.cpan.org/Ticket/Display.html?id=50017 > On Sep 25, 2009, at 8:19 AM, Bruce Lis via RT wrote: Show quoted text
I have no experience with a mainframe running OS/390 I see you have Debug turned on, but you did not include it with the ticket. Also, do you happen to have a debug trace form using another ftp client. Do you have a command line ftp client available that can output a protocol trace. Are you sure that ascii is the correct transfer method ? Graham. Jefferies archives and monitors outgoing and incoming e-mail. The contents of this email, including any attachments, are confidential to the ordinary user of the email address to which it was addressed. If you are not the addressee of this email you may not copy, forward, disclose or otherwise use it or any part of it in any form whatsoever. This email may be produced at the request of regulators or in connection with civil litigation. Jefferies accepts no liability for any errors or omissions arising as a result of transmission. Use by other than intended recipients is prohibited. In the United Kingdom, Jefferies operates as Jefferies International Limited; registered in England: no. 1978621; registered office: Vintners Place, 68 Upper Thames Street, London EC4V 3BJ. Jefferies International Limited is authorised and regulated by the Financial Services Authority.

Graham, File looks good by using DOS ftp with "ascii" and "site" commands F:\>ftp Show quoted text
Connected to 111.11.1.11. 220-FTPDJ1 IBM FTP CS V1R8 at NETTCPJ, 16:10:36 on 2009-09-25. 220 Connection will close if idle for more than 5 minutes. User (111.11.1.11:(none)): jfbll 331 Send password please. Password: 230 XXXXX is logged on. Working directory is "XXXXX.". Show quoted text
200 Representation type is Ascii NonPrint Show quoted text
200 SITE command was accepted Show quoted text
200 Port request OK. 125 Storing data set USER.TEST 250 Transfer completed (data was truncated) ftp: 132201 bytes sent in 2.25Seconds 58.78Kbytes/sec. Show quoted text
Regards, Bruce Lis Global Operations Technology work. 201-761-7645 "Graham Barr via RT" <bug-libnet@rt.cpan.org> 09/25/2009 11:52 AM Please respond to bug-libnet@rt.cpan.org To BLis@Jefferies.com cc Subject Re: [rt.cpan.org #50017] WIN to MAINFRAME ftp bug <URL: http://rt.cpan.org/Ticket/Display.html?id=50017 > Bruce, I never suggested it was a mainframe issue, just that I am not familiar with the mainframe at all. Looking at your DOS trace, I do not see any call to set the transfer in ascii mode or the site command that you are sending with Net::FTP, so these two are not comparable. ie, what happens if you do the ascii and site commands from dos and what happens if you do not do those commands with Net::FTP Graham. Jefferies archives and monitors outgoing and incoming e-mail. The contents of this email, including any attachments, are confidential to the ordinary user of the email address to which it was addressed. If you are not the addressee of this email you may not copy, forward, disclose or otherwise use it or any part of it in any form whatsoever. This email may be produced at the request of regulators or in connection with civil litigation. Jefferies accepts no liability for any errors or omissions arising as a result of transmission. Use by other than intended recipients is prohibited. In the United Kingdom, Jefferies operates as Jefferies International Limited; registered in England: no. 1978621; registered office: Vintners Place, 68 Upper Thames Street, London EC4V 3BJ. Jefferies International Limited is authorised and regulated by the Financial Services Authority.

Graham, Please find attached the file that you requested Regards, Bruce Lis Global Operations Technology work. 201-761-7645 "Graham Barr via RT" <bug-libnet@rt.cpan.org> 09/25/2009 01:15 PM Please respond to bug-libnet@rt.cpan.org To BLis@Jefferies.com cc Subject Re: [rt.cpan.org #50017] WIN to MAINFRAME ftp bug <URL: https://rt.cpan.org/Ticket/Display.html?id=50017 > Hi Bruce, Thanks for sending that trace. Sorry for all these requests, but I am just trying to determine what is happening differently What is intriguing me is that Net::FTP sent the command ALLO 101248 but the command line reported ftp: 132201 bytes sent so I am guessing that the file locally does not have \r\n line endings as Net::FTP would have used stat to determine local file size. Is there any chance you can send me the file (directly not via RT) and/ or maybe reproduce the issue with a smaller file. Say one about 8k Graham. Jefferies archives and monitors outgoing and incoming e-mail. The contents of this email, including any attachments, are confidential to the ordinary user of the email address to which it was addressed. If you are not the addressee of this email you may not copy, forward, disclose or otherwise use it or any part of it in any form whatsoever. This email may be produced at the request of regulators or in connection with civil litigation. Jefferies accepts no liability for any errors or omissions arising as a result of transmission. Use by other than intended recipients is prohibited. In the United Kingdom, Jefferies operates as Jefferies International Limited; registered in England: no. 1978621; registered office: Vintners Place, 68 Upper Thames Street, London EC4V 3BJ. Jefferies International Limited is authorised and regulated by the Financial Services Authority.

Graham, This file with one record has the same problem as the large file. Net::FTP>>> Net::FTP(2.77) Net::FTP>>> Exporter(5.60) Net::FTP>>> Net::Cmd(2.27) Net::FTP>>> IO::Socket::INET(1.31) Net::FTP>>> IO::Socket(1.30) Net::FTP>>> IO::Handle(1.27) Net::FTP=GLOB(0x18be728)<<< 220-FTPDJ1 IBM FTP CS V1R8 at NETTCPJ, 19:08:48 on 2009-09-28. Net::FTP=GLOB(0x18be728)<<< 220 Connection will close if idle for more than 5 minutes. Net::FTP=GLOB(0x18be728)>>> USER XXXXX Net::FTP=GLOB(0x18be728)<<< 331 Send password please. Net::FTP=GLOB(0x18be728)>>> PASS .... Net::FTP=GLOB(0x18be728)<<< 230 XXXXX is logged on. Working directory is "XXXXX.". Net::FTP=GLOB(0x18be728)>>> TYPE A Net::FTP=GLOB(0x18be728)<<< 200 Representation type is Ascii NonPrint Net::FTP=GLOB(0x18be728)>>> SITE quote RECFM=FB LRECL=302 BLKSIZE=27784 CYL PRI=10 SEC=1 Net::FTP=GLOB(0x18be728)<<< 200 SITE command was accepted Net::FTP=GLOB(0x18be728)>>> ALLO 306 Net::FTP=GLOB(0x18be728)<<< 202 ALLO not necessary, you may proceed Net::FTP=GLOB(0x18be728)>>> PASV Net::FTP=GLOB(0x18be728)<<< 227 Entering Passive Mode (149,83,3,21,8,236) Net::FTP=GLOB(0x18be728)>>> STOR 'TEST.FILE' Net::FTP=GLOB(0x18be728)<<< 125 Storing data set TEST.FILE Net::FTP=GLOB(0x18be728)<<< 250 Transfer completed successfully. Net::FTP=GLOB(0x18be728)>>> QUIT Net::FTP=GLOB(0x18be728)<<< 221 Quit command received. Goodbye. UNIX ftp has the same problem when going from windows to unix. When I am going from UNIX to Mainframe(NET:FTP) I have no problem, all 302 bytes are sent. Net::FTP>>> Net::FTP(2.77) Net::FTP>>> Exporter(5.60) Net::FTP>>> Net::Cmd(2.27) Net::FTP>>> IO::Socket::INET(1.31) Net::FTP>>> IO::Socket(1.30) Net::FTP>>> IO::Handle(1.27) Net::FTP=GLOB(0x18be850)<<< 220 clearingdev FTP server ready. Net::FTP=GLOB(0x18be850)>>> USER blis Net::FTP=GLOB(0x18be850)<<< 331 Password required for blis. Net::FTP=GLOB(0x18be850)>>> PASS .... Net::FTP=GLOB(0x18be850)<<< 230 User XXXXX logged in. Net::FTP=GLOB(0x18be850)>>> TYPE A Net::FTP=GLOB(0x18be850)<<< 200 Type set to A. Net::FTP=GLOB(0x18be850)>>> ALLO 306 Net::FTP=GLOB(0x18be850)<<< 202 ALLO command ignored. Net::FTP=GLOB(0x18be850)>>> PASV Net::FTP=GLOB(0x18be850)<<< 227 Entering Passive Mode (169,196,22,23,16,199) Net::FTP=GLOB(0x18be850)>>> STOR unix.test Net::FTP=GLOB(0x18be850)<<< 150 Opening ASCII mode data connection for unix.test. Net::FTP=GLOB(0x18be850)<<< 226-WARNING! 1 bare linefeeds received in ASCII mode Net::FTP=GLOB(0x18be850)<<< File may not have transferred correctly. Net::FTP=GLOB(0x18be850)<<< 226 Transfer complete. Net::FTP=GLOB(0x18be850)>>> QUIT Net::FTP=GLOB(0x18be850)<<< 221-You have transferred 304 bytes in 1 files. Net::FTP=GLOB(0x18be850)<<< 221-Total traffic for this session was 770 bytes in 1 transfers. Net::FTP=GLOB(0x18be850)<<< 221-Thank you for using the FTP service on clearingdev. Net::FTP=GLOB(0x18be850)<<< 221 Goodbye. Regards, Bruce Lis Global Operations Technology work. 201-761-7645 "Graham Barr via RT" <bug-libnet@rt.cpan.org> 09/28/2009 03:04 PM Please respond to bug-libnet@rt.cpan.org To BLis@Jefferies.com cc Subject Re: [rt.cpan.org #50017] WIN to MAINFRAME ftp bug <URL: http://rt.cpan.org/Ticket/Display.html?id=50017 > The file you sent looks very small, probably only one record. My suggestion was for a file with several records, say about 30 records. Although you say it goes wrong after the first record so maybe fewer will do. Can you also send me the Net::FTP debug trace and the ftp command line trace for the smaller file and confirm that the smaller file does have the same issue on the mainframe Another test, if you have access to such machines, would be to do the transfer to a unix box and compare the cmdline and Net::FTP transferred files on the unix box. Graham. Jefferies archives and monitors outgoing and incoming e-mail. The contents of this email, including any attachments, are confidential to the ordinary user of the email address to which it was addressed. If you are not the addressee of this email you may not copy, forward, disclose or otherwise use it or any part of it in any form whatsoever. This email may be produced at the request of regulators or in connection with civil litigation. Jefferies accepts no liability for any errors or omissions arising as a result of transmission. Use by other than intended recipients is prohibited. In the United Kingdom, Jefferies operates as Jefferies International Limited; registered in England: no. 1978621; registered office: Vintners Place, 68 Upper Thames Street, London EC4V 3BJ. Jefferies International Limited is authorised and regulated by the Financial Services Authority.