Bug #117005 for File-Slurp: File::Slurp is using deprecated syswrite/sysread on utf8 handles [perl 5.24]

Tue Aug 16 15:25:48 2016 me [...] eboxr.com - Ticket created

Subject:

File::Slurp is using deprecated syswrite/sysread on utf8 handles [perl 5.24]

This is a problem only with perl 5.24 and later, view https://rt.perl.org/Ticket/Display.html?id=125760 Steps to reproduce: Show quoted text

> perl -MFile::Slurp -E 'say $File::Slurp::VERSION'

9999.19 Show quoted text

> perl -MFile::Slurp -E 'my $p = File::Slurp::read_file( $^X, binmode => q{:utf8} ); File::Slurp::write_file( q{/tmp/xx}, { binmode => q{:utf8}, buf_ref => $p } )'

sysread() is deprecated on :utf8 handles at .../File/Slurp.pm line 225. sysread() is deprecated on :utf8 handles at .../File/Slurp.pm line 225. syswrite() is deprecated on :utf8 handles at .../File/Slurp.pm line 506.

Mon Apr 10 18:58:56 2017 LEONT [...] cpan.org - Correspondence added

On Tue Aug 16 15:25:48 2016, atoomic wrote: Show quoted text

> This is a problem only with perl 5.24 and later, view > https://rt.perl.org/Ticket/Display.html?id=125760 > > Steps to reproduce: >

> > perl -MFile::Slurp -E 'say $File::Slurp::VERSION'

> 9999.19 >

> > perl -MFile::Slurp -E 'my $p = File::Slurp::read_file( $^X, binmode > > => q{:utf8} ); File::Slurp::write_file( q{/tmp/xx}, { binmode => > > q{:utf8}, buf_ref => $p } )'

> sysread() is deprecated on :utf8 handles at .../File/Slurp.pm line > 225. > sysread() is deprecated on :utf8 handles at .../File/Slurp.pm line > 225. > syswrite() is deprecated on :utf8 handles at .../File/Slurp.pm line > 506.

This is ultimately a result of fixing the bug underlying #83126 in core. Fixing this may require rewriting quite a bit of File::Slurp. Leon

Mon Apr 10 18:58:57 2017 The RT System itself - Status changed from 'new' to 'open'

Mon Apr 10 19:33:35 2017 uri [...] stemsystems.com - Correspondence added

Subject:	Re: [rt.cpan.org #117005] File::Slurp is using deprecated syswrite/sysread on utf8 handles [perl 5.24]
Date:	Mon, 10 Apr 2017 19:23:22 -0400
To:	bug-File-Slurp [...] rt.cpan.org
From:	Uri Guttman <uri [...] stemsystems.com>

On 04/10/2017 06:58 PM, Leon Timmermans via RT wrote: Show quoted text

> Queue: File-Slurp > Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=117005 > > > On Tue Aug 16 15:25:48 2016, atoomic wrote:

>> This is a problem only with perl 5.24 and later, view >> https://rt.perl.org/Ticket/Display.html?id=125760 >> >> Steps to reproduce: >>

>>> perl -MFile::Slurp -E 'say $File::Slurp::VERSION'

>> 9999.19 >>

>>> perl -MFile::Slurp -E 'my $p = File::Slurp::read_file( $^X, binmode >>> => q{:utf8} ); File::Slurp::write_file( q{/tmp/xx}, { binmode => >>> q{:utf8}, buf_ref => $p } )'

>> sysread() is deprecated on :utf8 handles at .../File/Slurp.pm line >> 225. >> sysread() is deprecated on :utf8 handles at .../File/Slurp.pm line >> 225. >> syswrite() is deprecated on :utf8 handles at .../File/Slurp.pm line >> 506.

> This is ultimately a result of fixing the bug underlying #83126 in core. Fixing this may require rewriting quite a bit of File::Slurp. >

would reading in raw mode first and then converting to utf (with encode) work? i have to get back to hacking my modules so this is a good incentive thanx uri

Mon Apr 17 16:47:18 2017 jik [...] kamens.brookline.ma.us - Cc JIK added

Fri May 12 08:10:11 2017 ppisar [...] redhat.com - Correspondence added

From:

ppisar [...] redhat.com

Dne Po 10.dub.2017 19:33:35, uri@stemsystems.com napsal(a): Show quoted text

> would reading in raw mode first and then converting to utf (with > encode) > work? >

It would fix the warning. But the problem is binmode value has some internal syntax. It's not a plain encoding name. E.g. ":encoding(UTF-8)" is different form ":utf8". Or even ":crlf". (See PerlIO POD.) Should File::Slurp understand the syntax? Fully? Or support only some of them and fail/warn on other ones? Or remove the binmode argument completely and always return byte-string? Or should File::Slurp replace sysread() with high-level PerlIO-aware read()? If yes, then what would happen with support for slurping TTYs and all the other fancy stuff that current code attempts to support?

Tue Oct 16 21:02:54 2018 ANDK [...] cpan.org - Correspondence added

Now a fatality. Since this commit in bleadperl: https://perl5.git.perl.org/perl.git/commitdiff/1ed4b7762a the test suite fails. Sample fail report: http://www.cpantesters.org/cpan/report/0f2fb0a2-d112-11e8-b0df-bac9a1dbd8f1 XRefs to others who are affected: https://rt.perl.org/Public/Bug/Display.html?id=133585 Maybe raise severity?

Tue Oct 16 21:04:00 2018 cwhitener [...] gmail.com - Severity Normal changed to Critical

Tue Oct 16 21:06:41 2018 cwhitener [...] gmail.com - Correspondence added

No argument on the request to raise the severity or about the fact that this needs to be fixed ASAP. We've been working through some background issues first to get to the point where we felt comfortable in attempting to fix this. Several others are chipping in with help to make it happen. If you have any suggestions, they'd be welcome. #toolchain seems to be where most of the discussions are taking place lately. Thanks, Chase On Tue Oct 16 21:02:54 2018, ANDK wrote: Show quoted text

> Now a fatality. Since this commit in bleadperl: > > https://perl5.git.perl.org/perl.git/commitdiff/1ed4b7762a > > the test suite fails. Sample fail report: > > http://www.cpantesters.org/cpan/report/0f2fb0a2-d112-11e8-b0df- > bac9a1dbd8f1 > > XRefs to others who are affected: > https://rt.perl.org/Public/Bug/Display.html?id=133585 > > Maybe raise severity?

Tue Oct 16 22:39:22 2018 jkeenan [...] cpan.org - Cc JKEENAN added

Wed Oct 24 08:22:50 2018 SREZIC [...] cpan.org - Broken in 9999.23 added

Tue Oct 30 02:43:20 2018 SREZIC [...] cpan.org - Broken in 9999.24 added

Fri Nov 16 11:26:49 2018 cwhitener [...] gmail.com - Taken

Fri Nov 16 11:30:26 2018 cwhitener [...] gmail.com - Correspondence added

Release 9999.25 was just cut that fixes half of the problem. read_file no longer uses sysopen or sysread. An immense amount of effort was put into this release by many people to ensure everything got tested and we didn't break userland. We smoke tested all 646 reverse dependencies on CPAN to look for regressions. We found and fixed all of the regressions and added regression tests into the test suite. We will start working on the syswrite problem now. The same huge amount of effort will go into testing that change. Thanks to everyone that helped test and fix the regressions! That being said, if you find further regressions, please let us know so we can address them.

Fri Nov 16 13:38:19 2018 SREZIC [...] cpan.org - Broken in 9999.25 added

Wed Feb 13 11:48:21 2019 cwhitener [...] gmail.com - Correspondence added

Hi Everyone, Version 9999.26 was just released and no longer uses sysread/syswrite. This should be good now for all versions of Perl 5. Thanks, Chase

Wed Feb 13 11:48:22 2019 cwhitener [...] gmail.com - Status changed from 'open' to 'resolved'