Skip Menu |

This queue is for tickets about the Lingua-EN-Sentence CPAN distribution.

Report information
The Basics
Id: 38744
Status: resolved
Worked: 10 min
Priority: 0/
Queue: Lingua-EN-Sentence

People
Owner: kimryan [...] cpan.org
Requestors: VIPUL [...] cpan.org
Cc:
AdminCc:

Bug Information
Severity: (no value)
Broken in: (no value)
Fixed in: 0.27



Subject: use locale and utf8 strings hangs the module.
Here's a simple repro case. use locale; my $y = 'One of the masters in this field is the software developer [415]Craig W. ^A^A^AReynolds0_00_0. ^A^A^AHe pioneered and perfected a model of flocking behavio r by creating a computer program he calls “boids”. ^A^A^AMr. ^A^A^AReynolds employed three basic steering behaviors for his digital creatures:'; utf8::upgrade($y); $y =~ s/(\s\w\.\s+)\001/$1/sg;
I now detect the OSNAME vraiable and bypass calls to setlocale if this is 'android'. Not able to detect the Windows CE OS as OSNAME does not distinguish between Windows versions, they all return 'MSwin32 '.
Wrong comment on resolve action
The coded example does not actully call thus module, it just seems to be a stand alone demo. Also, the actual values of the UTF characters seem to be lost while being pasted into this bug report. They just appear as unprintable. So not sure what specific error was happening. But I tested the module with data that included correctly coded UTF characters and it worked without a problem. The bug was raised 7 years ago, and Perl's inbuilt handling of UTFdata is more robust now, so that may have solved the problem.