Skip Menu |

This queue is for tickets about the Text-Tokenizer CPAN distribution.

Report information
The Basics
Id: 6033
Status: resolved
Worked: 5 min
Priority: 0/
Queue: Text-Tokenizer

People
Owner: SAMSK [...] cpan.org
Requestors: pwinkeler [...] pbnj-solutions.com
Cc:
AdminCc:

Bug Information
Severity: Normal
Broken in: 0.2.2
Fixed in: (no value)



Subject: Comment parsing bug
The definition of a COMMENT in tokenizer.c.flex forces the leading pound-sign (#) to be followed by at least one non end-of-line character. This results in lines with a single pound-sign to be passed through the tokenizer as text. This can be fixed by changing the COMMENT definition to: (#[^\n]*) allowing for the absence of anything after the pound sign This is a cool module and I will be using it a lot; thanks for sharing it!
[guest - Thu Apr 15 17:05:00 2004]: Show quoted text
> The definition of a COMMENT in tokenizer.c.flex forces the leading > pound-sign (#) to be followed by at least one non end-of-line > character. This results in lines with a single pound-sign to be > passed through the tokenizer as text. > This can be fixed by changing the COMMENT definition to: > (#[^\n]*) > allowing for the absence of anything after the pound sign > > This is a cool module and I will be using it a lot; thanks for sharing > it!
Ok, i've fixed it. You can find new version 0.2.3 at cpan. Thanks for reminding me, and i'm happy you like it :)