Bug #94837 for Courriel: unparseable chunk in the header text

Thu Apr 17 11:37:27 2014 jcrotty_alpine [...] hotmail.com - Ticket created

Subject:

unparseable chunk in the header text

Courriel .31 Perl 5.16.3 CentOS 6.5 The attached email throws following error: Found an unparseable chunk in the header text starting at line 4: Received: from forward1-smtp.messagingengine.com (forward1-smtp.messagingengine.com [66.111.4.223]) by mxa.senderscore.net (Postfix) with ESMTP id 440FE140006 for <fastmailcomp@senderscore.net>; Tue, 15 Apr 2014 15:55:48 -0600 (MDT) I dug around in the code a bit, but can't figure out the exact problem. The place I work at parses a lot of email in the wild and we have lots of emails like this one that are failing daily since switching to Courriel a few days ago. W/out a fix I'll have to revert our code base and put back in Email::Simple which is tolerant of these emails.

Subject:

1397598970557.5849015a90cfee9916ffe0fc36f79fab.jcrotty

Download 1397598970557.5849015a90cfee9916ffe0fc36f79fab.jcrotty
application/octet-stream 8.1k

Message body not shown because it is not plain text.

Fri Apr 18 23:19:47 2014 DROLSKY [...] cpan.org - Correspondence added

On Thu Apr 17 11:37:27 2014, holybit wrote: Show quoted text

> Courriel .31 > Perl 5.16.3 > CentOS 6.5 > > The attached email throws following error: > > Found an unparseable chunk in the header text starting at line 4: > Received: from forward1-smtp.messagingengine.com (forward1- > smtp.messagingengine.com [66.111.4.223]) > by mxa.senderscore.net (Postfix) with ESMTP id 440FE140006 > for <fastmailcomp@senderscore.net>; Tue, 15 Apr 2014 15:55:48 > -0600 (MDT) > > I dug around in the code a bit, but can't figure out the exact > problem. The place I work at parses a lot of email in the wild and we > have lots of emails like this one that are failing daily since > switching to Courriel a few days ago. W/out a fix I'll have to revert > our code base and put back in Email::Simple which is tolerant of these > emails.

Can you attach the whole message (or at least all the headers) verbatim? I need to see all the whitespace and such to figure out what's going on.

Fri Apr 18 23:19:47 2014 The RT System itself - Status changed from 'new' to 'open'

Fri Apr 18 23:20:21 2014 DROLSKY [...] cpan.org - Correspondence added

On Fri Apr 18 23:19:47 2014, DROLSKY wrote: Show quoted text

> On Thu Apr 17 11:37:27 2014, holybit wrote:

> > Courriel .31 > > Perl 5.16.3 > > CentOS 6.5 > > > > The attached email throws following error: > > > > Found an unparseable chunk in the header text starting at line 4: > > Received: from forward1-smtp.messagingengine.com (forward1- > > smtp.messagingengine.com [66.111.4.223]) > > by mxa.senderscore.net (Postfix) with ESMTP id 440FE140006 > > for <fastmailcomp@senderscore.net>; Tue, 15 Apr 2014 15:55:48 > > -0600 (MDT) > > > > I dug around in the code a bit, but can't figure out the exact > > problem. The place I work at parses a lot of email in the wild and we > > have lots of emails like this one that are failing daily since > > switching to Courriel a few days ago. W/out a fix I'll have to revert > > our code base and put back in Email::Simple which is tolerant of > > these > > emails.

> > Can you attach the whole message (or at least all the headers) > verbatim? I need to see all the whitespace and such to figure out > what's going on.

Duh, you already did. Ignore me.

Fri Apr 18 23:35:28 2014 DROLSKY [...] cpan.org - Correspondence added

On Thu Apr 17 11:37:27 2014, holybit wrote: Show quoted text

> Courriel .31 > Perl 5.16.3 > CentOS 6.5 > > The attached email throws following error: > > Found an unparseable chunk in the header text starting at line 4: > Received: from forward1-smtp.messagingengine.com (forward1- > smtp.messagingengine.com [66.111.4.223]) > by mxa.senderscore.net (Postfix) with ESMTP id 440FE140006 > for <fastmailcomp@senderscore.net>; Tue, 15 Apr 2014 15:55:48 > -0600 (MDT) > > I dug around in the code a bit, but can't figure out the exact > problem. The place I work at parses a lot of email in the wild and we > have lots of emails like this one that are failing daily since > switching to Courriel a few days ago. W/out a fix I'll have to revert > our code base and put back in Email::Simple which is tolerant of these > emails.

I see the problem. A few of the header lines end with just a newline as opposed to CRLF. I can make Courriel more tolerant of this.

Sat Apr 19 12:39:04 2014 jcrotty_alpine [...] hotmail.com - Correspondence added

On Fri Apr 18 23:35:28 2014, DROLSKY wrote: Show quoted text

> On Thu Apr 17 11:37:27 2014, holybit wrote:

> > Courriel .31 > > Perl 5.16.3 > > CentOS 6.5 > > > > The attached email throws following error: > > > > Found an unparseable chunk in the header text starting at line 4: > > Received: from forward1-smtp.messagingengine.com (forward1- > > smtp.messagingengine.com [66.111.4.223]) > > by mxa.senderscore.net (Postfix) with ESMTP id 440FE140006 > > for <fastmailcomp@senderscore.net>; Tue, 15 Apr 2014 15:55:48 > > -0600 (MDT) > > > > I dug around in the code a bit, but can't figure out the exact > > problem. The place I work at parses a lot of email in the wild and we > > have lots of emails like this one that are failing daily since > > switching to Courriel a few days ago. W/out a fix I'll have to revert > > our code base and put back in Email::Simple which is tolerant of > > these > > emails.

> > I see the problem. A few of the header lines end with just a newline > as opposed to CRLF. I can make Courriel more tolerant of this.

Yes, the problem is in the folded headers. The last line/chunk of a folded header is EOL CRLF but the others are just LF. Thanks for the fix and release! I'll get this into production Monday AM and get get back to you if I see any other problems ASAP.

Mon Apr 21 13:48:03 2014 jcrotty_alpine [...] hotmail.com - Correspondence added

.33 fixed EOL problems. All is well and thanks for the update!

Mon Apr 21 13:48:04 2014 jcrotty_alpine [...] hotmail.com - Status changed from 'open' to 'resolved'