Bug #20853 for libwww-perl: LWP::UserAgent thinks # in URL is a comment

Fri Aug 04 17:40:24 2006 nfoggi [...] depaul.edu - Ticket created

Subject:

LWP::UserAgent thinks # in URL is a comment

When using something like this as a test: my $url = 'http://127.0.0.1/$$%%$$##!!'; my $browser = LWP::UserAgent->new(); my $response = $browser->get($url); The request is actually makes to the webserver truncates everything AFTER the # sign in the URL therefore doesn't submit the complete url.

Fri Aug 04 17:45:20 2006 nfoggi [...] depaul.edu - Correspondence added

From:

nfoggi [...] depaul.edu

Additional logs files from debug: # LWP::DebugFile logging to lwp_44d3bfa8_3491.log # Time now: {1154727848} = Fri Aug 4 16:44:08 2006 LWP::UserAgent::new: () # Time now: {1154727849} = Fri Aug 4 16:44:09 2006 LWP::UserAgent::request: () LWP::UserAgent::send_request: GET http://127.0.0.1/%5E%5E%%$$@@!!##%%%5E%5E&& LWP::UserAgent::_need_proxy: Not proxied LWP::Protocol::http::request: () but netcat shows differently: nc -l -k 127.0.0.1 80 GET /%5E%5E%%$$@@!! HTTP/1.1 TE: deflate,gzip;q=0.3 Connection: TE, close Host: 127.0.0.1 User-Agent: libwww-perl/5.805 On Fri Aug 04 17:40:24 2006, nfoggi wrote: Show quoted text

> When using something like this as a test: > > my $url = 'http://127.0.0.1/$$%%$$##!!'; > my $browser = LWP::UserAgent->new(); > my $response = $browser->get($url); > > The request is actually makes to the webserver truncates everything > AFTER the # sign in the URL therefore doesn't submit the complete url.

Fri Aug 04 18:03:18 2006 GAAS [...] cpan.org - Correspondence added

From:

GAAS [...] cpan.org

The struff after the first '#' is the fragment spec of the URL and is not meant for the server. Read more about it here: http://www.gbiv.com/protocols/uri/rfc/rfc3986.html#fragment

Fri Aug 04 18:03:19 2006 The RT System itself - Status changed from 'new' to 'open'

Fri Aug 04 18:04:22 2006 GAAS [...] cpan.org - Status changed from 'open' to 'rejected'

Fri Aug 04 18:23:27 2006 nfoggi [...] depaul.edu - Correspondence added

Subject:	RE: [rt.cpan.org #20853] LWP::UserAgent thinks # in URL is a comment
Date:	Fri, 4 Aug 2006 17:22:50 -0500
To:	<bug-libwww-perl [...] rt.cpan.org>
From:	"Foggi, Nicola" <NFOGGI [...] depaul.edu>

Hi Gisle, I was looking through the RFC, though I'm not too familiar with it, the problem stems from actually a script that we post against to get status of a user account: http://127.0.0.1/status.asp?pt1=xxxx&pt2=yyy##yy in this case it's not meant to be fragmented, but part of a value being submitted to a page via the URL. Would this then be invalid according to the RFC? Nicola Show quoted text

-----Original Message----- From: Gisle_Aas via RT [mailto:bug-libwww-perl@rt.cpan.org] Sent: Fri 8/4/2006 5:03 PM To: Foggi, Nicola Subject: [rt.cpan.org #20853] LWP::UserAgent thinks # in URL is a comment <URL: http://rt.cpan.org/Ticket/Display.html?id=20853 > The struff after the first '#' is the fragment spec of the URL and is not meant for the server. Read more about it here: http://www.gbiv.com/protocols/uri/rfc/rfc3986.html#fragment

Download winmail.dat
application/ms-tnef 3.1k

Message body not shown because it is not plain text.

Fri Aug 04 18:23:29 2006 The RT System itself - Status changed from 'rejected' to 'open'

Fri Aug 04 18:38:41 2006 GAAS [...] cpan.org - Correspondence added

If you want to pass '#' to the server as part of the URL it has to be percent encoded, so please try to this URL instead: http://127.0.0.1/status.asp?pt1=xxxx&pt2=yyy%23%23yy

Fri Aug 04 18:49:04 2006 nfoggi [...] depaul.edu - Correspondence added

From:

nfoggi [...] depaul.edu

Ahh... that's what I was trying to find in the RFC, just couldn't find that... Thanks! On Fri Aug 04 18:38:41 2006, GAAS wrote: Show quoted text

> If you want to pass '#' to the server as part of the URL it has to be > percent encoded, so please try to this URL instead: > > http://127.0.0.1/status.asp?pt1=xxxx&pt2=yyy%23%23yy

Fri Aug 04 19:33:58 2006 GAAS [...] cpan.org - Status changed from 'open' to 'resolved'