Wed Aug 07 09:04:18 2013rob.hammond [...] telegraph.co.uk - Ticket created
Subject:
RobotRules bug
Date:
Wed, 7 Aug 2013 14:04:03 +0100
To:
bug-WWW-RobotRules-Extended [...] rt.cpan.org
From:
Rob Hammond <rob.hammond [...] telegraph.co.uk>
Hi,
I've found a bug with your (very useful) module - I think line 252 should
be:
$result = 1;
where currently it's:
return 1;
Example issue is this site: http://www.localrecruit.co.uk/robots.txt where
/goto/ is allowed under the current code because the "Allow: /" rule comes
first.
Hope this makes sense
Thanks
Rob Hammond