Subject: | WWW::RobotRules::Memcache 0.1 with current LWP::RobotUA |
WWW::RobotRules::Memcache 0.1 can't be used with current version of LWP::RobotUA (I use libwww-6.08):
Undefined subroutine &WWW::RobotRules::agent called at /usr/local/lib/perl5/site_perl/LWP/RobotUA.pm line 54.
agent method must be provided by WWW::RobotRules, but there is no such method in WWW::RobotRules::Memcache.
agent in WWW::RobotRules::InCore/WWW::RobotRules::AnyDBM_File clears all cached data. With memcahced it is not safe to delete all data ("flush_all" command) because memcached server often used for store data from different software. It is better to use namespace based on user-agent. Data for old user-agent will be eventually evicted from memcached by LRU replacement.