Bug #81134 for Data-Riak: PBC support

Tue Nov 13 06:46:10 2012 DAMS [...] cpan.org - Ticket created

Subject:

PBC support

Hi, This module is great, but do you plan to support PBC connections as well ? Thanks

Tue Nov 13 09:53:54 2012 stevan.little [...] gmail.com - Correspondence added

Subject:	Re: [rt.cpan.org #81134] PBC support
Date:	Tue, 13 Nov 2012 07:53:36 -0700
To:	bug-Data-Riak [...] rt.cpan.org
From:	Stevan Little <stevan.little [...] iinteractive.com>

Damien, There are no plans at the moment no, however patches are always welcome. - Stevan On Nov 13, 2012, at 4:46 AM, Damien Krotkine via RT wrote: Show quoted text

> Tue Nov 13 06:46:10 2012: Request 81134 was acted upon. > Transaction: Ticket created by DAMS > Queue: Data-Riak > Subject: PBC support > Broken in: (no value) > Severity: Wishlist > Owner: Nobody > Requestors: DAMS@cpan.org > Status: new > Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > > > > Hi, > > This module is great, but do you plan to support PBC connections as well ? > > Thanks

Tue Nov 13 09:53:55 2012 The RT System itself - Status changed from 'new' to 'open'

Tue Nov 13 10:31:33 2012 dkrotkine [...] gmail.com - Correspondence added

CC:	DAMS [...] cpan.org
Subject:	Re: [rt.cpan.org #81134] PBC support
Date:	Tue, 13 Nov 2012 16:31:14 +0100
To:	bug-Data-Riak [...] rt.cpan.org
From:	damien krotkine <dkrotkine [...] gmail.com>

Hi, If you are interested, here is some benchmark I've done, fetching 1000 keys on a warm cache riak leveldb on a very fast local network (hence no network latency/congestion) : Net::Riak REST done - elapsed : get time : 2.711923 | total time : 2.930007; total length : 3782580 Net::Riak PBC done - elapsed : get time : 1.164557 | total time : 1.385791; total length : 3782580 Data::Riak done - elapsed : get time : 3.967794 | total time : 4.221516; total length : 3782580 Riak::Tiny done - elapsed : get time : 2.863182 | total time : 3.10498; total length : 3782580 | failed obj : 0 Riak::Tiny is : https://github.com/tempire/riak-tiny We have our own version of Net::Riak where we basically s/Moose/Mouse/ to have a 15% speedup. So Data::Riak is kinda slow :/ I've reproduced the tests numerous times and although the numbers change, the results is aloways the same. So for now I'll stick to Net::Riak, even if I don't like the implementation (ETOOMUCHCOMPLEXITY). I wonder why Data::Riak is slower. Maybe the Http Actionpack thingy ? On 13 November 2012 15:53, Stevan Little via RT <bug-Data-Riak@rt.cpan.org>wrote: Show quoted text

> <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > > > Damien, > > There are no plans at the moment no, however patches are always welcome. > > - Stevan > > On Nov 13, 2012, at 4:46 AM, Damien Krotkine via RT wrote: >

> > Tue Nov 13 06:46:10 2012: Request 81134 was acted upon. > > Transaction: Ticket created by DAMS > > Queue: Data-Riak > > Subject: PBC support > > Broken in: (no value) > > Severity: Wishlist > > Owner: Nobody > > Requestors: DAMS@cpan.org > > Status: new > > Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > > > > > > > Hi, > > > > This module is great, but do you plan to support PBC connections as well

> ?

> > > > Thanks

> > >

Tue Nov 13 11:27:23 2012 stevan.little [...] gmail.com - Correspondence added

Subject:	Re: [rt.cpan.org #81134] PBC support
Date:	Tue, 13 Nov 2012 09:23:09 -0700
To:	bug-Data-Riak [...] rt.cpan.org
From:	Stevan Little <stevan.little [...] iinteractive.com>

Damien, We'll honestly, we've never even tried to optimize this, it has been fast enough for our usages. I don't think Action Pack would slow things down that much, though it is possible that could be optimized. I tend to more think we were just using LWP poorly, especially after looking at how Net::Riak handles it. I wonder if this commit would boost performance any? https://github.com/holophrastic/data-riak/commit/21ca17929bb38baaa10779db35b747b0cb736f7c I don't have a means of testing it at the moment myself (at a conference on bad hotel wifi) but if you want to try it out and let us know that would be great. Thanks, - Stevan On Nov 13, 2012, at 8:31 AM, damien krotkine via RT wrote: Show quoted text

> Queue: Data-Riak > Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > > > Hi, > > If you are interested, here is some benchmark I've done, fetching 1000 keys > on a warm cache riak leveldb on a very fast local network (hence no network > latency/congestion) : > > Net::Riak REST > done - elapsed : get time : 2.711923 | total time : 2.930007; total length > : 3782580 > > Net::Riak PBC > done - elapsed : get time : 1.164557 | total time : 1.385791; total length > : 3782580 > > Data::Riak > done - elapsed : get time : 3.967794 | total time : 4.221516; total length > : 3782580 > > Riak::Tiny > done - elapsed : get time : 2.863182 | total time : 3.10498; total length : > 3782580 | failed obj : 0 > > > Riak::Tiny is : https://github.com/tempire/riak-tiny > We have our own version of Net::Riak where we basically s/Moose/Mouse/ to > have a 15% speedup. > > So Data::Riak is kinda slow :/ I've reproduced the tests numerous times and > although the numbers change, the results is aloways the same. > > So for now I'll stick to Net::Riak, even if I don't like the implementation > (ETOOMUCHCOMPLEXITY). > > I wonder why Data::Riak is slower. Maybe the Http Actionpack thingy ? > > > > > > On 13 November 2012 15:53, Stevan Little via RT > <bug-Data-Riak@rt.cpan.org>wrote: >

>> <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > >> >> Damien, >> >> There are no plans at the moment no, however patches are always welcome. >> >> - Stevan >> >> On Nov 13, 2012, at 4:46 AM, Damien Krotkine via RT wrote: >>

>>> Tue Nov 13 06:46:10 2012: Request 81134 was acted upon. >>> Transaction: Ticket created by DAMS >>> Queue: Data-Riak >>> Subject: PBC support >>> Broken in: (no value) >>> Severity: Wishlist >>> Owner: Nobody >>> Requestors: DAMS@cpan.org >>> Status: new >>> Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > >>> >>> >>> Hi, >>> >>> This module is great, but do you plan to support PBC connections as well

>> ?

>>> >>> Thanks

>> >> >>

Tue Nov 13 12:25:35 2012 dkrotkine [...] gmail.com - Correspondence added

CC:	DAMS [...] cpan.org
Subject:	Re: [rt.cpan.org #81134] PBC support
Date:	Tue, 13 Nov 2012 18:25:19 +0100
To:	bug-Data-Riak [...] rt.cpan.org
From:	damien krotkine <dkrotkine [...] gmail.com>

Hi, Sure, I'll test it, and I might also try to benchmark it a bit more in the inside. Thanks for the software anyway :) On 13 November 2012 17:27, Stevan Little via RT <bug-Data-Riak@rt.cpan.org>wrote: Show quoted text

> <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > > > Damien, > > We'll honestly, we've never even tried to optimize this, it has been fast > enough for our usages. > > I don't think Action Pack would slow things down that much, though it is > possible that could be optimized. > > I tend to more think we were just using LWP poorly, especially after > looking at how Net::Riak handles it. I wonder if this commit would boost > performance any? > > > https://github.com/holophrastic/data-riak/commit/21ca17929bb38baaa10779db35b747b0cb736f7c > > I don't have a means of testing it at the moment myself (at a conference > on bad hotel wifi) but if you want to try it out and let us know that would > be great. > > Thanks, > > - Stevan > > > On Nov 13, 2012, at 8:31 AM, damien krotkine via RT wrote: >

> > Queue: Data-Riak > > Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > > > > > Hi, > > > > If you are interested, here is some benchmark I've done, fetching 1000

> keys

> > on a warm cache riak leveldb on a very fast local network (hence no

> network

> > latency/congestion) : > > > > Net::Riak REST > > done - elapsed : get time : 2.711923 | total time : 2.930007; total

> length

> > : 3782580 > > > > Net::Riak PBC > > done - elapsed : get time : 1.164557 | total time : 1.385791; total

> length

> > : 3782580 > > > > Data::Riak > > done - elapsed : get time : 3.967794 | total time : 4.221516; total

> length

> > : 3782580 > > > > Riak::Tiny > > done - elapsed : get time : 2.863182 | total time : 3.10498; total

> length :

> > 3782580 | failed obj : 0 > > > > > > Riak::Tiny is : https://github.com/tempire/riak-tiny > > We have our own version of Net::Riak where we basically s/Moose/Mouse/ to > > have a 15% speedup. > > > > So Data::Riak is kinda slow :/ I've reproduced the tests numerous times

> and

> > although the numbers change, the results is aloways the same. > > > > So for now I'll stick to Net::Riak, even if I don't like the

> implementation

> > (ETOOMUCHCOMPLEXITY). > > > > I wonder why Data::Riak is slower. Maybe the Http Actionpack thingy ? > > > > > > > > > > > > On 13 November 2012 15:53, Stevan Little via RT > > <bug-Data-Riak@rt.cpan.org>wrote: > >

> >> <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > > >> > >> Damien, > >> > >> There are no plans at the moment no, however patches are always welcome. > >> > >> - Stevan > >> > >> On Nov 13, 2012, at 4:46 AM, Damien Krotkine via RT wrote: > >>

> >>> Tue Nov 13 06:46:10 2012: Request 81134 was acted upon. > >>> Transaction: Ticket created by DAMS > >>> Queue: Data-Riak > >>> Subject: PBC support > >>> Broken in: (no value) > >>> Severity: Wishlist > >>> Owner: Nobody > >>> Requestors: DAMS@cpan.org > >>> Status: new > >>> Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > > >>> > >>> > >>> Hi, > >>> > >>> This module is great, but do you plan to support PBC connections as

> well

> >> ?

> >>> > >>> Thanks

> >> > >> > >>

> >

> > >

Tue Nov 13 12:28:59 2012 stevan.little [...] gmail.com - Correspondence added

Subject:	Re: [rt.cpan.org #81134] PBC support
Date:	Tue, 13 Nov 2012 10:28:47 -0700
To:	bug-Data-Riak [...] rt.cpan.org
From:	Stevan Little <stevan.little [...] iinteractive.com>

Damian, Wonderful, thanks! - Stevan On Nov 13, 2012, at 10:25 AM, damien krotkine via RT wrote: Show quoted text

> Queue: Data-Riak > Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > > > Hi, > > Sure, I'll test it, and I might also try to benchmark it a bit more in the > inside. Thanks for the software anyway :) > > > On 13 November 2012 17:27, Stevan Little via RT > <bug-Data-Riak@rt.cpan.org>wrote: >

>> <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > >> >> Damien, >> >> We'll honestly, we've never even tried to optimize this, it has been fast >> enough for our usages. >> >> I don't think Action Pack would slow things down that much, though it is >> possible that could be optimized. >> >> I tend to more think we were just using LWP poorly, especially after >> looking at how Net::Riak handles it. I wonder if this commit would boost >> performance any? >> >> >> https://github.com/holophrastic/data-riak/commit/21ca17929bb38baaa10779db35b747b0cb736f7c >> >> I don't have a means of testing it at the moment myself (at a conference >> on bad hotel wifi) but if you want to try it out and let us know that would >> be great. >> >> Thanks, >> >> - Stevan >> >> >> On Nov 13, 2012, at 8:31 AM, damien krotkine via RT wrote: >>

>>> Queue: Data-Riak >>> Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > >>> >>> Hi, >>> >>> If you are interested, here is some benchmark I've done, fetching 1000

>> keys

>>> on a warm cache riak leveldb on a very fast local network (hence no

>> network

>>> latency/congestion) : >>> >>> Net::Riak REST >>> done - elapsed : get time : 2.711923 | total time : 2.930007; total

>> length

>>> : 3782580 >>> >>> Net::Riak PBC >>> done - elapsed : get time : 1.164557 | total time : 1.385791; total

>> length

>>> : 3782580 >>> >>> Data::Riak >>> done - elapsed : get time : 3.967794 | total time : 4.221516; total

>> length

>>> : 3782580 >>> >>> Riak::Tiny >>> done - elapsed : get time : 2.863182 | total time : 3.10498; total

>> length :

>>> 3782580 | failed obj : 0 >>> >>> >>> Riak::Tiny is : https://github.com/tempire/riak-tiny >>> We have our own version of Net::Riak where we basically s/Moose/Mouse/ to >>> have a 15% speedup. >>> >>> So Data::Riak is kinda slow :/ I've reproduced the tests numerous times

>> and

>>> although the numbers change, the results is aloways the same. >>> >>> So for now I'll stick to Net::Riak, even if I don't like the

>> implementation

>>> (ETOOMUCHCOMPLEXITY). >>> >>> I wonder why Data::Riak is slower. Maybe the Http Actionpack thingy ? >>> >>> >>> >>> >>> >>> On 13 November 2012 15:53, Stevan Little via RT >>> <bug-Data-Riak@rt.cpan.org>wrote: >>>

>>>> <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > >>>> >>>> Damien, >>>> >>>> There are no plans at the moment no, however patches are always welcome. >>>> >>>> - Stevan >>>> >>>> On Nov 13, 2012, at 4:46 AM, Damien Krotkine via RT wrote: >>>>

>>>>> Tue Nov 13 06:46:10 2012: Request 81134 was acted upon. >>>>> Transaction: Ticket created by DAMS >>>>> Queue: Data-Riak >>>>> Subject: PBC support >>>>> Broken in: (no value) >>>>> Severity: Wishlist >>>>> Owner: Nobody >>>>> Requestors: DAMS@cpan.org >>>>> Status: new >>>>> Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=81134 > >>>>> >>>>> >>>>> Hi, >>>>> >>>>> This module is great, but do you plan to support PBC connections as

>> well

>>>> ?

>>>>> >>>>> Thanks

>>>> >>>> >>>>

>>>

>> >> >>

Fri May 31 04:29:08 2013 DAMS [...] cpan.org - Correspondence added

Hi, Just to let you know, I've ask my developer to implement Riak::Light based on small list of feature requests: very fast, light, PBC support, and with timeout. the benchmarks are here: https://github.com/Weborama/Riak-Light#simple-benchmark You can check it out to steal its PBC support, as it's quite simple.