Bug #68856 for DataFlow: use DataFlow::Item to carry data AND metadata

Thu Jun 16 06:20:20 2011 RUSSOZ [...] cpan.org - Ticket created

Subject:

use DataFlow::Item to carry data AND metadata

Thu Jun 16 06:20:48 2011 RUSSOZ [...] cpan.org - Status changed from 'new' to 'open'

Thu Jun 16 06:21:02 2011 RUSSOZ [...] cpan.org - Taken

Thu Jun 16 06:21:19 2011 RUSSOZ [...] cpan.org - Correspondence added

possible features: ... autoboxing of data into an Item? ... autofilling some metadata through the flow?

Thu Jun 23 22:55:53 2011 RUSSOZ [...] cpan.org - Status changed from 'open' to 'new'

Sun Jul 24 18:05:01 2011 RUSSOZ [...] cpan.org - Status changed from 'new' to 'open'

Sun Jul 24 18:05:30 2011 RUSSOZ [...] cpan.org - Correspondence added

Work in progress

Sun Jul 24 22:11:49 2011 RUSSOZ [...] cpan.org - Correspondence added

Keeping DataFlow::Proc unaware of the item and metadata for the moment.

DataFlow::Item will carry the data and metada, and it will be a simple value-object.

DataFlow::Channel (for lack of a better name right now) will be a 'glue' between DataFlow and its processors. A Channel will manage the input and output channels of a running processor. This should NOT break the existing code, it should happen all transparently.

DataFlow will have to be adapted, mostly regarding the output method. It must allow to return the array of DataFlow::Items, for those interested, or a default output bringing only one specific channel (or 'default' channel if none is specified).

Thu Jul 28 20:41:12 2011 RUSSOZ [...] cpan.org - Correspondence added

Every Proc in a DataFlow is now wrapped with a ProcWrapper object. This object handles the DataFlow::Item manipulation.

There is some code in place for metadata handling, but it is not accessible to procs yet.

the future idea is to allow procs to have one (or more, as needed) additional methods to fuss in metadata before and/or after handling the data itself.

another fuzzy point is how to handle DataFlow::Item objects when the Proc returns undef. First approach was to wrap undef in Item, as any regular value, but for the time being we have two different tests in place to discard undef values (one in ProcWrapper the other in DataFlow itself)

Thu Jul 28 20:41:14 2011 RUSSOZ [...] cpan.org - Status changed from 'open' to 'resolved'

Thu Jul 28 20:41:35 2011 RUSSOZ [...] cpan.org - Status changed from 'resolved' to 'patched'