On 2016-01-04 21:45:17, JPEACOCK wrote:
Show quoted text> On Mon Jan 04 14:31:50 2016, SREZIC wrote:
> > I have to disagree. Devel releases should work as good as stable
> > ones,
> > for all modules, period.
>
> As an aside, that is a very short-sighted view, IMNSO. Devel releases
> might include massive refactoring and could be reasonably expected to
> break at least some modules. Devel releases might just be a preview
> of new functionality and should not disturb existing consumers. You
> shouldn't assume anything without checking the README or POD for the
> module in question.
If there's a known problem happening only with devel versions (and this every time!) then this problem should be fixed. We want to be able to do statistical analysis of cpantesters reports, and such fails ruin these attempts. This was my main objection to your statement.
For unexpected problems caused by devel releases... yes, devel versions may have bugs, and it's better if they are caught before doing the stable release. Still these problems could add additional "noise" to the cpantesters data, making it more difficult to analyze reports (e.g. for regression analysis for bleadperl). Yes, the cpantesters system is lacking something here, maybe it should just be possible to put a mark on smokers which are using devel module versions, so we can filter reports if needed for a specific analysis. Until we're there it surely helps if devel versions are not that experimental, and do not cause unnecessary failures.