| Subject: | Hash randomization (?) issue in tests |
On some of my smokers the tests fail like this:
# Failed test at t/WebService-Qiita-Client-Items.t line 130.
# Structures begin differing at:
# $got->[0]{created_at} = '2016-09-16 19:20:49 +0900'
# $expected->[0]{created_at} = '2012-10-12 12:30:50 +0900'
# Looks like you failed 1 test of 1.
# Failed test 'instance_method'
# at t/WebService-Qiita-Client-Items.t line 131.
# Looks like you failed 1 test of 2.
# Failed test 'search_item'
# at t/WebService-Qiita-Client-Items.t line 142.
# Looks like you failed 1 test of 7.
t/WebService-Qiita-Client-Items.t ..
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/7 subtests
Or like this:
# Failed test at t/WebService-Qiita-Client-Items.t line 130.
# Structures begin differing at:
# $got->[0]{created_at_as_seconds} = '1474021249'
# $expected->[0]{created_at_as_seconds} = '1350012650'
# Looks like you failed 1 test of 1.
# Failed test 'instance_method'
# at t/WebService-Qiita-Client-Items.t line 131.
# Looks like you failed 1 test of 2.
# Failed test 'search_item'
# at t/WebService-Qiita-Client-Items.t line 142.
# Looks like you failed 1 test of 7.
t/WebService-Qiita-Client-Items.t ..
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/7 subtests
This is probably a hash randomization issue, especially when looking at
http://matrix.cpantesters.org/?dist=WebService-Qiita%200.04
one sees that only perl >= 5.17.6 is affected, and that was the perl version with re-introduced hash randomization.