Surefire Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
789 0 19 0 97.592% 8,032.29

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.sat4j.pb.constraints 767 0 19 0 97.523% 8,025.89
org.sat4j.pb 22 0 0 0 100% 6.4

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.sat4j.pb

Class Tests Errors Failures Skipped Success Rate Time
TestEclipseBug247567 1 0 0 0 100% 0.304
TestEclipseBug275101 1 0 0 0 100% 5.716
TestDependencyHelper 19 0 0 0 100% 0.278
TestObjectiveFunction 1 0 0 0 100% 0.102

Test Cases

[Summary] [Package List] [Test Cases]

CounterPBConstrWithClauseCardConstrLearningTest

testncirc43 0.815
testncirc63 14.279
testncirc83 17.732
testndata43 0.094
testndata63 13.356
testndata83 16.985
testn9symml 0.091
testnC17 0.008
testnC432 0.133
testnb1 0.011
testnc8 0.052
testncc 0.019
testncm42a 0.015
testncmb 0.057
testnmux 0.049
testnmyadder 0.167
testPN34 0.003
testPN4 0.011
testPN45 0.002
testPN5 0.01
testPN56 0.003
testPN6 0.015
testPN67 0.003
testPN7 0.033
testPN78 0.003
testPN8 0.051
testPN89 0.003
testPN9 0.088
testPN910 0.004

PuebloWatchedPBConstrWithClauseLearningTest

testncirc43 0.89
testncirc63 3.335
testncirc83 11.542
testndata43 0.167
testndata63 2.723
testndata83 11.147
testn9symml 0.517
testnC17 0.008
testnC432 0.689
testnb1 0.019
testnc8 0.159
testncc 0.056
testncm42a 0.038
testncmb 0.327
testnmux 0.171
testnmyadder 0.434
testPN34 0.002
testPN4 0.011
testPN45 0.004
testPN5 0.028
testPN56 0.005
testPN6 0.139
testPN67 0.007
testPN7 0.538
testPN78 0.01
testPN8 1.959
testPN89 0.014
testPN9 12.415
testPN910 0.03

WatchedPBConstrWithPBConstrLearningTest

testaloul1011 1.003
testaloul1015 0.249
testaloul1020 0.42
testaloul1516 1.828
testaloul1520 0.704
testaloul1525 0.954
testaloul2021 6.338
testaloul2025 1.612
testaloul2030 2.469
testaloul3031 43.044
testaloul3035 6.474
testaloul3040 7.955
testaloul3536 89.668
testaloul3540 9.881
testaloul3545 13.1
testaloul4041 175.029
testaloul4045 16.249
testaloul4050 24.579
testaloul5051 191.931
Timeout: need more time to complete!
testaloul5055 39.653
testaloul5060 47.492
testncirc103 190.581
Timeout: need more time to complete!
testndata103 190.102
Timeout: need more time to complete!
testPN10 0.189
testncirc43 0.233
testncirc63 4.541
testncirc83 54.996
testndata43 0.236
testndata63 4.764
testndata83 54.911
testn9symml 0.463
testnC17 0.029
testnC432 0.745
testnb1 0.04
testnc8 0.187
testncc 0.055
testncm42a 0.049
testncmb 0.348
testnmux 0.255
testnmyadder 0.528
testPN34 0.003
testPN4 0.005
testPN45 0.004
testPN5 0.013
testPN56 0.006
testPN6 0.019
testPN67 0.007
testPN7 0.037
testPN78 0.01
testPN8 0.064
testPN89 0.014
testPN9 0.113
testPN910 0.017

TestEclipseBug247567

testReserveVarsButUseLess 0.223

CounterPBConstrWithCBClauseCardConstrLearningTest

testaloul1011 0.864
testaloul1015 0.191
testaloul1020 0.295
testaloul1516 1.548
testaloul1520 0.518
testaloul1525 0.739
testaloul2021 5.658
testaloul2025 1.258
testaloul2030 1.973
testaloul3031 39.628
testaloul3035 5.716
testaloul3040 7.073
testaloul3536 83.842
testaloul3540 8.712
testaloul3545 11.967
testaloul4041 163.779
testaloul4045 14.471
testaloul4050 22.34
testaloul5051 195.741
Timeout: need more time to complete!
testaloul5055 36.172
testaloul5060 43.202
testncirc103 189.195
Timeout: need more time to complete!
testndata103 188.184
Timeout: need more time to complete!
testPN10 0.15
testncirc43 0.119
testncirc63 4.301
testncirc83 70.127
testndata43 0.086
testndata63 4.255
testndata83 69.888
testn9symml 0.092
testnC17 0.066
testnC432 0.123
testnb1 0.003
testnc8 0.046
testncc 0.012
testncm42a 0.012
testncmb 0.054
testnmux 0.041
testnmyadder 0.15
testPN34 0.002
testPN4 0.004
testPN45 0.002
testPN5 0.007
testPN56 0.003
testPN6 0.015
testPN67 0.002
testPN7 0.028
testPN78 0.003
testPN8 0.061
testPN89 0.004
testPN9 0.09
testPN910 0.004

CounterPBConstrWithClauseAtLeastConstrLearningTest

testaloul1011 0.941
testaloul1015 0.198
testaloul1020 0.303
testaloul1516 1.58
testaloul1520 0.535
testaloul1525 0.771
testaloul2021 5.952
testaloul2025 1.312
testaloul2030 2.128
testaloul3031 40.792
testaloul3035 5.907
testaloul3040 7.447
testaloul3536 85.984
testaloul3540 8.957
testaloul3545 12.066
testaloul4041 167.046
testaloul4045 15.085
testaloul4050 23.222
testaloul5051 182.946
Timeout: need more time to complete!
testaloul5055 36.943
testaloul5060 44.165
testncirc103 191.28
Timeout: need more time to complete!
testndata103 191.082
Timeout: need more time to complete!
testPN10 0.171
testncirc43 0.088
testncirc63 2.656
testncirc83 6.768
testndata43 0.097
testndata63 2.641
testndata83 6.773
testn9symml 0.114
testnC17 0.029
testnC432 0.208
testnb1 0.067
testnc8 0.089
testncc 0.043
testncm42a 0.019
testncmb 0.104
testnmux 0.07
testnmyadder 0.183
testPN34 0.007
testPN4 0.005
testPN45 0.003
testPN5 0.068
testPN56 0.008
testPN6 0.019
testPN67 0.003
testPN7 0.047
testPN78 0.003
testPN8 0.06
testPN89 0.01
testPN9 0.091
testPN910 0.014

TestEclipseBug275101

testReserveVarsButUseLess 5.509

MyCounterCardConstrOnRandomCardProblemsTest

testRndDeg1 0.65
testRndDeg2 0.17
testRndDeg3 0.165
testRndDeg4 0.094
testRndDeg5 0.024
testRndDeg6 0.011
testRndDeg7 0.008
testRndDeg8 0.003
testRndDeg9 0.002
testRndDeg10 0.017
testRndDeg11 0.002
testRndDeg12 0.002
testRndDeg13 0.001
testRndDeg14 0.002
testRndDeg15 0.002
testRndDeg16 0.003
testRndDeg17 0.002
testRndDeg18 0.002
testPN34 0.007
testPN4 0.008
testPN45 0.004
testPN5 0.017
testPN56 0.005
testPN6 0.03
testPN67 0.006
testPN7 0.053
testPN78 0.006
testPN8 0.089
testPN89 0.008
testPN9 0.115
testPN910 0.007

PBCPMixedConstraintsResCPTest

testncirc43 0.692
testncirc63 1.368
testncirc83 8.759
testndata43 0.06
testndata63 0.731
testndata83 8.377
testn9symml 0.096
testnC17 0.005
testnC432 0.114
testnb1 0.005
testnc8 0.031
testncc 0.014
testncm42a 0.013
testncmb 0.047
testnmux 0.037
testnmyadder 0.087
testPN34 0.003
testPN4 0.002
testPN45 0.003
testPN5 0.064
testPN56 0.004
testPN6 0.008
testPN67 0.003
testPN7 0.025
testPN78 0.003
testPN8 0.108
testPN89 0.003
testPN9 0.71
testPN910 0.01

CounterCardConstrOnRandomCardProblemsTest

testRndDeg1 0.373
testRndDeg2 0.18
testRndDeg3 0.151
testRndDeg4 0.092
testRndDeg5 0.021
testRndDeg6 0.011
testRndDeg7 0.007
testRndDeg8 0.003
testRndDeg9 0.002
testRndDeg10 0.002
testRndDeg11 0.001
testRndDeg12 0.001
testRndDeg13 0.001
testRndDeg14 0.002
testRndDeg15 0.001
testRndDeg16 0.001
testRndDeg17 0.001
testRndDeg18 0.002
testPN34 0.007
testPN4 0.007
testPN45 0.004
testPN5 0.015
testPN56 0.004
testPN6 0.029
testPN67 0.004
testPN7 0.054
testPN78 0.005
testPN8 0.082
testPN89 0.006
testPN9 0.112
testPN910 0.007

TestDependencyHelper

testBasicRequirements 0.1
testBasicRequirementsDetailedExplanation 0.012
testDisjunctions 0.018
testDisjunctionExplanation 0.021
testExplanationForASolution 0.01
testObjectiveFunction 0.013
testJunitExample 0.005
testJunitSingletonObjectiveExample 0.005
testEquivalency 0.004
testDisjunction 0.006
testCathyExamples 0.018
testCardinalityConstraints 0.006
testPseudoConstraints 0.004
testPseudoConstraintsNegativeLiterals 0.004
testIgnoreContiguousDuplicatedEntry 0.003
testNonDuplicatedEntryNotCatched 0.004
testLimitofHashFunction 0.002
testVariablesIntroducedInNegativeFormFirst 0.003
testVariablesIntroducedInNegativeFormFirstStoredCorrectly 0.003

CounterPBConstrWithClauseLearningTest

testncirc43 0.845
testncirc63 2.41
testncirc83 7.095
testndata43 0.114
testndata63 1.734
testndata83 6.666
testn9symml 0.354
testnC17 0.003
testnC432 0.567
testnb1 0.011
testnc8 0.158
testncc 0.045
testncm42a 0.036
testncmb 0.411
testnmux 0.143
testnmyadder 0.411
testPN34 0.003
testPN4 0.007
testPN45 0.003
testPN5 0.018
testPN56 0.005
testPN6 0.057
testPN67 0.006
testPN7 0.247
testPN78 0.007
testPN8 1.21
testPN89 0.008
testPN9 6.676
testPN910 0.012

PuebloWatchedPBConstrWithPBConstrLearningTest

testaloul1011 0.91
testaloul1015 0.238
testaloul1020 0.38
testaloul1516 1.745
testaloul1520 0.657
testaloul1525 0.894
testaloul2021 6.253
testaloul2025 1.504
testaloul2030 2.36
testaloul3031 42.648
testaloul3035 6.359
testaloul3040 7.951
testaloul3536 89.92
testaloul3540 9.946
testaloul3545 13.031
testaloul4041 172.339
testaloul4045 16.002
testaloul4050 24.228
testaloul5051 188.588
Timeout: need more time to complete!
testaloul5055 38.709
testaloul5060 46.339
testncirc103 189.935
Timeout: need more time to complete!
testndata103 188.876
Timeout: need more time to complete!
testPN10 0.19
testncirc43 0.211
testncirc63 4.545
testncirc83 55.133
testndata43 0.204
testndata63 4.505
testndata83 55.064
testn9symml 0.422
testnC17 0.005
testnC432 0.689
testnb1 0.011
testnc8 0.169
testncc 0.05
testncm42a 0.039
testncmb 0.336
testnmux 0.247
testnmyadder 0.508
testPN34 0.002
testPN4 0.005
testPN45 0.003
testPN5 0.01
testPN56 0.005
testPN6 0.019
testPN67 0.007
testPN7 0.036
testPN78 0.01
testPN8 0.064
testPN89 0.013
testPN9 0.107
testPN910 0.016

WatchedPBConstrWithClauseLearningTest

testncirc43 0.892
testncirc63 3.567
testncirc83 11.74
testndata43 0.169
testndata63 2.945
testndata83 11.483
testn9symml 0.562
testnC17 0.008
testnC432 0.698
testnb1 0.015
testnc8 0.16
testncc 0.054
testncm42a 0.038
testncmb 0.34
testnmux 0.176
testnmyadder 0.429
testPN34 0.003
testPN4 0.011
testPN45 0.004
testPN5 0.051
testPN56 0.005
testPN6 0.126
testPN67 0.008
testPN7 0.551
testPN78 0.01
testPN8 2.013
testPN89 0.013
testPN9 12.708
testPN910 0.017

CounterPBConstrOnRandomCardProblemsTest

testRndDeg1 4.861
testRndDeg2 1.165
testRndDeg3 0.326
testRndDeg4 0.16
testRndDeg5 0.04
testRndDeg6 0.019
testRndDeg7 0.011
testRndDeg8 0.003
testRndDeg9 0.002
testRndDeg10 0.002
testRndDeg11 0.002
testRndDeg12 0.001
testRndDeg13 0.002
testRndDeg14 0.002
testRndDeg15 0.001
testRndDeg16 0.001
testRndDeg17 0.002
testRndDeg18 0.002
testPN34 0.004
testPN4 0.007
testPN45 0.005
testPN5 0.017
testPN56 0.006
testPN6 0.068
testPN67 0.007
testPN7 0.274
testPN78 0.011
testPN8 1.23
testPN89 0.011
testPN9 6.532
testPN910 0.016

CounterPBWithClauseCardConstrLearningReduceToClauseTest

testncirc43 0.78
testncirc63 10.808
testncirc83 16.682
testndata43 0.092
testndata63 10.06
testndata83 16.344
testn9symml 0.093
testnC17 0.007
testnC432 0.123
testnb1 0.006
testnc8 0.055
testncc 0.017
testncm42a 0.035
testncmb 0.052
testnmux 0.045
testnmyadder 0.155
testPN34 0.003
testPN4 0.01
testPN45 0.002
testPN5 0.01
testPN56 0.002
testPN6 0.014
testPN67 0.002
testPN7 0.029
testPN78 0.003
testPN8 0.052
testPN89 0.003
testPN9 0.089
testPN910 0.004

TestObjectiveFunction

testObjectiveFunctionWithAllWeightsToNull 0.081

WatchedCardConstrOnRandomCardProblemsTest

testRndDeg1 0.453
testRndDeg2 0.194
testRndDeg3 0.16
testRndDeg4 0.098
testRndDeg5 0.026
testRndDeg6 0.013
testRndDeg7 0.008
testRndDeg8 0.003
testRndDeg9 0.002
testRndDeg10 0.002
testRndDeg11 0.002
testRndDeg12 0.002
testRndDeg13 0.002
testRndDeg14 0.001
testRndDeg15 0.002
testRndDeg16 0.002
testRndDeg17 0.001
testRndDeg18 0.001
testPN34 0.016
testPN4 0.008
testPN45 0.006
testPN5 0.016
testPN56 0.004
testPN6 0.029
testPN67 0.006
testPN7 0.06
testPN78 0.007
testPN8 0.093
testPN89 0.006
testPN9 0.123
testPN910 0.008

PuebloWatchedPbClauseAtLeastConstrWithPBConstrLearningTest

testaloul1011 0.867
testaloul1015 0.186
testaloul1020 0.295
testaloul1516 1.556
testaloul1520 0.525
testaloul1525 0.738
testaloul2021 5.729
testaloul2025 1.278
testaloul2030 1.998
testaloul3031 40.085
testaloul3035 5.768
testaloul3040 7.159
testaloul3536 84.493
testaloul3540 8.695
testaloul3545 11.88
testaloul4041 162.869
testaloul4045 14.491
testaloul4050 22.422
testaloul5051 196.246
Timeout: need more time to complete!
testaloul5055 36.232
testaloul5060 43.369
testncirc103 195.736
Timeout: need more time to complete!
testndata103 193.002
Timeout: need more time to complete!
testPN10 0.148
testncirc43 0.098
testncirc63 2.95
testncirc83 11.479
testndata43 0.09
testndata63 2.936
testndata83 11.575
testn9symml 0.088
testnC17 0.01
testnC432 0.122
testnb1 0.039
testnc8 0.046
testncc 0.072
testncm42a 0.012
testncmb 0.048
testnmux 0.045
testnmyadder 0.153
testPN34 0.001
testPN4 0.004
testPN45 0.002
testPN5 0.008
testPN56 0.002
testPN6 0.014
testPN67 0.002
testPN7 0.029
testPN78 0.004
testPN8 0.052
testPN89 0.003
testPN9 0.089
testPN910 0.004

PuebloWatchedPBConstrOnRandomCardProblemsTest

testRndDeg1 1.633
testRndDeg2 0.672
testRndDeg3 0.635
testRndDeg4 0.188
testRndDeg5 0.053
testRndDeg6 0.025
testRndDeg7 0.014
testRndDeg8 0.004
testRndDeg9 0.003
testRndDeg10 0.002
testRndDeg11 0.002
testRndDeg12 0.002
testRndDeg13 0.001
testRndDeg14 0.001
testRndDeg15 0.001
testRndDeg16 0.001
testRndDeg17 0.002
testRndDeg18 0.001
testPN34 0.004
testPN4 0.007
testPN45 0.005
testPN5 0.016
testPN56 0.007
testPN6 0.033
testPN67 0.009
testPN7 0.048
testPN78 0.012
testPN8 0.084
testPN89 0.015
testPN9 0.128
testPN910 0.02

PuebloWatchedPBClauseCardConstrWithPBConstrLearningTest

testaloul1011 0.893
testaloul1015 0.24
testaloul1020 0.311
testaloul1516 1.568
testaloul1520 0.548
testaloul1525 0.784
testaloul2021 5.679
testaloul2025 1.493
testaloul2030 2.131
testaloul3031 40.066
testaloul3035 5.764
testaloul3040 7.195
testaloul3536 84.934
testaloul3540 9.117
testaloul3545 11.92
testaloul4041 164.181
testaloul4045 14.872
testaloul4050 22.859
testaloul5051 197.743
Timeout: need more time to complete!
testaloul5055 36.57
testaloul5060 43.216
testncirc103 126.142
testndata103 123.772
testPN10 0.283
testncirc43 0.111
testncirc63 4.709
testncirc83 13.598
testndata43 0.11
testndata63 4.802
testndata83 13.697
testn9symml 0.111
testnC17 0.044
testnC432 0.159
testnb1 0.012
testnc8 0.111
testncc 0.051
testncm42a 0.021
testncmb 0.054
testnmux 0.056
testnmyadder 0.177
testPN34 0.022
testPN4 0.008
testPN45 0.002
testPN5 0.008
testPN56 0.003
testPN6 0.016
testPN67 0.003
testPN7 0.031
testPN78 0.014
testPN8 0.054
testPN89 0.004
testPN9 0.091
testPN910 0.004

PBCPMixedConstraintsCautiousTest

testaloul1011 0.906
testaloul1015 0.191
testaloul1020 0.291
testaloul1516 1.546
testaloul1520 0.521
testaloul1525 0.75
testaloul2021 5.832
testaloul2025 1.289
testaloul2030 2.107
testaloul3031 39.946
testaloul3035 5.797
testaloul3040 7.118
testaloul3536 85.179
testaloul3540 8.701
testaloul3545 11.702
testaloul4041 162.377
testaloul4045 14.23
testaloul4050 22.211
testaloul5051 196.294
Timeout: need more time to complete!
testaloul5055 36.119
testaloul5060 43.159
testncirc103 190.227
Timeout: need more time to complete!
testndata103 189.135
Timeout: need more time to complete!
testPN10 0.228
testncirc43 0.103
testncirc63 13.427
testncirc83 17.263
testndata43 0.091
testndata63 13.319
testndata83 17.643
testn9symml 0.099
testnC17 0.012
testnC432 0.128
testnb1 0.007
testnc8 0.058
testncc 0.017
testncm42a 0.022
testncmb 0.061
testnmux 0.073
testnmyadder 0.164
testPN34 0.002
testPN4 0.004
testPN45 0.002
testPN5 0.008
testPN56 0.002
testPN6 0.016
testPN67 0.002
testPN7 0.03
testPN78 0.003
testPN8 0.114
testPN89 0.004
testPN9 0.092
testPN910 0.009

TestQuickExplainPB

testGlobalInconsistency 0.08
testGlobalInconsistencyPB 0.025
testAlmostGlobalInconsistency 0.005
testAlmostGlobalInconsistencyII 0.005
testAlmostGlobalInconsistencyPB 0.015
testEclipsePatchEncoding 0.015
testUpdatedEclipsePatchEncoding 0.011

WatchedPBConstrOnRandomCardProblemsTest

testRndDeg1 3.764
testRndDeg2 1.073
testRndDeg3 0.531
testRndDeg4 0.216
testRndDeg5 0.051
testRndDeg6 0.025
testRndDeg7 0.015
testRndDeg8 0.004
testRndDeg9 0.003
testRndDeg10 0.002
testRndDeg11 0.002
testRndDeg12 0.002
testRndDeg13 0.001
testRndDeg14 0.002
testRndDeg15 0.002
testRndDeg16 0.002
testRndDeg17 0.002
testRndDeg18 0.002
testPN34 0.007
testPN4 0.011
testPN45 0.012
testPN5 0.036
testPN56 0.011
testPN6 0.17
testPN67 0.01
testPN7 0.598
testPN78 0.012
testPN8 2.046
testPN89 0.015
testPN9 12.935
testPN910 0.019

CounterPBConstrWithPBConstrLearningTest

testncirc43 1.015
testncirc63 2.971
testncirc83 17.43
testndata43 0.157
testndata63 2.062
testndata83 16.778
testn9symml 0.389
testnC17 0.003
testnC432 0.624
testnb1 0.011
testnc8 0.161
testncc 0.046
testncm42a 0.04
testncmb 0.444
testnmux 0.205
testnmyadder 0.646
testPN34 0.003
testPN4 0.01
testPN45 0.004
testPN5 0.017
testPN56 0.012
testPN6 0.043
testPN67 0.005
testPN7 0.034
testPN78 0.007
testPN8 0.061
testPN89 0.01
testPN9 0.101
testPN910 0.012

Failure Details

[Summary] [Package List] [Test Cases]


testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata103
junit.framework.AssertionFailedError: Timeout: need more time to complete!