UAI 2016 Inference Evaluation

Tuning Results

Updated: 11-01-2016

Format: <score> (failed/total)

PR.UAI

Solver 1 min 20 mins 1 hour
brs 11578.091306 (33/170) 11585.816936 (32/170) 11586.218246 (32/170)
MN2C 118.422332471 (104/170) 537.523502763 (94/170) 521.733750361 (94/170)
wmb-is 4813.29332508 (2/170) 2650669.5102 (1/170) 2650654.08088 (1/170)
bks 11567.779366 (35/170) 11571.8645795 (33/170) 11586.571746 (32/170)
ai-14 619.421285888 (3/170) 240.210635332 (1/170) 202.082091611 (1/170)
merlin1 1031.37834777 (24/170) 658.920851766 (20/170) 452.396853766 (21/170)

MAR.UAI

Solver 1 min 20 mins 1 hour
brs 49.5732646368 (21/136) 49.5701433219 (21/136) 49.558579395 (21/136)
wmb-is 0.931414745941 (1/136) 0.190131453135 (0/136) 0.130405060642 (0/136)
bks 49.571504305 (21/136) 49.5505944863 (21/136) 49.5643758099 (21/136)
ai-14 1.74045457013 (0/136) 0.264443250298 (0/136) 0.111788870906 (0/136)
merlin1 3.67661562261 (0/136) 1.16456095302 (0/136) 0.630246773846 (0/136)

MPE.UAI

Solver 1 min 20 mins 1 hour
brs 211603.75074 (18/137) 216496.05302 (20/137) 216535.18254 (20/137)
tb2AMi 229041.17844 (3/137) 373453.59036 (0/137) 374690.99224 (0/137)
bks 212516.39124 (24/137) 209253.54214 (24/137) 212956.17814 (28/137)
merlin1 8079.13798 (32/137) 30431.71516 (8/137) 33184.1641 (8/137)
s-opt 254467.768389 (7/137) 335305.065894 (6/137) 349942.467894 (5/137)
tb2vns 228502.66334 (3/137) 335969.76653 (1/137) 335870.06836 (1/137)
s-lh 334027.921059 (6/137) 334639.443111 (6/137) 348973.923519 (5/137)

MMAP.UAI

Solver 1 min 20 mins 1 hour
brs 0 (119/119) 0 (119/119) 0 (119/119)
bks 34503.57863 (8/119) 26914.28253 (8/119) 33038.26093 (13/119)
merlin1 -438.56179 (70/119) -494.58659 (52/119) -497.70174 (55/119)
s-opt 187129.682371 (0/119) 187080.107053 (0/119) 187003.479749 (0/119)
s-lh 186021.854291 (0/119) 186249.386381 (0/119) 186101.164379 (0/119)
merlin2 53493.40566 (0/119) 42886.30773 (0/119) 42952.8442 (0/119)
merlin3 64899.35271 (0/119) 73957.11861 (2/119) 76027.32112 (1/119)

MPE.SUAI

Solver 1 min 20 mins 1 hour
s-lh 199074.0344 (7/137) 280402.6633 (6/137) 295297.5085 (5/137)

MMAP.SUAI

Solver 1 min 20 mins 1 hour
s-lh 136375.415 (0/119) 136272.60945 (0/119) 136483.5303 (0/119)