UAI 2014 Inference Competition

Organizer: Vibhav Gogate (Email: vgogate at hlt dot utdallas dot edu)

Results for bp solver

Note: Problem names and types have been made anonymous. PR: |log(Z/Z*)|, where Z is the exact partition function and Z* is the approximate. MAR: Hellinger distances. MAP: un-normalized MAP value. MMAP: given E = evidence, Q = query; log(Z) where Z is the partition function of P(E,Q). If the solver did not output a value, “error” is reported.

PR

Problem 20 secs 20 mins 1 hour
1 10.7915 7.2197 7.0991
2 13.8527 11.739 11.8497
3 5.674 7.0341 6.5246
4 108.85135 8.39615 5.65745
5 4.38629 1.911 0.9711
6 54.0585 38.9025 37.9335
7 115.2612 38.2272 37.4832
8 36.0663 29.286 29.0321
9 19.0236 14.5755 14.1136
10 22.5966 17.5572 16.4819
11 48.85815 0.0 0.0
12 32.1204 20.3476 20.6664
13 3.52259 7.03003 6.51898
14 25.5333 14.9848 14.5036
15 48.8584 0.0 0.0
16 24.0931 19.0915 19.3714
17 48.73 86.84 87.35
18 1854.7089 33.6228 33.2291
19 11.7163 8.8156 8.6495
20 0.0 0.0 0.0
21 16.5028 13.8444 13.4696
22 76.2074 14.8426 14.7153
23 41.3453 37.6955 38.0072
24 5.0239 6.376 5.8663
25 143.01255 1.2414 0.00105
26 25.4047 19.5176 19.363
27 12.0909 7.9069 7.7018
28 98.05238 1.08116 1.36593
29 35.2262 30.2126 29.7883
30 195.972 85.485 71.964
31 112.7271 66.9401 66.7011
32 24.8428 11.7986 11.555
33 0.45869 0.0 0.0
34 145.9868 42.0018 41.9678
35 0.0 0.0 0.0
36 0.0 0.0 0.0
37 18.3137 14.5869 13.6383
38 15.0258 9.3544 8.9344
39 24.3818 17.9111 17.1179
40 33.0938 28.0415 28.2515
41 55.81898 0.0 0.0
42 27.2486 25.3206 25.6625
43 944.78397 6.37417 5.43996
44 66.7145 29.2987 28.7377
45 197.16525 39.42985 34.33985
46 191.4968 95.7848 94.2608
47 128.6015 53.4645 52.6615
48 2.97029 0.0 0.0
49 14.6462 2.4459 2.2697
50 20.415 14.4422 14.0553
51 102.6909 24.9752 20.5008
52 22.9932 17.4422 16.6726
53 40.2263 33.1163 32.8613
54 36.0849 41.9993 39.7421
55 32.4509 21.8869 21.713
56 4.722 11.7 11.48
57 26.8948 20.0758 19.5401
58 26.9448 21.7703 21.5411
59 0.0 0.0 0.0
60 1664.31209 85.28399 81.79589
61 27.604 25.0077 24.5472
62 21.6625 17.9797 17.6606
63 41.52948 1.10908 0.79916
64 20.0716 13.7045 13.2614
65 0.0 0.0 0.0
66 44.29876 0.0 0.0
67 70.26384 0.0 0.0
68 20.2358 14.0595 13.7766
69 15.2582 10.2105 9.8569
70 26.8099 18.6954 18.1346
71 46.16734 0.0 0.0
72 16.623 10.9761 10.2478
73 0.0 0.0 0.0
74 25.4326 19.703 19.4725
75 4.89835 0.0 0.0
76 20.029 38.925 39.427
77 11.4312 8.9988 9.0948
78 14.3939 9.6561 9.3941
79 1142.7408 77.9632 75.3389
80 29.0164 25.1387 25.2436
81 74.69278 0.0 0.0
82 18.754 14.3994 13.8135
83 32.3048 26.7947 26.3821
84 90.2093 53.1693 52.5923
85 0.0 0.0 0.0
86 175.7319 73.8029 73.6909
87 0.0 0.0 0.0
88 79.76 136.27 136.78
89 20.8251 16.7451 17.0153
90 165.4422 95.3602 95.1702
91 38.5092 31.6973 29.4528
92 17.4067 0.0 0.0
93 13.8782 11.0823 10.7269
94 24.1441 17.0628 16.8869
95 219.3923 114.6403 112.5203
96 50.1354 44.6934 44.2515
97 24.333 18.7076 18.2331
98 26.2661 18.3682 18.0512
99 8.5446 4.7032 4.3883
100 0.0 0.0 0.0
101 26.1333 21.5292 21.7362
102 28.8993 20.2958 19.7703
103 14.4315 8.3142 8.3571
104 0.0 0.0 0.0
105 38.0655 7.1678 6.636
106 18.1251 14.5783 15.0381
107 12.8419 7.8174 8.0098
108 0.0 0.0 0.0
109 46.49383 0.0 0.0
110 37.17331 0.0 0.0
111 23.3862 17.6561 17.3777
112 0.0 0.0 0.0
113 36.971 0.0 0.0
114 45.034 0.0 0.0
115 234.75165 84.75405 78.52875
116 13.1966 10.0999 10.3121
117 0.18114 0.0 0.0
118 26.5174 20.4042 20.6941
119 31.6745 0.7372 0.1064
120 47.721 30.204 26.382
121 16.3196 11.3469 11.0313
122 0.0 0.0 0.0
123 19.8702 15.2918 14.6971
124 33.3456 25.2116 24.8996
125 13.6874 21.4875 21.9986
126 155.5691 77.7211 77.7131
127 24.5656 18.9673 18.5567
128 14.9187 12.1432 12.5214
129 52.9936 41.9046 41.2176
130 101.3993 93.5397 65.6613
131 18.0757 14.5751 14.2624
132 168.55972 20.59462 14.55612
133 24.1005 15.7166 15.1347
134 54.3947 18.0982 17.4174
135 166.61336 43.97826 37.74156
136 0.0 0.0 0.0
137 17.5126 11.9745 11.6181
138 112.357 43.034 42.954

MAR

Problem 20 secs 20 mins 1 hour
1 0.336266604338 0.217136265293 0.212757056265
2 0.455095770613 0.374025114159 0.36804326834
3 0.000720554524217 0.0010212615602 0.000965649305169
4 0.232180812447 0.168114117344 0.159503709251
5 0.079797407995 0.10748054226 0.0709690059626
6 0.570170553311 0.528823393165 0.513063599145
7 0.46158547867 0.359471738085 0.359307369487
8 0.369962685452 0.249338976751 0.246300243481
9 0.42112644941 0.335006475249 0.333199910075
10 0.268344682957 0.0 0.0
11 0.450067222906 0.35325755436 0.346336259651
12 0.00400419399594 0.000839264836794 0.000818984758779
13 0.367327000781 0.24458255057 0.242192588949
14 0.268165159127 0.0 0.0
15 0.485090099223 0.418469293161 0.413810070285
16 0.279466094726 0.391559354569 0.391453133414
17 0.53809183447 0.241051716243 0.238478078242
18 0.363787079639 0.242732600902 0.238732344355
19 0.0 0.0 0.0
20 0.391351980778 0.284057486137 0.280098398611
21 0.241644501504 0.136084938742 0.134540825503
22 0.561165889039 0.501206426066 0.496848554359
23 0.0337261359759 0.0340552211529 0.0339869329792
24 0.240302280869 0.160696123257 0.14947460064
25 0.382957904171 0.275746379552 0.27204073268
26 0.356898790962 0.228895461862 0.225422133924
27 0.297673516016 0.203849102374 0.177435346833
28 0.468170076558 0.396888845466 0.392536668745
29 0.267489828097 0.182509498699 0.182382966418
30 0.314603308599 0.254830313099 0.253310479264
31 0.445158718809 0.321271492127 0.315703895411
32 0.101671019879 0.0 0.0
33 0.281677081988 0.183529475154 0.182312315095
34 0.0 0.0 0.0
35 0.000340680247546 7.1846863737e-10 7.1846863737e-10
36 0.428304022667 0.317127476145 0.316743029915
37 0.372381924375 0.238956029317 0.235068990063
38 0.434187266623 0.331801593073 0.329055006374
39 0.472169099085 0.389464130021 0.384753260691
40 0.21824306829 0.0 0.0
41 0.459970467992 0.380574959962 0.375452878966
42 0.397555351733 0.173651571615 0.142830819273
43 0.249592534286 0.187124005276 0.185948308561
44 0.328717597584 0.234015055131 0.20418450496
45 0.298261759076 0.222982788438 0.222834064537
46 0.270853991962 0.156712516633 0.154564740718
47 0.204124031517 0.0 0.0
48 0.149135947343 0.0571617009233 0.0536472293229
49 0.377366185138 0.270179324201 0.265744737558
50 0.277108079199 0.187694784706 0.184069694653
51 0.405612198641 0.312877172367 0.309348423876
52 0.493572304368 0.385670821526 0.381399411479
53 0.297859889561 0.50125949261 0.475620831217
54 0.419540061619 0.297809760628 0.291928772955
55 0.172424398458 0.229910288343 0.221750468727
56 0.417387771585 0.310355509122 0.307674160476
57 0.447364785037 0.366266478679 0.360094940429
58 0.0 0.0 0.0
59 0.525861710906 0.262139016735 0.261449914576
60 0.465833945889 0.390175768837 0.381802951586
61 0.407002998585 0.315277968314 0.313262101115
62 0.300497389689 0.230648190656 0.190093901396
63 0.418492789993 0.317698490746 0.313666210491
64 0.188220853581 0.0 0.0
65 0.255999102246 0.0 0.0
66 0.366105217142 0.237667357985 0.233674771528
67 0.371311159468 0.243167636148 0.239595086472
68 0.439961957251 0.33049053009 0.32879137108
69 0.25223844553 0.0 0.0
70 0.437811893782 0.324156099523 0.321800163325
71 6.45467696458e-09 4.30319411e-09 4.30319411e-09
72 0.408820692467 0.312742198257 0.30952318258
73 0.274156656737 0.0 0.0
74 0.317983851986 0.370277100377 0.368998266075
75 0.419209969853 0.326481019976 0.318641519769
76 0.344866627073 0.223406215266 0.221122860169
77 0.386637299949 0.142388272507 0.139955897914
78 0.45578824444 0.401528755832 0.394566504679
79 0.283695213311 0.0 0.0
80 0.468572595978 0.399439024531 0.397501753859
81 0.485783994792 0.412680382016 0.402278551611
82 0.227344556245 0.156162333116 0.152181784588
83 0.0 0.0 0.0
84 0.280038972815 0.199919566498 0.199558542721
85 3.2066799353e-09 1.2554223424e-09 1.2554223424e-09
86 0.242820101464 0.384134092629 0.384107733117
87 0.46927744705 0.399797592605 0.392739002566
88 0.301798452302 0.238344745652 0.237864292241
89 0.556167967652 0.453877237066 0.450290953391
90 0.229077771707 0.0 0.0
91 0.411105991389 0.320501242039 0.317364541166
92 0.445198653205 0.326469415069 0.324137411087
93 0.322699833115 0.240643223218 0.240074701795
94 0.579799344936 0.492968921616 0.491533039918
95 0.417147931418 0.314460739992 0.311961726608
96 0.425984266731 0.310415288691 0.307396422939
97 0.315136266074 0.192556324641 0.188650490409
98 2.80343530681e-08 2.47633496009e-09 2.47633496009e-09
99 0.444429790757 0.349826661012 0.343949499464
100 0.410485719703 0.294620052901 0.29234581079
101 0.347529713225 0.218771495167 0.215277200531
102 0.0 0.0 0.0
103 0.221101872427 0.116440377512 0.110250329587
104 0.237198961969 0.251149505465 0.247552910508
105 0.426678133104 0.329197312946 0.321956501319
106 1.60950889815e-09 4.1356705175e-10 4.1356705175e-10
107 0.274494879329 0.0 0.0
108 0.267699607193 0.0 0.0
109 0.432083842939 0.357903321415 0.357471246504
110 0.0 0.0 0.0
111 0.233713626521 0.0 0.0
112 0.20985826928 0.00476974979139 0.0
113 0.317348428488 0.253598705465 0.252914732001
114 0.360888620435 0.249369523651 0.245087070971
115 0.183458849975 0.0 0.0
116 0.462585171663 0.36883160788 0.362192023832
117 0.226480810629 0.0501687580464 0.0290550459824
118 0.46040373583 0.352163309097 0.349462801369
119 0.381747010067 0.253912246634 0.249422079105
120 0.0 0.0 0.0
121 0.417879238385 0.315154655426 0.312270335304
122 0.444847024034 0.362012544417 0.356299807641
123 0.101768124252 0.210727489813 0.210556912395
124 0.300776851322 0.210946708688 0.210770716006
125 0.417913616988 0.302618436693 0.299007169759
126 0.449509484326 0.359978361523 0.350903793252
127 0.52707563591 0.406613578305 0.415406454686
128 0.178179084069 0.180522814449 0.1662544756
129 0.41579429752 0.319811038274 0.316874872542
130 0.383485127762 0.263762933996 0.231352495561
131 0.372663790459 0.255887852827 0.251914387961
132 0.281166878307 0.173073506509 0.169170320877
133 0.359668273118 0.26496876676 0.255789746694
134 0.0 0.0 0.0
135 0.358814256368 0.243001487598 0.238858692718
136 0.238387817372 0.144017154172 0.141997513948