UAI 2016 Evaluation
Home
Information
File Formats
UAI Model Format
Sparse Model Format
Binary Model Format
Evidence Format
Query Format
Result Format
Solvers
Requirements
Registration
Submit Solver
Results
Tuning

UAI 2016 Inference Evaluation

Organizer: Vibhav Gogate (Email: vgogate at hlt dot utdallas dot edu)

Tuning Results for brs solver

Note: Problem names and types have been made anonymous. PR: |log(Z/Z*)|, where Z is the exact partition function and Z* is the approximate. MAR: Hellinger distances. MAP: un-normalized MAP value. MMAP: given E = evidence, Q = query; log(Z) where Z is the partition function of P(E,Q). If the solver did not output a value, “error” is reported.

PR.UAI

Problem 1 min 20 mins 1 hour
1 31.8156 31.8156 31.8156
2 25.6391 25.6391 25.6391
3 26.2441 26.2441 26.2441
4 4.21774 4.31596 4.35718
5 error error error
6 71.0945 71.0945 71.0945
7 error error error
8 70.3557 70.3557 70.3557
9 37.5508 37.5508 37.5508
10 47.7321 47.7321 47.7321
11 1.19751 1.20228 1.21111
12 19.6966 19.6966 19.6966
13 10.2872 10.2872 10.2872
14 45.2178 45.2178 45.2178
15 1.18339 1.21402 1.20654
16 44.061 44.061 44.061
17 1311.98 1311.98 1311.98
18 2.62265 2.52309 2.53757
19 41.9716 41.9716 41.9716
20 error error error
21 44.6535 44.6535 44.6535
22 error error error
23 34.8383 34.8383 34.8383
24 23.9961 23.9961 23.9961
25 4.87282 4.90892 4.85297
26 41.6533 41.6533 41.6533
27 31.2439 31.2439 31.2439
28 2.08753 2.08739 2.09052
29 40.2516 40.2516 40.2516
30 error error error
31 error error error
32 46.6678 46.6678 46.6678
33 2.73918 2.84419 2.89463
34 error error error
35 152.617 152.617 152.617
36 66.5538 66.5538 66.5538
37 31.6116 31.6116 31.6116
38 33.7723 33.7723 33.7723
39 50.8014 50.8014 50.8014
40 36.0513 36.0513 36.0513
41 5.37051 5.30361 5.36732
42 35.2721 35.2721 35.2721
43 2.41963 2.31249 2.31625
44 error error error
45 4.89173 4.78833 4.72388
46 error error error
47 error error error
48 1.23674 1.23212 1.23221
49 error error error
50 36.6742 36.6742 36.6742
51 inf 6.52526 6.54021
52 39.4647 39.4647 39.4647
53 70.1997 70.1997 70.1997
54 33.3688 33.3688 33.3688
55 42.6617 42.6617 42.6617
56 291.733 291.733 291.733
57 21.3281 21.3281 21.3281
58 67.3803 67.3803 67.3803
59 3.71915 3.73021 3.72321
60 5.79842 6.12923 6.321
61 29.8625 29.8625 29.8625
62 35.8729 35.8729 35.8729
63 4.25185 4.21061 4.26936
64 36.5922 36.5922 36.5922
65 303.086 303.086 303.086
66 1.3341 1.35806 1.35929
67 2.90101 2.78328 2.60471
68 47.0408 47.0408 47.0408
69 33.6411 33.6411 33.6411
70 33.7535 33.7535 33.7535
71 1.94559 1.96224 1.9467
72 44.0869 44.0869 44.0869
73 169.408 169.408 169.408
74 38.6815 38.6815 38.6815
75 6.20679 5.9408 5.94838
76 665.116 665.116 665.116
77 18.6932 18.6932 18.6932
78 23.1519 23.1519 23.1519
79 4.91649 5.41275 5.58251
80 38.9285 38.9285 38.9285
81 1.22094 1.18063 1.25725
82 64.0901 64.0901 64.0901
83 29.8134 29.8134 29.8134
84 error error error
85 58.5307 58.5307 58.5307
86 error error error
87 497.763 497.763 497.763
88 1962.98 1962.98 1962.98
89 26.3792 26.3792 26.3792
90 error error error
91 37.0481 37.0481 37.0481
92 inf inf inf
93 26.4125 26.4125 26.4125
94 34.4033 34.4033 34.4033
95 error error error
96 38.4515 38.4515 38.4515
97 19.9071 19.9071 19.9071
98 36.2921 36.2921 36.2921
99 46.7958 46.7958 46.7958
100 63.1467 63.1467 63.1467
101 29.9518 29.9518 29.9518
102 41.0281 41.0281 41.0281
103 35.4056 35.4056 35.4056
104 166.111 166.111 166.111
105 error error error
106 38.1283 38.1283 38.1283
107 51.8613 51.8613 51.8613
108 333.321 333.321 333.321
109 2.22396 2.2978 2.30523
110 1.24941 1.26359 1.26556
111 52.3719 52.3719 52.3719
112 151.155 151.155 151.155
113 error error error
114 error error error
115 3.23146 3.25389 3.27331
116 53.4013 53.4013 53.4013
117 1.72167 1.74521 1.7474
118 33.4141 33.4141 33.4141
119 inf inf inf
120 75.07 75.07 75.07
121 41.4776 41.4776 41.4776
122 606.279 606.279 606.279
123 34.1176 34.1176 34.1176
124 74.8804 74.8804 74.8804
125 39.4965 39.4965 39.4965
126 error error error
127 40.6246 40.6246 40.6246
128 24.3918 24.3918 24.3918
129 72.2744 72.2744 72.2744
130 error error error
131 30.6846 30.6846 30.6846
132 0.2794 0.46179 0.48371
133 56.998 56.998 56.998
134 error error error
135 0.68557 1.26312 1.23417
136 303.086 303.086 303.086
137 24.7929 24.7929 24.7929
138 error error error
139 97.4412776799 97.4412776799 97.4412776799
140 15.9929982198 15.9929982198 15.9929982198
141 29.3156127896 29.3156127896 29.3156127896
142 9.93398985691 9.93398985691 9.93398985691
143 10.8370798439 10.8370798439 10.8370798439
144 18.0617997398 18.0617997398 18.0617997398
145 20.7513973273 20.7513973273 20.7513973273
146 10.5096693962 10.5096693962 10.5096693962
147 11.4469368913 11.4469368913 11.4469368913
148 28.3696148969 28.3696148969 28.3696148969
149 38.8598301072 38.8598301072 38.8598301072
150 14.5774564994 14.5774564994 14.5774564994
151 23.6557309049 23.6557309049 23.6557309049
152 24.5999195311 24.5999195311 24.5999195311
153 20.7513973273 20.7513973273 20.7513973273
154 10.5096693962 10.5096693962 10.5096693962
155 11.4469368913 11.4469368913 11.4469368913
156 28.3696148969 28.3696148969 28.3696148969
157 38.8598301072 38.8598301072 38.8598301072
158 36.918323423 36.918323423 36.918323423
159 286.272752832 286.272752832 286.272752832
160 371.731437632 371.731437632 371.731437632
161 393.88713065 393.88713065 393.88713065
162 23.7737592064 23.7737592064 23.7737592064
163 error error error
164 error error error
165 error error error
166 error error error
167 error error error
168 error error error
169 error error error
170 error error error

MAR.UAI

Problem 1 min 20 mins 1 hour
1 0.667737746023 0.670709289194 0.670777490976
2 0.582802615072 0.586816353426 0.58611707029
3 0.00261691458744 0.0026233482712 0.00251913366698
4 0.253386121657 0.253014541006 0.253124634013
5 error error error
6 0.58936039067 0.588412115388 0.589417275952
7 0.638647852378 0.631266962588 0.631197381456
8 0.675703948187 0.669974525335 0.670892802518
9 0.628121482127 0.628887382815 0.629182725979
10 0.212404091893 0.21186358062 0.212022886297
11 0.577055436806 0.585480400175 0.585174201896
12 0.000466484161529 0.000102955825919 6.56980948541e-05
13 0.675780086792 0.673590017209 0.671763753375
14 0.211794760633 0.211965353455 0.211979374931
15 0.591815171361 0.5874831436 0.586216650209
16 0.156692385807 0.158628705424 0.158406079772
17 0.176114601786 0.175491201963 0.175419024921
18 0.668683997325 0.671633576257 0.671489613881
19 error error error
20 0.670698373916 0.671831188127 0.672291400378
21 error error error
22 0.58632796493 0.590340871504 0.589094045452
23 0.106916520226 0.105616015439 0.105550939522
24 0.270727449116 0.269973600986 0.269932210644
25 0.673078593659 0.670779338262 0.670917444837
26 0.660915931987 0.671968270351 0.670608285456
27 0.195786715189 0.195684965026 0.195705942553
28 0.5852471257 0.585049293609 0.585530644877
29 error error error
30 error error error
31 0.629085434887 0.626207754433 0.62685476114
32 0.154300197112 0.154143752647 0.154234892201
33 error error error
34 0.326025164321 0.327755032759 0.327641101708
35 0.0871521778893 0.0903802857029 0.0902899413999
36 0.627922938326 0.633174971106 0.631050894662
37 0.670654441328 0.670952192187 0.672152515199
38 0.622496647475 0.62679527347 0.625904468185
39 0.58227239287 0.588650603821 0.587999160097
40 0.231995673233 0.23186512624 0.231847224049
41 0.590229965591 0.585312621572 0.585954164736
42 0.214938299423 0.214968112231 0.214918172355
43 error error error
44 0.223615674064 0.223581745628 0.223645384683
45 error error error
46 error error error
47 0.202343722126 0.202079894451 0.202212380435
48 error error error
49 0.681593567008 0.673541800023 0.672556765237
50 0.170398518714 0.170224133237 0.170181596867
51 0.626682632335 0.628331450753 0.627913482014
52 0.63069419923 0.62696396784 0.627781109282
53 0.0173583159499 0.0177219552749 0.0176413993273
54 0.617118418887 0.625532503921 0.625869862775
55 0.010220606005 0.00900161873242 0.00910793383006
56 0.62637483686 0.625567178169 0.625783655333
57 0.630314716319 0.630090565386 0.628830811171
58 0.0729617575342 0.0717201020315 0.0717201172989
59 0.171473071355 0.170665626774 0.170696846331
60 0.590181319664 0.588992750887 0.590236903562
61 0.636721820166 0.628996505822 0.627507395761
62 0.118476339314 0.118411697936 0.118320503139
63 0.626834120687 0.627214838906 0.629338335318
64 0.14035755012 0.139785851052 0.139789704357
65 0.206200443603 0.205741435789 0.205729902744
66 0.673051594266 0.670771608287 0.671352883224
67 0.673143525617 0.671968492498 0.672950067641
68 0.628071734723 0.631880391873 0.632454945407
69 0.208499818939 0.208433123825 0.208423005425
70 0.629569706105 0.627332213044 0.626757221601
71 0.238130569767 0.238639114139 0.238598959957
72 0.632391200123 0.626700851547 0.627779310569
73 0.0895553745243 0.0898872406768 0.0899235699073
74 0.193124222969 0.193902615393 0.193881824086
75 0.590172532588 0.589081651457 0.587831503596
76 0.666404272452 0.670966399086 0.671151904614
77 0.224399306509 0.22448262978 0.22442159905
78 0.588206612965 0.585282884436 0.587296476167
79 0.198080782243 0.197805082659 0.197825364994
80 0.580397730367 0.590266803389 0.589418218414
81 0.597049579882 0.590854545388 0.589064436261
82 error error error
83 0.180143719015 0.178212148495 0.177276629212
84 error error error
85 0.31796972144 0.319377805551 0.319086978935
86 0.240351754699 0.239819084695 0.239748012222
87 0.593553793915 0.590714497827 0.589271070626
88 error error error
89 0.634104391959 0.628930331681 0.629854455969
90 0.115238573286 0.114678490247 0.114445425656
91 0.629367661784 0.628694711012 0.627666030285
92 0.623841854625 0.630435976927 0.631241189454
93 error error error
94 0.635560276946 0.630734967602 0.630975191984
95 0.628819767702 0.628877309647 0.62893332372
96 0.621885963655 0.625405015948 0.626660040158
97 0.670544159974 0.671312309791 0.670280705199
98 0.18894701356 0.190172820919 0.190632773398
99 0.590634766639 0.586331753974 0.585448768379
100 0.631902850062 0.627009368145 0.625525630197
101 0.665714379425 0.671039728722 0.670061106654
102 0.319545703072 0.318973876877 0.317458656154
103 error error error
104 0.000605546064441 0.00014540011041 0.000124465431575
105 0.579905820463 0.587259357679 0.585504068389
106 0.310610998612 0.310998067591 0.311267823927
107 0.198071860198 0.197269975289 0.19708954284
108 0.198756627926 0.1985963183 0.198646593268
109 0.670721396296 0.67284427788 0.671805632538
110 0.3566805098 0.358401019206 0.356969039837
111 error error error
112 error error error
113 0.231151134747 0.2306504941 0.230554661539
114 0.674317678503 0.671450497395 0.670386400059
115 0.0922829345048 0.0921928625587 0.0922033360179
116 0.574081975643 0.584565086252 0.585802672931
117 0.169739204817 0.169164535324 0.169255440412
118 0.672221903754 0.671995360921 0.67122919293
119 0.669887231756 0.670891777419 0.671522754874
120 0.000642621742382 0.000137803629574 7.4678184532e-05
121 0.632011578167 0.62915684511 0.627741351435
122 0.676556893744 0.673991577365 0.672998227962
123 0.00065694831793 0.000385124584758 0.000322144376216
124 error error error
125 0.627270683575 0.626128105319 0.628577564699
126 0.587357705508 0.586514220973 0.587135472472
127 0.630898916792 0.626424301057 0.628077821596
128 error error error
129 0.632306570016 0.626907120691 0.627844769708
130 0.174444709241 0.173991230737 0.173958623402
131 0.674618011065 0.672026456918 0.672269955792
132 error error error
133 0.135386492302 0.134831633153 0.134752465629
134 0.237896604047 0.238041175199 0.237730908343
135 0.669929439059 0.672648506937 0.67192841018
136 error error error

MPE.UAI

Problem 1 min 20 mins 1 hour
1 5215.02 5108.46 5082.26
2 1120.71 1095.57 1091.07
3 4372.33 4385.57 4372.92
4 7488.23 7611.19 7462.08
5 2643.45 2671.27 2578.01
6 2638.76 2587.17 2591.71
7 7214.5 7257.86 7117.14
8 1086.16 1094.57 1090.38
9 1179.47 1212.52 1162.78
10 4983.23 4985.5 4824.48
11 1765.12 1746.31 1774.23
12 619.321 638.95 622.847
13 1139.53 1207.96 1180.47
14 -4816.33 -823.234 -823.234
15 -435.669 -435.669 -435.669
16 -7159.13 -7381.01 -3006.49
17 -3109.6 -1600.45 -3164.79
18 -1182.9 -1176.48 -3926.13
19 -inf -inf -inf
20 -inf -inf -inf
21 -inf -inf -inf
22 -inf -inf -inf
23 -inf -inf error
24 -inf -inf -inf
25 -inf -inf -inf
26 -inf -inf -inf
27 -40.2553 -38.5002 -34.9308
28 -31.5503 -27.1648 -31.4519
29 -58.8739 -61.1921 -60.3272
30 -52.6873 -27.2974 -33.5078
31 -inf -inf -inf
32 -42.2448 -45.0579 -47.7545
33 -33.3186 -46.3485 -37.3306
34 -56.2182 -53.9443 -48.1559
35 -69.9479 -63.1697 -70.983
36 -35.7483 -35.914 -31.1586
37 -47.0526 -52.3131 -36.3676
38 -inf -inf -inf
39 -64.5295 -45.2901 -51.9985
40 -19.3507 -15.388 -15.388
41 -22.3965 -25.1142 -26.4648
42 -37.5113 -48.3124 -34.5946
43 -15.6531 -16.7666 -18.4454
44 -14.0187 -9.70692 -13.9218
45 -52.4733 -31.5451 -31.8374
46 -28.3515 -25.6666 -31.8225
47 -32.0671 -25.3918 -23.4322
48 -38.0304 -23.6982 -21.694
49 -43.0269 -37.9686 -28.142
50 -37.0452 -30.158 -29.6406
51 -14.637 -14.637 -14.637
52 -14.7045 -12.8168 -13.773
53 -32.3934 -26.1796 -23.4015
54 -22.264 -37.6565 -16.49
55 -30.1474 -24.5646 -28.5311
56 -10.8499 -11.237 -10.8499
57 -14.2664 -17.8597 -13.8793
58 -30.8115 -27.3585 -21.6704
59 -11.5617 -11.5617 -11.5617
60 -20.9714 -19.6425 -16.7567
61 -15.8092 -15.8092 -15.4221
62 -16.1499 -16.1499 -16.1499
63 -28.7796 -25.248 -23.0612
64 -inf -inf -inf
65 -12.8785 -11.2166 -12.4914
66 -inf -inf -inf
67 -15.3752 -15.3752 -15.3752
68 -inf -inf -inf
69 -20.1479 -19.5282 -21.4527
70 -inf error -inf
71 -16.6205 -16.6205 -16.6205
72 -13.8743 -13.8743 -14.2615
73 -18.4673 -18.8544 -21.661
74 -45.7516 -28.0152 -47.9618
75 -15.1098 -15.1098 -15.4969
76 -15.0882 -13.9747 -15.0882
77 -10.4773 -10.4773 -10.4773
78 -12.3616 -12.3616 -12.7487
79 -10.863 -10.863 -10.863
80 -15.0021 -14.615 -16.277
81 -7.7599 -7.7599 -7.7599
82 -15.397 -16.8781 -17.0589
83 -17.4286 -18.2994 -17.3121
84 -48.0865 -24.1583 -29.7511
85 -11.5735 -11.5735 -11.5735
86 -4.70696 -4.70696 -4.70696
87 -12.3822 -12.3822 -12.3822
88 1712.08 1767.82 1754.61
89 -1546.13 -1708.26 -1702.97
90 -142.322 -685.866 -142.322
91 -330.735 -330.735 -330.735
92 -50.5516 -50.5516 -50.5516
93 -854.522 -854.522 -854.522
94 -inf -inf -inf
95 -inf -inf -inf
96 -inf -inf -inf
97 -inf -inf -inf
98 -inf -inf -inf
99 -inf -inf -inf
100 -inf -inf -inf
101 -inf -inf -inf
102 -inf error error
103 -157.033 -162.918 -161.356
104 -21.2144 -21.2144 -21.2144
105 -20.6534 -20.6534 -20.6534
106 -40.0195 -39.9682 -39.4336
107 -203.973 -201.565 -194.336
108 -42.5856 -41.5531 -41.9068
109 -222.296 -201.525 -197.237
110 -35.8288 -34.9067 -37.2906
111 -25.2677 -24.4949 -24.6847
112 -129.4 -128.777 -131.255
113 error error error
114 error error error
115 error error error
116 error error error
117 error error error
118 error error error
119 error error error
120 error error error
121 error error error
122 error error error
123 error error error
124 error error error
125 error error error
126 error error error
127 error error error
128 error error error
129 error error error
130 error error error
131 14739.9 14705.2 14708.4
132 29447.9 29465.6 29401.7
133 1808.37 1807.94 1812.85
134 60676.9 60655.2 60775.0
135 1591.32 1600.9 1612.41
136 1668.96 1664.42 1649.67
137 80493.7 80493.7 80493.8

MMAP.UAI

Problem 1 min 20 mins 1 hour
1 error error error
2 error error error
3 error error error
4 error error error
5 error error error
6 error error error
7 error error error
8 error error error
9 error error error
10 error error error
11 error error error
12 error error error
13 error error error
14 error error error
15 error error error
16 error error error
17 error error error
18 error error error
19 error error error
20 error error error
21 error error error
22 error error error
23 error error error
24 error error error
25 error error error
26 error error error
27 error error error
28 error error error
29 error error error
30 error error error
31 error error error
32 error error error
33 error error error
34 error error error
35 error error error
36 error error error
37 error error error
38 error error error
39 error error error
40 error error error
41 error error error
42 error error error
43 error error error
44 error error error
45 error error error
46 error error error
47 error error error
48 error error error
49 error error error
50 error error error
51 error error error
52 error error error
53 error error error
54 error error error
55 error error error
56 error error error
57 error error error
58 error error error
59 error error error
60 error error error
61 error error error
62 error error error
63 error error error
64 error error error
65 error error error
66 error error error
67 error error error
68 error error error
69 error error error
70 error error error
71 error error error
72 error error error
73 error error error
74 error error error
75 error error error
76 error error error
77 error error error
78 error error error
79 error error error
80 error error error
81 error error error
82 error error error
83 error error error
84 error error error
85 error error error
86 error error error
87 error error error
88 error error error
89 error error error
90 error error error
91 error error error
92 error error error
93 error error error
94 error error error
95 error error error
96 error error error
97 error error error
98 error error error
99 error error error
100 error error error
101 error error error
102 error error error
103 error error error
104 error error error
105 error error error
106 error error error
107 error error error
108 error error error
109 error error error
110 error error error
111 error error error
112 error error error
113 error error error
114 error error error
115 error error error
116 error error error
117 error error error
118 error error error
119 error error error