UAI 2016 Evaluation
Home
Information
File Formats
UAI Model Format
Sparse Model Format
Binary Model Format
Evidence Format
Query Format
Result Format
Solvers
Requirements
Registration
Submit Solver
Results
Tuning

UAI 2016 Inference Evaluation

Organizer: Vibhav Gogate (Email: vgogate at hlt dot utdallas dot edu)

Tuning Results for bks solver

Note: Problem names and types have been made anonymous. PR: |log(Z/Z*)|, where Z is the exact partition function and Z* is the approximate. MAR: Hellinger distances. MAP: un-normalized MAP value. MMAP: given E = evidence, Q = query; log(Z) where Z is the partition function of P(E,Q). If the solver did not output a value, “error” is reported.

PR.UAI

Problem 1 min 20 mins 1 hour
1 31.8156 31.8156 31.8156
2 25.6391 25.6391 25.6391
3 26.2441 26.2441 26.2441
4 3.88216 4.43172 4.41771
5 error error error
6 71.0945 71.0945 71.0945
7 error error error
8 70.3557 70.3557 70.3557
9 37.5508 37.5508 37.5508
10 47.7321 47.7321 47.7321
11 1.17524 1.21703 1.20502
12 19.6966 19.6966 19.6966
13 10.2872 10.2872 10.2872
14 45.2178 45.2178 45.2178
15 1.22192 1.2063 1.20487
16 44.061 44.061 44.061
17 1311.98 1311.98 1311.98
18 2.45886 2.53206 2.52797
19 41.9716 41.9716 41.9716
20 error error error
21 44.6535 44.6535 44.6535
22 error error error
23 34.8383 34.8383 34.8383
24 23.9961 23.9961 23.9961
25 4.7901 4.85443 4.84489
26 41.6533 41.6533 41.6533
27 31.2439 31.2439 31.2439
28 1.97988 2.09296 2.09154
29 40.2516 40.2516 40.2516
30 error error error
31 error error error
32 46.6678 46.6678 46.6678
33 2.26332 2.83605 2.82821
34 error error error
35 152.617 152.617 152.617
36 66.5538 66.5538 66.5538
37 31.6116 31.6116 31.6116
38 33.7723 33.7723 33.7723
39 50.8014 50.8014 50.8014
40 36.0513 36.0513 36.0513
41 5.01536 5.34401 5.36109
42 35.2721 35.2721 35.2721
43 2.21299 2.3062 2.3168
44 error error error
45 4.71352 4.74528 4.74351
46 error error error
47 error error error
48 1.248 1.21808 1.22865
49 error error error
50 36.6742 36.6742 36.6742
51 inf 6.83612 6.98512
52 39.4647 39.4647 39.4647
53 70.1997 70.1997 70.1997
54 33.3688 33.3688 33.3688
55 42.6617 42.6617 42.6617
56 291.733 291.733 291.733
57 21.3281 21.3281 21.3281
58 67.3803 67.3803 67.3803
59 3.78966 3.70915 3.73749
60 5.77132 6.31978 6.31979
61 29.8625 29.8625 29.8625
62 35.8729 35.8729 35.8729
63 4.51034 4.19337 4.20016
64 36.5922 36.5922 36.5922
65 303.086 303.086 303.086
66 1.2967 1.35649 1.35547
67 inf 2.71577 2.51018
68 47.0408 47.0408 47.0408
69 33.6411 33.6411 33.6411
70 33.7535 33.7535 33.7535
71 1.94432 1.95983 1.95408
72 44.0869 44.0869 44.0869
73 169.408 169.408 169.408
74 38.6815 38.6815 38.6815
75 5.25319 6.00703 5.9909
76 665.116 665.116 665.116
77 18.6932 18.6932 18.6932
78 23.1519 23.1519 23.1519
79 inf 5.41999 5.57061
80 38.9285 38.9285 38.9285
81 1.0441 1.23188 1.23251
82 64.0901 64.0901 64.0901
83 29.8134 29.8134 29.8134
84 error error error
85 58.5307 58.5307 58.5307
86 error error error
87 497.763 497.763 497.763
88 1962.98 1962.98 1962.98
89 26.3792 26.3792 26.3792
90 error error error
91 37.0481 37.0481 37.0481
92 inf inf inf
93 26.4125 26.4125 26.4125
94 34.4033 34.4033 34.4033
95 error error error
96 38.4515 38.4515 38.4515
97 19.9071 19.9071 19.9071
98 36.2921 36.2921 36.2921
99 46.7958 46.7958 46.7958
100 63.1467 63.1467 63.1467
101 29.9518 29.9518 29.9518
102 41.0281 41.0281 41.0281
103 35.4056 35.4056 35.4056
104 166.111 166.111 166.111
105 error error error
106 38.1283 38.1283 38.1283
107 51.8613 51.8613 51.8613
108 333.321 333.321 333.321
109 2.29749 2.29736 2.3011
110 1.23906 1.26608 1.26579
111 52.3719 52.3719 52.3719
112 151.155 151.155 151.155
113 error error error
114 error error error
115 3.4002 3.28497 3.28106
116 53.4013 53.4013 53.4013
117 1.7067 1.74603 1.75023
118 33.4141 33.4141 33.4141
119 inf inf inf
120 75.07 75.07 75.07
121 41.4776 41.4776 41.4776
122 606.279 606.279 606.279
123 34.1176 34.1176 34.1176
124 74.8804 74.8804 74.8804
125 39.4965 39.4965 39.4965
126 error error error
127 40.6246 40.6246 40.6246
128 24.3918 24.3918 24.3918
129 72.2744 72.2744 72.2744
130 error error error
131 30.6846 30.6846 30.6846
132 0.25716 0.48116 0.49203
133 56.998 56.998 56.998
134 error error error
135 0.74171 1.26684 1.2889
136 303.086 303.086 303.086
137 24.7929 24.7929 24.7929
138 error error error
139 97.4412776799 97.4412776799 97.4412776799
140 15.9929982198 15.9929982198 15.9929982198
141 29.3156127896 29.3156127896 29.3156127896
142 9.93398985691 9.93398985691 9.93398985691
143 10.8370798439 10.8370798439 10.8370798439
144 18.0617997398 18.0617997398 18.0617997398
145 20.7513973273 20.7513973273 20.7513973273
146 10.5096693962 10.5096693962 10.5096693962
147 11.4469368913 11.4469368913 11.4469368913
148 28.3696148969 28.3696148969 28.3696148969
149 38.8598301072 38.8598301072 38.8598301072
150 14.5774564994 error 14.5774564994
151 23.6557309049 23.6557309049 23.6557309049
152 24.5999195311 24.5999195311 24.5999195311
153 20.7513973273 20.7513973273 20.7513973273
154 10.5096693962 10.5096693962 10.5096693962
155 11.4469368913 11.4469368913 11.4469368913
156 28.3696148969 28.3696148969 28.3696148969
157 38.8598301072 38.8598301072 38.8598301072
158 36.918323423 36.918323423 36.918323423
159 286.272752832 286.272752832 286.272752832
160 371.731437632 371.731437632 371.731437632
161 393.88713065 393.88713065 393.88713065
162 23.7737592064 23.7737592064 23.7737592064
163 error error error
164 error error error
165 error error error
166 error error error
167 error error error
168 error error error
169 error error error
170 error error error

MAR.UAI

Problem 1 min 20 mins 1 hour
1 0.66982152629 0.669215729665 0.670153244681
2 0.57660432686 0.58716475671 0.586849434031
3 0.00246450995257 0.00258309642139 0.00258340179463
4 0.253043320224 0.253161049383 0.253103310864
5 error error error
6 0.598637086783 0.588791448697 0.590513195367
7 0.629179860143 0.630841103407 0.63081155324
8 0.672276300418 0.67229937645 0.670380342627
9 0.629402221289 0.627389496129 0.628408153975
10 0.212365587711 0.211859924273 0.212028047723
11 0.585313568647 0.586039047355 0.585847111885
12 0.000481167863285 0.000110582254172 6.46296092511e-05
13 0.66840625522 0.670803883854 0.671581823083
14 0.212262348209 0.212015386123 0.211996661059
15 0.593201573952 0.58780516328 0.586656612832
16 0.1572057181 0.158871343066 0.158431804559
17 0.175757255618 0.17541553954 0.175437481099
18 0.668497078825 0.67099205082 0.670933297764
19 error error error
20 0.668545957993 0.672009211455 0.672622231331
21 error error error
22 0.591264369425 0.590710577597 0.589757315657
23 0.107555064645 0.10558981853 0.105798655066
24 0.269808032501 0.269893449014 0.269884495705
25 0.666188556606 0.671656766564 0.672046920729
26 0.660860874205 0.671105828445 0.670838413082
27 0.195528892286 0.195651185896 0.195625827079
28 0.586172142806 0.583981099798 0.586288571377
29 error error error
30 error error error
31 0.631968153825 0.626818847707 0.625728249748
32 0.154569365255 0.15424408006 0.154266710191
33 error error error
34 0.330742331557 0.328005555467 0.327821470003
35 0.091500539536 0.0906895645717 0.0903304208994
36 0.630123603903 0.62989071313 0.630572608304
37 0.67396866865 0.672373081815 0.671683347068
38 0.630054727765 0.626129785373 0.627040611314
39 0.582602840756 0.586489217147 0.585620049128
40 0.231944021408 0.232062720118 0.231820578225
41 0.595164662989 0.585433062591 0.584870897314
42 0.214986597193 0.21488942097 0.214890490565
43 error error error
44 0.223853898471 0.22370586652 0.223727841103
45 error error error
46 error error error
47 0.202467649562 0.20206046073 0.202105641661
48 error error error
49 0.668378948522 0.672539891347 0.672405218942
50 0.171656316844 0.170043136876 0.170322172311
51 0.628959481125 0.628151369907 0.628511802618
52 0.628281428849 0.627655388807 0.628021300256
53 0.017978480709 0.0178711398387 0.0177122087673
54 0.620521933281 0.625481367479 0.625012900635
55 0.00915458468146 0.00929806967084 0.00901452768738
56 0.628196145638 0.625760432635 0.626116759778
57 0.635584031532 0.63020979653 0.630743750161
58 0.0725353371178 0.0717136683767 0.0717427226193
59 0.171090471496 0.170707884794 0.170517265891
60 0.586005265058 0.589390912139 0.590266808641
61 0.625396621944 0.627505763395 0.628133238767
62 0.118494469619 0.118473924932 0.118329039061
63 0.619439702013 0.627281529906 0.629182677828
64 0.140018705406 0.139919969207 0.139804328701
65 0.206094404188 0.20578466247 0.205764239782
66 0.675544123025 0.67214534484 0.671304484889
67 0.669909864719 0.671868658714 0.672275107486
68 0.627563065689 0.62893590147 0.630220296261
69 0.208362059635 0.20838376434 0.208405683577
70 0.628077287821 0.628674828527 0.62833532865
71 0.239144541108 0.238654464986 0.238854888457
72 0.62371835249 0.626828450569 0.627238365879
73 0.0900832666542 0.089976487567 0.0898893846507
74 0.195289708984 0.193599859968 0.19360212977
75 0.585690428944 0.588367540335 0.587743019477
76 0.669817793572 0.669405758012 0.670946823447
77 0.225160535706 0.224362002757 0.224381405206
78 0.581312122534 0.585100329554 0.585283789683
79 0.198119312805 0.197819823917 0.19784319986
80 0.58874145132 0.591215415296 0.591073056381
81 0.592670815658 0.590215814204 0.588960352851
82 error error error
83 0.173136544323 0.176621122618 0.177613339738
84 error error error
85 0.317527931793 0.319254314234 0.319206531199
86 0.240155638633 0.239912487413 0.239816936328
87 0.583420498764 0.590499782085 0.590665913502
88 error error error
89 0.627654768434 0.628223279813 0.630242769847
90 0.114743702736 0.114497104627 0.1143350331
91 0.625235999553 0.62873676613 0.628222969213
92 0.634665298318 0.631100882558 0.632407110083
93 error error error
94 0.628385547883 0.631988620317 0.631111803812
95 0.628244416569 0.628489255232 0.628127559371
96 0.627154834128 0.627015737816 0.626925832727
97 0.671976666169 0.669737900959 0.670555100708
98 0.192763987538 0.189977795538 0.190962263176
99 0.590196319174 0.585832693067 0.587286258533
100 0.627971419861 0.626565075732 0.625943068696
101 0.672766083417 0.670265204382 0.670223987448
102 0.316461141552 0.316001016434 0.317892385538
103 error error error
104 0.000507812202936 0.000166361354954 0.000139151190526
105 0.595105279545 0.588047978135 0.587465872742
106 0.311260825834 0.311362757644 0.311255042657
107 0.19729480052 0.19714919727 0.197204268155
108 0.198585761042 0.198697912308 0.198583755563
109 0.680533086223 0.670851962235 0.672065597891
110 0.355328280177 0.35794664822 0.357833861012
111 error error error
112 error error error
113 0.231161501686 0.230705792651 0.230566766294
114 0.666424832721 0.670497808044 0.670720450569
115 0.0925228813384 0.0922501804887 0.0921179432193
116 0.596993821039 0.58539661328 0.585994514794
117 0.169808112932 0.169376828142 0.169255065373
118 0.671465006912 0.670275242709 0.672051257317
119 0.674778253766 0.670474886444 0.671891475358
120 0.000553469786522 0.000132360132536 7.6091903784e-05
121 0.624717633495 0.629769148803 0.628830547992
122 0.677527812216 0.671949227964 0.671618997288
123 0.000612816844328 0.00033957628827 0.000348204479034
124 error error error
125 0.624874843355 0.627488870373 0.62797903495
126 0.591165616178 0.586281003197 0.586545991286
127 0.628015537747 0.627440145489 0.62721888076
128 error error error
129 0.628542773794 0.627161833842 0.627476273935
130 0.173685317117 0.174074184132 0.173956136961
131 0.669904602235 0.671442818159 0.671279371675
132 error error error
133 0.135115417311 0.134894310775 0.134776121597
134 0.238563707574 0.237749475455 0.237671048243
135 0.672211986468 0.671859679495 0.670835492918
136 error error error

MPE.UAI

Problem 1 min 20 mins 1 hour
1 5092.64 5068.37 5208.2
2 1093.0 error 1114.74
3 4360.61 4373.16 4363.44
4 7683.43 7520.15 7586.99
5 error 2650.6 2683.13
6 2597.12 error 2621.87
7 7255.87 7142.55 7300.32
8 1090.28 1094.67 1094.17
9 1238.13 1198.64 1228.54
10 4957.69 4934.0 4918.56
11 1744.3 1721.03 1813.08
12 622.988 633.111 638.499
13 1181.4 1213.49 1213.77
14 -854.285 -1676.52 -1692.65
15 -435.669 -435.669 -435.669
16 -3459.88 -6793.28 -6429.99
17 -3188.69 -3235.15 -3105.16
18 -4016.15 -1176.48 -1176.48
19 -inf -inf -inf
20 -inf -inf error
21 -inf -inf -inf
22 -inf -inf -inf
23 error -inf -inf
24 -inf -inf error
25 -inf -inf error
26 -inf -inf -inf
27 -41.8862 -37.8528 -59.0951
28 -28.6434 -27.5977 -26.692
29 -48.962 -56.0874 -71.2744
30 -42.4785 -40.4064 -33.5944
31 -inf -inf -inf
32 -35.6309 -47.4642 -32.2067
33 -41.4068 -38.6451 -39.0256
34 -44.1147 error -56.103
35 -64.7981 -77.5548 -58.3038
36 -40.5235 -31.5513 -33.8165
37 -31.9838 -26.7134 -37.2089
38 -inf -inf -inf
39 -61.4282 -57.1544 -54.9208
40 error -19.5227 -19.5227
41 -21.6931 -21.6931 error
42 -52.7858 -41.6702 error
43 -14.2696 error error
44 error error error
45 error -40.5376 error
46 -25.8885 error error
47 error -22.6202 -19.9659
48 -25.5856 -25.1914 -25.2057
49 -36.1201 -24.7851 -27.2568
50 -31.2495 -27.2938 -29.248
51 -17.4151 -14.637 -14.637
52 -12.8168 -14.7045 -14.3396
53 -20.0132 -23.4489 -26.669
54 -16.9183 -32.6629 -18.6842
55 -36.6527 -27.9625 -28.8837
56 -10.8499 -10.8499 -10.8499
57 -15.9283 -14.2664 -16.3563
58 -22.6405 -21.832 -21.832
59 -14.0388 -11.5617 -11.5617
60 -13.8925 -16.7567 -16.4665
61 -15.4221 -15.4221 -15.4221
62 -16.1499 -18.9457 -16.1499
63 -23.8245 -27.0717 -22.4522
64 -inf -inf -inf
65 -17.487 -13.6937 -11.2166
66 -inf -inf -inf
67 -15.5667 -15.3752 -15.3752
68 -inf -inf -inf
69 -18.8419 -21.2238 -20.5038
70 -inf -inf -inf
71 -19.5816 -16.6205 -16.6205
72 -13.8743 -13.8743 -13.8743
73 -20.1292 -18.4673 -18.6644
74 -35.6122 -35.5108 -35.687
75 -15.1098 -17.114 -22.3693
76 -13.9747 -15.0882 -15.0882
77 -12.1392 -10.4773 -10.4773
78 -12.3616 -14.0236 -12.3616
79 -10.863 -10.863 -12.5249
80 -14.615 -15.0021 -14.615
81 -7.7599 -7.7599 -7.7599
82 -15.397 -19.1105 -15.397
83 -19.169 -15.4243 -18.2994
84 -26.7947 -33.3514 -31.8416
85 -11.5735 -11.5735 -11.5735
86 -4.70696 -4.70696 -4.70696
87 -12.3822 -12.3822 -12.3822
88 1664.85 1795.36 1765.86
89 -3050.75 -3369.19 -3070.11
90 -142.322 -142.322 -142.322
91 -330.735 -723.157 -330.735
92 -50.5516 -50.5516 -50.5516
93 -854.522 -854.522 -854.522
94 -inf -inf -inf
95 -inf -inf -inf
96 -inf -inf -inf
97 -inf -inf -inf
98 -inf -inf -inf
99 -inf -inf -inf
100 -inf -inf -inf
101 -inf -inf -inf
102 -inf -inf -inf
103 -163.95 -179.516 -147.513
104 -21.2144 -21.2144 -21.2144
105 -20.6534 -20.6534 -20.6534
106 -40.4226 -39.7098 -39.6384
107 -197.448 -194.823 -196.013
108 -41.199 -41.7749 -41.5783
109 -202.225 -200.206 -206.788
110 -35.7205 -35.5735 -34.9029
111 -24.4949 -24.8671 -24.8208
112 -122.424 -121.083 -130.036
113 error error error
114 error error error
115 error error error
116 error error error
117 error error error
118 error error error
119 error error error
120 error error error
121 error error error
122 error error error
123 error error error
124 error error error
125 error error error
126 error error error
127 error error error
128 error error error
129 error error error
130 error error error
131 14687.9 14717.6 14717.9
132 29513.2 29464.7 29480.1
133 1820.16 1804.55 1810.44
134 60642.8 60721.9 60629.0
135 1606.53 1609.94 1604.2
136 1667.05 1668.29 error
137 80493.7 80493.8 80493.8

MMAP.UAI

Problem 1 min 20 mins 1 hour
1 5535.08 5520.02 5508.7
2 1209.71 1214.54 1212.46
3 4798.22 4792.03 4776.88
4 8196.94 8210.72 8233.81
5 2753.45 2771.73 2759.26
6 2700.1 2722.21 2735.01
7 7941.47 8002.47 7923.08
8 1196.0 1202.68 1201.37
9 1306.03 1300.09 1290.69
10 5355.43 5347.46 5363.43
11 1956.11 1927.14 1921.44
12 662.208 653.947 652.22
13 1310.33 1305.9 1308.44
14 -824.234 -4774.99 -856.351
15 -3444.64 -5377.67 -4843.17
16 -1605.94 -1557.49 -1557.49
17 -1177.47 -1181.96 -1177.47
18 -inf -inf -inf
19 -inf -inf error
20 -inf -inf error
21 -inf -inf -inf
22 -inf -inf error
23 -inf -inf error
24 -inf -inf -inf
25 -inf -inf -inf
26 -39.2874 -47.8009 -34.3821
27 -31.5047 -22.4734 -26.3786
28 -75.275 -66.5025 -60.2655
29 -33.7613 -29.4668 -31.1865
30 -inf -inf -inf
31 -57.1422 -35.5682 -53.881
32 -46.0306 -34.3786 -33.2651
33 -50.3684 -66.1254 -48.0809
34 -65.9863 -58.752 -67.7481
35 -30.738 -36.9046 -51.6314
36 -31.5984 -27.4326 -27.0453
37 -inf -inf -inf
38 -48.2063 -45.9743 -58.0627
39 -16.9846 -16.9846 -16.9846
40 -20.2013 -21.7912 -20.2013
41 -35.0852 -31.0203 -30.3254
42 -16.3687 -18.6416 -17.5281
43 -11.8283 -11.8283 -11.8283
44 -38.6919 -32.2605 -30.603
45 -33.4373 -28.4545 -24.5162
46 -20.9548 -21.3426 -22.834
47 -23.5319 -24.5911 -22.6662
48 -45.0102 -23.9799 -25.4214
49 -32.0975 -34.9586 -28.2759
50 -17.2829 -15.6209 -15.6209
51 -13.3688 -13.8059 -15.6936
52 -22.8468 -21.0017 -23.2746
53 -18.5976 -19.9543 -17.9055
54 -30.6681 -25.5462 -28.0691
55 -11.8339 -11.8339 -11.8339
56 -18.9255 -17.2635 -17.2635
57 -25.8391 -22.78 -22.78
58 -12.5447 -12.5447 -12.5447
59 -14.8388 -14.8388 -16.8387
60 -16.409 -16.409 -16.409
61 -17.1373 -17.1373 -16.0016
62 -20.9045 -21.2917 -20.9045
63 -inf -inf -inf
64 -11.8198 -11.8198 -11.8198
65 -inf -inf -inf
66 -16.3635 -16.3635 -16.3635
67 -inf -inf -inf
68 -16.757 -18.6478 -18.6478
69 -inf -inf -inf
70 -17.6038 -17.6038 -17.6038
71 -14.8624 -14.8624 -14.8624
72 -19.4353 -19.4353 -19.4353
73 -28.7994 -38.5705 -32.3459
74 -21.3514 -16.0962 -16.0962
75 -16.066 -16.066 -16.066
76 -11.4713 -11.4713 -11.4713
77 -13.3533 -13.3533 -13.3533
78 -11.852 -11.852 -11.852
79 -15.6097 -17.706 -17.706
80 -8.74756 -8.74756 -8.74756
81 -18.0299 -16.368 -16.368
82 -18.2603 -16.3719 -16.3719
83 -30.0742 -27.6592 -32.6483
84 -12.5637 -12.5637 -12.5637
85 -4.58531 -4.58531 -4.58531
86 -13.3712 -13.3712 -13.3712
87 1757.38 1755.79 1776.42
88 -1547.04 -3406.16 -1691.99
89 -143.322 -143.322 -143.322
90 -331.735 -331.735 -331.735
91 -51.5516 -51.5516 -51.5516
92 -855.522 -855.522 -855.522
93 -inf -inf -inf
94 -inf -inf -inf
95 -inf -inf -inf
96 -inf -inf -inf
97 -inf -inf -inf
98 -inf -inf -inf
99 -inf -inf -inf
100 -inf -inf -inf
101 -inf -inf error
102 -151.566 -153.641 -143.625
103 -21.9244 -21.9244 -21.9244
104 -21.3705 -21.3705 -21.3705
105 -39.2789 -39.4369 -39.2789
106 -188.979 -195.089 -185.816
107 -41.0845 -40.8798 -41.1201
108 -187.374 -197.882 -191.54
109 -33.9841 -33.9841 -33.9841
110 -24.075 -24.075 -24.075
111 -117.524 -112.986 -113.083
112 error error error
113 error error error
114 error error error
115 error error error
116 error error error
117 error error error
118 error error error
119 error error error