UAI 2016 Evaluation
Home
Information
File Formats
UAI Model Format
Sparse Model Format
Binary Model Format
Evidence Format
Query Format
Result Format
Solvers
Requirements
Registration
Submit Solver
Results
Tuning

UAI 2016 Inference Evaluation

Organizer: Vibhav Gogate (Email: vgogate at hlt dot utdallas dot edu)

Tuning Results for wmb-is solver

Note: Problem names and types have been made anonymous. PR: |log(Z/Z*)|, where Z is the exact partition function and Z* is the approximate. MAR: Hellinger distances. MAP: un-normalized MAP value. MMAP: given E = evidence, Q = query; log(Z) where Z is the partition function of P(E,Q). If the solver did not output a value, “error” is reported.

PR.UAI

Problem 1 min 20 mins 1 hour
1 0.0 0.0 0.0
2 9.99999999998e-05 0.0 0.0
3 0.0 0.0 0.0
4 0.0 0.0 0.0
5 0.0 0.0 0.0
6 0.000100000000003 0.0 0.0
7 2.3874 2.7396 2.7163
8 0.000600000000006 0.0 0.0
9 0.0 0.0 0.0
10 0.0 0.0 0.0
11 0.0 0.0 0.0
12 0.0 0.0 0.0
13 0.0 0.0 0.0
14 0.0 0.0 0.0
15 0.0 0.0 0.0
16 0.0002 0.0 0.0
17 0.0 0.0 0.0
18 0.0 0.0 0.0
19 0.0 0.0 0.0
20 0.0 0.0 0.0
21 0.0 0.0 0.0
22 0.3362 0.002 0.0345
23 0.000200000000007 9.99999999962e-05 9.99999999962e-05
24 0.0 0.0 0.0
25 0.0 0.0 0.0
26 9.99999999962e-05 0.0 0.0
27 0.0 0.0 0.0
28 0.0 0.0 0.0
29 0.0 0.0 0.0
30 0.00700000000001 0.0 0.000999999999991
31 0.447 0.0589 0.0079
32 0.0 0.0 0.0
33 0.0 0.0 0.0
34 0.8245 0.00710000000001 0.0101
35 0.0 0.0 0.0
36 0.4345 0.0 0.0
37 9.99999999998e-05 0.0 9.99999999998e-05
38 0.0 0.0 0.0
39 9.99999999962e-05 0.0 0.0
40 0.000100000000003 0.0 0.0
41 0.0 0.0 0.0
42 0.0 0.0 0.0
43 0.0 0.0 0.0
44 0.0131 0.000299999999996 0.000300000000003
45 0.00048 0.0 0.0
46 0.0312 0.0014 0.001
47 0.1078 0.0402 0.0299
48 0.0 0.0 0.0
49 0.0036 0.0002 0.0
50 0.0 0.0 0.0
51 0.0 0.0 0.0
52 0.0 0.0 0.0
53 0.0 0.0 0.0
54 0.0 0.0 0.0
55 0.0 0.0 0.0
56 0.00200000000001 0.0 0.0
57 0.0 0.0 0.0
58 0.0 0.0 0.0
59 0.0 0.0 0.0
60 0.0 0.0 0.0
61 9.99999999998e-05 9.99999999998e-05 0.0
62 0.0 0.0 0.0
63 0.0 0.0 0.0
64 0.0 0.0 0.0
65 0.0 0.0 0.0
66 0.0 0.0 0.0
67 0.0 0.0 0.0
68 0.0 0.0 0.0
69 0.0 0.0 0.0
70 0.000100000000003 0.0 0.0
71 0.0 0.0 0.0
72 0.0 0.0 0.0
73 0.0 0.0 0.0
74 0.0 0.0 0.0
75 0.0 0.0 0.0
76 0.000999999999976 0.0 0.0
77 0.0 0.0 0.0
78 0.0 0.0 0.0
79 0.0 0.0 0.0
80 0.0 0.0 0.0
81 0.0 0.0 0.0
82 0.000200000000007 0.000200000000007 0.000100000000003
83 0.0 0.0 0.0
84 0.000100000000003 0.00429999999999 0.00210000000001
85 0.0 0.0 0.0
86 0.00170000000001 0.0 0.0
87 0.0 0.0 0.0
88 0.0 0.0 0.0
89 9.99999999998e-05 9.99999999998e-05 0.0
90 1.1846 0.4829 0.2056
91 0.0 0.0 0.0
92 0.0 0.0 0.0
93 0.0 0.0 0.0
94 0.0002 0.0 0.0
95 0.0366 0.0105 0.0145
96 0.0 0.0 0.0
97 0.0 0.0 0.0
98 0.0 0.0 0.0
99 0.0 0.0 0.0
100 0.0 0.0 0.0
101 9.99999999998e-05 0.0 0.0
102 0.0 0.0 0.0
103 0.0 0.0 0.0
104 0.00399999999999 0.0 0.0
105 0.0027 0.0002 0.000100000000003
106 0.0 0.0 0.0
107 0.0 0.0 0.0
108 0.0 0.0 0.0
109 0.0 0.0 0.0
110 0.0 0.0 0.0
111 0.000100000000003 0.0 0.0
112 0.0 0.0 0.0
113 0.0 0.0 0.0
114 0.0 0.0 0.0
115 0.0 0.0 0.0
116 0.0 0.0 0.0
117 0.0 0.0 0.0
118 0.000100000000003 0.0 0.0
119 0.0 0.0 0.0
120 0.0 0.0 0.0
121 0.0 0.0 0.0
122 0.0 0.0 0.0
123 0.000100000000003 0.0 0.0
124 0.0 0.0 0.0
125 0.0 0.0 0.0
126 0.2177 0.0101 0.00790000000001
127 0.0 0.0 0.0
128 9.99999999998e-05 0.0 0.0
129 0.0 0.0 0.0
130 0.0 0.0 0.0
131 0.0 0.0 0.0
132 0.0 0.0 0.0
133 0.0 0.0 0.0
134 0.0082 0.0 0.0
135 7.99999999996e-05 0.0 0.0
136 0.0 0.0 0.0
137 0.0 0.0 0.0
138 2.738 0.004 0.004
139 41.4347223201 17.6007223201 17.1167223201
140 0.0152982198 0.0028982198 0.0020982198
141 17.3290872104 11.3312872104 10.6528872104
142 0.01392014309 0.00631014309 0.00301985691
143 0.000579843900001 0.0006798439 0.000379843899999
144 0.000199739800003 2.60200000213e-07 2.60200000213e-07
145 68.7645026727 7.0276026727 6.4462026727
146 212.162330604 135.416330604 134.738330604
147 229.922063109 145.544063109 144.866063109
148 299.599385103 152.076385103 151.398385103
149 348.046169893 188.330169893 187.652169893
150 124.520543501 86.5655435006 85.9835435006
151 111.625269095 75.1909690951 74.6094690951
152 167.747080469 109.437080469 108.855080469
153 62.0922026727 8.1451026727 7.5636026727
154 211.953330604 153.860330604 153.278330604
155 229.903063109 150.730063109 150.051063109
156 300.347385103 152.076385103 151.398385103
157 348.143169893 188.330169893 187.652169893
158 320.332676577 282.214676577 281.341676577
159 0.800752832 0.000247168000044 0.000247168000044
160 275.756562368 2489398.26856 2489398.26856
161 error 159210.112869 159209.112869
162 nan nan nan
163 86.0212 6.16575 5.48738
164 336.946 30.002 30.6787
165 26.2734 9.0209 8.15295
166 249.233 55.4795 54.898
167 214.453 39.8669 39.1885
168 1.03817 0.349901 0.010794
169 241.905 28.5369 27.8585
170 278.121 24.4577 23.7793

MAR.UAI

Problem 1 min 20 mins 1 hour
1 0.00119605958809 0.000315532649659 0.000184027622738
2 0.002051868342 0.000510700491551 0.000291437830038
3 0.000717493741091 0.000212257578514 0.000117016347202
4 0.000939446426 0.000211260980295 0.000170380255908
5 0.000449836030228 0.000119661121755 8.93961333746e-05
6 0.002157322329 0.000511875007032 0.000289178668703
7 0.00179211280693 0.000516369392254 0.000269159441067
8 0.00135923318727 0.000353595735641 0.000188936823944
9 0.00164494716227 0.000482518264259 0.000258389505971
10 0.000985436132952 0.000226467617395 0.000141744812347
11 0.0020880043069 0.000514978011203 0.000290236416884
12 0.000711064955949 0.000196024953563 0.000115102544264
13 0.00125317932361 0.00036213475947 0.000198550253612
14 0.000983062519198 0.000222143128957 0.000151261316354
15 0.00217002811194 0.000552240947451 0.000308556287337
16 0.00205151440907 0.000258759082986 0.000187577390791
17 0.00142743999539 0.00039902600389 0.000272405630084
18 0.0011961149192 0.000312263408741 0.000182340016036
19 0.000448430209738 0.000115222002301 7.18095027518e-05
20 0.00124761446495 0.000335403779085 0.000183917386679
21 0.0444195120199 0.0116112604031 0.00920704166259
22 0.00215567678531 0.000552754608985 0.00032453389121
23 0.000596780868848 0.00022684104536 0.000116031427857
24 0.00108148952983 0.000218431557174 0.000140513967361
25 0.0012903123721 0.000333403152905 0.000181894537588
26 0.00121365178424 0.0003312103066 0.00017615156636
27 0.0011520598018 0.000270615534791 0.000163240779646
28 0.0021888300439 0.000517187046872 0.000299227476929
29 0.00241668157423 0.000613783976228 0.000330632917113
30 0.046917469249 0.017588203863 0.012450487804
31 0.00164005065708 0.0004489956778 0.000255746929737
32 0.00135945472582 0.000423053555583 0.000112456375059
33 0.0957369224384 0.0210628944854 0.00812652389389
34 0.000218418463192 0.00020119097791 4.10913289013e-05
35 0.217129464864 8.12992279697e-05 3.73847831821e-05
36 0.00161600438437 0.000475870620654 0.000243063229709
37 0.0012942261661 0.000343621169195 0.000190304235482
38 0.00171775909365 0.000445057985495 0.000262967225047
39 0.00211621728779 0.000526195835882 0.000297829784117
40 0.000971336156805 0.000368988664681 0.00013672949336
41 0.00210705944782 0.000522351606681 0.000294967476572
42 0.00128802672689 0.000388527181281 0.000223236906888
43 0.0050704665133 0.000529478991379 0.000322185945216
44 0.00109390555636 0.000293577000885 0.000181744427736
45 0.00782630660585 0.00116175762281 0.000778457984733
46 0.0860740910237 0.0138648021509 0.0063663192651
47 0.00112106241062 0.000234288041104 0.000145269465402
48 0.00184706033859 0.000381838263762 0.000283914767028
49 0.00120042239559 0.00032388028671 0.000183989712942
50 0.00139226182714 0.000375569345485 0.000181705337686
51 0.00165206181895 0.000493915306791 0.000254946114744
52 0.00171950574092 0.000505706119776 0.000257827434645
53 0.000693009531125 0.000212144150376 0.000105057413268
54 0.00183329444228 0.000457566911727 0.000233908924685
55 0.000988360001372 0.000310450877333 0.000178435189154
56 0.00151384309611 0.000429053474116 0.000250581765933
57 0.00171945953402 0.00044347019861 0.000260882794215
58 0.000603349167657 0.000192074065404 0.000104614567456
59 0.00194883811127 0.000453683227806 0.000217294690486
60 0.00204158829968 0.00057121117668 0.000293322940485
61 0.00174324487974 0.000480893355188 0.000248832237771
62 0.00120998683746 0.000235158708387 0.000160541597432
63 0.00185231131383 0.000495489333344 0.000264470693453
64 0.00090063557952 0.000208008273551 0.000150942851591
65 0.000911524351494 0.000290759016092 0.000176618896851
66 0.00131540672007 0.000350959334522 0.000197720170372
67 0.0012780170668 0.000347679184675 0.000189546704785
68 0.00174072591355 0.000494138581216 0.000251750470556
69 0.0009244213788 0.000266798433743 0.000160016212587
70 0.00165234255623 0.000474540389535 0.000252798577551
71 0.000294873400986 0.000150798465266 0.000106003007868
72 0.00159162930503 0.000442821374205 0.000255443955232
73 0.000961609553541 0.000231162085192 0.000144711898832
74 0.00126107900432 0.000340885050445 0.000137136914792
75 0.00204048270616 0.000588259211353 0.000296593719245
76 0.00116833442566 0.000319301235309 0.000185215653422
77 0.00135556789481 0.000328266193403 0.000189857634758
78 0.00208388881421 0.00051820155824 0.000289439676665
79 0.00118789296042 0.000336060507888 0.000165719369941
80 0.00228030196746 0.000612085155338 0.000305534167795
81 0.00196865077612 0.000529668193547 0.000300945885648
82 0.00819024988507 0.00123518648853 0.000787037685214
83 0.000132001540852 2.3296461556e-05 1.83402992603e-05
84 0.00180087570464 0.000490573776687 0.000299115935088
85 0.000543732041637 0.000221939430098 5.8813318838e-05
86 0.00220343395071 0.000375875850241 0.000139445782496
87 0.00205788679946 0.000569015548866 0.000310905278904
88 0.183710391976 0.064023827688 0.060626742251
89 0.00178233605073 0.000442655449031 0.000245886262042
90 0.000657025061606 0.000179534851985 9.82442687926e-05
91 0.0016617937454 0.000484230680378 0.000257824249997
92 0.00216155807001 0.000497726119978 0.000251780586018
93 0.0399377792058 0.00424129259119 0.0022980354605
94 0.001696312239 0.000505838805707 0.000245725960378
95 0.00170892847086 0.000468069422908 0.000251289386517
96 0.00154048323664 0.000437756743747 0.000231105301037
97 0.00118768300973 0.000307014718068 0.000182232447371
98 0.000345058862592 9.8477628787e-05 7.66170850806e-05
99 0.0021831946133 0.000523708163651 0.000300669653404
100 0.00155080244134 0.000426820270345 0.0002372546167
101 0.00121249342952 0.000311207070534 0.000188144779632
102 0.00378777480988 0.000127035127735 0.000119294158966
103 0.00177612408919 0.000411366094189 0.000206867571279
104 0.00072774606662 0.000267187773923 0.000207520171866
105 0.00202490534376 0.000572571749474 0.000295801231594
106 0.000330141967794 0.000268032639607 6.95530680061e-05
107 0.000634609453139 0.000215587565303 0.000126474778376
108 0.00103426629416 0.000208262018861 0.000171135928077
109 0.0011557637601 0.000430938372025 0.000275588541744
110 6.40460848167e-07 6.40460848167e-07 6.40460848167e-07
111 0.000761010399765 0.000170978959975 8.94484992884e-05
112 0.000764613502938 0.000167416883861 9.23312601368e-05
113 0.00118366553522 0.000380552535501 0.000147333195084
114 0.00118890885997 0.000324630160826 0.00018501435438
115 0.00126634528748 0.000183724204396 0.000103683228743
116 0.00215792199713 0.000534991338135 0.000303076616815
117 0.000597499211852 0.000194214330131 0.000115793293642
118 0.00130858983674 0.000362961313069 0.000213412734403
119 0.00155372285049 0.000374461376045 0.000225404906918
120 0.00104328620689 0.000264027001829 0.000161658097782
121 0.00170853141299 0.000487922976012 0.000248209736222
122 0.00123383696364 0.000327263045873 0.000196283497081
123 0.000660171313977 0.000195755759693 0.000113979984177
124 0.0250666287768 0.00836366920671 0.00400712315015
125 0.00171230925074 0.00049484321323 0.000255193649741
126 0.00199583287599 0.000575071332748 0.000294993715881
127 0.00155100024583 0.000441303816781 0.000252911739991
128 0.000662152435539 0.000262801778606 0.000184646345433
129 0.0016902906733 0.000430844200397 0.000254822668728
130 0.00154119476133 0.000268758926315 0.000105827330214
131 0.00122453746286 0.000352199642116 0.000196900507396
132 0.00215035083819 0.000310861221631 0.000181998076929
133 0.00142932543688 0.000300391118365 0.000175883860337
134 0.000370360711541 0.000111589186826 8.48057683127e-05
135 0.00129723928929 0.000344510702062 0.000187641726294
136 error 0.00198346508985 0.000844815261982