UAI 2014 Inference Competition

Organizer: Vibhav Gogate (Email: vgogate at hlt dot utdallas dot edu)

Results for ai solver

Note: Problem names and types have been made anonymous. PR: |log(Z/Z*)|, where Z is the exact partition function and Z* is the approximate. MAR: Hellinger distances. MAP: un-normalized MAP value. MMAP: given E = evidence, Q = query; log(Z) where Z is the partition function of P(E,Q). If the solver did not output a value, “error” is reported.

PR

Problem	20 secs	20 mins	1 hour
1	0.0	0.0	0.0
2	0.0	0.0	0.0
3	0.0	0.0	0.0
4	0.0	0.0	0.0
5	0.0	0.0	0.0
6	0.0	0.0	0.0
7	2.1055	2.687	2.6671
8	0.0513	0.0	0.0
9	0.000499999999995	0.0	0.0
10	0.0	0.0	0.0
11	0.0	0.0	0.0
12	0.0	0.0	0.0
13	0.0	0.0	0.0
14	0.000100000000003	0.0	0.0
15	0.0	0.0	0.0
16	0.0	0.0	0.0
17	0.0	0.0	0.0
18	0.0	0.0	0.0
19	0.0	0.0	0.0
20	0.0	0.0	0.0
21	0.000399999999999	0.0	0.0
22	0.1474	0.0081	0.0222
23	0.4711	0.0	0.0
24	0.0	0.0	0.0
25	0.0	0.0	0.0
26	0.0002	0.0	0.0
27	0.0	0.0	0.0
28	0.0	0.0	0.0
29	0.0	0.0	0.0
30	0.015	0.0	0.0
31	0.0627	0.19	0.1915
32	0.0	0.0	0.0
33	0.0	0.0	0.0
34	0.3385	0.2758	0.4816
35	0.0	0.0	0.0
36	0.0	0.0	0.0
37	0.0221	0.0	0.0
38	0.0002	0.0	0.0
39	0.0012	0.0	0.0
40	1.0544	0.0	0.0
41	0.0	0.0	0.0
42	0.0	0.0	0.0
43	0.0	0.0	0.0
44	0.0019	0.0	0.0
45	0.0	0.0	0.0
46	0.0184	0.0	0.0
47	0.3568	0.0658	0.0868
48	0.0	0.0	0.0
49	0.0103	0.0	0.0
50	0.0	0.0	0.0
51	0.0	0.0	0.0
52	0.0	0.0	0.0
53	0.0	0.0	0.0
54	0.0	0.0	0.0
55	0.0	0.0	0.0
56	0.0	0.0	0.0
57	0.0	0.0	0.0
58	0.0	0.0	0.0
59	0.0	0.0	0.0
60	0.0	0.0	0.0
61	0.0232	0.0	0.0
62	9.99999999962e-05	0.0	0.0
63	0.0	0.0	0.0
64	0.000300000000003	0.0	0.0
65	0.0	0.0	0.0
66	0.0	0.0	0.0
67	0.0	0.0	0.0
68	0.000100000000003	0.0	0.0
69	0.000299999999996	0.0	0.0
70	0.0253	0.0	0.0
71	0.0	0.0	0.0
72	0.0097	0.0	0.0
73	0.0	0.0	0.0
74	0.0	0.0	0.0
75	0.0	0.0	0.0
76	0.0	0.0	0.0
77	0.0017	0.0	0.0
78	0.0	0.0	0.0
79	0.0	0.0	0.0
80	0.0032	0.0	0.0
81	0.0	0.0	0.0
82	0.0851	0.0	0.0
83	0.0224	0.0	0.0
84	0.5523	4.7881	10.3793
85	0.0	0.0	0.0
86	0.0	0.0	0.0
87	0.0	0.0	0.0
88	0.00999999999999	0.0	0.0
89	0.0356	0.0	0.0
90	0.3994	0.0108	0.0388
91	0.0	0.0	0.0
92	0.0	0.0	0.0
93	0.0	0.0	0.0
94	0.0128	0.0	0.0
95	0.1099	0.0184	0.000599999999991
96	0.5945	0.0	0.0
97	0.0	0.0	0.0
98	0.0	0.0	0.0
99	0.0	0.0	0.0
100	0.0	0.0	0.0
101	0.0	0.0	0.0
102	0.0	0.0	0.0
103	0.0	0.0	0.0
104	0.0	0.0	0.0
105	0.3001	0.0	0.0
106	0.0	0.0	0.0
107	0.0055	0.0	0.0
108	0.0	0.0	0.0
109	0.0	0.0	0.0
110	0.0	0.0	0.0
111	0.0183	0.0	0.0
112	0.0	0.0	0.0
113	0.0	0.0	0.0
114	0.0	0.0	0.0
115	0.0	0.0	0.0
116	0.0	0.0	0.0
117	0.0	0.0	0.0
118	0.0	0.0	0.0
119	0.0	0.0	0.0
120	0.000600000000006	0.0	0.0
121	0.000599999999999	0.0	0.0
122	0.0	0.0	0.0
123	0.000599999999999	0.0	0.0
124	0.0	0.0	0.0
125	0.0	0.0	0.0
126	1.0565	0.2176	0.0238
127	0.0002	0.0	0.0
128	0.0322	0.0	0.0
129	0.0	0.0	0.0
130	0.0	0.0	0.0
131	0.000399999999999	0.0	0.0
132	0.0	0.0	0.0
133	0.000399999999999	0.0	0.0
134	0.161	0.0	0.0
135	0.00055	0.0	0.0
136	0.0	0.0	0.0
137	9.99999999998e-05	0.0	0.0
138	0.202	8.246	0.254

MAR

Problem	20 secs	20 mins	1 hour
1	5.55296832448e-06	6.17422748948e-06	6.17422748948e-06
2	0.0249092492619	0.0	0.0
3	0.0	0.0	0.0
4	0.0	0.0	0.0
5	0.00421080674536	0.0	0.0
6	0.0723015289956	0.0	0.0
7	0.00491858423473	0.0	0.0
8	1.72104203283e-05	0.0	0.0
9	7.59596769663e-05	0.0	0.0
10	0.0	0.0	0.0
11	0.000181550907783	0.0	0.0
12	3.48659756934e-07	3.56760114935e-07	3.56760114935e-07
13	6.9468517587e-06	0.0	0.0
14	0.0	0.0	0.0
15	0.00121718154952	0.0	0.0
16	0.0156703916465	0.0	0.0
17	0.0	0.0	0.0
18	5.47685084765e-07	0.0	0.0
19	0.0	0.0	0.0
20	1.6458260822e-05	0.0	0.0
21	0.00199903234667	0.000987718844624	0.000374288805084
22	0.0497280682507	0.0101604922084	0.0
23	0.0	0.0	0.0
24	0.0	0.0	0.0
25	6.70362929415e-06	0.0	0.0
26	1.25597246863e-06	0.0	0.0
27	0.0	0.0	0.0
28	0.00033185128512	0.0	0.0
29	0.000322874971575	0.0	0.0
30	0.0114165039478	0.00891901986301	0.00743604599108
31	0.000300900688588	0.0	0.0
32	0.0	0.0	0.0
33	0.00817421822773	0.017913934081	0.014116207989
34	0.669086319213	0.0	0.0
35	0.288367921004	0.0	0.0
36	0.00167546770035	4.01293442908e-06	0.0
37	5.5179249762e-06	0.0	0.0
38	4.94398568008e-05	2.19621803264e-05	0.0
39	0.0874424900873	0.0	0.0
40	0.0	0.0	0.0
41	0.00112863442718	0.0	0.0
42	0.0	0.0	0.0
43	0.000260006553172	0.000124111590055	3.26134389606e-09
44	0.0222425263713	0.0	0.0
45	0.00207769820503	0.000841001186695	1.00721594189e-05
46	0.020630940204	0.00197022512594	0.00361973404966
47	0.0	0.0	0.0
48	0.000361159570303	0.0	0.0
49	1.32046820483e-06	0.0	0.0
50	0.0	0.0	0.0
51	1.37894389821e-05	0.0	0.0
52	0.000142089839141	0.0	0.0
53	0.0	0.0	0.0
54	3.93779593828e-06	0.0	0.0
55	0.000390973721929	0.0	0.0
56	2.49279008811e-06	0.0	0.0
57	0.000684510959468	0.0	0.0
58	0.00038661879402	0.000388158741347	0.000388158741347
59	0.0	0.0	0.0
60	0.000958282486481	0.000187366190928	0.0
61	8.39989742341e-06	0.0	0.0
62	0.0	0.0	0.0
63	1.26209938496e-05	0.0	0.0
64	0.0	0.0	0.0
65	0.0	0.0	0.0
66	5.7663507167e-06	0.0	0.0
67	1.40250071271e-05	0.0	0.0
68	0.000938592730051	3.89640700188e-06	0.0
69	0.0	0.0	0.0
70	0.000333523499737	0.0	0.0
71	0.165361856302	0.0	0.0
72	4.51784198478e-06	0.0	0.0
73	0.0	0.0	0.0
74	0.00132174351925	0.0	0.0
75	5.93094134519e-05	0.0	0.0
76	4.16601799898e-06	4.35970967049e-06	4.35970967049e-06
77	0.0	0.0	0.0
78	0.000151368041472	0.0	0.0
79	0.0	0.0	0.0
80	0.00718928152533	0.00135409639644	0.0
81	0.0011827674262	0.000236764065198	0.0
82	0.101814193887	0.104057540513	0.0620747103549
83	0.141949891674	0.0	0.0
84	1.1879052611e-05	0.0	0.0
85	0.329054199267	0.0	0.0
86	0.00135718326888	0.0	0.0
87	0.00208212365019	0.000701936581815	0.0
88	0.0290921931251	0.00438346102762	0.00519017163993
89	0.013487382576	0.0	0.0
90	0.0	0.0	0.0
91	1.17022694474e-05	0.0	0.0
92	0.000983804196567	3.10081731539e-06	0.0
93	0.00197822233456	0.0010783190564	0.000906921020191
94	0.0483260076395	0.0	0.0
95	7.40449157288e-06	0.0	0.0
96	2.21663731068e-05	0.0	0.0
97	3.99270846616e-07	4.1932651917e-07	4.1932651917e-07
98	0.0379455547829	0.0	0.0
99	6.38757011939e-05	0.0	0.0
100	8.06430752113e-06	0.0	0.0
101	2.64026770288e-06	2.84595996036e-06	2.84595996036e-06
102	0.0668024393883	0.0	0.0
103	0.00184788190222	0.0	0.0
104	0.0	0.0	0.0
105	0.000254867072916	0.0	0.0
106	0.277053148826	0.0	0.0
107	0.0	0.0	0.0
108	0.0	0.0	0.0
109	0.00212534582498	0.0	0.0
110	4.60570878353e-07	1.96204456674e-07	1.96204456674e-07
111	0.0	0.0	0.0
112	0.0	0.0	0.0
113	0.000505651739645	0.0	0.0
114	1.3092176946e-06	0.0	0.0
115	0.000153254046283	0.000152001661398	0.000152001661398
116	0.000353242028399	0.0	0.0
117	0.0	0.0	0.0
118	7.70914475155e-05	0.0	0.0
119	2.95617592128e-05	0.0	0.0
120	0.0	0.0	0.0
121	2.97268884314e-05	0.0	0.0
122	0.000238403526841	0.0	0.0
123	0.0	0.0	0.0
124	0.0140830443489	0.0103666715606	0.00246405610713
125	1.37468546774e-05	0.0	0.0
126	0.00137298243504	0.0	0.0
127	1.35965941514e-05	0.0	0.0
128	0.00269731379852	0.0	0.0
129	1.14718585605e-05	0.0	0.0
130	9.09499884162e-07	0.0	0.0
131	1.86652475359e-05	0.0	0.0
132	0.00440148135719	0.0	0.0
133	0.000564112669554	0.000497883123105	0.000497883123105
134	0.0	0.0	0.0
135	4.61319057021e-06	0.0	0.0
136	0.0143776125919	0.105926682334	0.0137122058946

MPE

Problem	20 secs	20 mins	1 hour
1	4973.55	5207.87	5306.98
2	1034.42	1034.42	1034.42
3	4078.81	4131.72	4131.72
4	7694.44	7651.0	7813.19
5	2524.2	2589.88	2548.09
6	2482.86	2557.48	2573.1
7	7421.98	7705.55	7794.02
8	1069.53	1069.53	1069.53
9	1210.97	1233.89	1272.39
10	4936.53	5123.82	5302.08
11	1916.02	1842.51	1930.41
12	629.605	624.572	633.058
13	1297.91	1293.31	1291.75
14	-823.234	-823.234	-823.234
15	-435.669	-435.669	-435.669
16	-10867.9	-2998.93	-2998.93
17	-1556.51	-1556.51	-1556.51
18	-1176.48	-1176.48	-1176.48
19	2887.35	3572.27	3572.27
20	1595.27	2985.0	2985.0
21	1826.02	2875.68	2949.57
22	2765.29	3329.28	3549.94
23	7021.01	7060.75	6898.9
24	7500.67	8114.55	8522.6
25	2563.34	3249.45	3249.45
26	2908.75	2601.88	2539.22
27	-44.1647	-44.6832	-44.1879
28	-45.4479	-38.6932	-45.4479
29	-56.7661	-61.127	-61.3955
30	-36.1997	-36.3758	-36.3758
31	-40.7015	-41.9613	-42.4007
32	error	error	error
33	-39.6068	-24.8835	-24.6238
34	error	error	error
35	-72.5841	-82.502	-82.0758
36	-28.9537	-40.5616	-20.8773
37	-60.563	-61.7391	-60.0577
38	-38.7015	-34.6974	-36.9192
39	-56.938	-54.7762	-27.939
40	-27.8341	-24.3873	-23.6382
41	-33.1215	-33.1215	-33.1215
42	error	error	error
43	-30.6418	-23.8439	-21.4838
44	error	error	error
45	-38.9064	-38.9064	-40.0542
46	-34.8262	-33.4083	-34.1847
47	-32.8678	-19.7581	-17.0236
48	error	error	error
49	-41.9516	-28.7144	-24.0725
50	-35.208	-34.2049	-35.4634
51	-17.5627	-22.9485	-21.2785
52	-28.7471	-28.7471	-28.7471
53	-38.3278	-38.5039	-16.9368
54	-25.4187	-25.8178	-19.0062
55	-38.1244	-30.0713	-30.0713
56	-19.3114	-18.3383	-15.1616
57	-29.3306	-18.3581	-18.3581
58	-37.0939	-38.8568	-35.2139
59	-20.3609	-20.3829	-20.3829
60	error	error	error
61	-14.4466	-9.10198	-9.10198
62	-24.0427	-25.9378	-25.9378
63	-32.4506	-15.4635	-15.4635
64	-28.8926	-27.4945	-28.8926
65	-17.1308	-14.7172	-11.4048
66	-22.7575	-22.7575	-19.5817
67	-20.3858	-16.9184	-16.4134
68	error	error	error
69	-27.0952	-22.9962	-12.4911
70	-13.7675	-13.7675	-12.9345
71	-26.9199	-25.5341	-25.5341
72	-24.8169	-11.725	-11.725
73	-14.4528	-14.4528	-13.3144
74	-52.7959	-51.678	-58.3413
75	-29.7462	-22.5376	-22.5376
76	-24.2853	-18.0766	-15.1829
77	-32.0359	-9.83824	-7.50729
78	-7.51866	-5.34279	-5.34279
79	-14.4284	-9.66153	-9.66153
80	-26.9662	-12.46	-12.46
81	-17.6975	-14.0102	-13.5214
82	-27.8059	-13.5417	-13.5417
83	error	error	error
84	-43.1637	-43.691	-43.691
85	-25.614	-22.3092	-13.567
86	-10.3875	-6.90906	-6.90906
87	-17.6717	-7.26558	-7.26558
88	1954.91	1954.91	1955.49
89	-1546.13	-1546.13	-1546.13
90	-142.322	-142.322	-142.322
91	-330.735	-330.735	-330.735
92	-50.5516	-50.5516	-50.5516
93	-854.522	-854.522	-854.522
94	8523.13	9862.98	9662.26
95	14010.3	13202.0	13754.5
96	1885.3	2366.74	2366.74
97	2905.56	3730.87	3730.87
98	2356.52	2336.14	2266.36
99	4162.19	5645.25	5645.25
100	3539.51	4118.94	4118.94
101	2684.26	4242.25	4242.25
102	3239.06	5245.51	3880.13
103	-134.83	-134.83	-134.83
104	-21.2144	-21.2144	-21.2144
105	-20.6534	-20.6534	-20.6534
106	-39.1	-39.1	-39.1
107	-164.203	-164.203	-164.203
108	-40.2579	-40.2579	-40.2579
109	-176.312	-175.786	-175.786
110	-34.9029	-34.9029	-34.9029
111	-24.4949	-24.4949	-24.4949
112	-112.879	-112.879	-112.879
113	-2.49658	-2.47199	-2.44752
114	-1.86334	-1.67485	-1.67485
115	-11.0	-11.0	-11.0
116	-27.0	-27.0	-27.0
117	-175.0	-167.0	-167.0
118	-40.308	-26.9	-15.64
119	-65.148	-30.124	-30.124
120	-31.0	-31.0	-19.012

MMAP

Problem	20 secs	20 mins	1 hour
1	5497.99	5502.63	5475.62
2	1221.05	1217.09	1218.05
3	4801.82	4800.6	4811.7
4	8271.56	8264.27	8252.56
5	2803.8	2791.02	2791.02
6	2748.21	2757.77	2751.62
7	8019.56	8052.06	7910.06
8	1207.84	1206.96	1208.49
9	1291.65	1301.77	1300.25
10	5378.43	5387.15	5397.7
11	1959.86	1933.09	1920.75
12	657.943	665.178	672.22
13	1304.31	1309.44	1309.44
14	-824.234	-824.234	-824.234
15	-3015.98	-2998.85	-2998.85
16	-1557.49	-1557.49	-1557.49
17	-1177.47	-1177.47	-1177.47
18	4279.09	4374.86	4374.86
19	6148.39	6762.53	6762.53
20	9898.69	9970.61	9970.61
21	9055.1	9082.09	9082.09
22	12253.1	12633.3	12633.3
23	14087.5	14347.1	14347.1
24	4156.03	4796.9	4791.66
25	8269.39	9017.11	9017.11
26	-inf	-inf	-inf
27	-inf	-30.6333	-30.6333
28	-27.6505	-27.8365	-27.8365
29	-inf	-inf	-inf
30	-inf	-inf	-inf
31	-30.4705	-30.4705	-30.4705
32	-inf	-inf	-inf
33	-inf	-inf	-inf
34	-inf	-31.3512	-31.3512
35	-12.1964	-12.1964	-12.1964
36	-inf	-19.9015	-19.9015
37	-inf	-26.4955	-26.4955
38	-26.3409	-26.3409	-26.3409
39	-inf	-inf	-21.5481
40	-inf	-inf	-inf
41	-27.4401	-27.4401	-27.4401
42	-inf	-17.6104	-17.6104
43	-10.6933	-10.6933	-10.6933
44	-inf	-inf	-inf
45	-10.4177	-10.4177	-10.4177
46	-inf	-inf	-inf
47	-24.3996	-24.3996	-24.3996
48	-14.0107	-14.0107	-14.0107
49	-17.0061	-17.0061	-17.0061
50	-11.2347	-11.2347	-11.2347
51	-8.16227	-8.16227	-8.16227
52	-16.8822	-16.8822	-16.8822
53	-23.002	-19.3446	-19.3903
54	-inf	-inf	-inf
55	-7.27188	-7.27188	-7.27188
56	-9.66002	-9.66002	-9.66002
57	-inf	-inf	-inf
58	-7.51856	-7.51856	-7.51856
59	-15.2259	-15.2259	-15.2259
60	-inf	-inf	-8.03426
61	-inf	-inf	-20.6714
62	-17.8867	-18.3595	-17.8867
63	-inf	-inf	-inf
64	-9.45864	-9.45864	-9.45864
65	-inf	-inf	-inf
66	-16.6233	-16.5033	-16.5033
67	-inf	-inf	-inf
68	-inf	-inf	-12.4493
69	-10.3087	-10.3087	-10.3087
70	-inf	-20.8276	-25.5591
71	-inf	-10.833	-13.6346
72	-inf	-13.5119	-11.9791
73	-22.7941	-22.096	-22.7984
74	-inf	-26.5568	-26.5568
75	-inf	-12.8721	-12.8721
76	-10.8285	-10.8285	-10.8285
77	-4.65322	-4.65322	-4.65322
78	-inf	-7.78272	-7.78272
79	-inf	-15.8548	-18.7244
80	-5.14184	-5.14184	-5.14184
81	-inf	-12.9816	-12.9816
82	-18.2603	-18.2603	-18.2603
83	-18.9131	-18.9131	-18.9131
84	-inf	-19.3457	-19.3457
85	-8.7281	-5.13996	-5.13996
86	-inf	-10.0048	-7.50542
87	1454.19	1509.73	1509.73
88	-1547.04	-1547.04	-1547.04
89	-143.322	-143.322	-143.322
90	-331.735	-331.735	-331.735
91	-51.5516	-51.5516	-51.5516
92	-855.522	-855.522	-855.522
93	13477.5	16544.2	16544.2
94	16351.4	18603.9	18603.9
95	1587.01	1525.3	1492.08
96	5351.37	5578.68	5578.68
97	7841.14	7958.72	7958.72
98	10498.2	10547.2	10547.2
99	4216.95	4203.92	4208.35
100	error	5871.41	5871.41
101	8614.2	8656.26	8656.26
102	-132.616	-132.547	-132.547
103	-21.9244	-21.9244	-21.9244
104	-21.3705	-21.3705	-21.3705
105	-39.8463	-39.8463	-39.8463
106	-169.625	-169.494	-169.494
107	-40.4954	-41.2352	-41.2352
108	-177.859	-176.275	-176.275
109	-37.5865	-33.9841	-33.9841
110	-24.075	-24.075	-24.075
111	-112.073	-112.007	-112.007
112	12.8674	12.8674	12.8674
113	26.0245	26.0245	26.0245
114	-42.4047	-14.2186	-10.7949
115	-20.6256	-31.9336	-41.2969
116	-219.512	-192.637	-265.54
117	-1.31627	-19.5369	-34.1685
118	-3.51313	-32.4571	-37.3033
119	-32.2185	-15.8743	-8.42433