UAI 2016 Inference Evaluation
Organizer: Vibhav Gogate (Email: vgogate at hlt dot utdallas dot edu)
Tuning Results for merlin3 solver
Note: Problem names and types have been made anonymous. PR: |log(Z/Z*)|, where Z is the exact partition function and Z* is the approximate. MAR: Hellinger distances. MAP: un-normalized MAP value. MMAP: given E = evidence, Q = query; log(Z) where Z is the partition function of P(E,Q). If the solver did not output a value, “error” is reported.
MMAP.UAI
| Problem | 1 min | 20 mins | 1 hour |
| 1 | 5383.72 | 5378.06 | 5378.06 |
| 2 | 1155.62 | 1154.57 | 1154.47 |
| 3 | 4552.6 | 4612.54 | 4613.19 |
| 4 | 8011.02 | 7947.06 | 7947.06 |
| 5 | 2674.84 | 2686.69 | 2664.85 |
| 6 | 2649.14 | 2637.53 | 2637.53 |
| 7 | 7777.24 | 7681.68 | 7681.68 |
| 8 | 1164.82 | 1170.26 | 1172.79 |
| 9 | 1279.23 | 1282.97 | 1282.97 |
| 10 | 5157.18 | 5157.18 | 5157.18 |
| 11 | 1906.15 | 1911.55 | 1911.55 |
| 12 | 651.192 | 658.513 | 658.513 |
| 13 | 1288.56 | 1292.79 | 1292.79 |
| 14 | -5851.96 | -inf | -inf |
| 15 | -9145.61 | -9148.51 | -9180.38 |
| 16 | -inf | -inf | -inf |
| 17 | -1687.71 | -inf | -inf |
| 18 | 1118.37 | 1118.37 | 1118.37 |
| 19 | 2543.66 | 2543.66 | 2543.66 |
| 20 | 3646.24 | 3646.24 | 3646.24 |
| 21 | 4931.72 | 4931.72 | 4931.72 |
| 22 | 6990.85 | 7045.54 | 6990.85 |
| 23 | 7214.93 | 7214.93 | 7214.93 |
| 24 | -647.767 | -132.486 | -132.486 |
| 25 | 757.984 | 757.984 | 757.984 |
| 26 | -inf | -inf | -inf |
| 27 | -inf | -inf | -inf |
| 28 | -inf | -inf | -inf |
| 29 | -inf | -inf | -inf |
| 30 | -inf | -42.4884 | -inf |
| 31 | -inf | -45.4805 | -inf |
| 32 | -30.8077 | -inf | -28.9676 |
| 33 | -41.5734 | -32.6372 | -29.1787 |
| 34 | -inf | -inf | -inf |
| 35 | -inf | -inf | -28.3848 |
| 36 | -inf | -inf | -inf |
| 37 | -30.2589 | -28.2796 | -20.2091 |
| 38 | -39.881 | -inf | -inf |
| 39 | -24.0068 | -13.8603 | -13.4412 |
| 40 | -inf | -inf | -18.1307 |
| 41 | -inf | -inf | -31.1052 |
| 42 | -18.3602 | -inf | -inf |
| 43 | -12.169 | -9.37682 | -6.98022 |
| 44 | -inf | -inf | -32.1049 |
| 45 | -inf | -27.7209 | -24.5433 |
| 46 | -inf | -23.4543 | -22.2401 |
| 47 | -inf | -30.7995 | -19.6044 |
| 48 | -16.63 | -21.7578 | -14.0107 |
| 49 | -inf | -inf | -20.9915 |
| 50 | -inf | -inf | -15.9429 |
| 51 | -inf | -inf | -19.5919 |
| 52 | -inf | -30.8418 | -19.6132 |
| 53 | -inf | -16.4957 | -12.3333 |
| 54 | -inf | -26.8653 | -26.1996 |
| 55 | -17.1948 | -9.43322 | -7.25237 |
| 56 | -14.0466 | -10.3576 | -10.2305 |
| 57 | -inf | -18.4025 | -13.215 |
| 58 | -15.3362 | -8.08526 | -7.51856 |
| 59 | -13.5291 | -17.4782 | -10.3464 |
| 60 | -inf | -9.82107 | -7.96205 |
| 61 | -19.8983 | -14.146 | -13.0155 |
| 62 | -19.266 | -14.6485 | -inf |
| 63 | -12.8811 | -inf | -13.3111 |
| 64 | -inf | -11.2084 | -9.28245 |
| 65 | -inf | -10.5094 | -8.97456 |
| 66 | -15.5654 | -12.0593 | -12.282 |
| 67 | -10.7716 | -13.1224 | -10.7701 |
| 68 | -10.2375 | -inf | -9.19054 |
| 69 | -inf | -11.7021 | -12.4286 |
| 70 | -inf | -12.7044 | -15.7716 |
| 71 | -18.6917 | -12.9453 | -12.33 |
| 72 | -inf | -10.5447 | -10.7357 |
| 73 | -inf | -21.3488 | -19.8621 |
| 74 | -inf | -11.1668 | -10.5411 |
| 75 | -inf | -10.018 | -10.0103 |
| 76 | -inf | -inf | -6.8747 |
| 77 | -6.44785 | -5.79445 | -5.31629 |
| 78 | -8.10444 | -6.08413 | -6.44711 |
| 79 | -18.8654 | -14.0738 | -11.4617 |
| 80 | -5.93409 | -5.88155 | -5.14184 |
| 81 | -10.6775 | -10.2766 | -12.3101 |
| 82 | -18.0366 | -13.3419 | -17.0943 |
| 83 | -20.6131 | -inf | -18.9131 |
| 84 | -11.3764 | -11.1645 | -11.1785 |
| 85 | -4.92997 | -4.10654 | -4.10654 |
| 86 | -6.56445 | -6.17566 | -6.00086 |
| 87 | 1811.59 | 1811.59 | 1811.59 |
| 88 | -2545.74 | -2549.73 | -2545.74 |
| 89 | -143.322 | -143.322 | -143.322 |
| 90 | -331.735 | -331.735 | -331.735 |
| 91 | -600.473 | -51.5516 | -51.5516 |
| 92 | -1467.9 | -1467.9 | -1467.9 |
| 93 | 2750.33 | -349.039 | 1615.43 |
| 94 | 4696.31 | 4696.31 | 4696.31 |
| 95 | -288.42 | -288.42 | -288.42 |
| 96 | 2743.31 | 2743.31 | 2743.31 |
| 97 | 3833.0 | 3833.0 | 3833.0 |
| 98 | 3640.78 | 3640.78 | 3640.78 |
| 99 | 972.307 | 972.307 | 972.307 |
| 100 | 2505.47 | 2494.52 | 2494.52 |
| 101 | -215.206 | -497.942 | -244.834 |
| 102 | -132.086 | -132.086 | -132.086 |
| 103 | -21.9244 | -21.9244 | -21.9244 |
| 104 | -21.3705 | -21.3705 | -21.3705 |
| 105 | -39.2789 | -39.2789 | -39.2789 |
| 106 | -165.427 | error | error |
| 107 | -40.4445 | -40.4445 | -40.4445 |
| 108 | -175.522 | -175.522 | -175.522 |
| 109 | -33.9841 | -33.9841 | -33.9841 |
| 110 | -24.075 | -24.075 | -24.075 |
| 111 | -inf | -inf | -inf |
| 112 | 9.01461 | 9.01461 | 9.01461 |
| 113 | 25.4311 | 25.4311 | 25.4311 |
| 114 | -2632.28 | -68.9634 | -68.9634 |
| 115 | -845.343 | error | -inf |
| 116 | -148.938 | -138.744 | -133.414 |
| 117 | -22.1015 | -22.1015 | -33.7133 |
| 118 | -715.311 | -193.152 | -186.507 |
| 119 | -506.672 | -560.04 | -539.658 |
|
|
|