UAI 2016 Inference Evaluation
Organizer: Vibhav Gogate (Email: vgogate at hlt dot utdallas dot edu)
Tuning Results for merlin2 solver
Note: Problem names and types have been made anonymous. PR: |log(Z/Z*)|, where Z is the exact partition function and Z* is the approximate. MAR: Hellinger distances. MAP: un-normalized MAP value. MMAP: given E = evidence, Q = query; log(Z) where Z is the partition function of P(E,Q). If the solver did not output a value, “error” is reported.
MMAP.UAI
| Problem | 1 min | 20 mins | 1 hour |
| 1 | 5383.72 | 5381.84 | 5381.84 |
| 2 | 1155.62 | 1154.57 | 1154.47 |
| 3 | 4527.71 | 4551.63 | 4564.92 |
| 4 | 8011.02 | 7952.68 | 7952.68 |
| 5 | 2674.84 | 2686.69 | 2687.24 |
| 6 | 2649.14 | 2639.92 | 2639.92 |
| 7 | 7777.24 | 7699.39 | 7699.39 |
| 8 | 1144.89 | 1167.59 | 1167.2 |
| 9 | 1279.23 | 1274.96 | 1274.96 |
| 10 | 5132.31 | 5166.48 | 5166.48 |
| 11 | 1906.15 | 1899.67 | 1899.67 |
| 12 | 651.192 | 642.623 | 642.623 |
| 13 | 1288.56 | 1290.04 | 1290.04 |
| 14 | -5851.96 | -inf | -inf |
| 15 | -9140.63 | -inf | -inf |
| 16 | -inf | -inf | -inf |
| 17 | -inf | -inf | -inf |
| 18 | 1118.37 | -inf | -inf |
| 19 | 2543.66 | -inf | -inf |
| 20 | -inf | -inf | -inf |
| 21 | 4931.72 | -inf | -inf |
| 22 | 6990.85 | -inf | -inf |
| 23 | 6543.88 | -inf | -inf |
| 24 | -647.767 | -inf | -inf |
| 25 | 757.984 | -inf | -inf |
| 26 | -43.2383 | -inf | -37.0941 |
| 27 | -inf | -inf | -20.9958 |
| 28 | -inf | -inf | -inf |
| 29 | -35.5071 | -29.7939 | -inf |
| 30 | -39.0286 | -34.097 | -inf |
| 31 | -inf | -inf | -inf |
| 32 | -inf | -inf | -inf |
| 33 | -32.757 | -26.8576 | -24.8654 |
| 34 | -45.9839 | -34.4267 | -31.5844 |
| 35 | -inf | -25.4579 | -24.8646 |
| 36 | -23.8217 | -inf | -inf |
| 37 | -inf | -20.1241 | -inf |
| 38 | -37.4148 | -inf | -inf |
| 39 | -14.772 | -inf | -inf |
| 40 | -inf | -inf | -inf |
| 41 | -31.9894 | -inf | -22.7575 |
| 42 | -12.7324 | -inf | -inf |
| 43 | -inf | -5.95651 | -5.95651 |
| 44 | -inf | -28.3265 | -23.3899 |
| 45 | -inf | -14.7735 | -inf |
| 46 | -15.5129 | -inf | -inf |
| 47 | -inf | -18.4962 | -17.3195 |
| 48 | -inf | -14.0107 | -inf |
| 49 | -inf | -21.8789 | -24.7299 |
| 50 | -inf | -inf | -12.4224 |
| 51 | -24.1909 | -13.0784 | -inf |
| 52 | -inf | -23.3387 | -15.4013 |
| 53 | -12.0601 | -inf | -inf |
| 54 | -25.0009 | -27.1956 | -20.6702 |
| 55 | -inf | -inf | -7.27188 |
| 56 | -inf | -inf | -inf |
| 57 | -22.8967 | -inf | -inf |
| 58 | -inf | -7.51856 | -7.51856 |
| 59 | -inf | -inf | -9.20674 |
| 60 | -inf | -7.48939 | -inf |
| 61 | -13.9258 | -inf | -inf |
| 62 | -inf | -inf | -inf |
| 63 | -inf | -10.7047 | -inf |
| 64 | -inf | -8.36077 | -inf |
| 65 | -inf | -8.97517 | -8.97517 |
| 66 | -12.282 | -inf | -12.282 |
| 67 | -10.7717 | -10.7717 | -10.7717 |
| 68 | -inf | -9.0702 | -inf |
| 69 | -inf | -10.3087 | -inf |
| 70 | -inf | -12.7044 | -12.7044 |
| 71 | -13.8017 | -inf | -10.833 |
| 72 | -10.3888 | -10.3888 | -10.3888 |
| 73 | -inf | -19.918 | -19.918 |
| 74 | -10.5411 | -inf | -10.5411 |
| 75 | -10.018 | -inf | -10.018 |
| 76 | -9.63478 | -6.87485 | -6.87485 |
| 77 | -inf | -inf | -4.65322 |
| 78 | -inf | -6.08413 | -inf |
| 79 | -inf | -11.4617 | -11.4617 |
| 80 | -5.14184 | -inf | -5.14184 |
| 81 | -10.3632 | -inf | -10.3632 |
| 82 | -inf | -13.3419 | -inf |
| 83 | -18.9131 | -inf | -18.9131 |
| 84 | -11.1785 | -11.1785 | -11.1785 |
| 85 | -inf | -4.10654 | -4.10654 |
| 86 | -6.00086 | -6.00086 | -6.00086 |
| 87 | 1727.58 | 1728.38 | 1728.38 |
| 88 | -inf | -inf | -inf |
| 89 | -143.322 | -143.322 | -143.322 |
| 90 | -331.735 | -inf | -inf |
| 91 | -600.473 | -51.5516 | -51.5516 |
| 92 | -inf | -inf | -inf |
| 93 | 2750.33 | -inf | -inf |
| 94 | -inf | -inf | -inf |
| 95 | -inf | -inf | -inf |
| 96 | 2743.31 | -inf | -inf |
| 97 | -inf | -inf | -inf |
| 98 | -inf | -inf | -inf |
| 99 | 972.307 | -inf | -inf |
| 100 | 2505.47 | -inf | -inf |
| 101 | -inf | -inf | -inf |
| 102 | -132.086 | -132.086 | -132.086 |
| 103 | -21.9244 | -21.9244 | -21.9244 |
| 104 | -21.3705 | -21.3705 | -21.3705 |
| 105 | -39.2789 | -39.2789 | -39.2789 |
| 106 | -169.608 | -169.608 | -169.608 |
| 107 | -40.4445 | -40.4445 | -40.4445 |
| 108 | -176.187 | -176.187 | -176.187 |
| 109 | -33.9841 | -33.9841 | -33.9841 |
| 110 | -24.075 | -24.075 | -24.075 |
| 111 | -112.039 | -111.998 | -111.998 |
| 112 | 8.52949 | 8.55402 | 8.55402 |
| 113 | -763.967 | 25.9786 | 25.9786 |
| 114 | -2632.28 | -53.1484 | -53.1484 |
| 115 | -845.343 | -21.5342 | -21.5342 |
| 116 | -164.034 | -163.557 | -163.557 |
| 117 | -7.84735 | -5.64721 | -5.30035 |
| 118 | -715.311 | -101.86 | -92.2018 |
| 119 | -506.672 | -560.04 | -538.755 |
|
|
|