UAI 2016 Inference Evaluation
Organizer: Vibhav Gogate (Email: vgogate at hlt dot utdallas dot edu)
Tuning Results for s-opt solver
Note: Problem names and types have been made anonymous. PR: |log(Z/Z*)|, where Z is the exact partition function and Z* is the approximate. MAR: Hellinger distances. MAP: un-normalized MAP value. MMAP: given E = evidence, Q = query; log(Z) where Z is the partition function of P(E,Q). If the solver did not output a value, “error” is reported.
MPE.UAI
| Problem | 1 min | 20 mins | 1 hour |
| 1 | 5674.97 | 5675.43 | 5675.43 |
| 2 | 1180.13 | 1180.24 | 1180.19 |
| 3 | 4665.69 | 4678.73 | 4678.73 |
| 4 | 8496.72 | 8497.67 | 8497.67 |
| 5 | 2821.29 | 2826.48 | 2826.48 |
| 6 | 2782.64 | 2782.64 | 2782.64 |
| 7 | 8233.58 | 8235.26 | 8235.26 |
| 8 | 1168.82 | 1168.82 | 1168.82 |
| 9 | 1326.04 | 1326.04 | 1326.04 |
| 10 | 5505.38 | 5505.38 | 5505.38 |
| 11 | 1982.76 | 1982.76 | 1982.76 |
| 12 | 670.971 | 670.971 | 670.971 |
| 13 | 1310.72 | 1310.72 | 1310.72 |
| 14 | -823.234 | -823.234 | -823.234 |
| 15 | -435.669 | -435.669 | -435.669 |
| 16 | -2998.93 | -2998.93 | -2998.93 |
| 17 | -1556.51 | -1556.51 | -1556.51 |
| 18 | -1176.48 | -1176.48 | -1176.48 |
| 19 | 4238.89 | 4275.92 | 4275.92 |
| 20 | 6685.99 | 6685.99 | 6685.99 |
| 21 | 9855.22 | 9855.22 | 9855.22 |
| 22 | 9021.78 | 9080.39 | 9021.78 |
| 23 | 12479.6 | 12479.6 | 12479.6 |
| 24 | 13770.5 | 13537.2 | 13537.2 |
| 25 | 4817.03 | 4817.03 | 4817.03 |
| 26 | 8850.45 | 8850.45 | 8850.45 |
| 27 | -21.7422 | -20.2907 | -19.9955 |
| 28 | -14.2865 | -14.2865 | -14.2865 |
| 29 | -26.0906 | -26.0906 | -26.0906 |
| 30 | -19.0953 | -17.5997 | -17.5997 |
| 31 | -23.6388 | -23.5389 | -23.5389 |
| 32 | -19.4317 | -18.715 | -18.715 |
| 33 | -18.7902 | -18.7902 | -18.7902 |
| 34 | -23.4057 | -23.4057 | -23.4057 |
| 35 | -25.1442 | -25.1442 | -25.1442 |
| 36 | -11.226 | -11.226 | -11.226 |
| 37 | -16.4425 | -16.4425 | -16.4425 |
| 38 | -15.2209 | -15.1126 | -15.1126 |
| 39 | -22.4585 | -22.4585 | -22.4585 |
| 40 | -11.5423 | -11.5423 | -11.5423 |
| 41 | -13.6721 | -13.6721 | -13.6721 |
| 42 | -18.6148 | -18.2451 | -18.2451 |
| 43 | -9.02328 | -9.02328 | -9.02328 |
| 44 | -4.97628 | -4.97628 | -4.97628 |
| 45 | -18.7611 | -18.7611 | -18.7611 |
| 46 | -9.43906 | -9.43906 | -9.43906 |
| 47 | -11.1996 | -11.1996 | -11.1996 |
| 48 | -12.875 | -12.875 | -12.875 |
| 49 | -13.0289 | -13.0289 | -13.0289 |
| 50 | -16.0229 | -16.0229 | -16.0229 |
| 51 | -10.2555 | -10.2555 | -10.2555 |
| 52 | -7.18 | -7.18 | -7.18 |
| 53 | -14.414 | -14.414 | -14.414 |
| 54 | -11.08 | -11.08 | -11.08 |
| 55 | -19.8679 | -19.6906 | -19.6906 |
| 56 | -6.28898 | -6.28898 | -6.28898 |
| 57 | -8.67899 | -8.67899 | -8.67899 |
| 58 | -11.7626 | -11.7626 | -11.7626 |
| 59 | -6.53627 | -6.53627 | -6.53627 |
| 60 | -8.26501 | -8.26501 | -8.26501 |
| 61 | -6.50045 | -6.50045 | -6.50045 |
| 62 | -11.802 | -11.802 | -11.802 |
| 63 | -13.0138 | -13.0138 | -13.0138 |
| 64 | -9.77858 | -9.77858 | -9.77858 |
| 65 | -7.37228 | -7.37228 | -7.37228 |
| 66 | -7.99506 | -7.99506 | -7.99506 |
| 67 | -11.2945 | -11.2945 | -11.2945 |
| 68 | -9.78424 | -9.78424 | -9.78424 |
| 69 | -8.0855 | -8.0855 | -8.0855 |
| 70 | -9.32425 | -9.32425 | -9.32425 |
| 71 | -11.7154 | -11.7154 | -11.7154 |
| 72 | -9.84402 | -9.84402 | -9.84402 |
| 73 | -9.43216 | -9.43216 | -9.43216 |
| 74 | -18.9466 | -18.9466 | -18.9466 |
| 75 | -9.5552 | -9.5552 | -9.5552 |
| 76 | -9.03647 | -9.03647 | -9.03647 |
| 77 | -5.8823 | -5.8823 | -5.8823 |
| 78 | -3.6654 | -3.6654 | -3.6654 |
| 79 | -5.09336 | -5.09336 | -5.09336 |
| 80 | -10.4698 | -10.4698 | -10.4698 |
| 81 | -4.15675 | -4.15675 | -4.15675 |
| 82 | -9.3921 | -9.3921 | -9.3921 |
| 83 | -12.3611 | -12.3611 | -12.3611 |
| 84 | -17.9407 | -17.9407 | -17.9407 |
| 85 | -10.1924 | -10.1924 | -10.1924 |
| 86 | -3.12158 | -3.12158 | -3.12158 |
| 87 | -5.01415 | -5.01415 | -5.01415 |
| 88 | 1962.85 | 1962.85 | 1962.85 |
| 89 | -1546.13 | -1546.13 | -1546.13 |
| 90 | -142.322 | -142.322 | -142.322 |
| 91 | -330.735 | -330.735 | -330.735 |
| 92 | -50.5516 | -50.5516 | -50.5516 |
| 93 | -854.522 | -854.522 | -854.522 |
| 94 | 16545.2 | 16545.2 | 16545.2 |
| 95 | 18607.3 | 18607.3 | 18607.3 |
| 96 | 2449.66 | 2449.66 | 2449.66 |
| 97 | 5578.25 | 5578.25 | 5578.25 |
| 98 | 7959.72 | 7959.72 | 7959.72 |
| 99 | 10548.2 | 10548.2 | 10548.2 |
| 100 | 4221.41 | 4262.99 | 4242.52 |
| 101 | 5869.77 | 5869.77 | 5869.77 |
| 102 | 8657.26 | 8657.26 | 8657.26 |
| 103 | -134.83 | -134.83 | -134.83 |
| 104 | -21.2144 | -21.2144 | -21.2144 |
| 105 | -20.6534 | -20.6534 | -20.6534 |
| 106 | -39.1 | -39.1 | -39.1 |
| 107 | -164.203 | -164.203 | -164.203 |
| 108 | -40.2579 | -40.2579 | -40.2579 |
| 109 | -175.786 | -175.786 | -175.786 |
| 110 | -34.9029 | -34.9029 | -34.9029 |
| 111 | -24.4949 | -24.4949 | -24.4949 |
| 112 | -112.879 | -112.879 | -112.879 |
| 113 | -2.36161 | -2.31256 | -2.31256 |
| 114 | -1.57891 | -1.57694 | -1.57684 |
| 115 | 0.787629 | 0.787629 | 0.787629 |
| 116 | -3.09754 | 0.862895 | 0.862895 |
| 117 | -75.0 | -75.0 | -75.0 |
| 118 | -15.98 | -15.492 | -15.492 |
| 119 | -22.792 | -12.124 | -12.156 |
| 120 | -7.04676 | 0.91749 | 0.91749 |
| 121 | error | error | error |
| 122 | -46.4336 | -45.5276 | -45.5276 |
| 123 | error | error | error |
| 124 | -56.3906 | -55.9653 | -55.9514 |
| 125 | -118.696 | -117.873 | -117.74 |
| 126 | error | error | error |
| 127 | -54.592 | -53.649 | -53.805 |
| 128 | error | error | error |
| 129 | -66.0553 | -64.8998 | -64.434 |
| 130 | -137.273 | -135.299 | -135.117 |
| 131 | error | error | 14512.0 |
| 132 | error | error | error |
| 133 | 1869.5 | 1870.59 | 1870.59 |
| 134 | 63377.8 | 63391.6 | 63596.3 |
| 135 | 1631.65 | 1636.09 | 1635.92 |
| 136 | 1691.17 | 1692.51 | 1691.61 |
| 137 | error | 80857.5 | 80857.5 |
|
|
MMAP.UAI
| Problem | 1 min | 20 mins | 1 hour |
| 1 | 5678.1 | 5678.7 | 5678.7 |
| 2 | 1221.26 | 1221.63 | 1222.56 |
| 3 | 4834.31 | 4838.38 | 4839.21 |
| 4 | 8498.78 | 8499.74 | 8499.74 |
| 5 | 2830.9 | 2835.16 | 2835.16 |
| 6 | 2793.03 | 2793.03 | 2793.03 |
| 7 | 8237.32 | 8237.32 | 8237.32 |
| 8 | 1209.3 | 1209.3 | 1209.3 |
| 9 | 1326.3 | 1326.3 | 1326.3 |
| 10 | 5508.12 | 5508.87 | 5508.87 |
| 11 | 1982.51 | 1982.51 | 1982.51 |
| 12 | 673.01 | 673.01 | 673.01 |
| 13 | 1311.49 | 1311.49 | 1311.49 |
| 14 | -824.234 | -824.234 | -824.234 |
| 15 | -2999.83 | -2999.83 | -2999.83 |
| 16 | -1557.49 | -1557.49 | -1557.49 |
| 17 | -1177.47 | -1177.47 | -1177.47 |
| 18 | 4237.89 | 4288.21 | 4288.21 |
| 19 | 6684.99 | 6684.99 | 6684.99 |
| 20 | 9854.22 | 9854.22 | 9854.22 |
| 21 | 9020.78 | 9079.39 | 9020.78 |
| 22 | 12478.6 | 12478.6 | 12478.6 |
| 23 | 13775.9 | 13536.2 | 13536.2 |
| 24 | 4816.03 | 4816.03 | 4816.03 |
| 25 | 8849.45 | 8849.45 | 8849.45 |
| 26 | -22.5362 | -21.2618 | -20.9672 |
| 27 | -15.2632 | -15.2632 | -15.2632 |
| 28 | -27.063 | -27.063 | -27.063 |
| 29 | -19.8732 | -18.5822 | -18.5822 |
| 30 | -25.3489 | -24.5237 | -24.5237 |
| 31 | -20.5726 | -19.6812 | -19.6812 |
| 32 | -19.7686 | -19.7686 | -19.7686 |
| 33 | -25.0796 | -24.3861 | -24.3861 |
| 34 | -26.1185 | -26.1185 | -26.1185 |
| 35 | -12.1964 | -12.1964 | -12.1964 |
| 36 | -17.4756 | -17.424 | -17.424 |
| 37 | -16.1443 | -16.0369 | -16.0369 |
| 38 | -23.4321 | -23.4321 | -23.4321 |
| 39 | -12.5101 | -12.5101 | -12.5101 |
| 40 | -14.6482 | -14.6482 | -14.6482 |
| 41 | -19.5897 | -19.2204 | -19.2204 |
| 42 | -10.0071 | -10.0071 | -10.0071 |
| 43 | -5.95651 | -5.95651 | -5.95651 |
| 44 | -19.7333 | -19.7333 | -19.7333 |
| 45 | -10.4177 | -10.4177 | -10.4177 |
| 46 | -12.1854 | -12.1854 | -12.1854 |
| 47 | -13.8599 | -13.8599 | -13.8599 |
| 48 | -14.0107 | -14.0107 | -14.0107 |
| 49 | -17.0061 | -17.0061 | -17.0061 |
| 50 | -11.6321 | -11.2347 | -11.2347 |
| 51 | -8.16227 | -8.16227 | -8.16227 |
| 52 | -15.4013 | -15.4013 | -15.4013 |
| 53 | -12.0601 | -12.0601 | -12.0601 |
| 54 | -20.8481 | -20.6702 | -20.6702 |
| 55 | -7.27188 | -7.27188 | -7.27188 |
| 56 | -9.66002 | -9.66002 | -9.66002 |
| 57 | -12.7336 | -12.7336 | -12.7336 |
| 58 | -7.51856 | -7.51856 | -7.51856 |
| 59 | -9.20674 | -9.20674 | -9.20674 |
| 60 | -7.48939 | -7.48939 | -7.48939 |
| 61 | -12.7852 | -12.7852 | -12.7852 |
| 62 | -13.9428 | -13.9428 | -13.9428 |
| 63 | -10.7047 | -10.7047 | -10.7047 |
| 64 | -8.36077 | -8.36077 | -8.36077 |
| 65 | -8.97517 | -8.97517 | -8.97517 |
| 66 | -12.282 | -12.282 | -12.282 |
| 67 | -10.7717 | -10.7717 | -10.7717 |
| 68 | -9.0702 | -9.0702 | -9.0702 |
| 69 | -10.3087 | -10.3087 | -10.3087 |
| 70 | -12.7044 | -12.7044 | -12.7044 |
| 71 | -10.833 | -10.833 | -10.833 |
| 72 | -10.3888 | -10.3888 | -10.3888 |
| 73 | -19.918 | -19.918 | -19.918 |
| 74 | -10.5411 | -10.5411 | -10.5411 |
| 75 | -10.018 | -10.018 | -10.018 |
| 76 | -6.87485 | -6.87485 | -6.87485 |
| 77 | -4.65322 | -4.65322 | -4.65322 |
| 78 | -6.08413 | -6.08413 | -6.08413 |
| 79 | -11.4617 | -11.4617 | -11.4617 |
| 80 | -5.14184 | -5.14184 | -5.14184 |
| 81 | -10.3632 | -10.3632 | -10.3632 |
| 82 | -13.3419 | -13.3419 | -13.3419 |
| 83 | -18.9131 | -18.9131 | -18.9131 |
| 84 | -11.1785 | -11.1785 | -11.1785 |
| 85 | -4.10654 | -4.10654 | -4.10654 |
| 86 | -6.00086 | -6.00086 | -6.00086 |
| 87 | 1962.31 | 1962.31 | 1962.31 |
| 88 | -1547.04 | -1547.04 | -1547.04 |
| 89 | -143.322 | -143.322 | -143.322 |
| 90 | -331.735 | -331.735 | -331.735 |
| 91 | -51.5516 | -51.5516 | -51.5516 |
| 92 | -855.522 | -855.522 | -855.522 |
| 93 | 16544.2 | 16544.2 | 16544.2 |
| 94 | 18606.3 | 18606.3 | 18606.3 |
| 95 | 2448.67 | 2448.67 | 2448.67 |
| 96 | 5577.25 | 5577.25 | 5577.25 |
| 97 | 7958.72 | 7958.72 | 7958.72 |
| 98 | 10547.2 | 10547.2 | 10547.2 |
| 99 | 4218.32 | 4261.99 | 4241.52 |
| 100 | 5868.77 | 5868.77 | 5868.77 |
| 101 | 8656.26 | 8656.26 | 8656.26 |
| 102 | -132.269 | -132.269 | -132.269 |
| 103 | -21.9244 | -21.9244 | -21.9244 |
| 104 | -21.3705 | -21.3705 | -21.3705 |
| 105 | -39.2789 | -39.2789 | -39.2789 |
| 106 | -163.792 | -163.792 | -163.792 |
| 107 | -40.4445 | -40.4445 | -40.4445 |
| 108 | -174.323 | -174.323 | -174.323 |
| 109 | -33.9841 | -33.9841 | -33.9841 |
| 110 | -24.075 | -24.075 | -24.075 |
| 111 | -112.007 | -112.007 | -112.007 |
| 112 | 5.74246 | 6.63751 | 6.7649 |
| 113 | 12.787 | 13.6737 | 13.6737 |
| 114 | 0.682731 | 0.381745 | 0.682731 |
| 115 | -1.98151 | 1.06734 | 1.06676 |
| 116 | -75.0961 | -74.6191 | -74.6191 |
| 117 | 23.8167 | 23.1639 | 23.206 |
| 118 | 24.0698 | 33.4773 | 33.4055 |
| 119 | -6.46036 | 0.213908 | 0.213908 |
|
|
|