Value iteration - average cost/reward criteria

Reward

Buy/sell some Buy/sell

Do nothing assets many assets
State action=1 action =2 action =3 TPM action 0 1
0 -50 200 500 state 0 1 0.3 0.25
1 -200 500 1000 2 0.6 0.3
2 -300 1000 2000 3 0.8 0.1
3 -500 1500 3000
TPM action 0 1
state 1 1 0.05 0.1
2 0.25 0.2
3 0.3 0.25

TPM action 0 1
state 2 1 0.6 0.3
2 0.05 0.2
3 0.05 0.1

TPM action 0 1
state 3 1 0.25 0.2
Read comment) 2 0.05 0.05
3 0.6 0.3

iteration V(0,1) V(0,2) V(0,3) max(V(0,k)) V(1,1) V(1,2) V(1,3) max(V(1,k)

0 0 0
1 -50 200 500 500 -200 500 1000 1000
2 800 550 750 800 1925 1675 1850 1925
3 1688.75 831.25 906.25 1688.75 2118.75 2360 2738.75 2738.75
4 1403.625 785.625 875.625 1403.625 2262.5 2194.625 2453.625 2453.625
5 1562.6063 794.5 884.5 1562.60625 2082.844 2260.444 2612.606 2612.606
6 1435.1003 785.5171875 875.5171875 1435.10031 2193.097 2198.598 2485.1 2485.1
7 1523.8286 791.0298438 881.0298438 1523.82864 2102.98 2238.049 2573.829 2573.829
8 1456.727 786.5240039 876.5240039 1456.72701 2165.02 2206.578 2506.727 2506.727
9 1505.0287 789.6260242 879.6260242 1505.02874 2117.796 2228.545 2555.029 2555.029
10 1469.2335 787.264814 877.264814 1469.23345 2151.661 2211.962 2519.233 2519.233
11 1495.3078 788.9580685 878.9580685 1495.30784 2126.508 2223.912 2545.308 2545.308
12 1476.1205 787.7004079 877.7004079 1476.12052 2144.806 2215.062 2526.121 2526.121
13 1490.1553 788.6153144 878.6153144 1490.15533 2131.331 2221.511 2540.155 2540.155
14 1479.8529 787.9415352 877.9415352 1479.85291 2141.183 2216.766 2529.853 2529.853
15 1487.3997 788.4341518 878.4341518 1487.39969 2133.949 2220.237 2537.4 2537.4
16 1481.8646 788.0724419 878.0724419 1481.86464 2139.247 2217.69 2531.865 2531.865
17 1485.9213 788.3373606 878.3373606 1485.92126 2135.361 2219.556 2535.921 2535.921
18 1482.9469 788.1430421 878.1430421 1482.9469 2138.209 2218.187 2532.947 2532.947
19 1485.1272 788.2854494 878.2854494 1485.12718 2136.121 2219.19 2535.127 2535.127
20 1483.5287 788.1810311 878.1810311 1483.52874 2137.651 2218.455 2533.529 2533.529
21 1484.7005 788.2575709 878.2575709 1484.70051 2136.529 2218.994 2534.701 2534.701
22 1483.8415 788.2014561 878.2014561 1483.84147 2137.352 2218.599 2533.841 2533.841
23 1484.4712 788.2425919 878.2425919 1484.47122 2136.749 2218.888 2534.471 2534.471
24 1484.0096 788.2124347 878.2124347 1484.00955 2137.191 2218.676 2534.01 2534.01
25 1484.348 788.2345425 878.2345425 1484.348 2136.867 2218.832 2534.348 2534.348
26 1484.0999 788.2183353 878.2183353 1484.09988 2137.104 2218.718 2534.1 2534.1
27 1484.2818 788.2302167 878.2302167 1484.28177 2136.93 2218.801 2534.282 2534.282
28 1484.1484 788.2215065 878.2215065 1484.14843 2137.058 2218.74 2534.148 2534.148
29 1484.2462 788.2278919 878.2278919 1484.24618 2136.964 2218.785 2534.246 2534.246
30 1484.1745 788.2232107 878.2232107 1484.17452 2137.033 2218.752 2534.175 2534.175
31 1484.2271 788.2266424 878.2266424 1484.22706 2136.983 2218.776 2534.227 2534.227
32 1484.1885 788.2241267 878.2241267 1484.18854 2137.019 2218.758 2534.189 2534.189
33 1484.2168 788.225971 878.225971 1484.21678 2136.992 2218.771 2534.217 2534.217
34 1484.1961 788.2246189 878.2246189 1484.19608 2137.012 2218.762 2534.196 2534.196
35 1484.2113 788.2256101 878.2256101 1484.21125 2136.998 2218.769 2534.211 2534.211
36 1484.2001 788.2248835 878.2248835 1484.20013 2137.008 2218.764 2534.2 2534.2
37 1484.2083 788.2254162 878.2254162 1484.20828 2137.001 2218.767 2534.208 2534.208
38 1484.2023 788.2250257 878.2250257 1484.20231 2137.006 2218.765 2534.202 2534.202
39 1484.2067 788.2253119 878.2253119 1484.20669 2137.002 2218.767 2534.207 2534.207
40 1484.2035 788.2251021 878.2251021 1484.20348 2137.005 2218.765 2534.203 2534.203
41 1484.2058 788.2252559 878.2252559 1484.20583 2137.003 2218.766 2534.206 2534.206
42 1484.2041 788.2251431 878.2251431 1484.2041 2137.005 2218.766 2534.204 2534.204
43 1484.2054 788.2252258 878.2252258 1484.20537 2137.003 2218.766 2534.205 2534.205
44 1484.2044 788.2251652 878.2251652 1484.20444 2137.004 2218.766 2534.204 2534.204
45 1484.2051 788.2252096 878.2252096 1484.20512 2137.004 2218.766 2534.205 2534.205
46 1484.2046 788.2251771 878.2251771 1484.20462 2137.004 2218.766 2534.205 2534.205
 2 3
0.4 0.05
0.05 0.05
0.05 0.05

2 3
0.05 0.8
0.3 0.25
0.4 0.05

2 3
0.05 0.05
0.15 0.6
0.05 0.8

2 3
0.3 0.25
0.8 0.1
0.05 0.05

V(2,1) V(2,2) V(2,3) max(V(2,k) V(3,1) V(3,2) V(3,3) max(V(3,k))

0 0
-300 1000 2000 2000 -500 1500 3000 3000
50 2825 4125 4125 675 2975 3350 3350
331.25 3253.75 4318.75 4318.75 1360 4471.25 3631.25 4471.25
285.625 3274 4462.5 4462.5 1194.625 3934.75 3585.625 3934.75
294.5 3187.506 4282.844 4282.844 1260.444 4252.713 3594.5 4252.713
285.5172 3232.099 4393.097 4393.097 1198.598 3997.701 3585.517 3997.701
291.0298 3191.26 4302.98 4302.98 1238.049 4175.157 3591.03 4175.157
286.524 3217.67 4365.02 4365.02 1206.578 4040.954 3586.524 4040.954
289.626 3196.78 4317.796 4317.796 1228.545 4137.557 3589.626 4137.557
287.2648 3211.432 4351.661 4351.661 1211.962 4065.967 3587.265 4065.967
288.9581 3200.404 4326.508 4326.508 1223.912 4118.116 3588.958 4118.116
287.7004 3208.365 4344.806 4344.806 1215.062 4079.741 3587.7 4079.741
288.6153 3202.475 4331.331 4331.331 1221.511 4107.811 3588.615 4107.811
287.9415 3206.77 4341.183 4341.183 1216.766 4087.206 3587.942 4087.206
288.4342 3203.611 4333.949 4333.949 1220.237 4102.299 3588.434 4102.299
288.0724 3205.922 4339.247 4339.247 1217.69 4091.229 3588.072 4091.229
288.3374 3204.226 4335.361 4335.361 1219.556 4099.343 3588.337 4099.343
288.143 3205.469 4338.209 4338.209 1218.187 4093.394 3588.143 4093.394
288.2854 3204.557 4336.121 4336.121 1219.19 4097.754 3588.285 4097.754
288.181 3205.225 4337.651 4337.651 1218.455 4094.557 3588.181 4094.557
288.2576 3204.736 4336.529 4336.529 1218.994 4096.901 3588.258 4096.901
288.2015 3205.095 4337.352 4337.352 1218.599 4095.183 3588.201 4095.183
288.2426 3204.831 4336.749 4336.749 1218.888 4096.442 3588.243 4096.442
288.2124 3205.024 4337.191 4337.191 1218.676 4095.519 3588.212 4095.519
288.2345 3204.883 4336.867 4336.867 1218.832 4096.196 3588.235 4096.196
288.2183 3204.987 4337.104 4337.104 1218.718 4095.7 3588.218 4095.7
288.2302 3204.911 4336.93 4336.93 1218.801 4096.064 3588.23 4096.064
288.2215 3204.966 4337.058 4337.058 1218.74 4095.797 3588.222 4095.797
288.2279 3204.925 4336.964 4336.964 1218.785 4095.992 3588.228 4095.992
288.2232 3204.955 4337.033 4337.033 1218.752 4095.849 3588.223 4095.849
288.2266 3204.933 4336.983 4336.983 1218.776 4095.954 3588.227 4095.954
288.2241 3204.95 4337.019 4337.019 1218.758 4095.877 3588.224 4095.877
288.226 3204.938 4336.992 4336.992 1218.771 4095.934 3588.226 4095.934
288.2246 3204.946 4337.012 4337.012 1218.762 4095.892 3588.225 4095.892
288.2256 3204.94 4336.998 4336.998 1218.769 4095.923 3588.226 4095.923
288.2249 3204.945 4337.008 4337.008 1218.764 4095.9 3588.225 4095.9
288.2254 3204.941 4337.001 4337.001 1218.767 4095.917 3588.225 4095.917
288.225 3204.944 4337.006 4337.006 1218.765 4095.905 3588.225 4095.905
288.2253 3204.942 4337.002 4337.002 1218.767 4095.913 3588.225 4095.913
288.2251 3204.943 4337.005 4337.005 1218.765 4095.907 3588.225 4095.907
288.2253 3204.942 4337.003 4337.003 1218.766 4095.912 3588.225 4095.912
288.2251 3204.943 4337.005 4337.005 1218.766 4095.908 3588.225 4095.908
288.2252 3204.943 4337.003 4337.003 1218.766 4095.911 3588.225 4095.911
288.2252 3204.943 4337.004 4337.004 1218.766 4095.909 3588.225 4095.909
288.2252 3204.943 4337.004 4337.004 1218.766 4095.91 3588.225 4095.91
288.2252 3204.943 4337.004 4337.004 1218.766 4095.909 3588.225 4095.909
 TPM action 0
state 0 1 0.3
2 0.6
3 0.8

TPM action 0
state 1 1 0.05
2 0.25
3 0.3

beta 0.9 TPM action 0

state 2 1 0.6
Buy/sell Buy/sell many
Do nothing some assets assets 2 0.05
Reward action=1 action =2 action =3 3 0.05
state 0 -50 200 500
1 -200 500 1000
2 -300 1000 2000 TPM action 0
3 -500 1500 3000 state 3 1 0.25
2 0.05
3 0.6
Vi(n+1)=max(over k)( c(i,k) + alpha ( sum Pi,j(k)Vj(n) )
iteration V(0,1) V(0,2) V(0,3) max(V(0,k)) V(1,1) V(1,2) V(1,3) max(V(1,k
0 0 0
1 -50 200 500 500 -200 500 1000 1000
2 1165 965 1175 1175 2162.5 2007.5 2215 2215
3 2505.55 1798.288 1911.0875 2505.55 2959.338 3188.075 3555.55 3555.55
4 3514.817 2976.124 3087.123688 3514.81675 4160.247 4251.559 4564.817 4564.82
5 4483.496 3884.435 3995.435185 4483.4958513 4938.771 5168.38 5533.496 5533.5
6 5289.566 4750.405 4861.404638 5289.5663463 5845.469 6002.426 6339.566 6339.57
7 6048.297 5477.438 5588.438003 6048.2974689 6528.128 6740.267 7098.297 7098.3
8 6705.266 6158.37 6269.369786 6705.266343 7231.515 7410.07 7755.266 7755.27
9 7312.084 6750.566 6861.565598 7312.0840112 7806.236 8008.05 8362.084 8362.08
10 7847.365 7295.957 7406.95669 7847.36454 8362.12 8549.018 8897.365 8897.36
11 8336.046 7778.148 7889.147849 8336.0459272 8836.984 9033.891 9386.046 9386.05
12 8771.197 8217.651 8328.651106 8771.1966392 9281.164 9471.532 9821.197 9821.2
13 9165.873 8609.483 8720.483263 9165.8731075 9669.849 9864.557 10215.87 10215.9
14 9519.062 8964.559 9075.559303 9519.0618178 10026.98 10218.83 10569.06 10569.1
15 9838.259 9282.516 9393.515533 9838.2591119 10343.57 10537.31 10888.26 10888.3
16 10124.66 9569.736 9680.735624 10124.658742 10631.69 10824.18 11174.66 11174.7
17 10383 9827.533 9938.533026 10382.996839 10888.89 11082.21 11433 11433
18 10615.12 10060.01 10171.01234 10615.119168 11121.76 11314.54 11665.12 11665.1
19 10824.28 10268.94 10379.93889 10824.28115 11330.43 11523.56 11874.28 11874.3
20 11012.36 10457.17 10568.17381 11012.360695 11518.83 11711.73 12062.36 12062.4
21 11181.74 10626.45 10737.45256 11181.741948 11688 11881.06 12231.74 12231.7
22 11334.11 10778.89 10889.89096 11334.112715 11840.51 12033.47 12384.11 12384.1
23 11471.29 10916.03 11027.02777 11471.294145 11977.6 12170.62 12521.29 12521.3
24 11594.73 11039.49 11150.489 11594.725933 12101.1 12294.07 12644.73 12644.7
25 11705.84 11150.58 11261.57897 11705.835324 12212.16 12405.17 12755.84 12755.8
26 11805.82 11250.58 11361.57652 11805.820064 12312.18 12505.16 12855.82 12855.8
27 11895.82 11340.56 11451.56338 11895.815378 12402.15 12595.15 12945.82 12945.8
28 11976.81 11421.56 11532.55877 11976.80519 12483.15 12676.14 13026.81 13026.8
29 12049.7 11494.45 11605.44986 12049.69996 12556.04 12749.04 13099.7 13099.7
30 12115.3 11560.05 11671.05498 12115.302654 12621.65 12814.64 13165.3 13165.3
31 12174.35 11619.1 11730.09752 12174.346794 12680.69 12873.68 13224.35 13224.3
32 12227.49 11672.24 11783.23717 12227.485388 12733.83 12926.82 13277.49 13277.5
33 12275.31 11720.06 11831.06196 12275.310869 12781.66 12974.65 13325.31 13325.3
34 12318.35 11763.1 11874.10486 12318.35331 12824.7 13017.69 13368.35 13368.4
35 12357.09 11801.84 11912.84307 12357.091831 12863.44 13056.43 13407.09 13407.1
36 12391.96 11836.71 11947.70773 12391.956286 12898.3 13091.29 13441.96 13442
37 12423.33 11868.09 11979.08575 12423.334437 12929.68 13122.67 13473.33 13473.3
38 12451.57 11896.33 12007.32608 12451.574679 12957.92 13150.91 13501.57 13501.6
39 12476.99 11921.74 12032.7423 12476.990959 12983.34 13176.33 13526.99 13527
40 12499.87 11944.62 12055.61695 12499.86557 13006.21 13199.2 13549.87 13549.9
41 12520.45 11965.2 12076.2041 12520.452747 13026.8 13219.79 13570.45 13570.5
42 12538.98 11983.73 12094.73256 12538.981189 13045.33 13238.32 13588.98 13589
43 12555.66 12000.41 12111.40816 12555.656798 13062 13254.99 13605.66 13605.7
44 12570.66 12015.42 12126.4162 12570.664838 13077.01 13270 13620.66 13620.7
45 12584.17 12028.92 12139.92344 12584.17208 13090.52 13283.51 13634.17 13634.2
46 12596.33 12041.08 12152.07996 12596.328594 13102.67 13295.67 13646.33 13646.3
47 12607.27 12052.02 12163.02082 12607.269458 13113.61 13306.61 13657.27 13657.3
48 12617.12 12061.87 12172.8676 12617.116235 13123.46 13316.45 13667.12 13667.1
49 12625.98 12070.73 12181.7297 12625.978335 13132.32 13325.32 13675.98 13676
50 12633.95 12078.71 12189.70559 12633.954225 13140.3 13333.29 13683.95 13684
51 12641.13 12085.88 12196.88389 12641.132526 13147.48 13340.47 13691.13 13691.1
52 12647.59 12092.34 12203.34436 12647.592996 13153.94 13346.93 13697.59 13697.6
53 12653.41 12098.16 12209.15878 12653.40742 13159.75 13352.74 13703.41 13703.4
54 12658.64 12103.39 12214.39176 12658.640401 13164.99 13357.98 13708.64 13708.6
55 12663.35 12108.1 12219.10145 12663.350084 13169.69 13362.69 13713.35 13713.4
56 12667.59 12112.34 12223.34016 12667.588799 13173.93 13366.93 13717.59 13717.6
57 12671.4 12116.16 12227.15501 12671.403642 13177.75 13370.74 13721.4 13721.4
58 12674.84 12119.59 12230.58837 12674.837001 13181.18 13374.17 13724.84 13724.8
59 12677.93 12122.68 12233.67839 12677.927025 13184.27 13377.26 13727.93 13727.9
60 12680.71 12125.46 12236.45941 12680.708045 13187.05 13380.05 13730.71 13730.7
61 12683.21 12127.96 12238.96233 12683.210964 13189.56 13382.55 13733.21 13733.2
62 12685.46 12130.21 12241.21495 12685.463591 13191.81 13384.8 13735.46 13735.5
63 12687.49 12132.24 12243.24232 12687.490955 13193.84 13386.83 13737.49 13737.5
64 12689.32 12134.07 12245.06695 12689.315583 13195.66 13388.65 13739.32 13739.3
65 12690.96 12135.71 12246.70911 12690.957748 13197.3 13390.29 13740.96 13741
66 12692.44 12137.19 12248.18706 12692.435696 13198.78 13391.77 13742.44 13742.4
67 12693.77 12138.52 12249.51721 12693.76585 13200.11 13393.1 13743.77 13743.8
68 12694.96 12139.71 12250.71435 12694.962988 13201.31 13394.3 13744.96 13745
69 12696.04 12140.79 12251.79178 12696.040413 13202.39 13395.38 13746.04 13746
70 12697.01 12141.76 12252.76146 12697.010095 13203.35 13396.35 13747.01 13747
71 12697.88 12142.63 12253.63417 12697.882808 13204.23 13397.22 13747.88 13747.9
72 12698.67 12143.42 12254.41961 12698.668251 13205.01 13398.01 13748.67 13748.7
73 12699.38 12144.13 12255.12651 12699.375149 13205.72 13398.71 13749.38 13749.4
74 12700.01 12144.76 12255.76272 12700.011357 13206.36 13399.35 13750.01 13750
 75 12700.58 12145.34 12256.33531 12700.583945 13206.93 13399.92 13750.58 13750.6
76 12701.1 12145.85 12256.85064 12701.099274 13207.44 13400.44 13751.1 13751.1
77 12701.56 12146.31 12257.31443 12701.563069 13207.91 13400.9 13751.56 13751.6
78 12701.98 12146.73 12257.73185 12701.980486 13208.33 13401.32 13751.98 13752
79 12702.36 12147.11 12258.10752 12702.35616 13208.7 13401.69 13752.36 13752.4
80 12702.69 12147.45 12258.44563 12702.694268 13209.04 13402.03 13752.69 13752.7
81 12703 12147.75 12258.74993 12702.998564 13209.34 13402.34 13753 13753
82 12703.27 12148.02 12259.02379 12703.272431 13209.62 13402.61 13753.27 13753.3
83 12703.52 12148.27 12259.27027 12703.518911 13209.86 13402.86 13753.52 13753.5
84 12703.74 12148.49 12259.49211 12703.740743 13210.09 13403.08 13753.74 13753.7
85 12703.94 12148.69 12259.69176 12703.940392 13210.29 13403.28 13753.94 13753.9
86 12704.12 12148.87 12259.87144 12704.120076 13210.46 13403.46 13754.12 13754.1
87 12704.28 12149.03 12260.03316 12704.281792 13210.63 13403.62 13754.28 13754.3
88 12704.43 12149.18 12260.1787 12704.427336 13210.77 13403.76 13754.43 13754.4
89 12704.56 12149.31 12260.30969 12704.558326 13210.9 13403.9 13754.56 13754.6
90 12704.68 12149.43 12260.42758 12704.676216 13211.02 13404.01 13754.68 13754.7
91 12704.78 12149.53 12260.53368 12704.782318 13211.13 13404.12 13754.78 13754.8
92 12704.88 12149.63 12260.62917 12704.877809 13211.22 13404.22 13754.88 13754.9
93 12704.96 12149.72 12260.71512 12704.963752 13211.31 13404.3 13754.96 13755
94 12705.04 12149.79 12260.79246 12705.0411 13211.39 13404.38 13755.04 13755
95 12705.11 12149.86 12260.86208 12705.110713 13211.46 13404.45 13755.11 13755.1
96 12705.17 12149.92 12260.92473 12705.173365 13211.52 13404.51 13755.17 13755.2
97 12705.23 12149.98 12260.98112 12705.229752 13211.57 13404.57 13755.23 13755.2
98 12705.28 12150.03 12261.03186 12705.2805 13211.63 13404.62 13755.28 13755.3
99 12705.33 12150.08 12261.07754 12705.326173 13211.67 13404.66 13755.33 13755.3
100 12705.37 12150.12 12261.11864 12705.367279 13211.71 13404.7 13755.37 13755.4
101 12705.4 12150.16 12261.15564 12705.404274 13211.75 13404.74 13755.4 13755.4
102 12705.44 12150.19 12261.18893 12705.43757 13211.78 13404.77 13755.44 13755.4
103 12705.47 12150.22 12261.2189 12705.467536 13211.81 13404.8 13755.47 13755.5
104 12705.49 12150.25 12261.24587 12705.494506 13211.84 13404.83 13755.49 13755.5
105 12705.52 12150.27 12261.27014 12705.518779 13211.86 13404.86 13755.52 13755.5
106 12705.54 12150.29 12261.29199 12705.540624 13211.89 13404.88 13755.54 13755.5
107 12705.56 12150.31 12261.31165 12705.560285 13211.91 13404.9 13755.56 13755.6
108 12705.58 12150.33 12261.32934 12705.57798 13211.92 13404.92 13755.58 13755.6
109 12705.59 12150.35 12261.34527 12705.593905 13211.94 13404.93 13755.59 13755.6
110 12705.61 12150.36 12261.3596 12705.608238 13211.95 13404.95 13755.61 13755.6
111 12705.62 12150.37 12261.3725 12705.621137 13211.97 13404.96 13755.62 13755.6
112 12705.63 12150.38 12261.38411 12705.632747 13211.98 13404.97 13755.63 13755.6
113 12705.64 12150.39 12261.39456 12705.643195 13211.99 13404.98 13755.64 13755.6
114 12705.65 12150.4 12261.40396 12705.652599 13212 13404.99 13755.65 13755.7
115 12705.66 12150.41 12261.41243 12705.661062 13212.01 13405 13755.66 13755.7
116 12705.67 12150.42 12261.42004 12705.668679 13212.01 13405.01 13755.67 13755.7
117 12705.68 12150.43 12261.4269 12705.675535 13212.02 13405.01 13755.68 13755.7
118 12705.68 12150.43 12261.43307 12705.681704 13212.03 13405.02 13755.68 13755.7
119 12705.69 12150.44 12261.43862 12705.687257 13212.03 13405.02 13755.69 13755.7
120 12705.69 12150.44 12261.44362 12705.692255 13212.04 13405.03 13755.69 13755.7
121 12705.7 12150.45 12261.44812 12705.696753 13212.04 13405.03 13755.7 13755.7
122 12705.7 12150.45 12261.45216 12705.700801 13212.05 13405.04 13755.7 13755.7
123 12705.7 12150.46 12261.45581 12705.704444 13212.05 13405.04 13755.7 13755.7
124 12705.71 12150.46 12261.45909 12705.707723 13212.05 13405.04 13755.71 13755.7
125 12705.71 12150.46 12261.46204 12705.710674 13212.06 13405.05 13755.71 13755.7
126 12705.71 12150.46 12261.46469 12705.713329 13212.06 13405.05 13755.71 13755.7
127 12705.72 12150.47 12261.46708 12705.71572 13212.06 13405.05 13755.72 13755.7
128 12705.72 12150.47 12261.46923 12705.717871 13212.06 13405.06 13755.72 13755.7
129 12705.72 12150.47 12261.47117 12705.719807 13212.06 13405.06 13755.72 13755.7
130 12705.72 12150.47 12261.47291 12705.72155 13212.07 13405.06 13755.72 13755.7
131 12705.72 12150.47 12261.47448 12705.723118 13212.07 13405.06 13755.72 13755.7
132 12705.72 12150.48 12261.47589 12705.724529 13212.07 13405.06 13755.72 13755.7
133 12705.73 12150.48 12261.47716 12705.7258 13212.07 13405.06 13755.73 13755.7
134 12705.73 12150.48 12261.47831 12705.726943 13212.07 13405.06 13755.73 13755.7
135 12705.73 12150.48 12261.47934 12705.727972 13212.07 13405.07 13755.73 13755.7
136 12705.73 12150.48 12261.48026 12705.728898 13212.07 13405.07 13755.73 13755.7
137 12705.73 12150.48 12261.4811 12705.729731 13212.07 13405.07 13755.73 13755.7
137 12705.73 12150.48 12261.48185 12705.730482 13212.08 13405.07 13755.73 13755.7
137 12705.73 12150.48 12261.48252 12705.731157 13212.08 13405.07 13755.73 13755.7
137 12705.73 12150.48 12261.48313 12705.731764 13212.08 13405.07 13755.73 13755.7
137 12705.73 12150.48 12261.48367 12705.732311 13212.08 13405.07 13755.73 13755.7
137 12705.73 12150.48 12261.48417 12705.732803 13212.08 13405.07 13755.73 13755.7
137 12705.73 12150.48 12261.48461 12705.733246 13212.08 13405.07 13755.73 13755.7
137 12705.73 12150.49 12261.48501 12705.733645 13212.08 13405.07 13755.73 13755.7
137 12705.73 12150.49 12261.48537 12705.734004 13212.08 13405.07 13755.73 13755.7
137 12705.73 12150.49 12261.48569 12705.734326 13212.08 13405.07 13755.73 13755.7
137 12705.73 12150.49 12261.48598 12705.734617 13212.08 13405.07 13755.73 13755.7
137 12705.73 12150.49 12261.48624 12705.734879 13212.08 13405.07 13755.73 13755.7
137 12705.74 12150.49 12261.48648 12705.735114 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48669 12705.735326 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48688 12705.735517 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48705 12705.735688 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48721 12705.735843 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48735 12705.735982 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48747 12705.736107 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48758 12705.736219 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48768 12705.736321 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48778 12705.736412 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48786 12705.736494 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48793 12705.736568 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.488 12705.736634 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48806 12705.736694 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48811 12705.736748 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48816 12705.736796 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4882 12705.73684 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48824 12705.736879 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48828 12705.736915 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48831 12705.736946 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48834 12705.736975 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48836 12705.737001 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48839 12705.737024 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48841 12705.737045 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48843 12705.737064 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48844 12705.73708 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48846 12705.737096 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48847 12705.737109 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48849 12705.737122 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4885 12705.737133 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48851 12705.737143 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48852 12705.737152 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48852 12705.73716 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48853 12705.737167 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48854 12705.737174 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48854 12705.737179 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48855 12705.737185 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48855 12705.73719 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48856 12705.737194 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48856 12705.737198 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48856 12705.737201 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48857 12705.737204 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48857 12705.737207 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48857 12705.73721 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48858 12705.737212 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48858 12705.737214 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48858 12705.737216 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48858 12705.737218 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48858 12705.737219 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48858 12705.73722 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737222 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737223 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737224 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737225 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737225 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737226 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737227 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737227 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737228 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737228 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737229 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737229 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737229 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.73723 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.73723 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.73723 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.73723 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737231 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737231 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737231 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.48859 12705.737231 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737231 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737231 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737232 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737232 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737232 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737232 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737232 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737232 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737232 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737232 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737232 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737232 13212.08 13405.07 13755.74 13755.7
137 12705.74 12150.49 12261.4886 12705.737232 13212.08 13405.07 13755.74 13755.7
 1 2 3
0.25 0.4 0.05
0.3 0.05 0.05
0.1 0.05 0.05

1 2 3
0.1 0.05 0.8
0.2 0.3 0.25
0.25 0.4 0.05

1 2 3
0.3 0.05 0.05

0.2 0.15 0.6

0.1 0.05 0.8

1 2 3
0.2 0.3 0.25
0.05 0.8 0.1
0.3 0.05 0.05

V(2,1) V(2,2) V(2,3) max(V(2,V(3,1) V(3,2) V(3,3) max(V(3,k))

0 0
-300 1000 2000 2000 -500 1500 3000 3000
465 3092.5 4362.5 4362.5 1007.5 3277.5 3765 3765
1298.288 4073.613 5159.338 5159.3 2188.075 5132.4 4598.288 5132.4
2476.124 5220.755 6360.247 6360.2 3251.559 5949.39 5776.124 5949.4
3384.435 6051.137 7138.771 7138.8 4168.38 6978.41 6684.435 6978.4
4250.405 6929.86 8045.469 8045.5 5002.426 7718.74 7550.405 7718.7
4977.438 7633.408 8728.128 8728.1 5740.267 8510.74 8277.438 8510.7
5658.37 8323.961 9431.515 9431.5 6410.07 9141.81 8958.37 9141.8
6250.566 8907.52 10006.24 10006 7008.05 9764.18 9550.566 9764.2
6795.957 9457.717 10562.12 10562 7549.018 10288.6 10095.96 10289
7278.148 9936.389 11036.98 11037 8033.891 10784.2 10578.15 10784
7717.651 10378.08 11481.16 11481 8471.532 11214.7 11017.65 11215
8109.483 10768.42 11869.85 11870 8864.557 11612.4 11409.48 11612
8464.559 11124.46 12226.98 12227 9218.832 11963.6 11764.56 11964
8782.516 11441.77 12543.57 12544 9537.311 12284.1 12082.52 12284
9069.736 11729.41 12831.69 12832 9824.184 12569.6 12369.74 12570
9327.533 11986.93 13088.89 13089 10082.21 12828.6 12627.53 12829
9560.012 12219.59 13321.76 13322 10314.54 13060.3 12860.01 13060
9768.939 12428.4 13530.43 13530 10523.56 13269.7 13068.94 13270
9957.174 12616.71 13718.83 13719 10711.73 13457.6 13257.17 13458
10126.45 12785.94 13888 13888 10881.06 13627.1 13426.45 13627
10278.89 12938.41 14040.51 14041 11033.47 13779.4 13578.89 13779
10416.03 13075.52 14177.6 14178 11170.62 13916.6 13716.03 13917
10539.49 13199 14301.1 14301 11294.07 14040 13839.49 14040
10650.58 13310.08 14412.16 14412 11405.17 14151.2 13950.58 14151
10750.58 13410.09 14512.18 14512 11505.16 14251.1 14050.58 14251
10840.56 13500.07 14602.15 14602 11595.15 14341.1 14140.56 14341
10921.56 13581.07 14683.15 14683 11676.14 14422.1 14221.56 14422
10994.45 13653.96 14756.04 14756 11749.04 14495 14294.45 14495
11060.05 13719.56 14821.65 14822 11814.64 14560.6 14360.05 14561
11119.1 13778.6 14880.69 14881 11873.68 14619.7 14419.1 14620
11172.24 13831.74 14933.83 14934 11926.82 14672.8 14472.24 14673
11220.06 13879.57 14981.66 14982 11974.65 14720.6 14520.06 14721
11263.1 13922.61 15024.7 15025 12017.69 14763.7 14563.1 14764
11301.84 13961.35 15063.44 15063 12056.43 14802.4 14601.84 14802
11336.71 13996.21 15098.3 15098 12091.29 14837.3 14636.71 14837
11368.09 14027.59 15129.68 15130 12122.67 14868.7 14668.09 14869
11396.33 14055.83 15157.92 15158 12150.91 14896.9 14696.33 14897
11421.74 14081.25 15183.34 15183 12176.33 14922.3 14721.74 14922
11444.62 14104.12 15206.21 15206 12199.2 14945.2 14744.62 14945
11465.2 14124.71 15226.8 15227 12219.79 14965.8 14765.2 14966
11483.73 14143.24 15245.33 15245 12238.32 14984.3 14783.73 14984
11500.41 14159.91 15262 15262 12254.99 15001 14800.41 15001
11515.42 14174.92 15277.01 15277 12270 15016 14815.42 15016
11528.92 14188.43 15290.52 15291 12283.51 15029.5 14828.92 15029
11541.08 14200.59 15302.67 15303 12295.67 15041.7 14841.08 15042
11552.02 14211.53 15313.61 15314 12306.61 15052.6 14852.02 15053
11561.87 14221.37 15323.46 15323 12316.45 15062.4 14861.87 15062
11570.73 14230.24 15332.32 15332 12325.32 15071.3 14870.73 15071
11578.71 14238.21 15340.3 15340 12333.29 15079.3 14878.71 15079
11585.88 14245.39 15347.48 15347 12340.47 15086.5 14885.88 15086
11592.34 14251.85 15353.94 15354 12346.93 15092.9 14892.34 15093
11598.16 14257.67 15359.75 15360 12352.74 15098.7 14898.16 15099
11603.39 14262.9 15364.99 15365 12357.98 15104 14903.39 15104
11608.1 14267.61 15369.69 15370 12362.69 15108.7 14908.1 15109
11612.34 14271.85 15373.93 15374 12366.93 15112.9 14912.34 15113
11616.16 14275.66 15377.75 15378 12370.74 15116.7 14916.16 15117
11619.59 14279.09 15381.18 15381 12374.17 15120.2 14919.59 15120
11622.68 14282.18 15384.27 15384 12377.26 15123.3 14922.68 15123
11625.46 14284.97 15387.05 15387 12380.05 15126 14925.46 15126
11627.96 14287.47 15389.56 15390 12382.55 15128.5 14927.96 15129
11630.21 14289.72 15391.81 15392 12384.8 15130.8 14930.21 15131
11632.24 14291.75 15393.84 15394 12386.83 15132.8 14932.24 15133
11634.07 14293.57 15395.66 15396 12388.65 15134.6 14934.07 15135
11635.71 14295.22 15397.3 15397 12390.29 15136.3 14935.71 15136
11637.19 14296.69 15398.78 15399 12391.77 15137.8 14937.19 15138
11638.52 14298.02 15400.11 15400 12393.1 15139.1 14938.52 15139
11639.71 14299.22 15401.31 15401 12394.3 15140.3 14939.71 15140
11640.79 14300.3 15402.39 15402 12395.38 15141.4 14940.79 15141
11641.76 14301.27 15403.35 15403 12396.35 15142.3 14941.76 15142
11642.63 14302.14 15404.23 15404 12397.22 15143.2 14942.63 15143
11643.42 14302.93 15405.01 15405 12398.01 15144 14943.42 15144
11644.13 14303.63 15405.72 15406 12398.71 15144.7 14944.13 15145
11644.76 14304.27 15406.36 15406 12399.35 15145.3 14944.76 15145
11645.34 14304.84 15406.93 15407 12399.92 15145.9 14945.34 15146
11645.85 14305.36 15407.44 15407 12400.44 15146.4 14945.85 15146
11646.31 14305.82 15407.91 15408 12400.9 15146.9 14946.31 15147
11646.73 14306.24 15408.33 15408 12401.32 15147.3 14946.73 15147
11647.11 14306.61 15408.7 15409 12401.69 15147.7 14947.11 15148
11647.45 14306.95 15409.04 15409 12402.03 15148 14947.45 15148
11647.75 14307.26 15409.34 15409 12402.34 15148.3 14947.75 15148
11648.02 14307.53 15409.62 15410 12402.61 15148.6 14948.02 15149
11648.27 14307.78 15409.86 15410 12402.86 15148.8 14948.27 15149
11648.49 14308 15410.09 15410 12403.08 15149.1 14948.49 15149
11648.69 14308.2 15410.29 15410 12403.28 15149.3 14948.69 15149
11648.87 14308.38 15410.46 15410 12403.46 15149.4 14948.87 15149
11649.03 14308.54 15410.63 15411 12403.62 15149.6 14949.03 15150
11649.18 14308.68 15410.77 15411 12403.76 15149.8 14949.18 15150
11649.31 14308.82 15410.9 15411 12403.9 15149.9 14949.31 15150
11649.43 14308.93 15411.02 15411 12404.01 15150 14949.43 15150
11649.53 14309.04 15411.13 15411 12404.12 15150.1 14949.53 15150
11649.63 14309.14 15411.22 15411 12404.22 15150.2 14949.63 15150
11649.72 14309.22 15411.31 15411 12404.3 15150.3 14949.72 15150
11649.79 14309.3 15411.39 15411 12404.38 15150.4 14949.79 15150
11649.86 14309.37 15411.46 15411 12404.45 15150.4 14949.86 15150
11649.92 14309.43 15411.52 15412 12404.51 15150.5 14949.92 15150
11649.98 14309.49 15411.57 15412 12404.57 15150.6 14949.98 15151
11650.03 14309.54 15411.63 15412 12404.62 15150.6 14950.03 15151
11650.08 14309.58 15411.67 15412 12404.66 15150.6 14950.08 15151
11650.12 14309.62 15411.71 15412 12404.7 15150.7 14950.12 15151
11650.16 14309.66 15411.75 15412 12404.74 15150.7 14950.16 15151
11650.19 14309.7 15411.78 15412 12404.77 15150.8 14950.19 15151
11650.22 14309.73 15411.81 15412 12404.8 15150.8 14950.22 15151
11650.25 14309.75 15411.84 15412 12404.83 15150.8 14950.25 15151
11650.27 14309.78 15411.86 15412 12404.86 15150.8 14950.27 15151
11650.29 14309.8 15411.89 15412 12404.88 15150.9 14950.29 15151
11650.31 14309.82 15411.91 15412 12404.9 15150.9 14950.31 15151
11650.33 14309.84 15411.92 15412 12404.92 15150.9 14950.33 15151
11650.35 14309.85 15411.94 15412 12404.93 15150.9 14950.35 15151
11650.36 14309.87 15411.95 15412 12404.95 15150.9 14950.36 15151
11650.37 14309.88 15411.97 15412 12404.96 15150.9 14950.37 15151
11650.38 14309.89 15411.98 15412 12404.97 15151 14950.38 15151
11650.39 14309.9 15411.99 15412 12404.98 15151 14950.39 15151
11650.4 14309.91 15412 15412 12404.99 15151 14950.4 15151
11650.41 14309.92 15412.01 15412 12405 15151 14950.41 15151
11650.42 14309.93 15412.01 15412 12405.01 15151 14950.42 15151
11650.43 14309.93 15412.02 15412 12405.01 15151 14950.43 15151
11650.43 14309.94 15412.03 15412 12405.02 15151 14950.43 15151
11650.44 14309.94 15412.03 15412 12405.02 15151 14950.44 15151
11650.44 14309.95 15412.04 15412 12405.03 15151 14950.44 15151
11650.45 14309.95 15412.04 15412 12405.03 15151 14950.45 15151
11650.45 14309.96 15412.05 15412 12405.04 15151 14950.45 15151
11650.46 14309.96 15412.05 15412 12405.04 15151 14950.46 15151
11650.46 14309.97 15412.05 15412 12405.04 15151 14950.46 15151
11650.46 14309.97 15412.06 15412 12405.05 15151 14950.46 15151
11650.46 14309.97 15412.06 15412 12405.05 15151 14950.46 15151
11650.47 14309.97 15412.06 15412 12405.05 15151 14950.47 15151
11650.47 14309.98 15412.06 15412 12405.06 15151 14950.47 15151
11650.47 14309.98 15412.06 15412 12405.06 15151 14950.47 15151
11650.47 14309.98 15412.07 15412 12405.06 15151 14950.47 15151
11650.47 14309.98 15412.07 15412 12405.06 15151 14950.47 15151
11650.48 14309.98 15412.07 15412 12405.06 15151 14950.48 15151
11650.48 14309.98 15412.07 15412 12405.06 15151 14950.48 15151
11650.48 14309.98 15412.07 15412 12405.06 15151.1 14950.48 15151
11650.48 14309.99 15412.07 15412 12405.07 15151.1 14950.48 15151
11650.48 14309.99 15412.07 15412 12405.07 15151.1 14950.48 15151
11650.48 14309.99 15412.07 15412 12405.07 15151.1 14950.48 15151
11650.48 14309.99 15412.08 15412 12405.07 15151.1 14950.48 15151
11650.48 14309.99 15412.08 15412 12405.07 15151.1 14950.48 15151
11650.48 14309.99 15412.08 15412 12405.07 15151.1 14950.48 15151
11650.48 14309.99 15412.08 15412 12405.07 15151.1 14950.48 15151
11650.48 14309.99 15412.08 15412 12405.07 15151.1 14950.48 15151
11650.48 14309.99 15412.08 15412 12405.07 15151.1 14950.48 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
11650.49 14309.99 15412.08 15412 12405.07 15151.1 14950.49 15151
 TPM action 0 1
state 0 1 0.3 0.25
2 0.6 0.3
3 0.8 0.1

TPM action 0 1
state 1 1 0.05 0.1
2 0.25 0.2
Gamma is not time value of money 3 0.3 0.25
e^(-gamma*time) is time value of money

gamma 0.1 TPM action 0 1

state 2 1 0.6 0.3
Buy/sell Buy/sell
some many
Reward Do nothing assets assets 2 0.05 0.2
state action=1 action =2 action =3 3 0.05 0.1
0 -50 200 500
1 -200 500 1000
2 -300 1000 2000 TPM action 0 1
3 -500 1500 3000 state 3 1 0.25 0.2
2 0.05 0.05
3 0.6 0.3
Vi(n+1)=min(over k)( c(i,k) + e^(-gamma*time) ( sum Pi,j(k)Vj(n) )
iteration V(0,1) V(0,2) V(0,3) max(V(0,kV(1,1) V(1,2) V(1,3) max(V(1,V(2,1)
0 0 0
1 -50 200 500 500 -200 500 1000 1000 -300
2 1018.788 832.0595128 903.6547 1018.79 1927.948 1494.987 1940.457 1940 387.6171
3 1594.414 1339.227348 1179.535 1594.41 2422.439 1979.614 2486.992 2487 921.454
4 1953.809 1752.005429 1418.338 1953.81 2809.114 2304.953 2823.885 2824 1367.101
5 2188.632 2012.855656 1571.956 2188.63 3132.116 2524.748 3040.689 3132 1650.48
6 2366.961 2205.675647 1680.13 2366.96 3344.773 2687.7 3208.706 3345 1857.586
7 2515.082 2348.931557 1762.3 2515.08 3497.867 2816.968 3347.201 3498 2010.829
8 2628.005 2461.090421 1827.545 2628.01 3612.802 2915.563 3452.463 3613 2131.181
9 2713.301 2546.204519 1877.223 2713.3 3703.426 2990.558 3531.81 3703 2222.652
10 2779.054 2611.516981 1915.142 2779.05 3772.583 3048.273 3593.089 3773 2292.756
11 2829.547 2661.671943 1944.291 2829.55 3825.423 3092.552 3640.135 3825 2346.595
12 2868.214 2700.114917 1966.648 2868.21 3866.013 3126.48 3676.154 3866 2387.87
13 2897.866 2729.588758 1983.783 2897.87 3897.145 3152.499 3703.779 3897 2419.513
14 2920.61 2752.192666 1996.924 2920.61 3921.009 3172.453 3724.967 3921 2443.78
15 2938.049 2769.525743 2007.001 2938.05 3939.309 3187.754 3741.214 3939 2462.389
16 2951.421 2782.816756 2014.728 2951.42 3953.343 3199.486 3753.671 3953 2476.658
17 2961.675 2793.008609 2020.654 2961.67 3964.104 3208.483 3763.224 3964 2487.6
18 2969.538 2800.82393 2025.197 2969.54 3972.355 3215.382 3770.549 3972 2495.99
19 2975.567 2806.81685 2028.682 2975.57 3978.683 3220.673 3776.167 3979 2502.424
20 2980.191 2811.41233 2031.353 2980.19 3983.535 3224.729 3780.474 3984 2507.358
21 2983.736 2814.93623 2033.402 2983.74 3987.256 3227.84 3783.777 3987 2511.141
22 2986.455 2817.63842 2034.973 2986.46 3990.109 3230.225 3786.31 3990 2514.042
23 2988.54 2819.710509 2036.178 2988.54 3992.297 3232.054 3788.252 3992 2516.267
24 2990.138 2821.299425 2037.101 2990.14 3993.974 3233.457 3789.741 3994 2517.972
25 2991.364 2822.517834 2037.81 2991.36 3995.261 3234.533 3790.883 3995 2519.28
26 2992.304 2823.452133 2038.353 2992.3 3996.247 3235.357 3791.759 3996 2520.283
27 2993.025 2824.16857 2038.769 2993.03 3997.004 3235.99 3792.43 3997 2521.053
28 2993.578 2824.717947 2039.089 2993.58 3997.584 3236.475 3792.945 3998 2521.642
29 2994.002 2825.13922 2039.334 2994 3998.029 3236.847 3793.34 3998 2522.095
30 2994.327 2825.462259 2039.522 2994.33 3998.37 3237.132 3793.643 3998 2522.442
31 2994.576 2825.709972 2039.666 2994.58 3998.631 3237.351 3793.875 3999 2522.707
32 2994.767 2825.899922 2039.776 2994.77 3998.832 3237.518 3794.053 3999 2522.911
33 2994.914 2826.04558 2039.861 2994.91 3998.986 3237.647 3794.19 3999 2523.068
34 2995.026 2826.157273 2039.926 2995.03 3999.103 3237.745 3794.294 3999 2523.188
35 2995.112 2826.242921 2039.975 2995.11 3999.194 3237.821 3794.375 3999 2523.28
36 2995.178 2826.308597 2040.014 2995.18 3999.263 3237.879 3794.436 3999 2523.35
37 2995.229 2826.358959 2040.043 2995.23 3999.316 3237.923 3794.483 3999 2523.404
38 2995.268 2826.397578 2040.065 2995.27 3999.357 3237.958 3794.52 3999 2523.446
39 2995.298 2826.427191 2040.083 2995.3 3999.388 3237.984 3794.547 3999 2523.477
40 2995.32 2826.449899 2040.096 2995.32 3999.412 3238.004 3794.569 3999 2523.502
41 2995.338 2826.467312 2040.106 2995.34 3999.431 3238.019 3794.585 3999 2523.521
42 2995.351 2826.480665 2040.114 2995.35 3999.445 3238.031 3794.597 3999 2523.535
43 2995.362 2826.490904 2040.12 2995.36 3999.456 3238.04 3794.607 3999 2523.546
44 2995.37 2826.498755 2040.124 2995.37 3999.464 3238.047 3794.614 3999 2523.554
45 2995.376 2826.504776 2040.128 2995.38 3999.47 3238.052 3794.62 3999 2523.561
46 2995.38 2826.509393 2040.13 2995.38 3999.475 3238.056 3794.624 3999 2523.566
47 2995.384 2826.512933 2040.132 2995.38 3999.479 3238.059 3794.628 3999 2523.57
48 2995.387 2826.515647 2040.134 2995.39 3999.482 3238.062 3794.63 3999 2523.572
49 2995.389 2826.517729 2040.135 2995.39 3999.484 3238.064 3794.632 3999 2523.575
50 2995.39 2826.519325 2040.136 2995.39 3999.486 3238.065 3794.634 3999 2523.576
51 2995.391 2826.520549 2040.137 2995.39 3999.487 3238.066 3794.635 3999 2523.578
52 2995.392 2826.521488 2040.137 2995.39 3999.488 3238.067 3794.636 3999 2523.579
53 2995.393 2826.522208 2040.138 2995.39 3999.489 3238.068 3794.636 3999 2523.579
54 2995.394 2826.52276 2040.138 2995.39 3999.489 3238.068 3794.637 3999 2523.58
55 2995.394 2826.523183 2040.138 2995.39 3999.49 3238.068 3794.637 3999 2523.581
56 2995.394 2826.523508 2040.139 2995.39 3999.49 3238.069 3794.638 3999 2523.581
57 2995.395 2826.523756 2040.139 2995.39 3999.49 3238.069 3794.638 3999 2523.581
58 2995.395 2826.523947 2040.139 2995.39 3999.491 3238.069 3794.638 3999 2523.581
59 2995.395 2826.524094 2040.139 2995.4 3999.491 3238.069 3794.638 3999 2523.582
60 2995.395 2826.524206 2040.139 2995.4 3999.491 3238.069 3794.638 3999 2523.582
61 2995.395 2826.524292 2040.139 2995.4 3999.491 3238.069 3794.638 3999 2523.582
62 2995.395 2826.524358 2040.139 2995.4 3999.491 3238.069 3794.638 3999 2523.582
63 2995.395 2826.524408 2040.139 2995.4 3999.491 3238.069 3794.638 3999 2523.582
64 2995.395 2826.524447 2040.139 2995.4 3999.491 3238.069 3794.639 3999 2523.582
65 2995.395 2826.524477 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
66 2995.395 2826.5245 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
67 2995.395 2826.524517 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
68 2995.395 2826.524531 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
69 2995.395 2826.524541 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
70 2995.395 2826.524549 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
71 2995.395 2826.524555 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
72 2995.395 2826.524559 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
73 2995.395 2826.524563 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
74 2995.395 2826.524566 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
 75 2995.395 2826.524568 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
76 2995.395 2826.524569 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
77 2995.395 2826.524571 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
78 2995.395 2826.524572 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
79 2995.395 2826.524572 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
80 2995.395 2826.524573 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
81 2995.395 2826.524573 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
82 2995.395 2826.524574 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
83 2995.395 2826.524574 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
84 2995.395 2826.524574 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
85 2995.395 2826.524574 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
86 2995.395 2826.524574 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
87 2995.395 2826.524574 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
88 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
89 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
90 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
91 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
92 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
93 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
94 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
95 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
96 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
97 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
98 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
99 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
100 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
101 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
102 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
103 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
104 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
105 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
106 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
107 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
108 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
109 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
110 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
111 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
112 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
113 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
114 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
115 2995.395 2826.524575 2040.139 2995.4 3999.491 3238.07 3794.639 3999 2523.582
 2 3 TTM action 0 1 2 3
0.4 0.05 state 0 1 1 2 3 1
0.05 0.05 2 3 2 2 6
0.05 0.05 3 10 2 3 4

2 3 TPM action 0 1 2 3
0.05 0.8 state 1 1 2 2 5 2
0.3 0.25 2 1 1 5 8
0.4 0.05 3 2 1 4 10

2 3 TPM action 0 1 2 3
0.05 0.05 state 2 1 2 2 5 1

0.15 0.6 2 3 1 8 6
0.05 0.8 3 1 2 1 15

2 3 TPM action 0 1 2 3
0.3 0.25 state 3 1 1 5 2 2
0.8 0.1 2 1 3 3 5
0.05 0.05 3 1 6 3 9

V(2,2) V(2,3) max(V(2,V(3,1) V(3,2) V(3,3) max(V(3,k))

0 0
1000 2000 2000 -500 1500 3000 3000
2322.148 2730.49 2730.5 839.6973 2926.93 3571.162 3571
2748.867 2965.963 2966 1367.465 3452.808 4046.323 4046
3041.429 3132.223 3132.2 1719.068 3667.468 4467.196 4467
3265.502 3258.715 3265.5 1968.216 3820.269 4732.494 4732
3426.321 3347.961 3426.3 2145.763 3937.389 4921.058 4921
3544.342 3414.375 3544.3 2289.996 4060.081 5062.676 5063
3632.121 3464.229 3632.1 2400.048 4150.988 5175.547 5176
3700.186 3502.868 3700.2 2484.198 4219.223 5261.323 5261
3752.578 3532.537 3752.6 2548.761 4271.981 5326.816 5327
3792.626 3555.235 3792.6 2598.298 4312.54 5377.172 5377
3823.339 3572.646 3823.3 2636.273 4343.57 5415.791 5416
3846.904 3586.002 3846.9 2665.392 4367.368 5445.389 5445
3864.971 3596.242 3865 2687.722 4385.623 5468.088 5468
3878.824 3604.094 3878.8 2704.846 4399.62 5485.495 5485
3889.447 3610.115 3889.4 2717.976 4410.353 5498.842 5499
3897.593 3614.732 3897.6 2728.044 4418.583 5509.077 5509
3903.84 3618.273 3903.8 2735.765 4424.895 5516.926 5517
3908.63 3620.987 3908.6 2741.686 4429.734 5522.944 5523
3912.303 3623.069 3912.3 2746.226 4433.445 5527.559 5528
3915.119 3624.666 3915.1 2749.707 4436.291 5531.098 5531
3917.279 3625.89 3917.3 2752.376 4438.473 5533.812 5534
3918.935 3626.829 3918.9 2754.423 4440.146 5535.893 5536
3920.205 3627.548 3920.2 2755.993 4441.429 5537.488 5537
3921.179 3628.1 3921.2 2757.197 4442.413 5538.712 5539
3921.926 3628.524 3921.9 2758.12 4443.168 5539.65 5540
3922.498 3628.848 3922.5 2758.827 4443.746 5540.37 5540
3922.938 3629.097 3922.9 2759.37 4444.19 5540.922 5541
3923.274 3629.288 3923.3 2759.786 4444.53 5541.345 5541
3923.532 3629.434 3923.5 2760.105 4444.791 5541.669 5542
3923.73 3629.547 3923.7 2760.35 4444.991 5541.918 5542
3923.882 3629.633 3923.9 2760.538 4445.144 5542.109 5542
3923.999 3629.699 3924 2760.682 4445.262 5542.255 5542
3924.088 3629.749 3924.1 2760.792 4445.352 5542.367 5542
3924.156 3629.788 3924.2 2760.877 4445.421 5542.453 5542
3924.209 3629.818 3924.2 2760.942 4445.474 5542.519 5543
3924.249 3629.841 3924.2 2760.991 4445.515 5542.57 5543
3924.28 3629.858 3924.3 2761.029 4445.546 5542.608 5543
3924.304 3629.871 3924.3 2761.059 4445.57 5542.638 5543
3924.322 3629.882 3924.3 2761.081 4445.588 5542.661 5543
3924.336 3629.89 3924.3 2761.098 4445.602 5542.678 5543
3924.346 3629.896 3924.3 2761.112 4445.613 5542.692 5543
3924.355 3629.9 3924.4 2761.122 4445.622 5542.702 5543
3924.361 3629.904 3924.4 2761.129 4445.628 5542.71 5543
3924.366 3629.907 3924.4 2761.135 4445.633 5542.716 5543
3924.369 3629.909 3924.4 2761.14 4445.636 5542.721 5543
3924.372 3629.91 3924.4 2761.143 4445.639 5542.724 5543
3924.374 3629.911 3924.4 2761.146 4445.641 5542.727 5543
3924.376 3629.912 3924.4 2761.148 4445.643 5542.729 5543
3924.377 3629.913 3924.4 2761.15 4445.644 5542.731 5543
3924.378 3629.914 3924.4 2761.151 4445.645 5542.732 5543
3924.379 3629.914 3924.4 2761.152 4445.646 5542.733 5543
3924.38 3629.914 3924.4 2761.153 4445.647 5542.733 5543
3924.38 3629.915 3924.4 2761.153 4445.647 5542.734 5543
3924.38 3629.915 3924.4 2761.154 4445.648 5542.734 5543
3924.381 3629.915 3924.4 2761.154 4445.648 5542.735 5543
3924.381 3629.915 3924.4 2761.154 4445.648 5542.735 5543
3924.381 3629.915 3924.4 2761.154 4445.648 5542.735 5543
3924.381 3629.915 3924.4 2761.154 4445.648 5542.735 5543
3924.381 3629.915 3924.4 2761.155 4445.648 5542.735 5543
3924.381 3629.915 3924.4 2761.155 4445.648 5542.736 5543
3924.381 3629.915 3924.4 2761.155 4445.649 5542.736 5543
3924.381 3629.915 3924.4 2761.155 4445.649 5542.736 5543
3924.381 3629.915 3924.4 2761.155 4445.649 5542.736 5543
3924.381 3629.915 3924.4 2761.155 4445.649 5542.736 5543
3924.381 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
3924.382 3629.916 3924.4 2761.155 4445.649 5542.736 5543
 1.2

0.8
For MDP For SMDP
t e^(-gamma*time)
0 1 0.6
0.9 1 0.904837418
0.81 2 0.8187307531
0.729 3 0.7408182207 0.4
0.6561 4 0.670320046
0.59049 5 0.6065306597
0.2
0.531441 6 0.5488116361
1
0.430467 8 0.4493289641
0
0.38742 9 0.4065696597
1234567891111111111222222222233333333334444444444555555555566666666667
0.348678 10 0.3678794412 0123456789012345678901234567890123456789012345678901234567890
0.313811 11 0.3328710837
0.28243 12 0.3011942119
0.254187 13 0.272531793
0.228768 14 0.2465969639
0.205891 15 0.2231301601
16 0.201896518
17 0.1826835241
18 0.1652988882
19 0.1495686192
20 0.1353352832
21 0.1224564283
22 0.1108031584
23 0.1002588437
24 0.0907179533
25 0.0820849986
26 0.0742735782
27 0.0672055127
28 0.0608100626
29 0.0550232201
30 0.0497870684
31 0.0450492024
32 0.040762204
33 0.0368831674
34 0.03337327
35 0.0301973834
36 0.0273237224
37 0.0247235265
38 0.0223707719
39 0.0202419114
40 0.0183156389
41 0.0165726754
42 0.0149955768
43 0.013568559
44 0.0122773399
45 0.0111089965
46 0.0100518357
47 0.0090952771
48 0.008229747
49 0.0074465831
50 0.006737947
51 0.0060967466
52 0.0055165644
53 0.0049915939
54 0.0045165809
55 0.0040867714
56 0.0036978637
57 0.0033459655
58 0.0030275547
59 0.0027394448
60 0.0024787522
61 0.0022428677
62 0.0020294306
63 0.0018363048
64 0.0016615573
65 0.0015034392
66 0.001360368
67 0.0012309119
68 0.0011137751
69 0.0010077854
70 0.000911882
71 0.0008251049
72 0.0007465858
73 0.0006755388
74 0.0006112528
75 0.0005530844
76 0.0005004514
77 0.0004528272
78 0.000409735
79 0.0003707435
80 0.0003354626
 Column W

444444455555555556666666666777777777788
345678901234567890123456789012345678901