Round 2 | ****EPOCH 0****
Step 00000050 L_out=0.033 Acc=0.20 ---25503.73 ms/batch
Step 00000100 L_out=0.121 Acc=0.52 ---48783.72 ms/batch
Step 00000150 L_out=0.050 Acc=0.36 ---72118.40 ms/batch
Step 00000200 L_out=0.678 Acc=0.29 ---95745.63 ms/batch
Step 00000250 L_out=0.085 Acc=0.25 ---119187.15 ms/batch
Step 00000300 L_out=0.096 Acc=0.22 ---142819.05 ms/batch
Step 00000350 L_out=1.092 Acc=0.14 ---166337.24 ms/batch
Step 00000400 L_out=0.055 Acc=0.09 ---189725.23 ms/batch
Step 00000450 L_out=0.098 Acc=0.37 ---213257.12 ms/batch
Step 00000500 L_out=0.234 Acc=0.44 ---236641.47 ms/batch
Step 00000550 L_out=0.116 Acc=0.34 ---260105.22 ms/batch
Step 00000600 L_out=0.216 Acc=0.34 ---283312.71 ms/batch
Step 00000650 L_out=0.309 Acc=0.24 ---306661.54 ms/batch
Round 2 | epoch=0, train costTime=314.56080770492554, | total_activation_sum=3742561
Round 2 | ****EPOCH 1****
Step 00000700 L_out=0.058 Acc=0.34 ---15474.19 ms/batch
Step 00000750 L_out=0.064 Acc=0.52 ---38650.68 ms/batch
Step 00000800 L_out=0.726 Acc=0.45 ---62087.28 ms/batch
Step 00000850 L_out=0.155 Acc=0.37 ---85889.49 ms/batch
Step 00000900 L_out=0.043 Acc=0.44 ---109368.06 ms/batch
Step 00000950 L_out=0.252 Acc=0.40 ---132819.48 ms/batch
Step 00001000 L_out=0.062 Acc=0.15 ---156247.72 ms/batch
Step 00001050 L_out=0.135 Acc=0.31 ---179562.85 ms/batch
Step 00001100 L_out=0.098 Acc=0.44 ---203047.86 ms/batch
Step 00001150 L_out=0.363 Acc=0.41 ---226260.46 ms/batch
Step 00001200 L_out=0.098 Acc=0.39 ---249634.19 ms/batch
Step 00001250 L_out=0.028 Acc=0.57 ---272992.71 ms/batch
Step 00001300 L_out=0.142 Acc=0.27 ---296200.60 ms/batch
Round 2 | epoch=1, train costTime=312.10830998420715, | total_activation_sum=3425619
Round 2 | ****EPOCH 2****
Step 00001350 L_out=0.155 Acc=0.51 --- 7611.55 ms/batch
Step 00001400 L_out=0.122 Acc=0.39 ---31101.94 ms/batch
Step 00001450 L_out=0.012 Acc=0.40 ---54592.52 ms/batch
Step 00001500 L_out=0.222 Acc=0.41 ---78066.08 ms/batch
Step 00001550 L_out=0.297 Acc=0.39 ---101540.06 ms/batch
Step 00001600 L_out=0.815 Acc=0.45 ---124878.24 ms/batch
Step 00001650 L_out=0.109 Acc=0.65 ---148271.73 ms/batch
Step 00001700 L_out=0.098 Acc=0.58 ---171912.23 ms/batch
Step 00001750 L_out=0.294 Acc=0.24 ---195269.40 ms/batch
Step 00001800 L_out=0.199 Acc=0.51 ---218697.01 ms/batch
Step 00001850 L_out=0.041 Acc=0.51 ---241952.53 ms/batch
Step 00001900 L_out=0.321 Acc=0.48 ---265395.63 ms/batch
Step 00001950 L_out=0.195 Acc=0.77 ---288815.87 ms/batch
Step 00002000 L_out=0.223 Acc=0.40 ---312394.88 ms/batch
Round 2 | epoch=2, train costTime=312.87224078178406, | total_activation_sum=3528026
Round 2 | ****EPOCH 3****
Step 00002050 L_out=0.225 Acc=0.54 ---22893.33 ms/batch
Step 00002100 L_out=0.055 Acc=0.43 ---46382.58 ms/batch
Step 00002150 L_out=0.303 Acc=0.47 ---69647.25 ms/batch
Step 00002200 L_out=0.134 Acc=0.53 ---92997.12 ms/batch
Step 00002250 L_out=0.130 Acc=0.41 ---116333.10 ms/batch
Step 00002300 L_out=0.065 Acc=0.57 ---139822.44 ms/batch
Step 00002350 L_out=0.052 Acc=0.59 ---163001.48 ms/batch
Step 00002400 L_out=0.127 Acc=0.40 ---186500.17 ms/batch
Step 00002450 L_out=0.160 Acc=0.54 ---210083.76 ms/batch
Step 00002500 L_out=0.037 Acc=0.59 ---233331.02 ms/batch
Step 00002550 L_out=0.032 Acc=0.74 ---256792.08 ms/batch
Step 00002600 L_out=0.061 Acc=0.36 ---280226.45 ms/batch
Step 00002650 L_out=0.248 Acc=0.59 ---303634.71 ms/batch
Round 2 | epoch=3, train costTime=312.0592694282532, | total_activation_sum=3483004
Round 2 | ****EPOCH 4****
Step 00002700 L_out=0.162 Acc=0.41 ---14997.71 ms/batch
Step 00002750 L_out=0.047 Acc=0.51 ---38389.71 ms/batch
Step 00002800 L_out=0.146 Acc=0.49 ---61879.72 ms/batch
Step 00002850 L_out=0.086 Acc=0.59 ---85163.07 ms/batch
Step 00002900 L_out=0.126 Acc=0.59 ---108402.69 ms/batch
Step 00002950 L_out=0.317 Acc=0.61 ---131892.76 ms/batch
Step 00003000 L_out=0.092 Acc=0.78 ---155068.28 ms/batch
Step 00003050 L_out=0.065 Acc=0.34 ---178190.13 ms/batch
Step 00003100 L_out=0.325 Acc=0.39 ---201404.59 ms/batch
Step 00003150 L_out=0.087 Acc=0.68 ---224771.20 ms/batch
Step 00003200 L_out=0.338 Acc=0.82 ---248149.31 ms/batch
Step 00003250 L_out=0.084 Acc=0.56 ---271461.15 ms/batch
Step 00003300 L_out=0.116 Acc=0.63 ---294890.86 ms/batch
Round 2 | epoch=4, train costTime=311.18666529655457, | total_activation_sum=3496535
Round 2 | ****EPOCH 5****
Step 00003350 L_out=0.122 Acc=0.74 --- 7006.61 ms/batch
Step 00003400 L_out=0.088 Acc=0.34 ---30476.40 ms/batch
Step 00003450 L_out=0.308 Acc=0.58 ---53904.08 ms/batch
Step 00003500 L_out=0.132 Acc=0.69 ---77329.81 ms/batch
Step 00003550 L_out=0.256 Acc=0.54 ---100828.18 ms/batch
Step 00003600 L_out=0.027 Acc=0.41 ---124336.85 ms/batch
Step 00003650 L_out=0.023 Acc=0.79 ---147684.71 ms/batch
Step 00003700 L_out=0.043 Acc=0.59 ---171114.15 ms/batch
Step 00003750 L_out=0.136 Acc=0.42 ---194608.48 ms/batch
Step 00003800 L_out=0.066 Acc=0.52 ---218098.31 ms/batch
Step 00003850 L_out=0.138 Acc=0.40 ---241577.67 ms/batch
Step 00003900 L_out=0.127 Acc=0.70 ---264952.80 ms/batch
Step 00003950 L_out=0.140 Acc=0.75 ---288346.10 ms/batch
Step 00004000 L_out=0.032 Acc=0.53 ---311643.97 ms/batch
Round 2 | epoch=5, train costTime=312.5638403892517, | total_activation_sum=3468216
Round 2 | ****EPOCH 6****
Step 00004050 L_out=0.129 Acc=0.61 ---22566.34 ms/batch
Step 00004100 L_out=0.070 Acc=0.60 ---45968.54 ms/batch
Step 00004150 L_out=0.035 Acc=0.63 ---69409.30 ms/batch
Step 00004200 L_out=0.071 Acc=0.63 ---92593.91 ms/batch
Step 00004250 L_out=0.188 Acc=0.77 ---115897.41 ms/batch
Step 00004300 L_out=0.432 Acc=0.76 ---139112.71 ms/batch
Step 00004350 L_out=0.209 Acc=0.62 ---162367.00 ms/batch
Step 00004400 L_out=0.038 Acc=0.62 ---185628.08 ms/batch
Step 00004450 L_out=0.387 Acc=0.58 ---208993.73 ms/batch
Step 00004500 L_out=0.097 Acc=0.59 ---232630.16 ms/batch
Step 00004550 L_out=0.247 Acc=0.70 ---256293.40 ms/batch
Step 00004600 L_out=0.105 Acc=0.66 ---279974.67 ms/batch
Step 00004650 L_out=0.036 Acc=0.56 ---303324.09 ms/batch
Round 2 | epoch=6, train costTime=312.2464668750763, | total_activation_sum=3620286
Round 2 | ****EPOCH 7****
Step 00004700 L_out=0.145 Acc=0.64 ---14447.67 ms/batch
Step 00004750 L_out=0.528 Acc=0.77 ---37950.59 ms/batch
Step 00004800 L_out=0.032 Acc=0.48 ---61247.05 ms/batch
Step 00004850 L_out=0.064 Acc=0.83 ---84515.18 ms/batch
Step 00004900 L_out=0.047 Acc=0.28 ---107807.35 ms/batch
Step 00004950 L_out=0.136 Acc=0.61 ---131356.73 ms/batch
Step 00005000 L_out=0.146 Acc=0.69 ---154698.23 ms/batch
Step 00005050 L_out=0.017 Acc=0.65 ---177910.31 ms/batch
Step 00005100 L_out=0.114 Acc=0.49 ---201518.92 ms/batch
Step 00005150 L_out=0.116 Acc=0.74 ---224903.50 ms/batch
Step 00005200 L_out=0.057 Acc=0.69 ---248320.06 ms/batch
Step 00005250 L_out=0.113 Acc=0.66 ---271517.64 ms/batch
Step 00005300 L_out=0.010 Acc=0.75 ---294986.78 ms/batch
Round 2 | epoch=7, train costTime=311.7083008289337, | total_activation_sum=3504662
Round 2 | ****EPOCH 8****
Step 00005350 L_out=0.185 Acc=0.73 --- 6638.22 ms/batch
Step 00005400 L_out=0.048 Acc=0.33 ---30297.03 ms/batch
Step 00005450 L_out=0.095 Acc=0.69 ---53462.12 ms/batch
Step 00005500 L_out=0.343 Acc=0.72 ---76862.87 ms/batch
Step 00005550 L_out=0.063 Acc=0.42 ---100191.04 ms/batch
Step 00005600 L_out=0.185 Acc=0.64 ---123501.44 ms/batch
Step 00005650 L_out=0.058 Acc=0.65 ---146650.14 ms/batch
Step 00005700 L_out=0.252 Acc=0.26 ---169917.32 ms/batch
Step 00005750 L_out=0.075 Acc=0.58 ---193369.83 ms/batch
Step 00005800 L_out=0.155 Acc=0.77 ---216777.21 ms/batch
Step 00005850 L_out=0.253 Acc=0.69 ---240037.37 ms/batch
Step 00005900 L_out=0.008 Acc=0.79 ---263556.11 ms/batch
Step 00005950 L_out=0.198 Acc=0.62 ---287056.47 ms/batch
Step 00006000 L_out=0.007 Acc=0.63 ---310581.42 ms/batch
Round 2 | epoch=8, train costTime=311.9877095222473, | total_activation_sum=3505397
Round 2 | ****EPOCH 9****
Step 00006050 L_out=0.215 Acc=0.57 ---22033.96 ms/batch
Step 00006100 L_out=0.097 Acc=0.58 ---45595.20 ms/batch
Step 00006150 L_out=0.051 Acc=0.52 ---69235.02 ms/batch
Step 00006200 L_out=0.110 Acc=0.69 ---92482.01 ms/batch
Step 00006250 L_out=0.085 Acc=0.36 ---115920.82 ms/batch
Step 00006300 L_out=0.021 Acc=0.54 ---139286.17 ms/batch
Step 00006350 L_out=0.192 Acc=0.65 ---162438.05 ms/batch
Step 00006400 L_out=0.234 Acc=0.49 ---185915.86 ms/batch
Step 00006450 L_out=0.539 Acc=0.67 ---209391.40 ms/batch
Step 00006500 L_out=0.090 Acc=0.50 ---232784.90 ms/batch
Step 00006550 L_out=0.088 Acc=0.51 ---256037.82 ms/batch
Step 00006600 L_out=0.059 Acc=0.67 ---279223.50 ms/batch
Step 00006650 L_out=0.326 Acc=0.81 ---302440.94 ms/batch
Round 2 | epoch=9, train costTime=311.88476371765137, | total_activation_sum=3481045
Round 2 | ****EPOCH 10****
Step 00006700 L_out=0.256 Acc=0.72 ---13968.28 ms/batch
Step 00006750 L_out=0.089 Acc=0.64 ---37214.51 ms/batch
Step 00006800 L_out=0.101 Acc=0.72 ---60750.11 ms/batch
Step 00006850 L_out=0.124 Acc=0.63 ---84075.31 ms/batch
Step 00006900 L_out=0.018 Acc=0.70 ---107593.46 ms/batch
Step 00006950 L_out=0.029 Acc=0.55 ---131296.13 ms/batch
Step 00007000 L_out=0.090 Acc=0.68 ---154741.31 ms/batch
Step 00007050 L_out=0.080 Acc=0.61 ---178288.52 ms/batch
Step 00007100 L_out=0.067 Acc=0.62 ---201578.84 ms/batch
Step 00007150 L_out=0.288 Acc=0.65 ---224914.60 ms/batch
Step 00007200 L_out=0.059 Acc=0.54 ---248308.39 ms/batch
Step 00007250 L_out=0.120 Acc=0.74 ---271810.00 ms/batch
Step 00007300 L_out=0.096 Acc=0.78 ---295098.02 ms/batch
Round 2 | epoch=10, train costTime=312.17236280441284, | total_activation_sum=3481189
Round 2 | ****EPOCH 11****
Step 00007350 L_out=0.118 Acc=0.71 --- 6053.45 ms/batch
Step 00007400 L_out=0.039 Acc=0.67 ---29567.68 ms/batch
Step 00007450 L_out=0.220 Acc=0.78 ---53033.34 ms/batch
Step 00007500 L_out=0.142 Acc=0.36 ---76263.73 ms/batch
Step 00007550 L_out=0.060 Acc=0.46 ---99846.07 ms/batch
Step 00007600 L_out=0.019 Acc=0.56 ---123204.49 ms/batch
Step 00007650 L_out=0.101 Acc=0.63 ---146360.88 ms/batch
Step 00007700 L_out=0.053 Acc=0.79 ---169726.21 ms/batch
Step 00007750 L_out=0.078 Acc=0.64 ---193112.40 ms/batch
Step 00007800 L_out=0.022 Acc=0.53 ---216532.92 ms/batch
Step 00007850 L_out=0.067 Acc=0.57 ---239951.59 ms/batch
Step 00007900 L_out=0.032 Acc=0.73 ---263414.25 ms/batch
Step 00007950 L_out=0.323 Acc=0.52 ---286931.85 ms/batch
Step 00008000 L_out=0.032 Acc=0.74 ---310426.42 ms/batch
Round 2 | epoch=11, train costTime=312.2457513809204, | total_activation_sum=3624679
Round 2 | ****EPOCH 12****
Step 00008050 L_out=0.309 Acc=0.45 ---21481.57 ms/batch
Step 00008100 L_out=0.153 Acc=0.63 ---44892.13 ms/batch
Step 00008150 L_out=0.019 Acc=0.91 ---68069.47 ms/batch
Step 00008200 L_out=0.042 Acc=0.74 ---91325.99 ms/batch
Step 00008250 L_out=0.067 Acc=0.67 ---114707.79 ms/batch
Step 00008300 L_out=0.127 Acc=0.63 ---138368.39 ms/batch
Step 00008350 L_out=0.021 Acc=0.84 ---161788.32 ms/batch
Step 00008400 L_out=0.222 Acc=0.60 ---185270.43 ms/batch
Step 00008450 L_out=0.050 Acc=0.58 ---208652.10 ms/batch
Step 00008500 L_out=0.086 Acc=0.71 ---231962.91 ms/batch
Step 00008550 L_out=0.207 Acc=0.72 ---255391.57 ms/batch
Step 00008600 L_out=0.161 Acc=0.75 ---278592.34 ms/batch
Step 00008650 L_out=0.068 Acc=0.70 ---302108.66 ms/batch
Round 2 | epoch=12, train costTime=312.01608324050903, | total_activation_sum=3527582
Round 2 | ****EPOCH 13****
Step 00008700 L_out=0.066 Acc=0.76 ---13650.48 ms/batch
Step 00008750 L_out=0.079 Acc=0.76 ---37132.74 ms/batch
Step 00008800 L_out=0.041 Acc=0.75 ---60617.75 ms/batch
Step 00008850 L_out=0.053 Acc=0.75 ---83899.63 ms/batch
Step 00008900 L_out=0.060 Acc=0.71 ---107169.17 ms/batch
Step 00008950 L_out=0.078 Acc=0.81 ---130391.28 ms/batch
Step 00009000 L_out=0.004 Acc=0.77 ---153867.48 ms/batch
Step 00009050 L_out=0.070 Acc=0.43 ---177059.71 ms/batch
Step 00009100 L_out=0.122 Acc=0.77 ---200449.26 ms/batch
Step 00009150 L_out=0.179 Acc=0.56 ---223714.01 ms/batch
Step 00009200 L_out=0.082 Acc=0.74 ---246958.86 ms/batch
Step 00009250 L_out=0.098 Acc=0.76 ---270778.88 ms/batch
Step 00009300 L_out=0.031 Acc=0.74 ---294317.04 ms/batch
Round 2 | epoch=13, train costTime=311.94265246391296, | total_activation_sum=3408890
Round 2 | ****EPOCH 14****
Step 00009350 L_out=0.062 Acc=0.67 --- 5605.99 ms/batch
Step 00009400 L_out=0.220 Acc=0.63 ---29005.74 ms/batch
Step 00009450 L_out=0.177 Acc=0.79 ---52300.23 ms/batch
Step 00009500 L_out=0.055 Acc=0.73 ---75809.12 ms/batch
Step 00009550 L_out=0.139 Acc=0.72 ---98989.34 ms/batch
Step 00009600 L_out=0.418 Acc=0.81 ---122448.38 ms/batch
Step 00009650 L_out=0.011 Acc=0.57 ---145971.69 ms/batch
Step 00009700 L_out=0.068 Acc=0.72 ---169215.76 ms/batch
Step 00009750 L_out=0.152 Acc=0.21 ---192742.45 ms/batch
Step 00009800 L_out=0.023 Acc=0.67 ---215913.75 ms/batch
Step 00009850 L_out=0.067 Acc=0.73 ---239204.86 ms/batch
Step 00009900 L_out=0.054 Acc=0.83 ---262667.31 ms/batch
Step 00009950 L_out=0.168 Acc=0.57 ---286113.87 ms/batch
Step 00010000 L_out=0.208 Acc=0.78 ---309630.53 ms/batch
Round 2 | epoch=14, train costTime=311.9317469596863, | total_activation_sum=3484490
Round 2 | ****EPOCH 15****
Step 00010050 L_out=0.022 Acc=0.75 ---20996.58 ms/batch
Step 00010100 L_out=0.030 Acc=0.58 ---44281.94 ms/batch
Step 00010150 L_out=0.044 Acc=0.80 ---67639.80 ms/batch
Step 00010200 L_out=0.133 Acc=0.73 ---90836.85 ms/batch
Step 00010250 L_out=0.119 Acc=0.70 ---114430.97 ms/batch
Step 00010300 L_out=0.037 Acc=0.69 ---138005.93 ms/batch
Step 00010350 L_out=0.014 Acc=0.67 ---161279.16 ms/batch
Step 00010400 L_out=0.087 Acc=0.67 ---184808.68 ms/batch
Step 00010450 L_out=0.096 Acc=0.81 ---208166.02 ms/batch
Step 00010500 L_out=0.062 Acc=0.56 ---231538.16 ms/batch
Step 00010550 L_out=0.086 Acc=0.60 ---254759.69 ms/batch
Step 00010600 L_out=0.061 Acc=0.78 ---278221.32 ms/batch
Step 00010650 L_out=0.016 Acc=0.63 ---301472.02 ms/batch
Round 2 | epoch=15, train costTime=311.58316469192505, | total_activation_sum=3526480
Round 2 | ****EPOCH 16****
Step 00010700 L_out=0.061 Acc=0.83 ---13046.99 ms/batch
Step 00010750 L_out=0.059 Acc=0.73 ---36538.64 ms/batch
Step 00010800 L_out=0.059 Acc=0.75 ---59849.79 ms/batch
Step 00010850 L_out=0.281 Acc=0.53 ---83082.45 ms/batch
Step 00010900 L_out=0.063 Acc=0.80 ---106605.70 ms/batch
Step 00010950 L_out=0.033 Acc=0.66 ---130073.08 ms/batch
Step 00011000 L_out=0.055 Acc=0.58 ---153456.17 ms/batch
Step 00011050 L_out=0.011 Acc=0.69 ---176725.95 ms/batch
Step 00011100 L_out=0.033 Acc=0.70 ---200181.41 ms/batch
Step 00011150 L_out=0.117 Acc=0.81 ---223463.59 ms/batch
Step 00011200 L_out=0.011 Acc=0.64 ---246666.13 ms/batch
Step 00011250 L_out=0.050 Acc=0.78 ---270028.21 ms/batch
Step 00011300 L_out=0.100 Acc=0.73 ---293315.08 ms/batch
Round 2 | epoch=16, train costTime=311.58194851875305, | total_activation_sum=3599223
Round 2 | ****EPOCH 17****
Step 00011350 L_out=0.211 Acc=0.71 --- 5138.26 ms/batch
Step 00011400 L_out=0.118 Acc=0.69 ---28463.02 ms/batch
Step 00011450 L_out=0.075 Acc=0.71 ---51994.80 ms/batch
Step 00011500 L_out=0.085 Acc=0.89 ---75316.00 ms/batch
Step 00011550 L_out=0.116 Acc=0.72 ---98756.30 ms/batch
Step 00011600 L_out=0.038 Acc=0.73 ---122298.93 ms/batch
Step 00011650 L_out=0.106 Acc=0.90 ---145698.19 ms/batch
Step 00011700 L_out=0.092 Acc=0.60 ---169126.65 ms/batch
Step 00011750 L_out=0.059 Acc=0.82 ---192401.70 ms/batch
Step 00011800 L_out=0.020 Acc=0.65 ---215677.87 ms/batch
Step 00011850 L_out=0.008 Acc=0.74 ---238863.45 ms/batch
Step 00011900 L_out=0.099 Acc=0.53 ---262407.39 ms/batch
Step 00011950 L_out=0.105 Acc=0.67 ---285870.80 ms/batch
Step 00012000 L_out=0.120 Acc=0.77 ---309380.91 ms/batch
Round 2 | epoch=17, train costTime=312.1416320800781, | total_activation_sum=3484875
Round 2 | epoch=18, current m_iou=0.4328952373742505
Round 2 | Best m_IoU is: 0.433, OA is: 0.805 | val costTime=118.28798341751099
Round 2 | ****EPOCH 18****
Step 00012050 L_out=0.029 Acc=0.79 ---20535.46 ms/batch
Step 00012100 L_out=0.044 Acc=0.69 ---43877.34 ms/batch
Step 00012150 L_out=0.137 Acc=0.72 ---67190.97 ms/batch
Step 00012200 L_out=0.112 Acc=0.76 ---90447.91 ms/batch
Step 00012250 L_out=0.032 Acc=0.79 ---114008.49 ms/batch
Step 00012300 L_out=0.020 Acc=0.77 ---137409.42 ms/batch
Step 00012350 L_out=0.097 Acc=0.77 ---160644.52 ms/batch
Step 00012400 L_out=0.013 Acc=0.84 ---184029.77 ms/batch
Step 00012450 L_out=0.038 Acc=0.74 ---207271.86 ms/batch
Step 00012500 L_out=0.273 Acc=0.58 ---230618.02 ms/batch
Step 00012550 L_out=0.100 Acc=0.69 ---254267.65 ms/batch
Step 00012600 L_out=0.048 Acc=0.78 ---277632.41 ms/batch
Step 00012650 L_out=0.054 Acc=0.76 ---301196.54 ms/batch
Round 2 | epoch=18, train costTime=311.96430468559265, | total_activation_sum=3474774
Round 2 | epoch=19, current m_iou=0.4885312814254179
Round 2 | Best m_IoU is: 0.489, OA is: 0.836 | val costTime=116.794016122818
Round 2 | ****EPOCH 19****
Step 00012700 L_out=0.078 Acc=0.74 ---12732.79 ms/batch
Step 00012750 L_out=0.046 Acc=0.69 ---36069.97 ms/batch
Step 00012800 L_out=0.064 Acc=0.80 ---59408.05 ms/batch
Step 00012850 L_out=0.042 Acc=0.70 ---82621.94 ms/batch
Step 00012900 L_out=0.010 Acc=0.67 ---106006.73 ms/batch
Step 00012950 L_out=0.015 Acc=0.80 ---129505.20 ms/batch
Step 00013000 L_out=0.025 Acc=0.78 ---152813.26 ms/batch
Step 00013050 L_out=0.057 Acc=0.66 ---176101.15 ms/batch
Step 00013100 L_out=0.042 Acc=0.75 ---199559.69 ms/batch
Step 00013150 L_out=0.029 Acc=0.80 ---222689.26 ms/batch
Step 00013200 L_out=0.026 Acc=0.84 ---246049.65 ms/batch
Step 00013250 L_out=0.342 Acc=0.80 ---269266.19 ms/batch
Step 00013300 L_out=0.023 Acc=0.77 ---292598.78 ms/batch
Round 2 | epoch=19, train costTime=311.39204263687134, | total_activation_sum=3431885
Round 2 | epoch=20, current m_iou=0.5288208646625576
Round 2 | Best m_IoU is: 0.529, OA is: 0.850 | val costTime=117.17051005363464
Round 2 | ****EPOCH 20****
Step 00013350 L_out=0.035 Acc=0.70 --- 4724.29 ms/batch
Step 00013400 L_out=0.080 Acc=0.68 ---27787.19 ms/batch
Step 00013450 L_out=0.084 Acc=0.83 ---51014.87 ms/batch
Step 00013500 L_out=0.074 Acc=0.65 ---74382.82 ms/batch
Step 00013550 L_out=0.024 Acc=0.69 ---97785.52 ms/batch
Step 00013600 L_out=0.084 Acc=0.73 ---121331.05 ms/batch
Step 00013650 L_out=0.055 Acc=0.71 ---144666.18 ms/batch
Step 00013700 L_out=0.077 Acc=0.78 ---168060.85 ms/batch
Step 00013750 L_out=0.101 Acc=0.66 ---191403.65 ms/batch
Step 00013800 L_out=0.045 Acc=0.72 ---215023.68 ms/batch
Step 00013850 L_out=0.079 Acc=0.72 ---238446.97 ms/batch
Step 00013900 L_out=0.018 Acc=0.75 ---261756.32 ms/batch
Step 00013950 L_out=0.027 Acc=0.69 ---285123.54 ms/batch
Step 00014000 L_out=0.056 Acc=0.70 ---308654.46 ms/batch
Round 2 | epoch=20, train costTime=312.0338110923767, | total_activation_sum=3510799
Round 2 | epoch=21, current m_iou=0.5147847304312454
Round 2 | Best m_IoU is: 0.529, OA is: 0.850 | val costTime=116.90933966636658
Round 2 | ****EPOCH 21****
Step 00014050 L_out=0.126 Acc=0.83 ---19996.07 ms/batch
Step 00014100 L_out=0.014 Acc=0.76 ---43468.05 ms/batch
Step 00014150 L_out=0.070 Acc=0.82 ---66820.87 ms/batch
Step 00014200 L_out=0.020 Acc=0.74 ---90053.21 ms/batch
Step 00014250 L_out=0.101 Acc=0.60 ---113217.88 ms/batch
Step 00014300 L_out=0.066 Acc=0.88 ---136465.46 ms/batch
Step 00014350 L_out=0.069 Acc=0.80 ---159771.83 ms/batch
Step 00014400 L_out=0.008 Acc=0.88 ---183142.46 ms/batch
Step 00014450 L_out=0.038 Acc=0.79 ---206673.11 ms/batch
Step 00014500 L_out=0.087 Acc=0.76 ---230130.05 ms/batch
Step 00014550 L_out=0.066 Acc=0.67 ---253486.36 ms/batch
Step 00014600 L_out=0.129 Acc=0.72 ---276936.28 ms/batch
Step 00014650 L_out=0.011 Acc=0.62 ---300296.23 ms/batch
Round 2 | epoch=21, train costTime=311.45004534721375, | total_activation_sum=3544383
Round 2 | epoch=22, current m_iou=0.5452174903792641
Round 2 | Best m_IoU is: 0.545, OA is: 0.845 | val costTime=117.18761420249939
Round 2 | ****EPOCH 22****
Step 00014700 L_out=0.103 Acc=0.81 ---12236.17 ms/batch
Step 00014750 L_out=0.027 Acc=0.80 ---35605.99 ms/batch
Step 00014800 L_out=0.070 Acc=0.83 ---58821.13 ms/batch
Step 00014850 L_out=0.072 Acc=0.67 ---82131.61 ms/batch
Step 00014900 L_out=0.056 Acc=0.85 ---105492.09 ms/batch
Step 00014950 L_out=0.199 Acc=0.78 ---129026.01 ms/batch
Step 00015000 L_out=0.045 Acc=0.78 ---152447.03 ms/batch
Step 00015050 L_out=0.019 Acc=0.84 ---175747.94 ms/batch
Step 00015100 L_out=0.037 Acc=0.89 ---199093.14 ms/batch
Step 00015150 L_out=0.078 Acc=0.80 ---222522.80 ms/batch
Step 00015200 L_out=0.016 Acc=0.66 ---245935.15 ms/batch
Step 00015250 L_out=0.077 Acc=0.48 ---269376.97 ms/batch
Step 00015300 L_out=0.047 Acc=0.77 ---292735.33 ms/batch
Round 2 | epoch=22, train costTime=311.94038939476013, | total_activation_sum=3621902
Round 2 | epoch=23, current m_iou=0.5489679507691885
Round 2 | Best m_IoU is: 0.549, OA is: 0.846 | val costTime=117.18124842643738
Round 2 | ****EPOCH 23****
Step 00015350 L_out=0.042 Acc=0.69 --- 4135.88 ms/batch
Step 00015400 L_out=0.079 Acc=0.86 ---27569.71 ms/batch
Step 00015450 L_out=0.016 Acc=0.88 ---50974.14 ms/batch
Step 00015500 L_out=0.072 Acc=0.74 ---74338.42 ms/batch
Step 00015550 L_out=0.072 Acc=0.90 ---97928.25 ms/batch
Step 00015600 L_out=0.090 Acc=0.66 ---121247.96 ms/batch
Step 00015650 L_out=0.053 Acc=0.85 ---144710.26 ms/batch
Step 00015700 L_out=0.012 Acc=0.85 ---167943.75 ms/batch
Step 00015750 L_out=0.022 Acc=0.82 ---191276.71 ms/batch
Step 00015800 L_out=0.021 Acc=0.83 ---214679.53 ms/batch
Step 00015850 L_out=0.059 Acc=0.71 ---237750.66 ms/batch
Step 00015900 L_out=0.077 Acc=0.79 ---261362.07 ms/batch
Step 00015950 L_out=0.071 Acc=0.76 ---284716.85 ms/batch
Step 00016000 L_out=0.027 Acc=0.83 ---308153.50 ms/batch
Round 2 | epoch=23, train costTime=311.87562680244446, | total_activation_sum=3546019
Round 2 | epoch=24, current m_iou=0.5521461300378745
Round 2 | Best m_IoU is: 0.552, OA is: 0.859 | val costTime=117.4785406589508
Round 2 | ****EPOCH 24****
Step 00016050 L_out=0.033 Acc=0.78 ---19766.39 ms/batch
Step 00016100 L_out=0.013 Acc=0.79 ---43306.04 ms/batch
Step 00016150 L_out=0.030 Acc=0.86 ---66722.60 ms/batch
Step 00016200 L_out=0.181 Acc=0.83 ---90043.84 ms/batch
Step 00016250 L_out=0.082 Acc=0.63 ---113329.49 ms/batch
Step 00016300 L_out=0.020 Acc=0.81 ---136708.06 ms/batch
Step 00016350 L_out=0.125 Acc=0.64 ---160147.57 ms/batch
Step 00016400 L_out=0.108 Acc=0.77 ---183678.74 ms/batch
Step 00016450 L_out=0.034 Acc=0.82 ---207073.90 ms/batch
Step 00016500 L_out=0.044 Acc=0.81 ---230494.70 ms/batch
Step 00016550 L_out=0.071 Acc=0.69 ---253905.52 ms/batch
Step 00016600 L_out=0.082 Acc=0.73 ---277254.52 ms/batch
Step 00016650 L_out=0.055 Acc=0.78 ---300563.88 ms/batch
Round 2 | epoch=24, train costTime=312.37615060806274, | total_activation_sum=3508528
Round 2 | epoch=25, current m_iou=0.5631135032120758
Round 2 | Best m_IoU is: 0.563, OA is: 0.862 | val costTime=117.40813517570496
Round 2 | ****EPOCH 25****
Step 00016700 L_out=0.082 Acc=0.68 ---11604.18 ms/batch
Step 00016750 L_out=0.011 Acc=0.69 ---34932.31 ms/batch
Step 00016800 L_out=0.033 Acc=0.67 ---58504.52 ms/batch
Step 00016850 L_out=0.030 Acc=0.66 ---81870.89 ms/batch
Step 00016900 L_out=0.170 Acc=0.75 ---105229.99 ms/batch
Step 00016950 L_out=0.050 Acc=0.77 ---128591.76 ms/batch
Step 00017000 L_out=0.037 Acc=0.89 ---152050.65 ms/batch
Step 00017050 L_out=0.071 Acc=0.70 ---175619.26 ms/batch
Step 00017100 L_out=0.012 Acc=0.70 ---199085.48 ms/batch
Step 00017150 L_out=0.031 Acc=0.81 ---222351.54 ms/batch
Step 00017200 L_out=0.030 Acc=0.75 ---245727.81 ms/batch
Step 00017250 L_out=0.068 Acc=0.81 ---269093.39 ms/batch
Step 00017300 L_out=0.019 Acc=0.77 ---292486.71 ms/batch
Round 2 | epoch=25, train costTime=312.1182610988617, | total_activation_sum=3506603
Round 2 | epoch=26, current m_iou=0.5780301539256775
Round 2 | Best m_IoU is: 0.578, OA is: 0.871 | val costTime=117.77739667892456
Round 2 | ****EPOCH 26****
Step 00017350 L_out=0.082 Acc=0.62 --- 3747.82 ms/batch
Step 00017400 L_out=0.032 Acc=0.72 ---27070.36 ms/batch
Step 00017450 L_out=0.011 Acc=0.72 ---50332.87 ms/batch
Step 00017500 L_out=0.016 Acc=0.80 ---73718.27 ms/batch
Step 00017550 L_out=0.043 Acc=0.82 ---97064.45 ms/batch
Step 00017600 L_out=0.026 Acc=0.78 ---120303.28 ms/batch
Step 00017650 L_out=0.013 Acc=0.66 ---143722.87 ms/batch
Step 00017700 L_out=0.015 Acc=0.77 ---167112.01 ms/batch
Step 00017750 L_out=0.022 Acc=0.87 ---190535.59 ms/batch
Step 00017800 L_out=0.122 Acc=0.76 ---214049.82 ms/batch
Step 00017850 L_out=0.087 Acc=0.88 ---237577.21 ms/batch
Step 00017900 L_out=0.022 Acc=0.75 ---261150.39 ms/batch
Step 00017950 L_out=0.048 Acc=0.82 ---284682.02 ms/batch
Step 00018000 L_out=0.105 Acc=0.77 ---308318.23 ms/batch
Round 2 | epoch=26, train costTime=312.519983291626, | total_activation_sum=3405880
Round 2 | epoch=27, current m_iou=0.5715115347180082
Round 2 | Best m_IoU is: 0.578, OA is: 0.871 | val costTime=116.59182381629944
Round 2 | ****EPOCH 27****
Step 00018050 L_out=0.059 Acc=0.80 ---19016.07 ms/batch
Step 00018100 L_out=0.005 Acc=0.72 ---42618.94 ms/batch
Step 00018150 L_out=0.047 Acc=0.77 ---65810.63 ms/batch
Step 00018200 L_out=0.033 Acc=0.82 ---89389.35 ms/batch
Step 00018250 L_out=0.021 Acc=0.77 ---112738.66 ms/batch
Step 00018300 L_out=0.034 Acc=0.84 ---136241.01 ms/batch
Step 00018350 L_out=0.021 Acc=0.84 ---159518.56 ms/batch
Step 00018400 L_out=0.092 Acc=0.71 ---182939.62 ms/batch
Step 00018450 L_out=0.057 Acc=0.63 ---206303.66 ms/batch
Step 00018500 L_out=0.028 Acc=0.86 ---229762.63 ms/batch
Step 00018550 L_out=0.067 Acc=0.87 ---253011.01 ms/batch
Step 00018600 L_out=0.015 Acc=0.76 ---276444.04 ms/batch
Step 00018650 L_out=0.022 Acc=0.60 ---300093.06 ms/batch
Round 2 | epoch=27, train costTime=312.17366003990173, | total_activation_sum=3501449
Round 2 | epoch=28, current m_iou=0.5669361829916462
Round 2 | Best m_IoU is: 0.578, OA is: 0.871 | val costTime=116.57100510597229
Round 2 | ****EPOCH 28****
Step 00018700 L_out=0.076 Acc=0.78 ---11324.28 ms/batch
Step 00018750 L_out=0.050 Acc=0.72 ---34807.71 ms/batch
Step 00018800 L_out=0.005 Acc=0.85 ---58096.72 ms/batch
Step 00018850 L_out=0.080 Acc=0.87 ---81560.15 ms/batch
Step 00018900 L_out=0.054 Acc=0.74 ---104874.18 ms/batch
Step 00018950 L_out=0.038 Acc=0.86 ---128638.04 ms/batch
Step 00019000 L_out=0.025 Acc=0.83 ---152067.60 ms/batch
Step 00019050 L_out=0.048 Acc=0.86 ---175606.90 ms/batch
Step 00019100 L_out=0.009 Acc=0.71 ---198944.68 ms/batch
Step 00019150 L_out=0.036 Acc=0.83 ---222575.81 ms/batch
Step 00019200 L_out=0.061 Acc=0.92 ---245858.70 ms/batch
Step 00019250 L_out=0.160 Acc=0.82 ---269149.74 ms/batch
Step 00019300 L_out=0.037 Acc=0.81 ---292555.42 ms/batch
Round 2 | epoch=28, train costTime=312.8181722164154, | total_activation_sum=3621965
Round 2 | epoch=29, current m_iou=0.5902631444155393
Round 2 | Best m_IoU is: 0.590, OA is: 0.876 | val costTime=117.13403558731079
Round 2 | ****EPOCH 29****
Step 00019350 L_out=0.069 Acc=0.78 --- 3233.31 ms/batch
Step 00019400 L_out=0.093 Acc=0.83 ---26516.44 ms/batch
Step 00019450 L_out=0.050 Acc=0.71 ---49781.41 ms/batch
Step 00019500 L_out=0.047 Acc=0.73 ---73271.52 ms/batch
Step 00019550 L_out=0.023 Acc=0.83 ---96814.56 ms/batch
Step 00019600 L_out=0.048 Acc=0.77 ---120241.68 ms/batch
Step 00019650 L_out=0.063 Acc=0.88 ---143645.90 ms/batch
Step 00019700 L_out=0.053 Acc=0.82 ---167017.20 ms/batch
Step 00019750 L_out=0.054 Acc=0.75 ---190390.82 ms/batch
Step 00019800 L_out=0.066 Acc=0.89 ---213979.07 ms/batch
Step 00019850 L_out=0.055 Acc=0.82 ---237207.73 ms/batch
Step 00019900 L_out=0.039 Acc=0.87 ---260593.78 ms/batch
Step 00019950 L_out=0.077 Acc=0.77 ---284039.60 ms/batch
Step 00020000 L_out=0.006 Acc=0.59 ---307579.93 ms/batch
Round 2 | epoch=29, train costTime=312.265643119812, | total_activation_sum=3477721
Round 2 | epoch=30, current m_iou=0.5877967916701501
Round 2 | Best m_IoU is: 0.590, OA is: 0.876 | val costTime=117.07110023498535
Round 2 | ****EPOCH 30****
Round 3 | ****EPOCH 0****
Step 00020050 L_out=0.236 Acc=0.53 ---18709.10 ms/batch
Step 00020100 L_out=0.339 Acc=0.49 ---42003.90 ms/batch
Step 00020150 L_out=0.382 Acc=0.41 ---65465.64 ms/batch
Step 00020200 L_out=0.374 Acc=0.44 ---88962.06 ms/batch
Step 00020250 L_out=0.402 Acc=0.23 ---112421.24 ms/batch
Step 00020300 L_out=0.327 Acc=0.26 ---136000.47 ms/batch
Step 00020350 L_out=0.792 Acc=0.35 ---159797.51 ms/batch
Step 00020400 L_out=0.118 Acc=0.36 ---183301.56 ms/batch
Step 00020450 L_out=0.676 Acc=0.47 ---206664.60 ms/batch
Step 00020500 L_out=0.656 Acc=0.56 ---230195.00 ms/batch
Step 00020550 L_out=0.368 Acc=0.29 ---253404.60 ms/batch
Step 00020600 L_out=0.484 Acc=0.60 ---277017.27 ms/batch
Step 00020650 L_out=0.064 Acc=0.54 ---300615.71 ms/batch
Round 3 | epoch=0, train costTime=313.477578163147, | total_activation_sum=5812646
Round 3 | ****EPOCH 1****
Step 00020700 L_out=0.662 Acc=0.54 ---10827.13 ms/batch
Step 00020750 L_out=0.224 Acc=0.63 ---34336.88 ms/batch
Step 00020800 L_out=0.428 Acc=0.71 ---57703.83 ms/batch
Step 00020850 L_out=0.198 Acc=0.41 ---81141.78 ms/batch
Step 00020900 L_out=0.263 Acc=0.64 ---104678.70 ms/batch
Step 00020950 L_out=0.098 Acc=0.53 ---128261.54 ms/batch
Step 00021000 L_out=0.649 Acc=0.43 ---152065.21 ms/batch
Step 00021050 L_out=0.423 Acc=0.66 ---175574.89 ms/batch
Step 00021100 L_out=0.155 Acc=0.66 ---198975.74 ms/batch
Step 00021150 L_out=0.424 Acc=0.78 ---222272.10 ms/batch
Step 00021200 L_out=0.120 Acc=0.46 ---245594.99 ms/batch
Step 00021250 L_out=0.146 Acc=0.73 ---269037.86 ms/batch
Step 00021300 L_out=0.591 Acc=0.48 ---292532.29 ms/batch
Round 3 | epoch=1, train costTime=313.2020032405853, | total_activation_sum=5873686
Round 3 | ****EPOCH 2****
Step 00021350 L_out=0.140 Acc=0.47 --- 2817.53 ms/batch
Step 00021400 L_out=0.127 Acc=0.46 ---26456.07 ms/batch
Step 00021450 L_out=0.222 Acc=0.61 ---49819.80 ms/batch
Step 00021500 L_out=0.065 Acc=0.61 ---72959.07 ms/batch
Step 00021550 L_out=0.226 Acc=0.71 ---96390.36 ms/batch
Step 00021600 L_out=0.294 Acc=0.64 ---119841.98 ms/batch
Step 00021650 L_out=0.298 Acc=0.67 ---143387.24 ms/batch
Step 00021700 L_out=0.142 Acc=0.48 ---166739.05 ms/batch
Step 00021750 L_out=0.533 Acc=0.78 ---190074.96 ms/batch
Step 00021800 L_out=0.207 Acc=0.66 ---213578.17 ms/batch
Step 00021850 L_out=0.224 Acc=0.87 ---237293.34 ms/batch
Step 00021900 L_out=0.099 Acc=0.57 ---260613.31 ms/batch
Step 00021950 L_out=0.083 Acc=0.75 ---283996.69 ms/batch
Step 00022000 L_out=0.404 Acc=0.69 ---307192.37 ms/batch
Round 3 | epoch=2, train costTime=312.301038980484, | total_activation_sum=5723964
Round 3 | ****EPOCH 3****
Step 00022050 L_out=0.428 Acc=0.72 ---18328.73 ms/batch
Step 00022100 L_out=0.146 Acc=0.73 ---41645.28 ms/batch
Step 00022150 L_out=0.110 Acc=0.76 ---65142.81 ms/batch
Step 00022200 L_out=0.333 Acc=0.41 ---88674.12 ms/batch
Step 00022250 L_out=0.274 Acc=0.64 ---112165.50 ms/batch
Step 00022300 L_out=0.123 Acc=0.69 ---135561.35 ms/batch
Step 00022350 L_out=0.319 Acc=0.75 ---158993.36 ms/batch
Step 00022400 L_out=0.261 Acc=0.87 ---182345.36 ms/batch
Step 00022450 L_out=0.313 Acc=0.62 ---205868.05 ms/batch
Step 00022500 L_out=0.376 Acc=0.65 ---229396.81 ms/batch
Step 00022550 L_out=0.156 Acc=0.51 ---252810.30 ms/batch
Step 00022600 L_out=0.331 Acc=0.76 ---276198.55 ms/batch
Step 00022650 L_out=0.187 Acc=0.71 ---299733.85 ms/batch
Round 3 | epoch=3, train costTime=312.85669803619385, | total_activation_sum=5725138
Round 3 | ****EPOCH 4****
Step 00022700 L_out=0.373 Acc=0.78 ---10433.88 ms/batch
Step 00022750 L_out=0.168 Acc=0.52 ---33859.75 ms/batch
Step 00022800 L_out=0.206 Acc=0.62 ---57366.20 ms/batch
Step 00022850 L_out=0.204 Acc=0.60 ---80825.53 ms/batch
Step 00022900 L_out=0.150 Acc=0.75 ---104217.33 ms/batch
Step 00022950 L_out=0.172 Acc=0.81 ---127487.68 ms/batch
Step 00023000 L_out=0.329 Acc=0.77 ---150838.58 ms/batch
Step 00023050 L_out=0.190 Acc=0.47 ---174186.70 ms/batch
Step 00023100 L_out=0.017 Acc=0.72 ---197634.73 ms/batch
Step 00023150 L_out=0.145 Acc=0.76 ---221022.27 ms/batch
Step 00023200 L_out=0.116 Acc=0.66 ---244201.01 ms/batch
Step 00023250 L_out=0.198 Acc=0.73 ---267751.05 ms/batch
Step 00023300 L_out=0.146 Acc=0.70 ---291175.58 ms/batch
Round 3 | epoch=4, train costTime=312.34451246261597, | total_activation_sum=5836924
Round 3 | ****EPOCH 5****
Step 00023350 L_out=0.116 Acc=0.73 --- 2283.21 ms/batch
Step 00023400 L_out=0.157 Acc=0.58 ---25586.35 ms/batch
Step 00023450 L_out=0.064 Acc=0.58 ---48851.39 ms/batch
Step 00023500 L_out=0.047 Acc=0.78 ---72151.00 ms/batch
Step 00023550 L_out=0.104 Acc=0.64 ---95542.94 ms/batch
Step 00023600 L_out=0.270 Acc=0.43 ---119024.82 ms/batch
Step 00023650 L_out=0.521 Acc=0.73 ---142346.09 ms/batch
Step 00023700 L_out=0.311 Acc=0.45 ---165794.45 ms/batch
Step 00023750 L_out=0.160 Acc=0.68 ---189402.34 ms/batch
Step 00023800 L_out=0.388 Acc=0.61 ---212857.00 ms/batch
Step 00023850 L_out=0.147 Acc=0.86 ---236264.05 ms/batch
Step 00023900 L_out=0.173 Acc=0.75 ---259987.73 ms/batch
Step 00023950 L_out=0.216 Acc=0.68 ---283539.65 ms/batch
Step 00024000 L_out=0.355 Acc=0.50 ---307130.43 ms/batch
Round 3 | epoch=5, train costTime=312.7486207485199, | total_activation_sum=5708867
Round 3 | ****EPOCH 6****
Step 00024050 L_out=0.178 Acc=0.75 ---17766.54 ms/batch
Step 00024100 L_out=0.876 Acc=0.57 ---41264.94 ms/batch
Step 00024150 L_out=0.254 Acc=0.68 ---64707.62 ms/batch
Step 00024200 L_out=0.212 Acc=0.81 ---88157.12 ms/batch
Step 00024250 L_out=0.111 Acc=0.81 ---111509.23 ms/batch
Step 00024300 L_out=0.167 Acc=0.71 ---135028.44 ms/batch
Step 00024350 L_out=0.279 Acc=0.60 ---158489.71 ms/batch
Step 00024400 L_out=0.402 Acc=0.67 ---181963.56 ms/batch
Step 00024450 L_out=0.521 Acc=0.66 ---205489.31 ms/batch
Step 00024500 L_out=0.099 Acc=0.80 ---228968.54 ms/batch
Step 00024550 L_out=0.136 Acc=0.79 ---252325.72 ms/batch
Step 00024600 L_out=0.239 Acc=0.80 ---275886.73 ms/batch
Step 00024650 L_out=0.222 Acc=0.67 ---299556.27 ms/batch
Round 3 | epoch=6, train costTime=313.14239382743835, | total_activation_sum=5864156
Round 3 | ****EPOCH 7****
Step 00024700 L_out=0.224 Acc=0.82 --- 9964.52 ms/batch
Step 00024750 L_out=0.078 Acc=0.69 ---33356.95 ms/batch
Step 00024800 L_out=0.140 Acc=0.73 ---56944.56 ms/batch
Step 00024850 L_out=0.157 Acc=0.78 ---80368.15 ms/batch
Step 00024900 L_out=0.139 Acc=0.75 ---103639.89 ms/batch
Step 00024950 L_out=0.145 Acc=0.42 ---127099.75 ms/batch
Step 00025000 L_out=0.168 Acc=0.63 ---150343.87 ms/batch
Step 00025050 L_out=0.267 Acc=0.81 ---173787.69 ms/batch
Step 00025100 L_out=0.423 Acc=0.62 ---197196.94 ms/batch
Step 00025150 L_out=0.167 Acc=0.63 ---220675.97 ms/batch
Step 00025200 L_out=0.098 Acc=0.81 ---244246.68 ms/batch
Step 00025250 L_out=0.026 Acc=0.69 ---267735.48 ms/batch
Step 00025300 L_out=0.338 Acc=0.71 ---291187.66 ms/batch
Round 3 | epoch=7, train costTime=312.6884808540344, | total_activation_sum=5714332
Round 3 | ****EPOCH 8****
Step 00025350 L_out=0.289 Acc=0.85 --- 1833.36 ms/batch
Step 00025400 L_out=0.186 Acc=0.86 ---25335.59 ms/batch
Step 00025450 L_out=0.052 Acc=0.86 ---48681.42 ms/batch
Step 00025500 L_out=0.087 Acc=0.85 ---72097.62 ms/batch
Step 00025550 L_out=0.175 Acc=0.74 ---95709.30 ms/batch
Step 00025600 L_out=0.237 Acc=0.76 ---119025.98 ms/batch
Step 00025650 L_out=0.112 Acc=0.75 ---142425.73 ms/batch
Step 00025700 L_out=0.191 Acc=0.72 ---165763.19 ms/batch
Step 00025750 L_out=0.218 Acc=0.57 ---189113.32 ms/batch
Step 00025800 L_out=0.147 Acc=0.70 ---212606.21 ms/batch
Step 00025850 L_out=0.058 Acc=0.68 ---236004.99 ms/batch
Step 00025900 L_out=0.162 Acc=0.85 ---259400.02 ms/batch
Step 00025950 L_out=0.254 Acc=0.78 ---282570.51 ms/batch
Step 00026000 L_out=0.077 Acc=0.71 ---306189.51 ms/batch
Round 3 | epoch=8, train costTime=312.2638900279999, | total_activation_sum=5755473
Round 3 | ****EPOCH 9****
Step 00026050 L_out=0.088 Acc=0.75 ---17408.12 ms/batch
Step 00026100 L_out=0.150 Acc=0.68 ---40694.56 ms/batch
Step 00026150 L_out=0.095 Acc=0.80 ---64055.42 ms/batch
Step 00026200 L_out=0.046 Acc=0.82 ---87354.74 ms/batch
Step 00026250 L_out=0.213 Acc=0.72 ---110649.07 ms/batch
Step 00026300 L_out=0.196 Acc=0.69 ---133915.71 ms/batch
Step 00026350 L_out=0.093 Acc=0.68 ---157211.98 ms/batch
Step 00026400 L_out=0.167 Acc=0.85 ---180734.41 ms/batch
Step 00026450 L_out=0.083 Acc=0.85 ---204260.35 ms/batch
Step 00026500 L_out=0.445 Acc=0.69 ---227767.71 ms/batch
Step 00026550 L_out=0.053 Acc=0.81 ---251267.64 ms/batch
Step 00026600 L_out=0.054 Acc=0.90 ---274631.35 ms/batch
Step 00026650 L_out=0.219 Acc=0.69 ---298093.88 ms/batch
Round 3 | epoch=9, train costTime=312.2907497882843, | total_activation_sum=5808893
Round 3 | ****EPOCH 10****
Step 00026700 L_out=0.122 Acc=0.90 --- 9359.15 ms/batch
Step 00026750 L_out=0.206 Acc=0.85 ---32696.75 ms/batch
Step 00026800 L_out=0.063 Acc=0.61 ---56109.09 ms/batch
Step 00026850 L_out=0.072 Acc=0.80 ---79410.13 ms/batch
Step 00026900 L_out=0.107 Acc=0.86 ---103112.65 ms/batch
Step 00026950 L_out=0.126 Acc=0.74 ---126390.04 ms/batch
Step 00027000 L_out=0.070 Acc=0.84 ---149965.57 ms/batch
Step 00027050 L_out=0.117 Acc=0.81 ---173442.43 ms/batch
Step 00027100 L_out=0.215 Acc=0.71 ---197063.23 ms/batch
Step 00027150 L_out=0.127 Acc=0.72 ---220474.13 ms/batch
Step 00027200 L_out=0.151 Acc=0.74 ---244043.85 ms/batch
Step 00027250 L_out=0.176 Acc=0.69 ---267243.54 ms/batch
Step 00027300 L_out=0.251 Acc=0.77 ---290836.79 ms/batch
Round 3 | epoch=10, train costTime=312.8698663711548, | total_activation_sum=5859065
Round 3 | ****EPOCH 11****
Step 00027350 L_out=0.197 Acc=0.66 --- 1404.93 ms/batch
Step 00027400 L_out=0.149 Acc=0.77 ---25002.40 ms/batch
Step 00027450 L_out=0.100 Acc=0.67 ---48543.82 ms/batch
Step 00027500 L_out=0.072 Acc=0.75 ---72075.08 ms/batch
Step 00027550 L_out=0.096 Acc=0.87 ---95717.21 ms/batch
Step 00027600 L_out=0.413 Acc=0.53 ---118973.97 ms/batch
Step 00027650 L_out=0.350 Acc=0.87 ---142432.08 ms/batch
Step 00027700 L_out=0.103 Acc=0.73 ---165947.68 ms/batch
Step 00027750 L_out=0.112 Acc=0.77 ---189445.79 ms/batch
Step 00027800 L_out=0.364 Acc=0.79 ---212933.79 ms/batch
Step 00027850 L_out=0.273 Acc=0.76 ---236548.74 ms/batch
Step 00027900 L_out=0.136 Acc=0.72 ---259894.70 ms/batch
Step 00027950 L_out=0.280 Acc=0.81 ---283230.86 ms/batch
Step 00028000 L_out=0.146 Acc=0.79 ---306813.58 ms/batch
Round 3 | epoch=11, train costTime=313.3339204788208, | total_activation_sum=5771085
Round 3 | ****EPOCH 12****
Step 00028050 L_out=0.063 Acc=0.84 ---16876.42 ms/batch
Step 00028100 L_out=0.059 Acc=0.80 ---40483.66 ms/batch
Step 00028150 L_out=0.205 Acc=0.72 ---63881.26 ms/batch
Step 00028200 L_out=0.201 Acc=0.84 ---87252.29 ms/batch
Step 00028250 L_out=0.110 Acc=0.61 ---110664.10 ms/batch
Step 00028300 L_out=0.289 Acc=0.79 ---133976.43 ms/batch
Step 00028350 L_out=0.046 Acc=0.71 ---157484.86 ms/batch
Step 00028400 L_out=0.170 Acc=0.87 ---180884.87 ms/batch
Step 00028450 L_out=0.079 Acc=0.79 ---204346.92 ms/batch
Step 00028500 L_out=0.089 Acc=0.85 ---227759.47 ms/batch
Step 00028550 L_out=0.284 Acc=0.80 ---251064.11 ms/batch
Step 00028600 L_out=0.283 Acc=0.71 ---274568.65 ms/batch
Step 00028650 L_out=0.184 Acc=0.91 ---297995.55 ms/batch
Round 3 | epoch=12, train costTime=312.56486654281616, | total_activation_sum=5810672
Round 3 | ****EPOCH 13****
Step 00028700 L_out=0.140 Acc=0.80 --- 8908.99 ms/batch
Step 00028750 L_out=0.084 Acc=0.61 ---32573.84 ms/batch
Step 00028800 L_out=0.066 Acc=0.81 ---56014.62 ms/batch
Step 00028850 L_out=0.080 Acc=0.82 ---79435.69 ms/batch
Step 00028900 L_out=0.085 Acc=0.85 ---102825.35 ms/batch
Step 00028950 L_out=0.257 Acc=0.60 ---126211.33 ms/batch
Step 00029000 L_out=0.135 Acc=0.83 ---149613.68 ms/batch
Step 00029050 L_out=0.154 Acc=0.85 ---172955.21 ms/batch
Step 00029100 L_out=0.249 Acc=0.62 ---196393.99 ms/batch
Step 00029150 L_out=0.177 Acc=0.72 ---219654.25 ms/batch
Step 00029200 L_out=0.111 Acc=0.86 ---243058.49 ms/batch
Step 00029250 L_out=0.351 Acc=0.74 ---266492.05 ms/batch
Step 00029300 L_out=0.129 Acc=0.87 ---290052.77 ms/batch
Round 3 | epoch=13, train costTime=312.40088295936584, | total_activation_sum=5810597
Round 3 | ****EPOCH 14****
Step 00029350 L_out=0.085 Acc=0.85 ---  924.06 ms/batch
Step 00029400 L_out=0.113 Acc=0.84 ---24502.41 ms/batch
Step 00029450 L_out=0.194 Acc=0.75 ---47787.77 ms/batch
Step 00029500 L_out=0.102 Acc=0.66 ---71171.42 ms/batch
Step 00029550 L_out=0.116 Acc=0.78 ---94776.61 ms/batch
Step 00029600 L_out=0.127 Acc=0.57 ---118310.58 ms/batch
Step 00029650 L_out=0.173 Acc=0.71 ---141628.83 ms/batch
Step 00029700 L_out=0.121 Acc=0.82 ---165134.44 ms/batch
Step 00029750 L_out=0.084 Acc=0.77 ---188433.11 ms/batch
Step 00029800 L_out=0.122 Acc=0.83 ---212093.25 ms/batch
Step 00029850 L_out=0.047 Acc=0.76 ---235663.63 ms/batch
Step 00029900 L_out=0.250 Acc=0.93 ---259302.91 ms/batch
Step 00029950 L_out=0.068 Acc=0.57 ---282882.18 ms/batch
Step 00030000 L_out=0.269 Acc=0.63 ---306538.93 ms/batch
Round 3 | epoch=14, train costTime=313.58922243118286, | total_activation_sum=5717865
Round 3 | ****EPOCH 15****
Step 00030050 L_out=0.077 Acc=0.73 ---16249.06 ms/batch
Step 00030100 L_out=0.157 Acc=0.75 ---39481.04 ms/batch
Step 00030150 L_out=0.152 Acc=0.56 ---63061.04 ms/batch
Step 00030200 L_out=0.042 Acc=0.90 ---86394.72 ms/batch
Step 00030250 L_out=0.095 Acc=0.84 ---110085.96 ms/batch
Step 00030300 L_out=0.343 Acc=0.82 ---133353.17 ms/batch
Step 00030350 L_out=0.138 Acc=0.69 ---156634.98 ms/batch
Step 00030400 L_out=0.319 Acc=0.54 ---180369.14 ms/batch
Step 00030450 L_out=0.090 Acc=0.69 ---203661.28 ms/batch
Step 00030500 L_out=0.182 Acc=0.90 ---227077.31 ms/batch
Step 00030550 L_out=0.118 Acc=0.68 ---250719.77 ms/batch
Step 00030600 L_out=0.099 Acc=0.81 ---274123.83 ms/batch
Step 00030650 L_out=0.304 Acc=0.78 ---297811.94 ms/batch
Round 3 | epoch=15, train costTime=312.8978192806244, | total_activation_sum=5733237
Round 3 | ****EPOCH 16****
Step 00030700 L_out=0.134 Acc=0.75 --- 8548.40 ms/batch
Step 00030750 L_out=0.114 Acc=0.81 ---31830.23 ms/batch
Step 00030800 L_out=0.102 Acc=0.82 ---55383.92 ms/batch
Step 00030850 L_out=0.146 Acc=0.81 ---78758.08 ms/batch
Step 00030900 L_out=0.044 Acc=0.80 ---102283.17 ms/batch
Step 00030950 L_out=0.093 Acc=0.80 ---125818.52 ms/batch
Step 00031000 L_out=0.138 Acc=0.77 ---149100.65 ms/batch
Step 00031050 L_out=0.075 Acc=0.79 ---172548.82 ms/batch
Step 00031100 L_out=0.098 Acc=0.86 ---195902.24 ms/batch
Step 00031150 L_out=0.154 Acc=0.68 ---219511.73 ms/batch
Step 00031200 L_out=0.127 Acc=0.69 ---243014.85 ms/batch
Step 00031250 L_out=0.056 Acc=0.80 ---266505.57 ms/batch
Step 00031300 L_out=0.088 Acc=0.84 ---289933.68 ms/batch
Round 3 | epoch=16, train costTime=312.86970114707947, | total_activation_sum=5747298
Round 3 | ****EPOCH 17****
Step 00031350 L_out=0.099 Acc=0.56 ---  461.62 ms/batch
Step 00031400 L_out=0.044 Acc=0.90 ---23855.18 ms/batch
Step 00031450 L_out=0.169 Acc=0.70 ---47234.20 ms/batch
Step 00031500 L_out=0.078 Acc=0.75 ---70614.41 ms/batch
Step 00031550 L_out=0.155 Acc=0.68 ---94024.13 ms/batch
Step 00031600 L_out=0.115 Acc=0.85 ---117401.34 ms/batch
Step 00031650 L_out=0.171 Acc=0.81 ---140624.24 ms/batch
Step 00031700 L_out=0.044 Acc=0.80 ---163951.49 ms/batch
Step 00031750 L_out=0.102 Acc=0.75 ---187419.70 ms/batch
Step 00031800 L_out=0.096 Acc=0.92 ---210852.84 ms/batch
Step 00031850 L_out=0.082 Acc=0.91 ---234260.14 ms/batch
Step 00031900 L_out=0.174 Acc=0.79 ---257746.65 ms/batch
Step 00031950 L_out=0.102 Acc=0.94 ---281001.57 ms/batch
Step 00032000 L_out=0.186 Acc=0.67 ---304617.25 ms/batch
Round 3 | epoch=17, train costTime=312.194326877594, | total_activation_sum=5890996
Round 3 | epoch=18, current m_iou=0.6026372516004264
Round 3 | Best m_IoU is: 0.603, OA is: 0.875 | val costTime=117.71448111534119
Round 3 | ****EPOCH 18****
Step 00032050 L_out=0.082 Acc=0.64 ---15868.30 ms/batch
Step 00032100 L_out=0.036 Acc=0.85 ---39375.26 ms/batch
Step 00032150 L_out=0.106 Acc=0.79 ---62754.79 ms/batch
Step 00032200 L_out=0.195 Acc=0.76 ---86350.24 ms/batch
Step 00032250 L_out=0.167 Acc=0.79 ---109860.93 ms/batch
Step 00032300 L_out=0.022 Acc=0.86 ---133155.36 ms/batch
Step 00032350 L_out=0.417 Acc=0.87 ---156525.65 ms/batch
Step 00032400 L_out=0.020 Acc=0.81 ---180118.54 ms/batch
Step 00032450 L_out=0.096 Acc=0.77 ---203606.19 ms/batch
Step 00032500 L_out=0.198 Acc=0.82 ---226999.72 ms/batch
Step 00032550 L_out=0.060 Acc=0.87 ---250225.46 ms/batch
Step 00032600 L_out=0.029 Acc=0.81 ---273919.15 ms/batch
Step 00032650 L_out=0.095 Acc=0.79 ---297626.45 ms/batch
Round 3 | epoch=18, train costTime=312.8652787208557, | total_activation_sum=5774715
Round 3 | epoch=19, current m_iou=0.6252877431108212
Round 3 | Best m_IoU is: 0.625, OA is: 0.891 | val costTime=117.45655584335327
Round 3 | ****EPOCH 19****
Step 00032700 L_out=0.103 Acc=0.77 --- 7915.27 ms/batch
Step 00032750 L_out=0.198 Acc=0.87 ---31298.75 ms/batch
Step 00032800 L_out=0.519 Acc=0.82 ---54713.47 ms/batch
Step 00032850 L_out=0.056 Acc=0.93 ---78131.05 ms/batch
Step 00032900 L_out=0.032 Acc=0.77 ---101609.84 ms/batch
Step 00032950 L_out=0.182 Acc=0.75 ---125173.11 ms/batch
Step 00033000 L_out=0.166 Acc=0.73 ---148732.85 ms/batch
Step 00033050 L_out=0.182 Acc=0.92 ---172158.98 ms/batch
Step 00033100 L_out=0.085 Acc=0.84 ---195605.22 ms/batch
Step 00033150 L_out=0.073 Acc=0.88 ---218949.40 ms/batch
Step 00033200 L_out=0.234 Acc=0.80 ---242390.07 ms/batch
Step 00033250 L_out=0.028 Acc=0.78 ---265943.04 ms/batch
Step 00033300 L_out=0.023 Acc=0.85 ---289381.79 ms/batch
Step 00033350 L_out=0.061 Acc=0.92 ---312694.98 ms/batch
Round 3 | epoch=19, train costTime=312.6952850818634, | total_activation_sum=5745118
Round 3 | epoch=20, current m_iou=0.6282574951610367
Round 3 | Best m_IoU is: 0.628, OA is: 0.887 | val costTime=117.7988953590393
Round 3 | ****EPOCH 20****
Step 00033400 L_out=0.119 Acc=0.76 ---23238.26 ms/batch
Step 00033450 L_out=0.020 Acc=0.73 ---44820.13 ms/batch
Step 00033500 L_out=0.115 Acc=0.78 ---68076.63 ms/batch
Step 00033550 L_out=0.090 Acc=0.85 ---91513.72 ms/batch
Step 00033600 L_out=0.093 Acc=0.85 ---115202.91 ms/batch
Step 00033650 L_out=0.058 Acc=0.67 ---138494.50 ms/batch
Step 00033700 L_out=0.264 Acc=0.83 ---162015.21 ms/batch
Step 00033750 L_out=0.125 Acc=0.90 ---185370.98 ms/batch
Step 00033800 L_out=0.344 Acc=0.85 ---208744.95 ms/batch
Step 00033850 L_out=0.025 Acc=0.78 ---232144.59 ms/batch
Step 00033900 L_out=0.232 Acc=0.80 ---255432.98 ms/batch
Step 00033950 L_out=0.142 Acc=0.87 ---278996.23 ms/batch
Step 00034000 L_out=0.163 Acc=0.78 ---302575.30 ms/batch
Round 3 | epoch=20, train costTime=310.520525932312, | total_activation_sum=5740921
Round 3 | epoch=21, current m_iou=0.6350079599212225
Round 3 | Best m_IoU is: 0.635, OA is: 0.888 | val costTime=117.97640252113342
Round 3 | ****EPOCH 21****
Step 00034050 L_out=0.062 Acc=0.83 ---15307.20 ms/batch
Step 00034100 L_out=0.106 Acc=0.79 ---38719.58 ms/batch
Step 00034150 L_out=0.116 Acc=0.83 ---62054.16 ms/batch
Step 00034200 L_out=0.095 Acc=0.79 ---85556.40 ms/batch
Step 00034250 L_out=0.075 Acc=0.73 ---108930.71 ms/batch
Step 00034300 L_out=0.138 Acc=0.83 ---132267.99 ms/batch
Step 00034350 L_out=0.186 Acc=0.89 ---155518.66 ms/batch
Step 00034400 L_out=0.051 Acc=0.90 ---178942.36 ms/batch
Step 00034450 L_out=0.080 Acc=0.80 ---202273.67 ms/batch
Step 00034500 L_out=0.061 Acc=0.84 ---225644.40 ms/batch
Step 00034550 L_out=0.077 Acc=0.81 ---249038.43 ms/batch
Step 00034600 L_out=0.117 Acc=0.83 ---272534.50 ms/batch
Step 00034650 L_out=0.087 Acc=0.86 ---295968.81 ms/batch
Round 3 | epoch=21, train costTime=311.9584834575653, | total_activation_sum=5883659
Round 3 | epoch=22, current m_iou=0.6369829857018612
Round 3 | Best m_IoU is: 0.637, OA is: 0.887 | val costTime=118.0011694431305
Round 3 | ****EPOCH 22****
Step 00034700 L_out=0.069 Acc=0.75 --- 7457.10 ms/batch
Step 00034750 L_out=0.160 Acc=0.85 ---31009.19 ms/batch
Step 00034800 L_out=0.126 Acc=0.63 ---54465.44 ms/batch
Step 00034850 L_out=0.010 Acc=0.83 ---77689.78 ms/batch
Step 00034900 L_out=0.151 Acc=0.77 ---101078.42 ms/batch
Step 00034950 L_out=0.096 Acc=0.82 ---124482.13 ms/batch
Step 00035000 L_out=0.204 Acc=0.46 ---147772.93 ms/batch
Step 00035050 L_out=0.026 Acc=0.82 ---171295.58 ms/batch
Step 00035100 L_out=0.245 Acc=0.89 ---194886.22 ms/batch
Step 00035150 L_out=0.328 Acc=0.90 ---218235.23 ms/batch
Step 00035200 L_out=0.084 Acc=0.78 ---241600.97 ms/batch
Step 00035250 L_out=0.046 Acc=0.83 ---265106.66 ms/batch
Step 00035300 L_out=0.131 Acc=0.78 ---288463.75 ms/batch
Step 00035350 L_out=0.078 Acc=0.67 ---311894.80 ms/batch
Round 3 | epoch=22, train costTime=312.3783211708069, | total_activation_sum=5734246
Round 3 | epoch=23, current m_iou=0.6350841551131685
Round 3 | Best m_IoU is: 0.637, OA is: 0.887 | val costTime=117.39619064331055
Round 3 | ****EPOCH 23****
Step 00035400 L_out=0.062 Acc=0.81 ---23002.47 ms/batch
Step 00035450 L_out=0.073 Acc=0.61 ---46452.05 ms/batch
Step 00035500 L_out=0.130 Acc=0.91 ---69918.73 ms/batch
Step 00035550 L_out=0.301 Acc=0.79 ---93208.90 ms/batch
Step 00035600 L_out=0.147 Acc=0.87 ---116883.96 ms/batch
Step 00035650 L_out=0.182 Acc=0.72 ---140323.45 ms/batch
Step 00035700 L_out=0.322 Acc=0.86 ---163841.92 ms/batch
Step 00035750 L_out=0.078 Acc=0.87 ---187467.07 ms/batch
Step 00035800 L_out=0.155 Acc=0.88 ---210813.50 ms/batch
Step 00035850 L_out=0.124 Acc=0.76 ---234172.72 ms/batch
Step 00035900 L_out=0.117 Acc=0.79 ---257787.20 ms/batch
Step 00035950 L_out=0.081 Acc=0.88 ---281076.92 ms/batch
Step 00036000 L_out=0.120 Acc=0.89 ---304406.64 ms/batch
Round 3 | epoch=23, train costTime=312.770968914032, | total_activation_sum=5710955
Round 3 | epoch=24, current m_iou=0.6448615405797424
Round 3 | Best m_IoU is: 0.645, OA is: 0.898 | val costTime=117.37559485435486
Round 3 | ****EPOCH 24****
Step 00036050 L_out=0.416 Acc=0.76 ---14894.70 ms/batch
Step 00036100 L_out=0.177 Acc=0.81 ---38271.82 ms/batch
Step 00036150 L_out=0.119 Acc=0.90 ---61795.96 ms/batch
Step 00036200 L_out=0.178 Acc=0.81 ---85188.16 ms/batch
Step 00036250 L_out=0.044 Acc=0.90 ---108683.65 ms/batch
Step 00036300 L_out=0.056 Acc=0.72 ---132127.76 ms/batch
Step 00036350 L_out=0.151 Acc=0.78 ---155595.92 ms/batch
Step 00036400 L_out=0.056 Acc=0.81 ---179098.32 ms/batch
Step 00036450 L_out=0.123 Acc=0.80 ---202573.65 ms/batch
Step 00036500 L_out=0.328 Acc=0.89 ---225897.32 ms/batch
Step 00036550 L_out=0.256 Acc=0.84 ---249463.73 ms/batch
Step 00036600 L_out=0.099 Acc=0.85 ---272961.75 ms/batch
Step 00036650 L_out=0.046 Acc=0.84 ---296181.59 ms/batch
Round 3 | epoch=24, train costTime=312.6963617801666, | total_activation_sum=5777610
Round 3 | epoch=25, current m_iou=0.6463922093689425
Round 3 | Best m_IoU is: 0.646, OA is: 0.895 | val costTime=117.84179854393005
Round 3 | ****EPOCH 25****
Step 00036700 L_out=0.087 Acc=0.83 --- 6927.81 ms/batch
Step 00036750 L_out=0.060 Acc=0.69 ---30343.78 ms/batch
Step 00036800 L_out=0.120 Acc=0.72 ---53646.23 ms/batch
Step 00036850 L_out=0.077 Acc=0.80 ---76916.21 ms/batch
Step 00036900 L_out=0.096 Acc=0.88 ---100280.24 ms/batch
Step 00036950 L_out=0.067 Acc=0.90 ---123728.92 ms/batch
Step 00037000 L_out=0.170 Acc=0.80 ---147060.68 ms/batch
Step 00037050 L_out=0.166 Acc=0.87 ---170601.25 ms/batch
Step 00037100 L_out=0.107 Acc=0.75 ---194008.13 ms/batch
Step 00037150 L_out=0.309 Acc=0.71 ---217412.54 ms/batch
Step 00037200 L_out=0.038 Acc=0.79 ---240878.82 ms/batch
Step 00037250 L_out=0.102 Acc=0.89 ---264130.24 ms/batch
Step 00037300 L_out=0.099 Acc=0.89 ---287507.21 ms/batch
Step 00037350 L_out=0.126 Acc=0.83 ---311081.96 ms/batch
Round 3 | epoch=25, train costTime=312.0108938217163, | total_activation_sum=5851966
Round 3 | epoch=26, current m_iou=0.6490730894360454
Round 3 | Best m_IoU is: 0.649, OA is: 0.896 | val costTime=118.01994061470032
Round 3 | ****EPOCH 26****
Step 00037400 L_out=0.136 Acc=0.80 ---22539.28 ms/batch
Step 00037450 L_out=0.026 Acc=0.87 ---46023.38 ms/batch
Step 00037500 L_out=0.121 Acc=0.77 ---69526.38 ms/batch
Step 00037550 L_out=0.082 Acc=0.82 ---92984.35 ms/batch
Step 00037600 L_out=0.208 Acc=0.47 ---116468.45 ms/batch
Step 00037650 L_out=0.074 Acc=0.74 ---139900.38 ms/batch
Step 00037700 L_out=0.065 Acc=0.79 ---163345.78 ms/batch
Step 00037750 L_out=0.068 Acc=0.87 ---186793.34 ms/batch
Step 00037800 L_out=0.082 Acc=0.87 ---210288.18 ms/batch
Step 00037850 L_out=0.201 Acc=0.88 ---233793.82 ms/batch
Step 00037900 L_out=0.056 Acc=0.73 ---257297.87 ms/batch
Step 00037950 L_out=0.138 Acc=0.82 ---280933.38 ms/batch
Step 00038000 L_out=0.137 Acc=0.87 ---304292.32 ms/batch
Round 3 | epoch=26, train costTime=313.2823340892792, | total_activation_sum=5796737
Round 3 | epoch=27, current m_iou=0.6090871796385716
Round 3 | Best m_IoU is: 0.649, OA is: 0.896 | val costTime=117.54170083999634
Round 3 | ****EPOCH 27****
Step 00038050 L_out=0.039 Acc=0.77 ---14587.22 ms/batch
Step 00038100 L_out=0.175 Acc=0.76 ---38142.86 ms/batch
Step 00038150 L_out=0.059 Acc=0.85 ---61594.97 ms/batch
Step 00038200 L_out=0.096 Acc=0.73 ---85046.91 ms/batch
Step 00038250 L_out=0.119 Acc=0.79 ---108529.39 ms/batch
Step 00038300 L_out=0.078 Acc=0.93 ---132131.25 ms/batch
Step 00038350 L_out=0.053 Acc=0.90 ---155618.53 ms/batch
Step 00038400 L_out=0.205 Acc=0.78 ---179152.23 ms/batch
Step 00038450 L_out=0.070 Acc=0.82 ---202561.56 ms/batch
Step 00038500 L_out=0.122 Acc=0.76 ---225959.22 ms/batch
Step 00038550 L_out=0.152 Acc=0.78 ---249575.28 ms/batch
Step 00038600 L_out=0.065 Acc=0.79 ---273036.82 ms/batch
Step 00038650 L_out=0.046 Acc=0.87 ---296636.82 ms/batch
Round 3 | epoch=27, train costTime=313.59698009490967, | total_activation_sum=5693577
Round 3 | epoch=28, current m_iou=0.634027828161832
Round 3 | Best m_IoU is: 0.649, OA is: 0.896 | val costTime=117.51030826568604
Round 3 | ****EPOCH 28****
Step 00038700 L_out=0.128 Acc=0.77 --- 6643.63 ms/batch
Step 00038750 L_out=0.093 Acc=0.66 ---30200.42 ms/batch
Step 00038800 L_out=0.053 Acc=0.72 ---53585.66 ms/batch
Step 00038850 L_out=0.032 Acc=0.93 ---77040.77 ms/batch
Step 00038900 L_out=0.034 Acc=0.93 ---100480.48 ms/batch
Step 00038950 L_out=0.095 Acc=0.92 ---124054.88 ms/batch
Step 00039000 L_out=0.058 Acc=0.95 ---147483.99 ms/batch
Step 00039050 L_out=0.108 Acc=0.85 ---170819.86 ms/batch
Step 00039100 L_out=0.107 Acc=0.66 ---194287.65 ms/batch
Step 00039150 L_out=0.066 Acc=0.80 ---217496.50 ms/batch
Step 00039200 L_out=0.064 Acc=0.88 ---240981.70 ms/batch
Step 00039250 L_out=0.093 Acc=0.83 ---264512.96 ms/batch
Step 00039300 L_out=0.078 Acc=0.73 ---288042.66 ms/batch
Step 00039350 L_out=0.149 Acc=0.81 ---311441.97 ms/batch
Round 3 | epoch=28, train costTime=312.8712434768677, | total_activation_sum=5790689
Round 3 | epoch=29, current m_iou=0.6441653013323669
Round 3 | Best m_IoU is: 0.649, OA is: 0.896 | val costTime=117.22313666343689
Round 3 | ****EPOCH 29****
Step 00039400 L_out=0.209 Acc=0.65 ---22043.05 ms/batch
Step 00039450 L_out=0.122 Acc=0.94 ---45530.34 ms/batch
Step 00039500 L_out=0.240 Acc=0.87 ---68942.84 ms/batch
Step 00039550 L_out=0.209 Acc=0.86 ---92184.86 ms/batch
Step 00039600 L_out=0.237 Acc=0.66 ---115639.95 ms/batch
Step 00039650 L_out=0.076 Acc=0.90 ---139236.70 ms/batch
Step 00039700 L_out=0.056 Acc=0.70 ---162643.96 ms/batch
Step 00039750 L_out=0.061 Acc=0.88 ---185968.91 ms/batch
Step 00039800 L_out=0.115 Acc=0.84 ---209358.05 ms/batch
Step 00039850 L_out=0.131 Acc=0.84 ---232731.60 ms/batch
Step 00039900 L_out=0.138 Acc=0.80 ---256074.69 ms/batch
Step 00039950 L_out=0.087 Acc=0.83 ---279919.97 ms/batch
Step 00040000 L_out=0.047 Acc=0.88 ---303224.83 ms/batch
Round 3 | epoch=29, train costTime=312.51659297943115, | total_activation_sum=5768761
Round 3 | epoch=30, current m_iou=0.6464145387237104
Round 3 | Best m_IoU is: 0.649, OA is: 0.896 | val costTime=117.03026390075684
Round 3 | ****EPOCH 30****
Round 4 | ****EPOCH 0****
Step 00040050 L_out=0.211 Acc=0.64 ---14129.85 ms/batch
Step 00040100 L_out=0.633 Acc=0.18 ---37873.07 ms/batch
Step 00040150 L_out=0.278 Acc=0.03 ---61137.79 ms/batch
Step 00040200 L_out=1.093 Acc=0.57 ---84827.11 ms/batch
Step 00040250 L_out=1.064 Acc=0.61 ---108347.99 ms/batch
Step 00040300 L_out=0.440 Acc=0.42 ---131685.69 ms/batch
Step 00040350 L_out=0.393 Acc=0.43 ---155321.50 ms/batch
Step 00040400 L_out=0.515 Acc=0.54 ---178957.62 ms/batch
Step 00040450 L_out=0.427 Acc=0.55 ---202468.50 ms/batch
Step 00040500 L_out=0.156 Acc=0.64 ---225894.11 ms/batch
Step 00040550 L_out=0.223 Acc=0.66 ---249443.93 ms/batch
Step 00040600 L_out=0.548 Acc=0.70 ---273039.14 ms/batch
Step 00040650 L_out=0.424 Acc=0.74 ---296453.89 ms/batch
Round 4 | epoch=0, train costTime=313.75824880599976, | total_activation_sum=7708721
Round 4 | ****EPOCH 1****
Step 00040700 L_out=0.204 Acc=0.65 --- 6085.19 ms/batch
Step 00040750 L_out=0.967 Acc=0.49 ---29648.04 ms/batch
Step 00040800 L_out=1.805 Acc=0.58 ---53337.42 ms/batch
Step 00040850 L_out=0.574 Acc=0.56 ---76742.17 ms/batch
Step 00040900 L_out=0.394 Acc=0.80 ---100264.41 ms/batch
Step 00040950 L_out=0.302 Acc=0.65 ---123927.08 ms/batch
Step 00041000 L_out=0.562 Acc=0.58 ---147432.03 ms/batch
Step 00041050 L_out=0.207 Acc=0.64 ---170925.58 ms/batch
Step 00041100 L_out=0.331 Acc=0.73 ---194272.24 ms/batch
Step 00041150 L_out=0.953 Acc=0.82 ---217915.45 ms/batch
Step 00041200 L_out=0.348 Acc=0.60 ---241451.96 ms/batch
Step 00041250 L_out=0.463 Acc=0.84 ---265001.11 ms/batch
Step 00041300 L_out=0.116 Acc=0.88 ---288405.68 ms/batch
Step 00041350 L_out=0.549 Acc=0.80 ---311860.00 ms/batch
Round 4 | epoch=1, train costTime=313.7308700084686, | total_activation_sum=7891789
Round 4 | ****EPOCH 2****
Step 00041400 L_out=0.217 Acc=0.75 ---21622.06 ms/batch
Step 00041450 L_out=0.196 Acc=0.87 ---45031.61 ms/batch
Step 00041500 L_out=0.503 Acc=0.68 ---68408.03 ms/batch
Step 00041550 L_out=0.198 Acc=0.79 ---91753.52 ms/batch
Step 00041600 L_out=0.182 Acc=0.91 ---115067.95 ms/batch
Step 00041650 L_out=0.312 Acc=0.77 ---138490.54 ms/batch
Step 00041700 L_out=0.237 Acc=0.64 ---162003.04 ms/batch
Step 00041750 L_out=0.186 Acc=0.70 ---185340.27 ms/batch
Step 00041800 L_out=0.480 Acc=0.51 ---208812.10 ms/batch
Step 00041850 L_out=0.271 Acc=0.69 ---232112.31 ms/batch
Step 00041900 L_out=0.348 Acc=0.76 ---255710.67 ms/batch
Step 00041950 L_out=0.056 Acc=0.86 ---279166.54 ms/batch
Step 00042000 L_out=0.124 Acc=0.76 ---302636.85 ms/batch
Round 4 | epoch=2, train costTime=312.41027641296387, | total_activation_sum=7754826
Round 4 | ****EPOCH 3****
Step 00042050 L_out=0.464 Acc=0.73 ---13690.15 ms/batch
Step 00042100 L_out=0.320 Acc=0.68 ---37143.06 ms/batch
Step 00042150 L_out=0.163 Acc=0.66 ---60770.42 ms/batch
Step 00042200 L_out=0.294 Acc=0.76 ---84222.62 ms/batch
Step 00042250 L_out=0.246 Acc=0.79 ---107755.77 ms/batch
Step 00042300 L_out=0.566 Acc=0.68 ---131197.88 ms/batch
Step 00042350 L_out=0.328 Acc=0.86 ---154664.15 ms/batch
Step 00042400 L_out=0.269 Acc=0.75 ---178000.71 ms/batch
Step 00042450 L_out=0.236 Acc=0.71 ---201256.30 ms/batch
Step 00042500 L_out=0.160 Acc=0.71 ---224679.76 ms/batch
Step 00042550 L_out=0.342 Acc=0.71 ---248249.33 ms/batch
Step 00042600 L_out=0.285 Acc=0.84 ---271594.23 ms/batch
Step 00042650 L_out=0.254 Acc=0.91 ---294835.09 ms/batch
Round 4 | epoch=3, train costTime=312.52908182144165, | total_activation_sum=7839208
Round 4 | ****EPOCH 4****
Step 00042700 L_out=0.306 Acc=0.90 --- 5670.33 ms/batch
Step 00042750 L_out=0.021 Acc=0.73 ---29124.00 ms/batch
Step 00042800 L_out=0.042 Acc=0.79 ---52714.56 ms/batch
Step 00042850 L_out=0.432 Acc=0.65 ---76266.25 ms/batch
Step 00042900 L_out=0.299 Acc=0.90 ---99673.98 ms/batch
Step 00042950 L_out=0.171 Acc=0.78 ---122925.87 ms/batch
Step 00043000 L_out=0.087 Acc=0.69 ---146220.26 ms/batch
Step 00043050 L_out=0.118 Acc=0.90 ---169754.40 ms/batch
Step 00043100 L_out=0.203 Acc=0.85 ---193318.29 ms/batch
Step 00043150 L_out=0.316 Acc=0.75 ---216442.86 ms/batch
Step 00043200 L_out=0.205 Acc=0.81 ---239823.28 ms/batch
Step 00043250 L_out=0.702 Acc=0.73 ---263428.15 ms/batch
Step 00043300 L_out=0.443 Acc=0.77 ---286972.29 ms/batch
Step 00043350 L_out=0.120 Acc=0.63 ---310507.11 ms/batch
Round 4 | epoch=4, train costTime=312.86121225357056, | total_activation_sum=7775272
Round 4 | ****EPOCH 5****
Step 00043400 L_out=0.168 Acc=0.86 ---21123.13 ms/batch
Step 00043450 L_out=0.502 Acc=0.66 ---44553.69 ms/batch
Step 00043500 L_out=0.396 Acc=0.71 ---67839.70 ms/batch
Step 00043550 L_out=0.120 Acc=0.79 ---91261.80 ms/batch
Step 00043600 L_out=0.360 Acc=0.87 ---114462.97 ms/batch
Step 00043650 L_out=0.188 Acc=0.81 ---137881.50 ms/batch
Step 00043700 L_out=0.169 Acc=0.83 ---161295.42 ms/batch
Step 00043750 L_out=0.275 Acc=0.69 ---184736.99 ms/batch
Step 00043800 L_out=0.116 Acc=0.85 ---208299.79 ms/batch
Step 00043850 L_out=0.448 Acc=0.73 ---231708.69 ms/batch
Step 00043900 L_out=0.221 Acc=0.78 ---255115.70 ms/batch
Step 00043950 L_out=0.316 Acc=0.87 ---278658.67 ms/batch
Step 00044000 L_out=0.123 Acc=0.62 ---301997.92 ms/batch
Round 4 | epoch=5, train costTime=312.26626896858215, | total_activation_sum=8002410
Round 4 | ****EPOCH 6****
Step 00044050 L_out=0.468 Acc=0.56 ---13250.83 ms/batch
Step 00044100 L_out=0.088 Acc=0.85 ---36687.13 ms/batch
Step 00044150 L_out=0.220 Acc=0.82 ---59863.98 ms/batch
Step 00044200 L_out=0.123 Acc=0.86 ---83417.25 ms/batch
Step 00044250 L_out=0.293 Acc=0.86 ---106904.69 ms/batch
Step 00044300 L_out=0.493 Acc=0.76 ---130164.34 ms/batch
Step 00044350 L_out=0.514 Acc=0.76 ---153737.83 ms/batch
Step 00044400 L_out=0.172 Acc=0.79 ---177193.41 ms/batch
Step 00044450 L_out=0.216 Acc=0.71 ---200801.37 ms/batch
Step 00044500 L_out=0.651 Acc=0.60 ---224076.77 ms/batch
Step 00044550 L_out=0.149 Acc=0.83 ---247308.83 ms/batch
Step 00044600 L_out=0.110 Acc=0.86 ---270780.20 ms/batch
Step 00044650 L_out=0.713 Acc=0.63 ---294187.30 ms/batch
Round 4 | epoch=6, train costTime=312.57719898223877, | total_activation_sum=7774621
Round 4 | ****EPOCH 7****
Step 00044700 L_out=0.150 Acc=0.72 --- 5078.62 ms/batch
Step 00044750 L_out=0.167 Acc=0.80 ---28496.38 ms/batch
Step 00044800 L_out=0.628 Acc=0.71 ---51949.40 ms/batch
Step 00044850 L_out=0.486 Acc=0.73 ---75434.71 ms/batch
Step 00044900 L_out=0.076 Acc=0.79 ---98877.08 ms/batch
Step 00044950 L_out=0.417 Acc=0.87 ---122234.24 ms/batch
Step 00045000 L_out=0.203 Acc=0.77 ---145613.87 ms/batch
Step 00045050 L_out=0.322 Acc=0.76 ---168984.53 ms/batch
Step 00045100 L_out=0.314 Acc=0.81 ---192467.37 ms/batch
Step 00045150 L_out=0.387 Acc=0.84 ---215833.14 ms/batch
Step 00045200 L_out=0.501 Acc=0.81 ---239018.36 ms/batch
Step 00045250 L_out=0.154 Acc=0.80 ---262463.94 ms/batch
Step 00045300 L_out=0.192 Acc=0.88 ---286069.09 ms/batch
Step 00045350 L_out=0.126 Acc=0.75 ---309261.43 ms/batch
Round 4 | epoch=7, train costTime=312.0321915149689, | total_activation_sum=7801265
Round 4 | ****EPOCH 8****
Step 00045400 L_out=0.307 Acc=0.78 ---20402.58 ms/batch
Step 00045450 L_out=0.143 Acc=0.84 ---44063.27 ms/batch
Step 00045500 L_out=0.414 Acc=0.84 ---67386.21 ms/batch
Step 00045550 L_out=0.176 Acc=0.69 ---90969.16 ms/batch
Step 00045600 L_out=0.208 Acc=0.80 ---114230.45 ms/batch
Step 00045650 L_out=0.312 Acc=0.76 ---137918.40 ms/batch
Step 00045700 L_out=0.141 Acc=0.81 ---161232.92 ms/batch
Step 00045750 L_out=0.508 Acc=0.69 ---184713.65 ms/batch
Step 00045800 L_out=0.242 Acc=0.87 ---208147.94 ms/batch
Step 00045850 L_out=0.086 Acc=0.92 ---231483.24 ms/batch
Step 00045900 L_out=0.200 Acc=0.77 ---254799.09 ms/batch
Step 00045950 L_out=0.297 Acc=0.79 ---278204.69 ms/batch
Step 00046000 L_out=0.199 Acc=0.73 ---301622.86 ms/batch
Round 4 | epoch=8, train costTime=312.3033378124237, | total_activation_sum=7940888
Round 4 | ****EPOCH 9****
Step 00046050 L_out=0.227 Acc=0.89 ---12467.21 ms/batch
Step 00046100 L_out=0.184 Acc=0.61 ---35773.59 ms/batch
Step 00046150 L_out=0.137 Acc=0.92 ---59256.53 ms/batch
Step 00046200 L_out=0.409 Acc=0.81 ---82704.95 ms/batch
Step 00046250 L_out=0.148 Acc=0.83 ---106047.13 ms/batch
Step 00046300 L_out=0.321 Acc=0.72 ---129427.46 ms/batch
Step 00046350 L_out=0.074 Acc=0.68 ---152896.61 ms/batch
Step 00046400 L_out=0.135 Acc=0.85 ---176607.77 ms/batch
Step 00046450 L_out=0.095 Acc=0.81 ---200111.12 ms/batch
Step 00046500 L_out=0.195 Acc=0.81 ---223633.44 ms/batch
Step 00046550 L_out=0.025 Acc=0.80 ---247138.42 ms/batch
Step 00046600 L_out=0.233 Acc=0.80 ---270660.12 ms/batch
Step 00046650 L_out=0.122 Acc=0.88 ---294006.12 ms/batch
Round 4 | epoch=9, train costTime=312.61878967285156, | total_activation_sum=7728680
Round 4 | ****EPOCH 10****
Step 00046700 L_out=0.361 Acc=0.88 --- 4702.63 ms/batch
Step 00046750 L_out=0.284 Acc=0.89 ---28067.85 ms/batch
Step 00046800 L_out=0.135 Acc=0.88 ---51432.19 ms/batch
Step 00046850 L_out=0.227 Acc=0.57 ---74942.29 ms/batch
Step 00046900 L_out=0.262 Acc=0.92 ---98448.28 ms/batch
Step 00046950 L_out=0.159 Acc=0.83 ---121969.97 ms/batch
Step 00047000 L_out=0.371 Acc=0.86 ---145565.36 ms/batch
Step 00047050 L_out=0.329 Acc=0.81 ---169051.09 ms/batch
Step 00047100 L_out=0.202 Acc=0.53 ---192610.03 ms/batch
Step 00047150 L_out=0.255 Acc=0.88 ---216121.26 ms/batch
Step 00047200 L_out=0.158 Acc=0.89 ---239499.88 ms/batch
Step 00047250 L_out=0.131 Acc=0.85 ---263090.39 ms/batch
Step 00047300 L_out=0.390 Acc=0.86 ---286273.93 ms/batch
Step 00047350 L_out=0.058 Acc=0.86 ---309662.40 ms/batch
Round 4 | epoch=10, train costTime=312.98894000053406, | total_activation_sum=7926247
Round 4 | ****EPOCH 11****
Step 00047400 L_out=0.262 Acc=0.78 ---20014.86 ms/batch
Step 00047450 L_out=0.295 Acc=0.86 ---43312.17 ms/batch
Step 00047500 L_out=0.213 Acc=0.94 ---66702.96 ms/batch
Step 00047550 L_out=0.227 Acc=0.93 ---90302.57 ms/batch
Step 00047600 L_out=0.106 Acc=0.63 ---113733.41 ms/batch
Step 00047650 L_out=0.192 Acc=0.84 ---137169.51 ms/batch
Step 00047700 L_out=0.385 Acc=0.83 ---160661.22 ms/batch
Step 00047750 L_out=0.203 Acc=0.68 ---183977.55 ms/batch
Step 00047800 L_out=0.105 Acc=0.88 ---207368.78 ms/batch
Step 00047850 L_out=0.239 Acc=0.79 ---230638.02 ms/batch
Step 00047900 L_out=0.260 Acc=0.95 ---254165.64 ms/batch
Step 00047950 L_out=0.233 Acc=0.87 ---277478.38 ms/batch
Step 00048000 L_out=0.147 Acc=0.93 ---300929.16 ms/batch
Round 4 | epoch=11, train costTime=312.3075406551361, | total_activation_sum=7846578
Round 4 | ****EPOCH 12****
Step 00048050 L_out=0.213 Acc=0.91 ---12225.49 ms/batch
Step 00048100 L_out=0.165 Acc=0.90 ---35696.18 ms/batch
Step 00048150 L_out=0.524 Acc=0.81 ---59101.24 ms/batch
Step 00048200 L_out=0.090 Acc=0.66 ---82410.76 ms/batch
Step 00048250 L_out=0.137 Acc=0.93 ---106013.58 ms/batch
Step 00048300 L_out=0.160 Acc=0.90 ---129385.27 ms/batch
Step 00048350 L_out=0.183 Acc=0.84 ---152894.65 ms/batch
Step 00048400 L_out=0.206 Acc=0.91 ---176213.04 ms/batch
Step 00048450 L_out=0.138 Acc=0.92 ---199468.54 ms/batch
Step 00048500 L_out=0.373 Acc=0.89 ---222887.07 ms/batch
Step 00048550 L_out=0.238 Acc=0.94 ---246460.12 ms/batch
Step 00048600 L_out=0.163 Acc=0.89 ---269965.14 ms/batch
Step 00048650 L_out=0.100 Acc=0.86 ---293396.40 ms/batch
Round 4 | epoch=12, train costTime=312.5908076763153, | total_activation_sum=7796911
Round 4 | ****EPOCH 13****
Step 00048700 L_out=0.190 Acc=0.91 --- 4143.75 ms/batch
Step 00048750 L_out=0.470 Acc=0.82 ---27662.93 ms/batch
Step 00048800 L_out=0.037 Acc=0.83 ---51194.87 ms/batch
Step 00048850 L_out=0.112 Acc=0.87 ---74556.88 ms/batch
Step 00048900 L_out=0.113 Acc=0.93 ---98196.47 ms/batch
Step 00048950 L_out=0.323 Acc=0.83 ---121517.81 ms/batch
Step 00049000 L_out=0.333 Acc=0.92 ---144800.41 ms/batch
Step 00049050 L_out=0.215 Acc=0.82 ---168273.52 ms/batch
Step 00049100 L_out=0.187 Acc=0.84 ---191521.32 ms/batch
Step 00049150 L_out=0.240 Acc=0.79 ---214795.64 ms/batch
Step 00049200 L_out=0.352 Acc=0.76 ---238077.92 ms/batch
Step 00049250 L_out=0.236 Acc=0.85 ---261506.47 ms/batch
Step 00049300 L_out=0.071 Acc=0.92 ---285045.30 ms/batch
Step 00049350 L_out=0.211 Acc=0.69 ---308499.33 ms/batch
Round 4 | epoch=13, train costTime=312.2274889945984, | total_activation_sum=7877705
Round 4 | ****EPOCH 14****
Step 00049400 L_out=0.224 Acc=0.90 ---19608.49 ms/batch
Step 00049450 L_out=0.286 Acc=0.64 ---42946.81 ms/batch
Step 00049500 L_out=0.124 Acc=0.95 ---66192.78 ms/batch
Step 00049550 L_out=0.193 Acc=0.87 ---89542.88 ms/batch
Step 00049600 L_out=0.157 Acc=0.88 ---112860.63 ms/batch
Step 00049650 L_out=0.148 Acc=0.88 ---136375.31 ms/batch
Step 00049700 L_out=0.332 Acc=0.90 ---159960.97 ms/batch
Step 00049750 L_out=0.181 Acc=0.91 ---183529.94 ms/batch
Step 00049800 L_out=0.130 Acc=0.87 ---206942.61 ms/batch
Step 00049850 L_out=0.165 Acc=0.83 ---230069.30 ms/batch
Step 00049900 L_out=0.074 Acc=0.57 ---253455.30 ms/batch
Step 00049950 L_out=0.105 Acc=0.87 ---276814.04 ms/batch
Step 00050000 L_out=0.341 Acc=0.81 ---300480.94 ms/batch
Round 4 | epoch=14, train costTime=312.02119064331055, | total_activation_sum=7851837
Round 4 | ****EPOCH 15****
Step 00050050 L_out=0.166 Acc=0.90 ---11718.83 ms/batch
Step 00050100 L_out=0.475 Acc=0.76 ---35200.73 ms/batch
Step 00050150 L_out=0.152 Acc=0.76 ---58575.46 ms/batch
Step 00050200 L_out=0.151 Acc=0.75 ---82104.83 ms/batch
Step 00050250 L_out=0.092 Acc=0.89 ---105572.66 ms/batch
Step 00050300 L_out=0.106 Acc=0.76 ---128981.76 ms/batch
Step 00050350 L_out=0.189 Acc=0.78 ---152431.35 ms/batch
Step 00050400 L_out=0.352 Acc=0.80 ---175899.62 ms/batch
Step 00050450 L_out=0.266 Acc=0.77 ---199196.61 ms/batch
Step 00050500 L_out=0.156 Acc=0.88 ---222557.88 ms/batch
Step 00050550 L_out=0.165 Acc=0.82 ---245903.66 ms/batch
Step 00050600 L_out=0.102 Acc=0.81 ---269366.66 ms/batch
Step 00050650 L_out=0.487 Acc=0.83 ---292739.07 ms/batch
Round 4 | epoch=15, train costTime=312.3512969017029, | total_activation_sum=7909289
Round 4 | ****EPOCH 16****
Step 00050700 L_out=0.091 Acc=0.85 --- 3775.78 ms/batch
Step 00050750 L_out=0.164 Acc=0.85 ---27093.00 ms/batch
Step 00050800 L_out=0.061 Acc=0.94 ---50337.47 ms/batch
Step 00050850 L_out=0.344 Acc=0.70 ---73838.36 ms/batch
Step 00050900 L_out=0.488 Acc=0.86 ---97241.82 ms/batch
Step 00050950 L_out=0.089 Acc=0.96 ---120342.89 ms/batch
Step 00051000 L_out=0.150 Acc=0.86 ---143657.30 ms/batch
Step 00051050 L_out=0.020 Acc=0.92 ---166995.31 ms/batch
Step 00051100 L_out=0.215 Acc=0.93 ---190767.45 ms/batch
Step 00051150 L_out=0.073 Acc=0.81 ---214062.31 ms/batch
Step 00051200 L_out=0.307 Acc=0.80 ---237262.99 ms/batch
Step 00051250 L_out=0.148 Acc=0.94 ---260732.46 ms/batch
Step 00051300 L_out=0.196 Acc=0.85 ---284133.94 ms/batch
Step 00051350 L_out=0.141 Acc=0.91 ---307651.63 ms/batch
Round 4 | epoch=16, train costTime=311.93287229537964, | total_activation_sum=7836984
Round 4 | ****EPOCH 17****
Step 00051400 L_out=0.239 Acc=0.80 ---19207.04 ms/batch
Step 00051450 L_out=0.135 Acc=0.83 ---42515.18 ms/batch
Step 00051500 L_out=0.337 Acc=0.78 ---65887.41 ms/batch
Step 00051550 L_out=0.212 Acc=0.86 ---89326.02 ms/batch
Step 00051600 L_out=0.131 Acc=0.88 ---112634.73 ms/batch
Step 00051650 L_out=0.211 Acc=0.81 ---136157.78 ms/batch
Step 00051700 L_out=0.130 Acc=0.89 ---159675.04 ms/batch
Step 00051750 L_out=0.233 Acc=0.79 ---183291.59 ms/batch
Step 00051800 L_out=0.182 Acc=0.94 ---206756.54 ms/batch
Step 00051850 L_out=0.214 Acc=0.84 ---230153.71 ms/batch
Step 00051900 L_out=0.074 Acc=0.92 ---253439.73 ms/batch
Step 00051950 L_out=0.233 Acc=0.87 ---276824.72 ms/batch
Step 00052000 L_out=0.139 Acc=0.73 ---300365.11 ms/batch
Round 4 | epoch=17, train costTime=312.55888652801514, | total_activation_sum=7700520
Round 4 | epoch=18, current m_iou=0.6666636146396399
Round 4 | Best m_IoU is: 0.667, OA is: 0.909 | val costTime=117.75935983657837
Round 4 | ****EPOCH 18****
Step 00052050 L_out=0.114 Acc=0.90 ---11230.63 ms/batch
Step 00052100 L_out=0.126 Acc=0.95 ---34622.63 ms/batch
Step 00052150 L_out=0.147 Acc=0.80 ---58440.18 ms/batch
Step 00052200 L_out=0.189 Acc=0.90 ---81854.75 ms/batch
Step 00052250 L_out=0.140 Acc=0.89 ---105173.04 ms/batch
Step 00052300 L_out=0.095 Acc=0.93 ---128581.44 ms/batch
Step 00052350 L_out=0.301 Acc=0.89 ---151920.69 ms/batch
Step 00052400 L_out=0.108 Acc=0.83 ---175432.55 ms/batch
Step 00052450 L_out=0.247 Acc=0.80 ---198828.63 ms/batch
Step 00052500 L_out=0.066 Acc=0.93 ---222152.27 ms/batch
Step 00052550 L_out=0.049 Acc=0.85 ---245625.07 ms/batch
Step 00052600 L_out=0.103 Acc=0.85 ---268933.63 ms/batch
Step 00052650 L_out=0.236 Acc=0.60 ---292193.95 ms/batch
Round 4 | epoch=18, train costTime=312.2419443130493, | total_activation_sum=7988065
Round 4 | epoch=19, current m_iou=0.6777585235370313
Round 4 | Best m_IoU is: 0.678, OA is: 0.916 | val costTime=117.58698225021362
Round 4 | ****EPOCH 19****
Step 00052700 L_out=0.084 Acc=0.88 --- 3243.91 ms/batch
Step 00052750 L_out=0.189 Acc=0.87 ---26664.73 ms/batch
Step 00052800 L_out=0.231 Acc=0.84 ---50174.38 ms/batch
Step 00052850 L_out=0.089 Acc=0.83 ---73605.98 ms/batch
Step 00052900 L_out=0.162 Acc=0.84 ---97003.70 ms/batch
Step 00052950 L_out=0.180 Acc=0.75 ---120446.46 ms/batch
Step 00053000 L_out=0.103 Acc=0.85 ---143673.91 ms/batch
Step 00053050 L_out=0.043 Acc=0.87 ---167138.36 ms/batch
Step 00053100 L_out=0.238 Acc=0.92 ---190569.99 ms/batch
Step 00053150 L_out=0.085 Acc=0.92 ---214046.73 ms/batch
Step 00053200 L_out=0.278 Acc=0.75 ---237590.74 ms/batch
Step 00053250 L_out=0.098 Acc=0.89 ---260896.59 ms/batch
Step 00053300 L_out=0.191 Acc=0.86 ---284285.77 ms/batch
Step 00053350 L_out=0.070 Acc=0.89 ---307686.20 ms/batch
Round 4 | epoch=19, train costTime=312.4104120731354, | total_activation_sum=7798928
Round 4 | epoch=20, current m_iou=0.6900484784433591
Round 4 | Best m_IoU is: 0.690, OA is: 0.917 | val costTime=117.38043284416199
Round 4 | ****EPOCH 20****
Step 00053400 L_out=0.075 Acc=0.93 ---18656.44 ms/batch
Step 00053450 L_out=0.114 Acc=0.90 ---42067.36 ms/batch
Step 00053500 L_out=0.168 Acc=0.85 ---65432.42 ms/batch
Step 00053550 L_out=0.074 Acc=0.70 ---88942.95 ms/batch
Step 00053600 L_out=0.160 Acc=0.90 ---112380.32 ms/batch
Step 00053650 L_out=0.274 Acc=0.84 ---135864.42 ms/batch
Step 00053700 L_out=0.169 Acc=0.84 ---159131.02 ms/batch
Step 00053750 L_out=0.165 Acc=0.89 ---182522.81 ms/batch
Step 00053800 L_out=0.457 Acc=0.70 ---205814.37 ms/batch
Step 00053850 L_out=0.350 Acc=0.80 ---229138.66 ms/batch
Step 00053900 L_out=0.068 Acc=0.95 ---252316.45 ms/batch
Step 00053950 L_out=0.179 Acc=0.87 ---275715.79 ms/batch
Step 00054000 L_out=0.179 Acc=0.82 ---298967.78 ms/batch
Round 4 | epoch=20, train costTime=311.69195675849915, | total_activation_sum=7843902
Round 4 | epoch=21, current m_iou=0.6883617247457641
Round 4 | Best m_IoU is: 0.690, OA is: 0.917 | val costTime=117.43571662902832
Round 4 | ****EPOCH 21****
Step 00054050 L_out=0.183 Acc=0.89 ---10863.82 ms/batch
Step 00054100 L_out=0.039 Acc=0.95 ---34319.06 ms/batch
Step 00054150 L_out=0.381 Acc=0.80 ---57788.96 ms/batch
Step 00054200 L_out=0.089 Acc=0.90 ---81196.43 ms/batch
Step 00054250 L_out=0.078 Acc=0.95 ---104746.29 ms/batch
Step 00054300 L_out=0.209 Acc=0.88 ---128115.89 ms/batch
Step 00054350 L_out=0.013 Acc=0.93 ---151608.59 ms/batch
Step 00054400 L_out=0.110 Acc=0.87 ---175221.24 ms/batch
Step 00054450 L_out=0.122 Acc=0.95 ---198567.21 ms/batch
Step 00054500 L_out=0.225 Acc=0.92 ---221970.22 ms/batch
Step 00054550 L_out=0.093 Acc=0.86 ---245381.34 ms/batch
Step 00054600 L_out=0.135 Acc=0.86 ---268953.28 ms/batch
Step 00054650 L_out=0.203 Acc=0.91 ---292446.17 ms/batch
Round 4 | epoch=21, train costTime=313.0215439796448, | total_activation_sum=7770025
Round 4 | epoch=22, current m_iou=0.6928427215449556
Round 4 | Best m_IoU is: 0.693, OA is: 0.920 | val costTime=117.4698920249939
Round 4 | ****EPOCH 22****
Step 00054700 L_out=0.204 Acc=0.91 --- 2855.85 ms/batch
Step 00054750 L_out=0.147 Acc=0.89 ---26259.18 ms/batch
Step 00054800 L_out=0.127 Acc=0.93 ---49851.76 ms/batch
Step 00054850 L_out=0.051 Acc=0.87 ---73310.31 ms/batch
Step 00054900 L_out=0.255 Acc=0.93 ---96732.03 ms/batch
Step 00054950 L_out=0.128 Acc=0.88 ---120216.92 ms/batch
Step 00055000 L_out=0.193 Acc=0.70 ---143823.81 ms/batch
Step 00055050 L_out=0.147 Acc=0.95 ---167305.80 ms/batch
Step 00055100 L_out=0.235 Acc=0.80 ---190803.41 ms/batch
Step 00055150 L_out=0.350 Acc=0.81 ---213994.14 ms/batch
Step 00055200 L_out=0.194 Acc=0.89 ---237448.11 ms/batch
Step 00055250 L_out=0.137 Acc=0.73 ---260908.05 ms/batch
Step 00055300 L_out=0.128 Acc=0.77 ---284291.13 ms/batch
Step 00055350 L_out=0.071 Acc=0.90 ---307728.12 ms/batch
Round 4 | epoch=22, train costTime=312.91549468040466, | total_activation_sum=8006253
Round 4 | epoch=23, current m_iou=0.6993289275563448
Round 4 | Best m_IoU is: 0.699, OA is: 0.922 | val costTime=117.23636174201965
Round 4 | ****EPOCH 23****
Step 00055400 L_out=0.123 Acc=0.86 ---18263.38 ms/batch
Step 00055450 L_out=0.052 Acc=0.94 ---41442.92 ms/batch
Step 00055500 L_out=0.112 Acc=0.87 ---64904.95 ms/batch
Step 00055550 L_out=0.124 Acc=0.86 ---88274.96 ms/batch
Step 00055600 L_out=0.313 Acc=0.90 ---111705.67 ms/batch
Step 00055650 L_out=0.056 Acc=0.78 ---135235.39 ms/batch
Step 00055700 L_out=0.102 Acc=0.95 ---158635.45 ms/batch
Step 00055750 L_out=0.082 Acc=0.91 ---181929.60 ms/batch
Step 00055800 L_out=0.118 Acc=0.81 ---205303.79 ms/batch
Step 00055850 L_out=0.023 Acc=0.81 ---228604.34 ms/batch
Step 00055900 L_out=0.060 Acc=0.85 ---251774.94 ms/batch
Step 00055950 L_out=0.275 Acc=0.84 ---275363.18 ms/batch
Step 00056000 L_out=0.208 Acc=0.93 ---298856.10 ms/batch
Round 4 | epoch=23, train costTime=311.8952281475067, | total_activation_sum=7828549
Round 4 | epoch=24, current m_iou=0.6946786690231163
Round 4 | Best m_IoU is: 0.699, OA is: 0.922 | val costTime=117.33932709693909
Round 4 | ****EPOCH 24****
Step 00056050 L_out=0.202 Acc=0.88 ---10325.19 ms/batch
Step 00056100 L_out=0.230 Acc=0.78 ---33737.36 ms/batch
Step 00056150 L_out=0.128 Acc=0.79 ---57008.52 ms/batch
Step 00056200 L_out=0.042 Acc=0.87 ---80485.35 ms/batch
Step 00056250 L_out=0.065 Acc=0.90 ---103761.40 ms/batch
Step 00056300 L_out=0.157 Acc=0.88 ---127415.38 ms/batch
Step 00056350 L_out=0.282 Acc=0.88 ---150820.43 ms/batch
Step 00056400 L_out=0.182 Acc=0.86 ---174270.67 ms/batch
Step 00056450 L_out=0.160 Acc=0.92 ---197689.45 ms/batch
Step 00056500 L_out=0.347 Acc=0.84 ---221199.46 ms/batch
Step 00056550 L_out=0.195 Acc=0.88 ---244761.92 ms/batch
Step 00056600 L_out=0.128 Acc=0.91 ---267989.13 ms/batch
Step 00056650 L_out=0.176 Acc=0.85 ---291254.41 ms/batch
Round 4 | epoch=24, train costTime=312.3474168777466, | total_activation_sum=7926543
Round 4 | epoch=25, current m_iou=0.6900974016039911
Round 4 | Best m_IoU is: 0.699, OA is: 0.922 | val costTime=117.0757348537445
Round 4 | ****EPOCH 25****
Step 00056700 L_out=0.163 Acc=0.86 --- 2411.01 ms/batch
Step 00056750 L_out=0.186 Acc=0.80 ---25705.15 ms/batch
Step 00056800 L_out=0.139 Acc=0.67 ---48945.84 ms/batch
Step 00056850 L_out=0.178 Acc=0.86 ---72372.19 ms/batch
Step 00056900 L_out=0.156 Acc=0.93 ---95664.87 ms/batch
Step 00056950 L_out=0.190 Acc=0.95 ---119079.98 ms/batch
Step 00057000 L_out=0.198 Acc=0.93 ---142478.19 ms/batch
Step 00057050 L_out=0.147 Acc=0.90 ---165739.05 ms/batch
Step 00057100 L_out=0.044 Acc=0.60 ---189042.18 ms/batch
Step 00057150 L_out=0.086 Acc=0.92 ---212595.05 ms/batch
Step 00057200 L_out=0.079 Acc=0.89 ---235964.34 ms/batch
Step 00057250 L_out=0.186 Acc=0.90 ---259354.66 ms/batch
Step 00057300 L_out=0.163 Acc=0.82 ---282876.02 ms/batch
Step 00057350 L_out=0.119 Acc=0.76 ---306203.65 ms/batch
Round 4 | epoch=25, train costTime=311.82959747314453, | total_activation_sum=7654105
Round 4 | epoch=26, current m_iou=0.6911214637281519
Round 4 | Best m_IoU is: 0.699, OA is: 0.922 | val costTime=117.36194276809692
Round 4 | ****EPOCH 26****
Step 00057400 L_out=0.132 Acc=0.87 ---17793.37 ms/batch
Step 00057450 L_out=0.099 Acc=0.83 ---41356.92 ms/batch
Step 00057500 L_out=0.064 Acc=0.89 ---64804.53 ms/batch
Step 00057550 L_out=0.133 Acc=0.75 ---88273.05 ms/batch
Step 00057600 L_out=0.049 Acc=0.91 ---111617.16 ms/batch
Step 00057650 L_out=0.191 Acc=0.82 ---134950.23 ms/batch
Step 00057700 L_out=0.306 Acc=0.79 ---158217.39 ms/batch
Step 00057750 L_out=0.152 Acc=0.90 ---181562.72 ms/batch
Step 00057800 L_out=0.147 Acc=0.92 ---204831.51 ms/batch
Step 00057850 L_out=0.067 Acc=0.81 ---228315.33 ms/batch
Step 00057900 L_out=0.091 Acc=0.87 ---251905.84 ms/batch
Step 00057950 L_out=0.124 Acc=0.93 ---275308.15 ms/batch
Step 00058000 L_out=0.106 Acc=0.94 ---298736.27 ms/batch
Round 4 | epoch=26, train costTime=312.43360137939453, | total_activation_sum=7883330
Round 4 | epoch=27, current m_iou=0.6821214869582415
Round 4 | Best m_IoU is: 0.699, OA is: 0.922 | val costTime=116.46269106864929
Round 4 | ****EPOCH 27****
Step 00058050 L_out=0.089 Acc=0.89 --- 9907.52 ms/batch
Step 00058100 L_out=0.083 Acc=0.93 ---33422.30 ms/batch
Step 00058150 L_out=0.055 Acc=0.88 ---56671.89 ms/batch
Step 00058200 L_out=0.260 Acc=0.91 ---80057.53 ms/batch
Step 00058250 L_out=0.175 Acc=0.90 ---103578.84 ms/batch
Step 00058300 L_out=0.137 Acc=0.92 ---127022.10 ms/batch
Step 00058350 L_out=0.202 Acc=0.82 ---150510.53 ms/batch
Step 00058400 L_out=0.122 Acc=0.90 ---174015.32 ms/batch
Step 00058450 L_out=0.095 Acc=0.83 ---197544.62 ms/batch
Step 00058500 L_out=0.077 Acc=0.92 ---220997.20 ms/batch
Step 00058550 L_out=0.094 Acc=0.93 ---244515.22 ms/batch
Step 00058600 L_out=0.104 Acc=0.85 ---268062.27 ms/batch
Step 00058650 L_out=0.142 Acc=0.89 ---291610.59 ms/batch
Round 4 | epoch=27, train costTime=313.13303780555725, | total_activation_sum=7876198
Round 4 | epoch=28, current m_iou=0.68113099018174
Round 4 | Best m_IoU is: 0.699, OA is: 0.922 | val costTime=117.3508095741272
Round 4 | ****EPOCH 28****
Step 00058700 L_out=0.073 Acc=0.93 --- 1930.39 ms/batch
Step 00058750 L_out=0.252 Acc=0.89 ---25565.52 ms/batch
Step 00058800 L_out=0.173 Acc=0.87 ---48956.81 ms/batch
Step 00058850 L_out=0.359 Acc=0.82 ---72444.09 ms/batch
Step 00058900 L_out=0.106 Acc=0.88 ---95700.07 ms/batch
Step 00058950 L_out=0.076 Acc=0.87 ---119236.12 ms/batch
Step 00059000 L_out=0.068 Acc=0.76 ---142708.58 ms/batch
Step 00059050 L_out=0.182 Acc=0.90 ---166194.26 ms/batch
Step 00059100 L_out=0.082 Acc=0.73 ---189651.97 ms/batch
Step 00059150 L_out=0.240 Acc=0.80 ---213060.30 ms/batch
Step 00059200 L_out=0.182 Acc=0.80 ---236546.90 ms/batch
Step 00059250 L_out=0.206 Acc=0.90 ---260194.39 ms/batch
Step 00059300 L_out=0.064 Acc=0.64 ---283472.13 ms/batch
Step 00059350 L_out=0.070 Acc=0.89 ---306867.61 ms/batch
Round 4 | epoch=28, train costTime=312.91363859176636, | total_activation_sum=7869922
Round 4 | epoch=29, current m_iou=0.6866689853539698
Round 4 | Best m_IoU is: 0.699, OA is: 0.922 | val costTime=117.895831823349
Round 4 | ****EPOCH 29****
Step 00059400 L_out=0.134 Acc=0.90 ---17250.36 ms/batch
Step 00059450 L_out=0.124 Acc=0.87 ---40599.46 ms/batch
Step 00059500 L_out=0.129 Acc=0.80 ---63923.83 ms/batch
Step 00059550 L_out=0.296 Acc=0.84 ---87330.44 ms/batch
Step 00059600 L_out=0.178 Acc=0.91 ---110843.71 ms/batch
Step 00059650 L_out=0.143 Acc=0.92 ---134252.41 ms/batch
Step 00059700 L_out=0.124 Acc=0.84 ---157966.50 ms/batch
Step 00059750 L_out=0.113 Acc=0.91 ---181641.37 ms/batch
Step 00059800 L_out=0.304 Acc=0.75 ---205086.61 ms/batch
Step 00059850 L_out=0.077 Acc=0.90 ---228391.14 ms/batch
Step 00059900 L_out=0.148 Acc=0.93 ---251966.10 ms/batch
Step 00059950 L_out=0.064 Acc=0.86 ---275612.36 ms/batch
Step 00060000 L_out=0.184 Acc=0.74 ---298965.19 ms/batch
Round 4 | epoch=29, train costTime=312.93054151535034, | total_activation_sum=7921754
Round 4 | epoch=30, current m_iou=0.6887864966842376
Round 4 | Best m_IoU is: 0.699, OA is: 0.922 | val costTime=116.95030379295349
Round 4 | ****EPOCH 30****
Round 5 | ****EPOCH 0****
Step 00060050 L_out=0.210 Acc=0.74 --- 9397.93 ms/batch
Step 00060100 L_out=0.445 Acc=0.49 ---32855.54 ms/batch
Step 00060150 L_out=0.296 Acc=0.76 ---56367.38 ms/batch
Step 00060200 L_out=0.640 Acc=0.66 ---79994.45 ms/batch
Step 00060250 L_out=0.366 Acc=0.46 ---103437.30 ms/batch
Step 00060300 L_out=0.475 Acc=0.70 ---127019.18 ms/batch
Step 00060350 L_out=0.458 Acc=0.79 ---150818.96 ms/batch
Step 00060400 L_out=0.736 Acc=0.56 ---174601.76 ms/batch
Step 00060450 L_out=0.517 Acc=0.80 ---198073.46 ms/batch
Step 00060500 L_out=0.746 Acc=0.68 ---221461.67 ms/batch
Step 00060550 L_out=0.703 Acc=0.68 ---244959.21 ms/batch
Step 00060600 L_out=0.829 Acc=0.78 ---268366.39 ms/batch
Step 00060650 L_out=0.482 Acc=0.77 ---291789.98 ms/batch
Round 5 | epoch=0, train costTime=313.7345495223999, | total_activation_sum=9773176
Round 5 | ****EPOCH 1****
Step 00060700 L_out=0.296 Acc=0.71 --- 1364.07 ms/batch
Step 00060750 L_out=0.802 Acc=0.81 ---24646.01 ms/batch
Step 00060800 L_out=0.200 Acc=0.93 ---48157.19 ms/batch
Step 00060850 L_out=0.838 Acc=0.50 ---71539.74 ms/batch
Step 00060900 L_out=0.622 Acc=0.56 ---94861.66 ms/batch
Step 00060950 L_out=0.334 Acc=0.83 ---118236.87 ms/batch
Step 00061000 L_out=0.410 Acc=0.84 ---141540.54 ms/batch
Step 00061050 L_out=0.753 Acc=0.74 ---164737.93 ms/batch
Step 00061100 L_out=0.507 Acc=0.78 ---188048.50 ms/batch
Step 00061150 L_out=0.830 Acc=0.75 ---211449.68 ms/batch
Step 00061200 L_out=0.371 Acc=0.81 ---235062.60 ms/batch
Step 00061250 L_out=0.305 Acc=0.84 ---258629.34 ms/batch
Step 00061300 L_out=0.198 Acc=0.79 ---281993.63 ms/batch
Step 00061350 L_out=0.495 Acc=0.75 ---305710.17 ms/batch
Round 5 | epoch=1, train costTime=312.32692289352417, | total_activation_sum=10123476
Round 5 | ****EPOCH 2****
Step 00061400 L_out=0.215 Acc=0.85 ---16779.38 ms/batch
Step 00061450 L_out=0.294 Acc=0.86 ---40309.46 ms/batch
Step 00061500 L_out=0.080 Acc=0.83 ---63914.76 ms/batch
Step 00061550 L_out=0.802 Acc=0.67 ---87249.80 ms/batch
Step 00061600 L_out=0.168 Acc=0.90 ---110854.26 ms/batch
Step 00061650 L_out=0.982 Acc=0.84 ---134134.52 ms/batch
Step 00061700 L_out=0.370 Acc=0.86 ---157561.03 ms/batch
Step 00061750 L_out=0.101 Acc=0.75 ---180892.46 ms/batch
Step 00061800 L_out=0.716 Acc=0.77 ---204343.43 ms/batch
Step 00061850 L_out=0.285 Acc=0.81 ---227732.41 ms/batch
Step 00061900 L_out=0.195 Acc=0.81 ---251141.41 ms/batch
Step 00061950 L_out=0.382 Acc=0.83 ---274761.26 ms/batch
Step 00062000 L_out=0.153 Acc=0.82 ---298203.86 ms/batch
Round 5 | epoch=2, train costTime=312.7868323326111, | total_activation_sum=10099324
Round 5 | ****EPOCH 3****
Step 00062050 L_out=0.402 Acc=0.86 --- 8952.76 ms/batch
Step 00062100 L_out=0.560 Acc=0.74 ---32473.51 ms/batch
Step 00062150 L_out=0.293 Acc=0.86 ---55952.72 ms/batch
Step 00062200 L_out=0.261 Acc=0.64 ---79691.22 ms/batch
Step 00062250 L_out=0.211 Acc=0.82 ---103093.06 ms/batch
Step 00062300 L_out=0.303 Acc=0.92 ---126350.48 ms/batch
Step 00062350 L_out=0.274 Acc=0.92 ---150090.37 ms/batch
Step 00062400 L_out=0.396 Acc=0.77 ---173460.21 ms/batch
Step 00062450 L_out=0.661 Acc=0.85 ---196934.07 ms/batch
Step 00062500 L_out=0.540 Acc=0.72 ---220408.71 ms/batch
Step 00062550 L_out=0.277 Acc=0.71 ---243845.36 ms/batch
Step 00062600 L_out=0.320 Acc=0.74 ---267230.66 ms/batch
Step 00062650 L_out=0.228 Acc=0.84 ---290978.37 ms/batch
Round 5 | epoch=3, train costTime=313.5154194831848, | total_activation_sum=10115371
Round 5 | ****EPOCH 4****
Step 00062700 L_out=0.162 Acc=0.93 ---  923.16 ms/batch
Step 00062750 L_out=0.203 Acc=0.89 ---24317.51 ms/batch
Step 00062800 L_out=0.261 Acc=0.83 ---47872.28 ms/batch
Step 00062850 L_out=0.261 Acc=0.86 ---71012.89 ms/batch
Step 00062900 L_out=0.366 Acc=0.91 ---94282.63 ms/batch
Step 00062950 L_out=0.342 Acc=0.79 ---117848.65 ms/batch
Step 00063000 L_out=0.262 Acc=0.87 ---141656.31 ms/batch
Step 00063050 L_out=0.974 Acc=0.58 ---165245.44 ms/batch
Step 00063100 L_out=0.390 Acc=0.83 ---188884.40 ms/batch
Step 00063150 L_out=0.296 Acc=0.86 ---212301.69 ms/batch
Step 00063200 L_out=0.328 Acc=0.83 ---235769.36 ms/batch
Step 00063250 L_out=0.153 Acc=0.89 ---259318.13 ms/batch
Step 00063300 L_out=0.308 Acc=0.62 ---282665.18 ms/batch
Step 00063350 L_out=0.117 Acc=0.82 ---306246.95 ms/batch
Round 5 | epoch=4, train costTime=313.2973885536194, | total_activation_sum=10178796
Round 5 | ****EPOCH 5****
Step 00063400 L_out=0.368 Acc=0.77 ---16380.34 ms/batch
Step 00063450 L_out=0.373 Acc=0.91 ---39966.83 ms/batch
Step 00063500 L_out=0.104 Acc=0.83 ---63158.84 ms/batch
Step 00063550 L_out=0.215 Acc=0.81 ---86610.64 ms/batch
Step 00063600 L_out=0.203 Acc=0.90 ---110685.07 ms/batch
Step 00063650 L_out=0.241 Acc=0.68 ---134127.89 ms/batch
Step 00063700 L_out=0.381 Acc=0.89 ---157741.57 ms/batch
Step 00063750 L_out=0.459 Acc=0.90 ---181125.89 ms/batch
Step 00063800 L_out=0.178 Acc=0.92 ---204521.51 ms/batch
Step 00063850 L_out=0.227 Acc=0.84 ---227883.66 ms/batch
Step 00063900 L_out=0.384 Acc=0.76 ---251366.74 ms/batch
Step 00063950 L_out=0.236 Acc=0.93 ---274695.84 ms/batch
Step 00064000 L_out=0.383 Acc=0.82 ---298140.65 ms/batch
Round 5 | epoch=5, train costTime=313.1804127693176, | total_activation_sum=10172480
Round 5 | ****EPOCH 6****
Step 00064050 L_out=0.280 Acc=0.81 --- 8335.88 ms/batch
Step 00064100 L_out=0.599 Acc=0.90 ---31731.78 ms/batch
Step 00064150 L_out=0.401 Acc=0.79 ---55227.35 ms/batch
Step 00064200 L_out=0.228 Acc=0.89 ---78488.07 ms/batch
Step 00064250 L_out=0.234 Acc=0.94 ---101936.06 ms/batch
Step 00064300 L_out=0.334 Acc=0.89 ---125358.42 ms/batch
Step 00064350 L_out=0.208 Acc=0.87 ---148946.25 ms/batch
Step 00064400 L_out=0.365 Acc=0.88 ---172232.17 ms/batch
Step 00064450 L_out=0.406 Acc=0.91 ---195873.42 ms/batch
Step 00064500 L_out=0.414 Acc=0.85 ---219361.22 ms/batch
Step 00064550 L_out=0.120 Acc=0.82 ---242792.63 ms/batch
Step 00064600 L_out=0.268 Acc=0.84 ---266146.15 ms/batch
Step 00064650 L_out=0.175 Acc=0.92 ---289601.00 ms/batch
Round 5 | epoch=6, train costTime=312.6457266807556, | total_activation_sum=10034710
Round 5 | ****EPOCH 7****
Step 00064700 L_out=0.456 Acc=0.89 ---  430.41 ms/batch
Step 00064750 L_out=0.179 Acc=0.90 ---24034.06 ms/batch
Step 00064800 L_out=0.233 Acc=0.85 ---47605.42 ms/batch
Step 00064850 L_out=0.077 Acc=0.90 ---71159.81 ms/batch
Step 00064900 L_out=0.267 Acc=0.88 ---94480.28 ms/batch
Step 00064950 L_out=0.342 Acc=0.88 ---118037.25 ms/batch
Step 00065000 L_out=0.585 Acc=0.83 ---141468.29 ms/batch
Step 00065050 L_out=0.282 Acc=0.84 ---164853.35 ms/batch
Step 00065100 L_out=0.323 Acc=0.76 ---188235.60 ms/batch
Step 00065150 L_out=0.331 Acc=0.89 ---211943.63 ms/batch
Step 00065200 L_out=0.197 Acc=0.91 ---235309.58 ms/batch
Step 00065250 L_out=0.135 Acc=0.80 ---258667.65 ms/batch
Step 00065300 L_out=0.397 Acc=0.82 ---281956.28 ms/batch
Step 00065350 L_out=0.157 Acc=0.94 ---305319.50 ms/batch
Round 5 | epoch=7, train costTime=312.79942893981934, | total_activation_sum=10151840
Round 5 | ****EPOCH 8****
Step 00065400 L_out=0.309 Acc=0.88 ---16131.55 ms/batch
Step 00065450 L_out=0.232 Acc=0.53 ---39790.02 ms/batch
Step 00065500 L_out=0.134 Acc=0.78 ---63321.17 ms/batch
Step 00065550 L_out=0.239 Acc=0.81 ---86562.45 ms/batch
Step 00065600 L_out=0.329 Acc=0.83 ---110071.64 ms/batch
Step 00065650 L_out=0.510 Acc=0.71 ---133426.89 ms/batch
Step 00065700 L_out=0.255 Acc=0.91 ---156845.16 ms/batch
Step 00065750 L_out=0.098 Acc=0.82 ---180003.82 ms/batch
Step 00065800 L_out=0.349 Acc=0.93 ---203459.80 ms/batch
Step 00065850 L_out=0.222 Acc=0.68 ---226968.75 ms/batch
Step 00065900 L_out=0.416 Acc=0.93 ---250424.63 ms/batch
Step 00065950 L_out=0.206 Acc=0.92 ---273848.47 ms/batch
Step 00066000 L_out=0.199 Acc=0.89 ---297284.26 ms/batch
Round 5 | epoch=8, train costTime=312.62554597854614, | total_activation_sum=10085712
Round 5 | ****EPOCH 9****
Step 00066050 L_out=0.223 Acc=0.86 --- 7940.76 ms/batch
Step 00066100 L_out=0.355 Acc=0.79 ---31393.24 ms/batch
Step 00066150 L_out=0.649 Acc=0.84 ---54817.40 ms/batch
Step 00066200 L_out=0.141 Acc=0.87 ---78345.57 ms/batch
Step 00066250 L_out=0.386 Acc=0.80 ---102049.80 ms/batch
Step 00066300 L_out=0.165 Acc=0.89 ---125439.87 ms/batch
Step 00066350 L_out=0.419 Acc=0.74 ---148873.29 ms/batch
Step 00066400 L_out=0.255 Acc=0.85 ---172405.59 ms/batch
Step 00066450 L_out=0.463 Acc=0.84 ---195849.13 ms/batch
Step 00066500 L_out=0.192 Acc=0.90 ---219575.92 ms/batch
Step 00066550 L_out=0.127 Acc=0.93 ---242859.78 ms/batch
Step 00066600 L_out=0.195 Acc=0.85 ---266212.25 ms/batch
Step 00066650 L_out=0.316 Acc=0.82 ---289471.02 ms/batch
Step 00066700 L_out=0.195 Acc=0.85 ---312859.35 ms/batch
Round 5 | epoch=9, train costTime=312.85968017578125, | total_activation_sum=10154406
Round 5 | ****EPOCH 10****
Step 00066750 L_out=0.223 Acc=0.94 ---23275.78 ms/batch
Step 00066800 L_out=0.487 Acc=0.85 ---46702.27 ms/batch
Step 00066850 L_out=0.496 Acc=0.90 ---70044.44 ms/batch
Step 00066900 L_out=0.278 Acc=0.71 ---93497.15 ms/batch
Step 00066950 L_out=0.411 Acc=0.84 ---116762.08 ms/batch
Step 00067000 L_out=0.143 Acc=0.90 ---140254.65 ms/batch
Step 00067050 L_out=0.239 Acc=0.79 ---163779.07 ms/batch
Step 00067100 L_out=0.469 Acc=0.78 ---187455.38 ms/batch
Step 00067150 L_out=0.300 Acc=0.92 ---210816.33 ms/batch
Step 00067200 L_out=0.212 Acc=0.74 ---234303.22 ms/batch
Step 00067250 L_out=0.296 Acc=0.76 ---257593.85 ms/batch
Step 00067300 L_out=0.213 Acc=0.90 ---281048.44 ms/batch
Step 00067350 L_out=0.231 Acc=0.84 ---304480.70 ms/batch
Round 5 | epoch=10, train costTime=312.448388338089, | total_activation_sum=10100785
Round 5 | ****EPOCH 11****
Step 00067400 L_out=0.156 Acc=0.76 ---15226.52 ms/batch
Step 00067450 L_out=0.135 Acc=0.81 ---38708.55 ms/batch
Step 00067500 L_out=0.137 Acc=0.75 ---62239.68 ms/batch
Step 00067550 L_out=0.204 Acc=0.89 ---85801.30 ms/batch
Step 00067600 L_out=0.175 Acc=0.75 ---109283.87 ms/batch
Step 00067650 L_out=0.341 Acc=0.94 ---132911.95 ms/batch
Step 00067700 L_out=0.157 Acc=0.91 ---156409.47 ms/batch
Step 00067750 L_out=0.207 Acc=0.88 ---179967.82 ms/batch
Step 00067800 L_out=0.108 Acc=0.90 ---203660.93 ms/batch
Step 00067850 L_out=0.239 Acc=0.89 ---227114.82 ms/batch
Step 00067900 L_out=0.321 Acc=0.93 ---250291.80 ms/batch
Step 00067950 L_out=0.079 Acc=0.94 ---273676.36 ms/batch
Step 00068000 L_out=0.225 Acc=0.84 ---297160.58 ms/batch
Round 5 | epoch=11, train costTime=313.17400074005127, | total_activation_sum=10196023
Round 5 | ****EPOCH 12****
Step 00068050 L_out=0.146 Acc=0.95 --- 7417.34 ms/batch
Step 00068100 L_out=0.189 Acc=0.91 ---30853.33 ms/batch
Step 00068150 L_out=0.478 Acc=0.74 ---54445.37 ms/batch
Step 00068200 L_out=0.462 Acc=0.81 ---77841.95 ms/batch
Step 00068250 L_out=0.097 Acc=0.90 ---101123.56 ms/batch
Step 00068300 L_out=0.149 Acc=0.87 ---124653.89 ms/batch
Step 00068350 L_out=0.299 Acc=0.60 ---148010.47 ms/batch
Step 00068400 L_out=0.091 Acc=0.89 ---171568.85 ms/batch
Step 00068450 L_out=0.156 Acc=0.94 ---194838.70 ms/batch
Step 00068500 L_out=0.179 Acc=0.91 ---218376.31 ms/batch
Step 00068550 L_out=0.164 Acc=0.94 ---242024.09 ms/batch
Step 00068600 L_out=0.138 Acc=0.93 ---265365.61 ms/batch
Step 00068650 L_out=0.200 Acc=0.92 ---288998.90 ms/batch
Step 00068700 L_out=0.209 Acc=0.87 ---312207.75 ms/batch
Round 5 | epoch=12, train costTime=312.6796553134918, | total_activation_sum=10111578
Round 5 | ****EPOCH 13****
Step 00068750 L_out=0.121 Acc=0.90 ---22786.34 ms/batch
Step 00068800 L_out=0.272 Acc=0.94 ---46215.70 ms/batch
Step 00068850 L_out=0.419 Acc=0.89 ---69586.24 ms/batch
Step 00068900 L_out=0.275 Acc=0.72 ---92876.23 ms/batch
Step 00068950 L_out=0.171 Acc=0.93 ---116345.89 ms/batch
Step 00069000 L_out=0.171 Acc=0.91 ---139786.46 ms/batch
Step 00069050 L_out=0.248 Acc=0.69 ---163346.16 ms/batch
Step 00069100 L_out=0.082 Acc=0.87 ---186723.83 ms/batch
Step 00069150 L_out=0.409 Acc=0.87 ---210234.97 ms/batch
Step 00069200 L_out=0.161 Acc=0.90 ---233674.98 ms/batch
Step 00069250 L_out=0.229 Acc=0.81 ---257134.15 ms/batch
Step 00069300 L_out=0.399 Acc=0.83 ---280439.12 ms/batch
Step 00069350 L_out=0.185 Acc=0.90 ---303810.39 ms/batch
Round 5 | epoch=13, train costTime=312.2316472530365, | total_activation_sum=10142941
Round 5 | ****EPOCH 14****
Step 00069400 L_out=0.592 Acc=0.68 ---14955.22 ms/batch
Step 00069450 L_out=0.303 Acc=0.84 ---38365.93 ms/batch
Step 00069500 L_out=0.354 Acc=0.80 ---61702.16 ms/batch
Step 00069550 L_out=0.294 Acc=0.90 ---85236.09 ms/batch
Step 00069600 L_out=0.204 Acc=0.92 ---108601.63 ms/batch
Step 00069650 L_out=0.330 Acc=0.89 ---132401.37 ms/batch
Step 00069700 L_out=0.109 Acc=0.91 ---155716.48 ms/batch
Step 00069750 L_out=0.326 Acc=0.84 ---179032.79 ms/batch
Step 00069800 L_out=0.291 Acc=0.94 ---202531.39 ms/batch
Step 00069850 L_out=0.104 Acc=0.88 ---225927.46 ms/batch
Step 00069900 L_out=0.257 Acc=0.92 ---249191.81 ms/batch
Step 00069950 L_out=0.204 Acc=0.92 ---272450.31 ms/batch
Step 00070000 L_out=0.117 Acc=0.95 ---295880.39 ms/batch
Round 5 | epoch=14, train costTime=312.19183230400085, | total_activation_sum=10124051
Round 5 | ****EPOCH 15****
Step 00070050 L_out=0.366 Acc=0.90 --- 7014.43 ms/batch
Step 00070100 L_out=0.552 Acc=0.87 ---30518.92 ms/batch
Step 00070150 L_out=0.353 Acc=0.78 ---53865.14 ms/batch
Step 00070200 L_out=0.231 Acc=0.92 ---77315.90 ms/batch
Step 00070250 L_out=0.235 Acc=0.86 ---100673.18 ms/batch
Step 00070300 L_out=0.252 Acc=0.91 ---124334.64 ms/batch
Step 00070350 L_out=0.175 Acc=0.89 ---147799.21 ms/batch
Step 00070400 L_out=0.217 Acc=0.96 ---171268.05 ms/batch
Step 00070450 L_out=0.173 Acc=0.89 ---194801.70 ms/batch
Step 00070500 L_out=0.206 Acc=0.91 ---218192.66 ms/batch
Step 00070550 L_out=0.116 Acc=0.88 ---241628.24 ms/batch
Step 00070600 L_out=0.185 Acc=0.75 ---265160.07 ms/batch
Step 00070650 L_out=0.319 Acc=0.69 ---288705.50 ms/batch
Step 00070700 L_out=0.094 Acc=0.89 ---312338.59 ms/batch
Round 5 | epoch=15, train costTime=313.22824478149414, | total_activation_sum=10134813
Round 5 | ****EPOCH 16****
Step 00070750 L_out=0.265 Acc=0.90 ---22624.23 ms/batch
Step 00070800 L_out=0.224 Acc=0.93 ---46042.65 ms/batch
Step 00070850 L_out=0.624 Acc=0.85 ---69347.19 ms/batch
Step 00070900 L_out=0.295 Acc=0.86 ---92630.86 ms/batch
Step 00070950 L_out=0.253 Acc=0.85 ---116043.03 ms/batch
Step 00071000 L_out=0.638 Acc=0.82 ---139389.81 ms/batch
Step 00071050 L_out=0.097 Acc=0.64 ---162781.78 ms/batch
Step 00071100 L_out=0.165 Acc=0.85 ---186373.81 ms/batch
Step 00071150 L_out=0.386 Acc=0.94 ---209752.12 ms/batch
Step 00071200 L_out=0.208 Acc=0.93 ---233465.80 ms/batch
Step 00071250 L_out=0.206 Acc=0.88 ---257025.72 ms/batch
Step 00071300 L_out=0.311 Acc=0.84 ---280493.44 ms/batch
Step 00071350 L_out=0.096 Acc=0.93 ---304144.43 ms/batch
Round 5 | epoch=16, train costTime=313.167733669281, | total_activation_sum=10045001
Round 5 | ****EPOCH 17****
Step 00071400 L_out=0.217 Acc=0.92 ---14635.35 ms/batch
Step 00071450 L_out=0.101 Acc=0.95 ---38080.25 ms/batch
Step 00071500 L_out=0.087 Acc=0.91 ---61429.01 ms/batch
Step 00071550 L_out=0.244 Acc=0.92 ---84749.45 ms/batch
Step 00071600 L_out=0.064 Acc=0.95 ---108222.17 ms/batch
Step 00071650 L_out=0.100 Acc=0.72 ---131537.31 ms/batch
Step 00071700 L_out=0.340 Acc=0.91 ---154918.14 ms/batch
Step 00071750 L_out=0.219 Acc=0.93 ---178207.54 ms/batch
Step 00071800 L_out=0.194 Acc=0.86 ---201783.25 ms/batch
Step 00071850 L_out=0.145 Acc=0.93 ---225139.23 ms/batch
Step 00071900 L_out=0.273 Acc=0.93 ---248584.40 ms/batch
Step 00071950 L_out=0.181 Acc=0.94 ---271894.89 ms/batch
Step 00072000 L_out=0.079 Acc=0.91 ---295353.64 ms/batch
Round 5 | epoch=17, train costTime=312.1526720523834, | total_activation_sum=10104344
Round 5 | epoch=18, current m_iou=0.6871913091450825
Round 5 | Best m_IoU is: 0.687, OA is: 0.918 | val costTime=117.41570687294006
Round 5 | ****EPOCH 18****
Step 00072050 L_out=0.195 Acc=0.87 --- 6708.52 ms/batch
Step 00072100 L_out=0.736 Acc=0.82 ---30053.57 ms/batch
Step 00072150 L_out=0.058 Acc=0.95 ---53580.17 ms/batch
Step 00072200 L_out=0.222 Acc=0.88 ---77072.52 ms/batch
Step 00072250 L_out=0.208 Acc=0.88 ---100599.45 ms/batch
Step 00072300 L_out=0.206 Acc=0.89 ---124168.95 ms/batch
Step 00072350 L_out=0.231 Acc=0.93 ---147559.00 ms/batch
Step 00072400 L_out=0.150 Acc=0.82 ---170908.06 ms/batch
Step 00072450 L_out=0.111 Acc=0.93 ---194231.18 ms/batch
Step 00072500 L_out=0.214 Acc=0.92 ---217654.06 ms/batch
Step 00072550 L_out=0.102 Acc=0.94 ---241269.54 ms/batch
Step 00072600 L_out=0.557 Acc=0.79 ---264633.88 ms/batch
Step 00072650 L_out=0.261 Acc=0.92 ---287952.74 ms/batch
Step 00072700 L_out=0.125 Acc=0.91 ---311545.35 ms/batch
Round 5 | epoch=18, train costTime=312.9173457622528, | total_activation_sum=10047548
Round 5 | epoch=19, current m_iou=0.6874056744029657
Round 5 | Best m_IoU is: 0.687, OA is: 0.920 | val costTime=117.09118294715881
Round 5 | ****EPOCH 19****
Step 00072750 L_out=0.111 Acc=0.86 ---22088.92 ms/batch
Step 00072800 L_out=0.126 Acc=0.89 ---45381.47 ms/batch
Step 00072850 L_out=0.135 Acc=0.93 ---68749.81 ms/batch
Step 00072900 L_out=0.187 Acc=0.77 ---92153.68 ms/batch
Step 00072950 L_out=0.294 Acc=0.91 ---115667.34 ms/batch
Step 00073000 L_out=0.231 Acc=0.77 ---139114.79 ms/batch
Step 00073050 L_out=0.205 Acc=0.95 ---162511.31 ms/batch
Step 00073100 L_out=0.182 Acc=0.94 ---185843.75 ms/batch
Step 00073150 L_out=0.149 Acc=0.92 ---209156.19 ms/batch
Step 00073200 L_out=0.359 Acc=0.74 ---232728.21 ms/batch
Step 00073250 L_out=0.352 Acc=0.90 ---255981.66 ms/batch
Step 00073300 L_out=0.238 Acc=0.95 ---279385.33 ms/batch
Step 00073350 L_out=0.204 Acc=0.94 ---302640.69 ms/batch
Round 5 | epoch=19, train costTime=311.9768681526184, | total_activation_sum=10182170
Round 5 | epoch=20, current m_iou=0.701072595737288
Round 5 | Best m_IoU is: 0.701, OA is: 0.924 | val costTime=117.55260872840881
Round 5 | ****EPOCH 20****
Step 00073400 L_out=0.173 Acc=0.91 ---14086.08 ms/batch
Step 00073450 L_out=0.488 Acc=0.78 ---37501.93 ms/batch
Step 00073500 L_out=0.167 Acc=0.94 ---61121.23 ms/batch
Step 00073550 L_out=0.297 Acc=0.90 ---84546.07 ms/batch
Step 00073600 L_out=0.172 Acc=0.87 ---107964.06 ms/batch
Step 00073650 L_out=0.122 Acc=0.95 ---131398.88 ms/batch
Step 00073700 L_out=0.125 Acc=0.82 ---154937.27 ms/batch
Step 00073750 L_out=0.127 Acc=0.92 ---178382.69 ms/batch
Step 00073800 L_out=0.059 Acc=0.91 ---201823.70 ms/batch
Step 00073850 L_out=0.163 Acc=0.92 ---225227.21 ms/batch
Step 00073900 L_out=0.206 Acc=0.94 ---248643.38 ms/batch
Step 00073950 L_out=0.135 Acc=0.83 ---272060.95 ms/batch
Step 00074000 L_out=0.177 Acc=0.95 ---295557.68 ms/batch
Round 5 | epoch=20, train costTime=312.93048310279846, | total_activation_sum=10246239
Round 5 | epoch=21, current m_iou=0.696654389500716
Round 5 | Best m_IoU is: 0.701, OA is: 0.924 | val costTime=116.93118023872375
Round 5 | ****EPOCH 21****
Step 00074050 L_out=0.324 Acc=0.94 --- 6107.38 ms/batch
Step 00074100 L_out=0.199 Acc=0.96 ---29661.12 ms/batch
Step 00074150 L_out=0.117 Acc=0.91 ---53168.57 ms/batch
Step 00074200 L_out=0.102 Acc=0.92 ---76570.89 ms/batch
Step 00074250 L_out=0.287 Acc=0.92 ---99799.97 ms/batch
Step 00074300 L_out=0.130 Acc=0.82 ---123377.38 ms/batch
Step 00074350 L_out=0.079 Acc=0.96 ---146785.82 ms/batch
Step 00074400 L_out=0.242 Acc=0.86 ---170143.12 ms/batch
Step 00074450 L_out=0.182 Acc=0.89 ---193620.63 ms/batch
Step 00074500 L_out=0.194 Acc=0.90 ---217091.54 ms/batch
Step 00074550 L_out=0.251 Acc=0.80 ---240540.15 ms/batch
Step 00074600 L_out=0.215 Acc=0.78 ---263963.17 ms/batch
Step 00074650 L_out=0.133 Acc=0.94 ---287436.69 ms/batch
Step 00074700 L_out=0.259 Acc=0.91 ---311021.43 ms/batch
Round 5 | epoch=21, train costTime=312.94156646728516, | total_activation_sum=10020811
Round 5 | epoch=22, current m_iou=0.698374619684673
Round 5 | Best m_IoU is: 0.701, OA is: 0.924 | val costTime=117.19823288917542
Round 5 | ****EPOCH 22****
Step 00074750 L_out=0.090 Acc=0.84 ---21438.39 ms/batch
Step 00074800 L_out=0.077 Acc=0.96 ---44794.84 ms/batch
Step 00074850 L_out=0.191 Acc=0.92 ---68197.75 ms/batch
Step 00074900 L_out=0.146 Acc=0.88 ---91527.26 ms/batch
Step 00074950 L_out=0.136 Acc=0.95 ---114943.46 ms/batch
Step 00075000 L_out=0.126 Acc=0.91 ---138356.99 ms/batch
Step 00075050 L_out=0.184 Acc=0.84 ---161934.12 ms/batch
Step 00075100 L_out=0.467 Acc=0.80 ---185501.86 ms/batch
Step 00075150 L_out=0.061 Acc=0.86 ---208780.56 ms/batch
Step 00075200 L_out=0.124 Acc=0.93 ---232091.20 ms/batch
Step 00075250 L_out=0.132 Acc=0.89 ---255284.02 ms/batch
Step 00075300 L_out=0.163 Acc=0.96 ---278698.45 ms/batch
Step 00075350 L_out=0.032 Acc=0.90 ---302261.04 ms/batch
Round 5 | epoch=22, train costTime=312.04837012290955, | total_activation_sum=10247712
Round 5 | epoch=23, current m_iou=0.7011704707069552
Round 5 | Best m_IoU is: 0.701, OA is: 0.925 | val costTime=117.60129356384277
Round 5 | ****EPOCH 23****
Step 00075400 L_out=0.179 Acc=0.95 ---13593.93 ms/batch
Step 00075450 L_out=0.108 Acc=0.95 ---37055.73 ms/batch
Step 00075500 L_out=0.227 Acc=0.90 ---60450.19 ms/batch
Step 00075550 L_out=0.196 Acc=0.85 ---83964.13 ms/batch
Step 00075600 L_out=0.102 Acc=0.91 ---107377.56 ms/batch
Step 00075650 L_out=0.147 Acc=0.93 ---130624.57 ms/batch
Step 00075700 L_out=0.151 Acc=0.80 ---153936.24 ms/batch
Step 00075750 L_out=0.357 Acc=0.89 ---177430.35 ms/batch
Step 00075800 L_out=0.093 Acc=0.93 ---200963.04 ms/batch
Step 00075850 L_out=0.194 Acc=0.86 ---224355.78 ms/batch
Step 00075900 L_out=0.159 Acc=0.94 ---248053.50 ms/batch
Step 00075950 L_out=0.179 Acc=0.85 ---271284.96 ms/batch
Step 00076000 L_out=0.129 Acc=0.92 ---294729.23 ms/batch
Round 5 | epoch=23, train costTime=312.4659867286682, | total_activation_sum=10093079
Round 5 | epoch=24, current m_iou=0.6980653187665583
Round 5 | Best m_IoU is: 0.701, OA is: 0.925 | val costTime=116.79792404174805
Round 5 | ****EPOCH 24****
Step 00076050 L_out=0.071 Acc=0.91 --- 5576.10 ms/batch
Step 00076100 L_out=0.345 Acc=0.85 ---28975.67 ms/batch
Step 00076150 L_out=0.250 Acc=0.94 ---52489.77 ms/batch
Step 00076200 L_out=0.288 Acc=0.93 ---75979.79 ms/batch
Step 00076250 L_out=0.166 Acc=0.91 ---99293.88 ms/batch
Step 00076300 L_out=0.112 Acc=0.94 ---122886.72 ms/batch
Step 00076350 L_out=0.295 Acc=0.82 ---146445.88 ms/batch
Step 00076400 L_out=0.208 Acc=0.88 ---170017.80 ms/batch
Step 00076450 L_out=0.294 Acc=0.87 ---193340.01 ms/batch
Step 00076500 L_out=0.037 Acc=0.97 ---216902.62 ms/batch
Step 00076550 L_out=0.273 Acc=0.94 ---240196.15 ms/batch
Step 00076600 L_out=0.086 Acc=0.91 ---263546.90 ms/batch
Step 00076650 L_out=0.153 Acc=0.91 ---286913.46 ms/batch
Step 00076700 L_out=0.178 Acc=0.90 ---310183.23 ms/batch
Round 5 | epoch=24, train costTime=312.5351803302765, | total_activation_sum=10001188
Round 5 | epoch=25, current m_iou=0.7052668565454989
Round 5 | Best m_IoU is: 0.705, OA is: 0.927 | val costTime=117.59751009941101
Round 5 | ****EPOCH 25****
Step 00076750 L_out=0.274 Acc=0.93 ---21229.17 ms/batch
Step 00076800 L_out=0.245 Acc=0.88 ---44687.22 ms/batch
Step 00076850 L_out=0.156 Acc=0.90 ---68299.48 ms/batch
Step 00076900 L_out=0.130 Acc=0.84 ---91594.78 ms/batch
Step 00076950 L_out=0.152 Acc=0.92 ---115142.54 ms/batch
Step 00077000 L_out=0.269 Acc=0.93 ---138628.35 ms/batch
Step 00077050 L_out=0.106 Acc=0.96 ---162010.31 ms/batch
Step 00077100 L_out=0.162 Acc=0.94 ---185548.50 ms/batch
Step 00077150 L_out=0.103 Acc=0.95 ---209090.24 ms/batch
Step 00077200 L_out=0.351 Acc=0.92 ---232674.20 ms/batch
Step 00077250 L_out=0.046 Acc=0.95 ---256072.77 ms/batch
Step 00077300 L_out=0.282 Acc=0.93 ---279349.41 ms/batch
Step 00077350 L_out=0.285 Acc=0.92 ---302718.43 ms/batch
Round 5 | epoch=25, train costTime=312.9800708293915, | total_activation_sum=10112236
Round 5 | epoch=26, current m_iou=0.7027951378563835
Round 5 | Best m_IoU is: 0.705, OA is: 0.927 | val costTime=117.04809856414795
Round 5 | ****EPOCH 26****
Step 00077400 L_out=0.091 Acc=0.94 ---13207.81 ms/batch
Step 00077450 L_out=0.434 Acc=0.85 ---36665.41 ms/batch
Step 00077500 L_out=0.121 Acc=0.94 ---60082.94 ms/batch
Step 00077550 L_out=0.265 Acc=0.89 ---83638.77 ms/batch
Step 00077600 L_out=0.139 Acc=0.80 ---107272.13 ms/batch
Step 00077650 L_out=0.176 Acc=0.94 ---130652.61 ms/batch
Step 00077700 L_out=0.137 Acc=0.91 ---153982.28 ms/batch
Step 00077750 L_out=0.283 Acc=0.91 ---177606.37 ms/batch
Step 00077800 L_out=0.122 Acc=0.92 ---200974.48 ms/batch
Step 00077850 L_out=0.187 Acc=0.91 ---224453.80 ms/batch
Step 00077900 L_out=0.078 Acc=0.90 ---247889.22 ms/batch
Step 00077950 L_out=0.177 Acc=0.91 ---271357.87 ms/batch
Step 00078000 L_out=0.181 Acc=0.95 ---294994.50 ms/batch
Round 5 | epoch=26, train costTime=313.2177755832672, | total_activation_sum=10182476
Round 5 | epoch=27, current m_iou=0.7012903763262472
Round 5 | Best m_IoU is: 0.705, OA is: 0.927 | val costTime=117.28692126274109
Round 5 | ****EPOCH 27****
Step 00078050 L_out=0.055 Acc=0.93 --- 5124.43 ms/batch
Step 00078100 L_out=0.054 Acc=0.93 ---28717.42 ms/batch
Step 00078150 L_out=0.177 Acc=0.85 ---52054.92 ms/batch
Step 00078200 L_out=0.119 Acc=0.90 ---75450.37 ms/batch
Step 00078250 L_out=0.140 Acc=0.97 ---98835.81 ms/batch
Step 00078300 L_out=0.079 Acc=0.84 ---122364.52 ms/batch
Step 00078350 L_out=0.215 Acc=0.89 ---145711.78 ms/batch
Step 00078400 L_out=0.100 Acc=0.94 ---169232.46 ms/batch
Step 00078450 L_out=0.100 Acc=0.96 ---192770.88 ms/batch
Step 00078500 L_out=0.208 Acc=0.84 ---216248.03 ms/batch
Step 00078550 L_out=0.289 Acc=0.90 ---239828.40 ms/batch
Step 00078600 L_out=0.242 Acc=0.95 ---263254.27 ms/batch
Step 00078650 L_out=0.165 Acc=0.80 ---286611.18 ms/batch
Step 00078700 L_out=0.101 Acc=0.91 ---309927.72 ms/batch
Round 5 | epoch=27, train costTime=312.7336654663086, | total_activation_sum=10089629
Round 5 | epoch=28, current m_iou=0.7026410080916126
Round 5 | Best m_IoU is: 0.705, OA is: 0.927 | val costTime=116.86604928970337
Round 5 | ****EPOCH 28****
Step 00078750 L_out=0.248 Acc=0.81 ---20704.33 ms/batch
Step 00078800 L_out=0.152 Acc=0.90 ---44343.77 ms/batch
Step 00078850 L_out=0.166 Acc=0.87 ---67750.12 ms/batch
Step 00078900 L_out=0.180 Acc=0.95 ---90906.71 ms/batch
Step 00078950 L_out=0.200 Acc=0.94 ---114223.79 ms/batch
Step 00079000 L_out=0.054 Acc=0.92 ---137951.09 ms/batch
Step 00079050 L_out=0.072 Acc=0.92 ---161513.03 ms/batch
Step 00079100 L_out=0.161 Acc=0.95 ---185090.08 ms/batch
Step 00079150 L_out=0.133 Acc=0.83 ---208475.28 ms/batch
Step 00079200 L_out=0.077 Acc=0.82 ---231923.87 ms/batch
Step 00079250 L_out=0.149 Acc=0.90 ---255285.40 ms/batch
Step 00079300 L_out=0.165 Acc=0.92 ---278733.37 ms/batch
Step 00079350 L_out=0.195 Acc=0.93 ---302079.21 ms/batch
Round 5 | epoch=28, train costTime=312.86510038375854, | total_activation_sum=10226746
Round 5 | epoch=29, current m_iou=0.7015513192698315
Round 5 | Best m_IoU is: 0.705, OA is: 0.927 | val costTime=116.84338283538818
Round 5 | ****EPOCH 29****
Step 00079400 L_out=0.252 Acc=0.88 ---12578.22 ms/batch
Step 00079450 L_out=0.062 Acc=0.89 ---36087.69 ms/batch
Step 00079500 L_out=0.079 Acc=0.89 ---59363.46 ms/batch
Step 00079550 L_out=0.309 Acc=0.84 ---82771.24 ms/batch
Step 00079600 L_out=0.117 Acc=0.94 ---106212.89 ms/batch
Step 00079650 L_out=0.077 Acc=0.93 ---129539.23 ms/batch
Step 00079700 L_out=0.186 Acc=0.92 ---153070.01 ms/batch
Step 00079750 L_out=0.149 Acc=0.79 ---176476.67 ms/batch
Step 00079800 L_out=0.077 Acc=0.95 ---199822.72 ms/batch
Step 00079850 L_out=0.151 Acc=0.93 ---223253.74 ms/batch
Step 00079900 L_out=0.049 Acc=0.92 ---246925.99 ms/batch
Step 00079950 L_out=0.068 Acc=0.97 ---270409.48 ms/batch
Step 00080000 L_out=0.197 Acc=0.89 ---293839.24 ms/batch
Round 5 | epoch=29, train costTime=312.59505343437195, | total_activation_sum=10122840
Round 5 | epoch=30, current m_iou=0.697775803612033
Round 5 | Best m_IoU is: 0.705, OA is: 0.927 | val costTime=116.90881395339966
Round 5 | ****EPOCH 30****
Round 6 | ****EPOCH 0****
Step 00080050 L_out=0.043 Acc=0.88 --- 4725.61 ms/batch
Step 00080100 L_out=0.292 Acc=0.71 ---28453.24 ms/batch
Step 00080150 L_out=1.001 Acc=0.76 ---51883.76 ms/batch
Step 00080200 L_out=0.237 Acc=0.77 ---75442.34 ms/batch
Step 00080250 L_out=0.199 Acc=0.91 ---99112.41 ms/batch
Step 00080300 L_out=2.107 Acc=0.71 ---122577.79 ms/batch
Step 00080350 L_out=0.963 Acc=0.71 ---146186.90 ms/batch
Step 00080400 L_out=1.779 Acc=0.62 ---169726.54 ms/batch
Step 00080450 L_out=0.438 Acc=0.86 ---193365.41 ms/batch
Step 00080500 L_out=0.741 Acc=0.56 ---216914.37 ms/batch
Step 00080550 L_out=0.242 Acc=0.91 ---240344.28 ms/batch
Step 00080600 L_out=0.662 Acc=0.90 ---263878.62 ms/batch
Step 00080650 L_out=0.455 Acc=0.76 ---287629.10 ms/batch
Step 00080700 L_out=0.379 Acc=0.88 ---311088.80 ms/batch
Round 6 | epoch=0, train costTime=314.4855613708496, | total_activation_sum=12228884
Round 6 | ****EPOCH 1****
Step 00080750 L_out=0.221 Acc=0.66 ---20172.71 ms/batch
Step 00080800 L_out=0.175 Acc=0.78 ---43597.89 ms/batch
Step 00080850 L_out=0.370 Acc=0.94 ---66942.84 ms/batch
Step 00080900 L_out=0.294 Acc=0.74 ---90353.62 ms/batch
Step 00080950 L_out=0.371 Acc=0.87 ---113928.89 ms/batch
Step 00081000 L_out=1.056 Acc=0.58 ---137580.82 ms/batch
Step 00081050 L_out=0.755 Acc=0.71 ---161023.27 ms/batch
Step 00081100 L_out=0.507 Acc=0.88 ---184456.42 ms/batch
Step 00081150 L_out=0.284 Acc=0.83 ---207807.46 ms/batch
Step 00081200 L_out=0.323 Acc=0.75 ---231339.36 ms/batch
Step 00081250 L_out=0.358 Acc=0.87 ---254898.21 ms/batch
Step 00081300 L_out=0.107 Acc=0.92 ---278226.74 ms/batch
Step 00081350 L_out=0.351 Acc=0.86 ---301579.33 ms/batch
Round 6 | epoch=1, train costTime=312.8049666881561, | total_activation_sum=12903745
Round 6 | ****EPOCH 2****
Step 00081400 L_out=0.476 Acc=0.61 ---12234.03 ms/batch
Step 00081450 L_out=0.385 Acc=0.88 ---35751.88 ms/batch
Step 00081500 L_out=0.394 Acc=0.90 ---59262.25 ms/batch
Step 00081550 L_out=0.102 Acc=0.92 ---82935.91 ms/batch
Step 00081600 L_out=0.359 Acc=0.92 ---106351.09 ms/batch
Step 00081650 L_out=0.417 Acc=0.84 ---129802.00 ms/batch
Step 00081700 L_out=0.439 Acc=0.94 ---153548.84 ms/batch
Step 00081750 L_out=0.214 Acc=0.91 ---176986.48 ms/batch
Step 00081800 L_out=0.840 Acc=0.63 ---200452.37 ms/batch
Step 00081850 L_out=0.460 Acc=0.85 ---224172.15 ms/batch
Step 00081900 L_out=0.404 Acc=0.93 ---247650.47 ms/batch
Step 00081950 L_out=0.246 Acc=0.77 ---271292.88 ms/batch
Step 00082000 L_out=0.559 Acc=0.87 ---295047.93 ms/batch
Round 6 | epoch=2, train costTime=314.4325587749481, | total_activation_sum=12895144
Round 6 | ****EPOCH 3****
Step 00082050 L_out=0.158 Acc=0.89 --- 4239.45 ms/batch
Step 00082100 L_out=0.264 Acc=0.82 ---27803.49 ms/batch
Step 00082150 L_out=0.342 Acc=0.86 ---51101.60 ms/batch
Step 00082200 L_out=0.103 Acc=0.89 ---74542.02 ms/batch
Step 00082250 L_out=0.256 Acc=0.92 ---98047.51 ms/batch
Step 00082300 L_out=0.236 Acc=0.93 ---121724.45 ms/batch
Step 00082350 L_out=0.748 Acc=0.90 ---145045.33 ms/batch
Step 00082400 L_out=0.269 Acc=0.57 ---168637.71 ms/batch
Step 00082450 L_out=0.354 Acc=0.74 ---192185.47 ms/batch
Step 00082500 L_out=0.318 Acc=0.80 ---215556.71 ms/batch
Step 00082550 L_out=0.163 Acc=0.78 ---238958.17 ms/batch
Step 00082600 L_out=0.209 Acc=0.91 ---262472.69 ms/batch
Step 00082650 L_out=0.344 Acc=0.85 ---285838.53 ms/batch
Step 00082700 L_out=0.191 Acc=0.93 ---309436.31 ms/batch
Round 6 | epoch=3, train costTime=313.18744444847107, | total_activation_sum=12985780
Round 6 | ****EPOCH 4****
Step 00082750 L_out=0.225 Acc=0.92 ---19634.29 ms/batch
Step 00082800 L_out=0.226 Acc=0.87 ---43287.05 ms/batch
Step 00082850 L_out=0.632 Acc=0.85 ---66499.76 ms/batch
Step 00082900 L_out=0.382 Acc=0.87 ---90159.89 ms/batch
Step 00082950 L_out=0.326 Acc=0.93 ---113566.40 ms/batch
Step 00083000 L_out=0.115 Acc=0.79 ---137036.63 ms/batch
Step 00083050 L_out=0.318 Acc=0.89 ---160696.98 ms/batch
Step 00083100 L_out=0.322 Acc=0.68 ---184296.99 ms/batch
Step 00083150 L_out=0.359 Acc=0.85 ---207778.28 ms/batch
Step 00083200 L_out=0.191 Acc=0.86 ---231344.44 ms/batch
Step 00083250 L_out=0.320 Acc=0.77 ---254494.18 ms/batch
Step 00083300 L_out=0.260 Acc=0.93 ---277815.46 ms/batch
Step 00083350 L_out=0.341 Acc=0.88 ---301459.55 ms/batch
Round 6 | epoch=4, train costTime=313.2303512096405, | total_activation_sum=12910774
Round 6 | ****EPOCH 5****
Step 00083400 L_out=0.461 Acc=0.93 ---11647.09 ms/batch
Step 00083450 L_out=0.822 Acc=0.74 ---34972.21 ms/batch
Step 00083500 L_out=0.370 Acc=0.91 ---58421.25 ms/batch
Step 00083550 L_out=0.160 Acc=0.94 ---81845.60 ms/batch
Step 00083600 L_out=0.140 Acc=0.90 ---105391.58 ms/batch
Step 00083650 L_out=0.423 Acc=0.81 ---128794.13 ms/batch
Step 00083700 L_out=0.624 Acc=0.81 ---152367.48 ms/batch
Step 00083750 L_out=0.319 Acc=0.91 ---175917.54 ms/batch
Step 00083800 L_out=0.288 Acc=0.92 ---199324.60 ms/batch
Step 00083850 L_out=0.196 Acc=0.83 ---222977.68 ms/batch
Step 00083900 L_out=0.621 Acc=0.82 ---246550.73 ms/batch
Step 00083950 L_out=0.480 Acc=0.84 ---270024.26 ms/batch
Step 00084000 L_out=0.584 Acc=0.84 ---293642.34 ms/batch
Round 6 | epoch=5, train costTime=313.38722372055054, | total_activation_sum=12941683
Round 6 | ****EPOCH 6****
Step 00084050 L_out=0.417 Acc=0.93 --- 3762.10 ms/batch
Step 00084100 L_out=0.326 Acc=0.90 ---27316.83 ms/batch
Step 00084150 L_out=0.659 Acc=0.91 ---50808.81 ms/batch
Step 00084200 L_out=0.210 Acc=0.97 ---74260.95 ms/batch
Step 00084250 L_out=0.395 Acc=0.89 ---97767.74 ms/batch
Step 00084300 L_out=0.314 Acc=0.85 ---120969.98 ms/batch
Step 00084350 L_out=0.257 Acc=0.93 ---144458.61 ms/batch
Step 00084400 L_out=1.093 Acc=0.62 ---168127.49 ms/batch
Step 00084450 L_out=0.269 Acc=0.92 ---191576.00 ms/batch
Step 00084500 L_out=0.502 Acc=0.93 ---214967.64 ms/batch
Step 00084550 L_out=0.281 Acc=0.95 ---238465.26 ms/batch
Step 00084600 L_out=0.839 Acc=0.53 ---261953.53 ms/batch
Step 00084650 L_out=0.307 Acc=0.86 ---285253.06 ms/batch
Step 00084700 L_out=0.238 Acc=0.95 ---308630.36 ms/batch
Round 6 | epoch=6, train costTime=312.8224070072174, | total_activation_sum=12774422
Round 6 | ****EPOCH 7****
Step 00084750 L_out=0.253 Acc=0.71 ---19220.27 ms/batch
Step 00084800 L_out=0.195 Acc=0.88 ---42572.51 ms/batch
Step 00084850 L_out=0.139 Acc=0.96 ---65978.37 ms/batch
Step 00084900 L_out=0.454 Acc=0.92 ---89416.73 ms/batch
Step 00084950 L_out=0.101 Acc=0.97 ---112724.28 ms/batch
Step 00085000 L_out=0.581 Acc=0.85 ---136324.00 ms/batch
Step 00085050 L_out=0.159 Acc=0.87 ---159962.31 ms/batch
Step 00085100 L_out=0.224 Acc=0.85 ---183317.22 ms/batch
Step 00085150 L_out=0.274 Acc=0.94 ---207117.66 ms/batch
Step 00085200 L_out=0.143 Acc=0.71 ---230647.56 ms/batch
Step 00085250 L_out=0.415 Acc=0.88 ---254157.85 ms/batch
Step 00085300 L_out=0.100 Acc=0.89 ---277613.18 ms/batch
Step 00085350 L_out=0.171 Acc=0.95 ---301139.53 ms/batch
Round 6 | epoch=7, train costTime=313.37835907936096, | total_activation_sum=12992136
Round 6 | ****EPOCH 8****
Step 00085400 L_out=0.359 Acc=0.87 ---11217.91 ms/batch
Step 00085450 L_out=0.149 Acc=0.96 ---34628.86 ms/batch
Step 00085500 L_out=0.313 Acc=0.86 ---58139.50 ms/batch
Step 00085550 L_out=0.056 Acc=0.96 ---81711.39 ms/batch
Step 00085600 L_out=0.353 Acc=0.90 ---105339.02 ms/batch
Step 00085650 L_out=0.107 Acc=0.87 ---129003.10 ms/batch
Step 00085700 L_out=0.242 Acc=0.90 ---152421.72 ms/batch
Step 00085750 L_out=0.246 Acc=0.92 ---175968.80 ms/batch
Step 00085800 L_out=0.155 Acc=0.84 ---199519.41 ms/batch
Step 00085850 L_out=0.195 Acc=0.90 ---223096.87 ms/batch
Step 00085900 L_out=0.249 Acc=0.89 ---246756.92 ms/batch
Step 00085950 L_out=0.125 Acc=0.94 ---270362.22 ms/batch
Step 00086000 L_out=0.383 Acc=0.83 ---293890.68 ms/batch
Round 6 | epoch=8, train costTime=313.9560935497284, | total_activation_sum=12999155
Round 6 | ****EPOCH 9****
Step 00086050 L_out=0.531 Acc=0.70 --- 3241.93 ms/batch
Step 00086100 L_out=0.090 Acc=0.90 ---26562.26 ms/batch
Step 00086150 L_out=0.101 Acc=0.94 ---49991.23 ms/batch
Step 00086200 L_out=0.141 Acc=0.87 ---73475.58 ms/batch
Step 00086250 L_out=0.126 Acc=0.94 ---96876.96 ms/batch
Step 00086300 L_out=0.165 Acc=0.91 ---120239.08 ms/batch
Step 00086350 L_out=0.193 Acc=0.80 ---143702.53 ms/batch
Step 00086400 L_out=0.225 Acc=0.88 ---167120.44 ms/batch
Step 00086450 L_out=0.304 Acc=0.90 ---190506.85 ms/batch
Step 00086500 L_out=0.376 Acc=0.83 ---213958.50 ms/batch
Step 00086550 L_out=0.300 Acc=0.89 ---237436.44 ms/batch
Step 00086600 L_out=0.346 Acc=0.91 ---260999.84 ms/batch
Step 00086650 L_out=0.225 Acc=0.95 ---284576.06 ms/batch
Step 00086700 L_out=0.131 Acc=0.95 ---307912.87 ms/batch
Round 6 | epoch=9, train costTime=312.6433982849121, | total_activation_sum=12846629
Round 6 | ****EPOCH 10****
Step 00086750 L_out=0.207 Acc=0.92 ---18808.77 ms/batch
Step 00086800 L_out=0.370 Acc=0.86 ---42215.80 ms/batch
Step 00086850 L_out=0.109 Acc=0.89 ---65618.84 ms/batch
Step 00086900 L_out=0.258 Acc=0.88 ---89062.49 ms/batch
Step 00086950 L_out=0.323 Acc=0.89 ---112587.63 ms/batch
Step 00087000 L_out=0.348 Acc=0.94 ---136115.73 ms/batch
Step 00087050 L_out=0.290 Acc=0.93 ---159679.10 ms/batch
Step 00087100 L_out=0.336 Acc=0.89 ---183309.44 ms/batch
Step 00087150 L_out=0.386 Acc=0.88 ---206799.13 ms/batch
Step 00087200 L_out=0.164 Acc=0.96 ---230269.52 ms/batch
Step 00087250 L_out=0.206 Acc=0.87 ---253648.95 ms/batch
Step 00087300 L_out=0.514 Acc=0.91 ---277188.94 ms/batch
Step 00087350 L_out=0.246 Acc=0.82 ---300925.18 ms/batch
Round 6 | epoch=10, train costTime=313.5051500797272, | total_activation_sum=12862190
Round 6 | ****EPOCH 11****
Step 00087400 L_out=0.239 Acc=0.84 ---10956.23 ms/batch
Step 00087450 L_out=0.129 Acc=0.96 ---34190.28 ms/batch
Step 00087500 L_out=0.372 Acc=0.92 ---57456.14 ms/batch
Step 00087550 L_out=0.160 Acc=0.94 ---80854.20 ms/batch
Step 00087600 L_out=0.235 Acc=0.92 ---104423.46 ms/batch
Step 00087650 L_out=0.117 Acc=0.92 ---127807.82 ms/batch
Step 00087700 L_out=0.150 Acc=0.88 ---151255.92 ms/batch
Step 00087750 L_out=0.141 Acc=0.93 ---174856.33 ms/batch
Step 00087800 L_out=0.095 Acc=0.94 ---198401.25 ms/batch
Step 00087850 L_out=0.648 Acc=0.90 ---221780.92 ms/batch
Step 00087900 L_out=0.320 Acc=0.92 ---245177.58 ms/batch
Step 00087950 L_out=0.147 Acc=0.95 ---268504.23 ms/batch
Step 00088000 L_out=0.273 Acc=0.77 ---292154.91 ms/batch
Round 6 | epoch=11, train costTime=312.9139869213104, | total_activation_sum=12965639
Round 6 | ****EPOCH 12****
Step 00088050 L_out=0.092 Acc=0.97 --- 2795.55 ms/batch
Step 00088100 L_out=0.566 Acc=0.91 ---26147.38 ms/batch
Step 00088150 L_out=0.334 Acc=0.91 ---49538.48 ms/batch
Step 00088200 L_out=0.365 Acc=0.82 ---72788.25 ms/batch
Step 00088250 L_out=0.344 Acc=0.89 ---96438.05 ms/batch
Step 00088300 L_out=0.442 Acc=0.82 ---119768.59 ms/batch
Step 00088350 L_out=0.218 Acc=0.94 ---143125.71 ms/batch
Step 00088400 L_out=0.189 Acc=0.93 ---166622.35 ms/batch
Step 00088450 L_out=0.281 Acc=0.95 ---190212.16 ms/batch
Step 00088500 L_out=0.115 Acc=0.92 ---213681.84 ms/batch
Step 00088550 L_out=0.520 Acc=0.90 ---237097.86 ms/batch
Step 00088600 L_out=0.335 Acc=0.89 ---260655.19 ms/batch
Step 00088650 L_out=0.392 Acc=0.94 ---284094.27 ms/batch
Step 00088700 L_out=0.159 Acc=0.94 ---307534.80 ms/batch
Round 6 | epoch=12, train costTime=312.7390682697296, | total_activation_sum=12945106
Round 6 | ****EPOCH 13****
Step 00088750 L_out=0.293 Acc=0.87 ---18469.86 ms/batch
Step 00088800 L_out=0.284 Acc=0.87 ---42230.18 ms/batch
Step 00088850 L_out=0.415 Acc=0.90 ---65750.83 ms/batch
Step 00088900 L_out=0.489 Acc=0.80 ---89186.34 ms/batch
Step 00088950 L_out=0.132 Acc=0.95 ---112707.89 ms/batch
Step 00089000 L_out=0.175 Acc=0.89 ---136318.43 ms/batch
Step 00089050 L_out=0.271 Acc=0.83 ---160035.89 ms/batch
Step 00089100 L_out=0.155 Acc=0.95 ---183457.14 ms/batch
Step 00089150 L_out=0.323 Acc=0.92 ---206934.26 ms/batch
Step 00089200 L_out=0.730 Acc=0.86 ---230427.35 ms/batch
Step 00089250 L_out=0.576 Acc=0.87 ---253705.17 ms/batch
Step 00089300 L_out=0.069 Acc=0.91 ---277168.11 ms/batch
Step 00089350 L_out=0.241 Acc=0.93 ---300602.72 ms/batch
Round 6 | epoch=13, train costTime=313.80389070510864, | total_activation_sum=12775256
Round 6 | ****EPOCH 14****
Step 00089400 L_out=0.322 Acc=0.96 ---10561.02 ms/batch
Step 00089450 L_out=0.351 Acc=0.86 ---33883.98 ms/batch
Step 00089500 L_out=0.126 Acc=0.93 ---57404.31 ms/batch
Step 00089550 L_out=0.386 Acc=0.83 ---81099.71 ms/batch
Step 00089600 L_out=0.326 Acc=0.91 ---104735.98 ms/batch
Step 00089650 L_out=0.391 Acc=0.91 ---128117.05 ms/batch
Step 00089700 L_out=0.275 Acc=0.87 ---151637.95 ms/batch
Step 00089750 L_out=0.215 Acc=0.94 ---174950.67 ms/batch
Step 00089800 L_out=0.117 Acc=0.91 ---198486.62 ms/batch
Step 00089850 L_out=0.164 Acc=0.89 ---221973.10 ms/batch
Step 00089900 L_out=0.237 Acc=0.93 ---245591.75 ms/batch
Step 00089950 L_out=0.217 Acc=0.88 ---269215.00 ms/batch
Step 00090000 L_out=0.137 Acc=0.91 ---292686.31 ms/batch
Round 6 | epoch=14, train costTime=313.929767370224, | total_activation_sum=12936415
Round 6 | ****EPOCH 15****
Step 00090050 L_out=0.072 Acc=0.94 --- 2337.15 ms/batch
Step 00090100 L_out=0.257 Acc=0.95 ---25798.03 ms/batch
Step 00090150 L_out=0.282 Acc=0.89 ---49402.55 ms/batch
Step 00090200 L_out=0.049 Acc=0.98 ---72857.34 ms/batch
Step 00090250 L_out=0.105 Acc=0.81 ---96272.50 ms/batch
Step 00090300 L_out=0.143 Acc=0.89 ---119777.80 ms/batch
Step 00090350 L_out=0.204 Acc=0.91 ---143216.27 ms/batch
Step 00090400 L_out=0.238 Acc=0.94 ---166553.92 ms/batch
Step 00090450 L_out=0.114 Acc=0.85 ---190210.93 ms/batch
Step 00090500 L_out=0.181 Acc=0.84 ---213830.90 ms/batch
Step 00090550 L_out=0.358 Acc=0.90 ---237222.63 ms/batch
Step 00090600 L_out=0.189 Acc=0.93 ---260695.65 ms/batch
Step 00090650 L_out=0.368 Acc=0.92 ---284237.12 ms/batch
Step 00090700 L_out=0.098 Acc=0.94 ---307772.61 ms/batch
Round 6 | epoch=15, train costTime=313.4286358356476, | total_activation_sum=12866352
Round 6 | ****EPOCH 16****
Step 00090750 L_out=0.209 Acc=0.96 ---17818.57 ms/batch
Step 00090800 L_out=0.276 Acc=0.95 ---41401.03 ms/batch
Step 00090850 L_out=0.328 Acc=0.90 ---64967.05 ms/batch
Step 00090900 L_out=0.245 Acc=0.92 ---88528.04 ms/batch
Step 00090950 L_out=0.201 Acc=0.94 ---112330.46 ms/batch
Step 00091000 L_out=0.084 Acc=0.95 ---135827.15 ms/batch
Step 00091050 L_out=0.273 Acc=0.94 ---159325.53 ms/batch
Step 00091100 L_out=0.413 Acc=0.88 ---182879.02 ms/batch
Step 00091150 L_out=0.485 Acc=0.92 ---206115.12 ms/batch
Step 00091200 L_out=0.238 Acc=0.76 ---229582.35 ms/batch
Step 00091250 L_out=0.163 Acc=0.94 ---252986.57 ms/batch
Step 00091300 L_out=0.428 Acc=0.89 ---276316.56 ms/batch
Step 00091350 L_out=0.199 Acc=0.83 ---299744.46 ms/batch
Round 6 | epoch=16, train costTime=313.4593868255615, | total_activation_sum=12799281
Round 6 | ****EPOCH 17****
Step 00091400 L_out=0.069 Acc=0.92 --- 9851.92 ms/batch
Step 00091450 L_out=0.060 Acc=0.93 ---33195.79 ms/batch
Step 00091500 L_out=0.109 Acc=0.94 ---56924.94 ms/batch
Step 00091550 L_out=0.130 Acc=0.88 ---80266.90 ms/batch
Step 00091600 L_out=0.079 Acc=0.96 ---103690.67 ms/batch
Step 00091650 L_out=0.141 Acc=0.92 ---127160.20 ms/batch
Step 00091700 L_out=0.238 Acc=0.77 ---150691.32 ms/batch
Step 00091750 L_out=0.109 Acc=0.88 ---174204.00 ms/batch
Step 00091800 L_out=0.189 Acc=0.88 ---197705.52 ms/batch
Step 00091850 L_out=0.478 Acc=0.92 ---221223.14 ms/batch
Step 00091900 L_out=0.281 Acc=0.83 ---244651.13 ms/batch
Step 00091950 L_out=0.422 Acc=0.92 ---268220.95 ms/batch
Step 00092000 L_out=0.226 Acc=0.92 ---291659.51 ms/batch
Round 6 | epoch=17, train costTime=313.26710987091064, | total_activation_sum=13045779
Round 6 | epoch=18, current m_iou=0.7117983959776114
Round 6 | Best m_IoU is: 0.712, OA is: 0.924 | val costTime=117.57985138893127
Round 6 | ****EPOCH 18****
Step 00092050 L_out=0.156 Acc=0.94 --- 1858.54 ms/batch
Step 00092100 L_out=0.116 Acc=0.85 ---25006.92 ms/batch
Step 00092150 L_out=0.161 Acc=0.93 ---48574.34 ms/batch
Step 00092200 L_out=0.377 Acc=0.86 ---72075.14 ms/batch
Step 00092250 L_out=0.138 Acc=0.96 ---95546.60 ms/batch
Step 00092300 L_out=0.225 Acc=0.90 ---119044.52 ms/batch
Step 00092350 L_out=0.173 Acc=0.96 ---142536.53 ms/batch
Step 00092400 L_out=0.313 Acc=0.80 ---166048.02 ms/batch
Step 00092450 L_out=0.222 Acc=0.93 ---189360.26 ms/batch
Step 00092500 L_out=0.237 Acc=0.90 ---212836.19 ms/batch
Step 00092550 L_out=0.246 Acc=0.90 ---236470.36 ms/batch
Step 00092600 L_out=0.136 Acc=0.94 ---259751.86 ms/batch
Step 00092650 L_out=0.044 Acc=0.96 ---283287.48 ms/batch
Step 00092700 L_out=0.275 Acc=0.93 ---306860.23 ms/batch
Round 6 | epoch=18, train costTime=312.97436475753784, | total_activation_sum=12811592
Round 6 | epoch=19, current m_iou=0.7106385433250402
Round 6 | Best m_IoU is: 0.712, OA is: 0.924 | val costTime=117.64104557037354
Round 6 | ****EPOCH 19****
Step 00092750 L_out=0.046 Acc=0.95 ---17404.20 ms/batch
Step 00092800 L_out=0.114 Acc=0.91 ---40751.75 ms/batch
Step 00092850 L_out=0.046 Acc=0.97 ---64184.79 ms/batch
Step 00092900 L_out=0.638 Acc=0.84 ---87611.02 ms/batch
Step 00092950 L_out=0.288 Acc=0.81 ---111378.07 ms/batch
Step 00093000 L_out=0.237 Acc=0.92 ---134649.36 ms/batch
Step 00093050 L_out=0.256 Acc=0.87 ---158139.46 ms/batch
Step 00093100 L_out=0.203 Acc=0.96 ---181512.72 ms/batch
Step 00093150 L_out=0.488 Acc=0.92 ---204924.10 ms/batch
Step 00093200 L_out=0.178 Acc=0.92 ---228419.11 ms/batch
Step 00093250 L_out=0.195 Acc=0.95 ---252011.61 ms/batch
Step 00093300 L_out=0.353 Acc=0.92 ---275351.20 ms/batch
Step 00093350 L_out=0.189 Acc=0.94 ---299062.03 ms/batch
Round 6 | epoch=19, train costTime=313.09853959083557, | total_activation_sum=12872464
Round 6 | epoch=20, current m_iou=0.7047504535419062
Round 6 | Best m_IoU is: 0.712, OA is: 0.924 | val costTime=117.38324022293091
Round 6 | ****EPOCH 20****
Step 00093400 L_out=0.087 Acc=0.96 --- 9323.55 ms/batch
Step 00093450 L_out=0.464 Acc=0.90 ---32714.12 ms/batch
Step 00093500 L_out=0.095 Acc=0.88 ---56076.13 ms/batch
Step 00093550 L_out=0.169 Acc=0.94 ---79593.47 ms/batch
Step 00093600 L_out=0.180 Acc=0.92 ---102994.39 ms/batch
Step 00093650 L_out=0.119 Acc=0.93 ---126402.90 ms/batch
Step 00093700 L_out=0.306 Acc=0.94 ---149629.77 ms/batch
Step 00093750 L_out=0.884 Acc=0.72 ---173247.89 ms/batch
Step 00093800 L_out=0.304 Acc=0.94 ---196708.70 ms/batch
Step 00093850 L_out=0.034 Acc=0.92 ---220493.83 ms/batch
Step 00093900 L_out=0.279 Acc=0.94 ---244105.61 ms/batch
Step 00093950 L_out=0.243 Acc=0.79 ---267660.61 ms/batch
Step 00094000 L_out=0.310 Acc=0.93 ---291086.72 ms/batch
Round 6 | epoch=20, train costTime=313.37841606140137, | total_activation_sum=12862150
Round 6 | epoch=21, current m_iou=0.7085845630614427
Round 6 | Best m_IoU is: 0.712, OA is: 0.924 | val costTime=117.12300634384155
Round 6 | ****EPOCH 21****
Step 00094050 L_out=0.187 Acc=0.91 --- 1408.89 ms/batch
Step 00094100 L_out=0.139 Acc=0.88 ---24835.99 ms/batch
Step 00094150 L_out=0.157 Acc=0.91 ---48268.86 ms/batch
Step 00094200 L_out=0.088 Acc=0.91 ---71624.97 ms/batch
Step 00094250 L_out=0.139 Acc=0.83 ---95291.68 ms/batch
Step 00094300 L_out=0.122 Acc=0.91 ---118876.70 ms/batch
Step 00094350 L_out=0.414 Acc=0.89 ---142303.19 ms/batch
Step 00094400 L_out=0.253 Acc=0.84 ---165832.40 ms/batch
Step 00094450 L_out=0.065 Acc=0.88 ---189371.29 ms/batch
Step 00094500 L_out=0.236 Acc=0.95 ---212650.01 ms/batch
Step 00094550 L_out=0.151 Acc=0.91 ---236056.31 ms/batch
Step 00094600 L_out=0.095 Acc=0.95 ---259608.14 ms/batch
Step 00094650 L_out=0.134 Acc=0.90 ---282962.77 ms/batch
Step 00094700 L_out=0.086 Acc=0.92 ---306552.92 ms/batch
Round 6 | epoch=21, train costTime=313.19256377220154, | total_activation_sum=12757214
Round 6 | epoch=22, current m_iou=0.7027705468564907
Round 6 | Best m_IoU is: 0.712, OA is: 0.924 | val costTime=116.73475790023804
Round 6 | ****EPOCH 22****
Step 00094750 L_out=0.198 Acc=0.96 ---16744.43 ms/batch
Step 00094800 L_out=0.076 Acc=0.92 ---40245.08 ms/batch
Step 00094850 L_out=0.207 Acc=0.95 ---63541.21 ms/batch
Step 00094900 L_out=0.208 Acc=0.94 ---86981.75 ms/batch
Step 00094950 L_out=0.343 Acc=0.89 ---110517.67 ms/batch
Step 00095000 L_out=0.183 Acc=0.96 ---134154.04 ms/batch
Step 00095050 L_out=0.208 Acc=0.94 ---157680.23 ms/batch
Step 00095100 L_out=0.249 Acc=0.95 ---181033.70 ms/batch
Step 00095150 L_out=0.326 Acc=0.94 ---204443.76 ms/batch
Step 00095200 L_out=0.271 Acc=0.94 ---227856.97 ms/batch
Step 00095250 L_out=0.234 Acc=0.94 ---251308.70 ms/batch
Step 00095300 L_out=0.264 Acc=0.94 ---274810.29 ms/batch
Step 00095350 L_out=0.113 Acc=0.88 ---298232.34 ms/batch
Round 6 | epoch=22, train costTime=313.04789996147156, | total_activation_sum=13028122
Round 6 | epoch=23, current m_iou=0.7051923389430174
Round 6 | Best m_IoU is: 0.712, OA is: 0.924 | val costTime=117.34916496276855
Round 6 | ****EPOCH 23****
Step 00095400 L_out=0.096 Acc=0.87 --- 8909.22 ms/batch
Step 00095450 L_out=0.394 Acc=0.92 ---32574.34 ms/batch
Step 00095500 L_out=0.144 Acc=0.94 ---56028.17 ms/batch
Step 00095550 L_out=0.255 Acc=0.96 ---79711.47 ms/batch
Step 00095600 L_out=0.238 Acc=0.93 ---103358.36 ms/batch
Step 00095650 L_out=0.538 Acc=0.92 ---126942.27 ms/batch
Step 00095700 L_out=0.077 Acc=0.95 ---150549.12 ms/batch
Step 00095750 L_out=0.097 Acc=0.96 ---173890.25 ms/batch
Step 00095800 L_out=0.120 Acc=0.91 ---197344.60 ms/batch
Step 00095850 L_out=0.114 Acc=0.97 ---220895.46 ms/batch
Step 00095900 L_out=0.149 Acc=0.83 ---244511.92 ms/batch
Step 00095950 L_out=0.029 Acc=0.82 ---268037.05 ms/batch
Step 00096000 L_out=0.241 Acc=0.80 ---291490.08 ms/batch
Round 6 | epoch=23, train costTime=314.0480718612671, | total_activation_sum=12766264
Round 6 | epoch=24, current m_iou=0.703746967399422
Round 6 | Best m_IoU is: 0.712, OA is: 0.924 | val costTime=117.37621450424194
Round 6 | ****EPOCH 24****
Step 00096050 L_out=0.086 Acc=0.97 ---  925.79 ms/batch
Step 00096100 L_out=0.253 Acc=0.92 ---24332.98 ms/batch
Step 00096150 L_out=0.292 Acc=0.94 ---47756.51 ms/batch
Step 00096200 L_out=0.206 Acc=0.85 ---71304.10 ms/batch
Step 00096250 L_out=0.107 Acc=0.94 ---94655.91 ms/batch
Step 00096300 L_out=0.161 Acc=0.87 ---118175.38 ms/batch
Step 00096350 L_out=0.347 Acc=0.93 ---141691.68 ms/batch
Step 00096400 L_out=0.127 Acc=0.96 ---165164.01 ms/batch
Step 00096450 L_out=0.162 Acc=0.95 ---188843.68 ms/batch
Step 00096500 L_out=0.281 Acc=0.92 ---212150.87 ms/batch
Step 00096550 L_out=0.178 Acc=0.83 ---235427.87 ms/batch
Step 00096600 L_out=0.124 Acc=0.95 ---258872.37 ms/batch
Step 00096650 L_out=0.306 Acc=0.84 ---282354.70 ms/batch
Step 00096700 L_out=0.192 Acc=0.95 ---305744.84 ms/batch
Round 6 | epoch=24, train costTime=312.80521154403687, | total_activation_sum=13151043
Round 6 | epoch=25, current m_iou=0.7028842570047126
Round 6 | Best m_IoU is: 0.712, OA is: 0.924 | val costTime=117.31123065948486
Round 6 | ****EPOCH 25****
Step 00096750 L_out=0.173 Acc=0.75 ---16436.98 ms/batch
Step 00096800 L_out=0.221 Acc=0.96 ---39842.02 ms/batch
Step 00096850 L_out=0.401 Acc=0.91 ---63268.59 ms/batch
Step 00096900 L_out=0.452 Acc=0.91 ---86714.22 ms/batch
Step 00096950 L_out=0.170 Acc=0.89 ---110233.57 ms/batch
Step 00097000 L_out=0.268 Acc=0.93 ---133750.83 ms/batch
Step 00097050 L_out=0.190 Acc=0.95 ---157156.29 ms/batch
Step 00097100 L_out=0.105 Acc=0.94 ---180602.21 ms/batch
Step 00097150 L_out=0.153 Acc=0.94 ---204181.96 ms/batch
Step 00097200 L_out=0.144 Acc=0.94 ---227674.36 ms/batch
Step 00097250 L_out=0.185 Acc=0.93 ---251268.27 ms/batch
Step 00097300 L_out=0.429 Acc=0.93 ---275019.11 ms/batch
Step 00097350 L_out=0.119 Acc=0.87 ---298404.50 ms/batch
Round 6 | epoch=25, train costTime=313.47777676582336, | total_activation_sum=12751241
Round 6 | epoch=26, current m_iou=0.7057280460146391
Round 6 | Best m_IoU is: 0.712, OA is: 0.924 | val costTime=116.84431958198547
Round 6 | ****EPOCH 26****
Step 00097400 L_out=0.113 Acc=0.93 --- 8431.57 ms/batch
Step 00097450 L_out=0.307 Acc=0.90 ---31839.72 ms/batch
Step 00097500 L_out=0.015 Acc=0.97 ---55165.48 ms/batch
Step 00097550 L_out=0.288 Acc=0.83 ---78589.23 ms/batch
Step 00097600 L_out=0.326 Acc=0.86 ---102076.68 ms/batch
Step 00097650 L_out=0.263 Acc=0.95 ---125399.03 ms/batch
Step 00097700 L_out=0.160 Acc=0.85 ---148849.80 ms/batch
Step 00097750 L_out=0.193 Acc=0.92 ---172148.91 ms/batch
Step 00097800 L_out=0.136 Acc=0.94 ---195725.80 ms/batch
Step 00097850 L_out=0.234 Acc=0.94 ---219180.71 ms/batch
Step 00097900 L_out=0.083 Acc=0.96 ---242594.13 ms/batch
Step 00097950 L_out=0.198 Acc=0.96 ---266004.24 ms/batch
Step 00098000 L_out=0.076 Acc=0.94 ---289582.71 ms/batch
Round 6 | epoch=26, train costTime=312.723760843277, | total_activation_sum=12838264
Round 6 | epoch=27, current m_iou=0.708615296842128
Round 6 | Best m_IoU is: 0.712, OA is: 0.924 | val costTime=117.25388622283936
Round 6 | ****EPOCH 27****
Step 00098050 L_out=0.321 Acc=0.93 ---  461.29 ms/batch
Step 00098100 L_out=0.177 Acc=0.96 ---23670.91 ms/batch
Step 00098150 L_out=0.051 Acc=0.93 ---47058.97 ms/batch
Step 00098200 L_out=0.479 Acc=0.88 ---70757.78 ms/batch
Step 00098250 L_out=0.023 Acc=0.95 ---94355.16 ms/batch
Step 00098300 L_out=0.212 Acc=0.95 ---118121.36 ms/batch
Step 00098350 L_out=0.260 Acc=0.90 ---141847.11 ms/batch
Step 00098400 L_out=0.181 Acc=0.92 ---165306.91 ms/batch
Step 00098450 L_out=0.283 Acc=0.93 ---188830.93 ms/batch
Step 00098500 L_out=0.366 Acc=0.96 ---212358.63 ms/batch
Step 00098550 L_out=0.327 Acc=0.90 ---235884.95 ms/batch
Step 00098600 L_out=0.231 Acc=0.93 ---259061.60 ms/batch
Step 00098650 L_out=0.183 Acc=0.96 ---282641.94 ms/batch
Step 00098700 L_out=0.129 Acc=0.96 ---305935.48 ms/batch
Round 6 | epoch=27, train costTime=313.50507974624634, | total_activation_sum=12823495
Round 6 | epoch=28, current m_iou=0.7109467749249276
Round 6 | Best m_IoU is: 0.712, OA is: 0.924 | val costTime=117.20516538619995
Round 6 | ****EPOCH 28****
Step 00098750 L_out=0.090 Acc=0.94 ---15999.13 ms/batch
Step 00098800 L_out=0.061 Acc=0.98 ---39408.58 ms/batch
Step 00098850 L_out=0.154 Acc=0.98 ---62663.35 ms/batch
Step 00098900 L_out=0.500 Acc=0.90 ---86166.96 ms/batch
Step 00098950 L_out=0.265 Acc=0.84 ---109575.65 ms/batch
Step 00099000 L_out=0.209 Acc=0.91 ---132931.45 ms/batch
Step 00099050 L_out=0.186 Acc=0.89 ---156421.73 ms/batch
Step 00099100 L_out=0.167 Acc=0.96 ---180028.92 ms/batch
Step 00099150 L_out=0.144 Acc=0.93 ---203519.00 ms/batch
Step 00099200 L_out=0.018 Acc=0.97 ---226888.13 ms/batch
Step 00099250 L_out=0.205 Acc=0.89 ---250389.12 ms/batch
Step 00099300 L_out=0.305 Acc=0.95 ---274029.62 ms/batch
Step 00099350 L_out=0.228 Acc=0.83 ---297500.02 ms/batch
Round 6 | epoch=28, train costTime=313.037960767746, | total_activation_sum=12846302
Round 6 | epoch=29, current m_iou=0.7119290438973513
Round 6 | Best m_IoU is: 0.712, OA is: 0.927 | val costTime=117.48358201980591
Round 6 | ****EPOCH 29****
Step 00099400 L_out=0.316 Acc=0.93 --- 8168.41 ms/batch
Step 00099450 L_out=0.106 Acc=0.94 ---31610.63 ms/batch
Step 00099500 L_out=0.394 Acc=0.88 ---55263.59 ms/batch
Step 00099550 L_out=0.244 Acc=0.86 ---78536.07 ms/batch
Step 00099600 L_out=0.107 Acc=0.94 ---101935.86 ms/batch
Step 00099650 L_out=0.269 Acc=0.95 ---125519.68 ms/batch
Step 00099700 L_out=0.202 Acc=0.92 ---149136.46 ms/batch
Step 00099750 L_out=0.170 Acc=0.96 ---172587.07 ms/batch
Step 00099800 L_out=0.195 Acc=0.95 ---196010.79 ms/batch
Step 00099850 L_out=0.431 Acc=0.94 ---219308.08 ms/batch
Step 00099900 L_out=0.037 Acc=0.98 ---242663.64 ms/batch
Step 00099950 L_out=0.231 Acc=0.89 ---266236.56 ms/batch
Step 00100000 L_out=0.073 Acc=0.93 ---289667.51 ms/batch
Step 00100050 L_out=0.158 Acc=0.89 ---313052.68 ms/batch
Round 6 | epoch=29, train costTime=313.05304169654846, | total_activation_sum=13060626
Round 6 | epoch=30, current m_iou=0.7097731774429386
Round 6 | Best m_IoU is: 0.712, OA is: 0.927 | val costTime=117.08718609809875
Round 6 | ****EPOCH 30****
Round 7 | ****EPOCH 0****
Step 00100100 L_out=0.128 Acc=0.59 ---23653.99 ms/batch
Step 00100150 L_out=1.403 Acc=0.46 ---47142.00 ms/batch
Step 00100200 L_out=0.716 Acc=0.70 ---70620.43 ms/batch
Step 00100250 L_out=0.519 Acc=0.79 ---93927.07 ms/batch
Step 00100300 L_out=1.950 Acc=0.69 ---117732.39 ms/batch
Step 00100350 L_out=0.674 Acc=0.65 ---141391.97 ms/batch
Step 00100400 L_out=1.736 Acc=0.81 ---165167.40 ms/batch
Step 00100450 L_out=1.155 Acc=0.81 ---188962.25 ms/batch
Step 00100500 L_out=0.768 Acc=0.88 ---212380.03 ms/batch
Step 00100550 L_out=0.225 Acc=0.79 ---235930.98 ms/batch
Step 00100600 L_out=0.397 Acc=0.88 ---259517.03 ms/batch
Step 00100650 L_out=0.707 Acc=0.81 ---283040.86 ms/batch
Step 00100700 L_out=0.207 Acc=0.92 ---306552.48 ms/batch
Round 7 | epoch=0, train costTime=314.63447976112366, | total_activation_sum=14068274
Round 7 | ****EPOCH 1****
Step 00100750 L_out=0.402 Acc=0.92 ---15359.69 ms/batch
Step 00100800 L_out=0.214 Acc=0.79 ---38648.25 ms/batch
Step 00100850 L_out=0.416 Acc=0.88 ---62290.95 ms/batch
Step 00100900 L_out=0.503 Acc=0.84 ---85528.31 ms/batch
Step 00100950 L_out=1.043 Acc=0.79 ---108907.39 ms/batch
Step 00101000 L_out=1.663 Acc=0.65 ---132397.18 ms/batch
Step 00101050 L_out=0.220 Acc=0.95 ---155719.68 ms/batch
Step 00101100 L_out=0.286 Acc=0.90 ---179128.95 ms/batch
Step 00101150 L_out=0.237 Acc=0.94 ---202672.86 ms/batch
Step 00101200 L_out=0.259 Acc=0.93 ---226167.73 ms/batch
Step 00101250 L_out=0.508 Acc=0.84 ---249500.35 ms/batch
Step 00101300 L_out=0.525 Acc=0.81 ---272896.86 ms/batch
Step 00101350 L_out=0.569 Acc=0.93 ---296643.99 ms/batch
Round 7 | epoch=1, train costTime=312.69318294525146, | total_activation_sum=14857604
Round 7 | ****EPOCH 2****
Step 00101400 L_out=0.589 Acc=0.92 --- 7629.74 ms/batch
Step 00101450 L_out=0.302 Acc=0.87 ---31035.72 ms/batch
Step 00101500 L_out=0.032 Acc=0.95 ---54437.59 ms/batch
Step 00101550 L_out=0.249 Acc=0.94 ---77981.80 ms/batch
Step 00101600 L_out=0.193 Acc=0.94 ---101549.62 ms/batch
Step 00101650 L_out=0.351 Acc=0.89 ---124921.19 ms/batch
Step 00101700 L_out=0.390 Acc=0.77 ---148429.68 ms/batch
Step 00101750 L_out=0.338 Acc=0.92 ---172021.44 ms/batch
Step 00101800 L_out=0.402 Acc=0.84 ---195338.26 ms/batch
Step 00101850 L_out=0.188 Acc=0.93 ---218854.44 ms/batch
Step 00101900 L_out=2.030 Acc=0.57 ---242623.64 ms/batch
Step 00101950 L_out=0.481 Acc=0.73 ---265850.38 ms/batch
Step 00102000 L_out=0.429 Acc=0.73 ---289275.28 ms/batch
Step 00102050 L_out=0.391 Acc=0.88 ---312747.27 ms/batch
Round 7 | epoch=2, train costTime=313.1985855102539, | total_activation_sum=14923072
Round 7 | ****EPOCH 3****
Step 00102100 L_out=0.155 Acc=0.83 ---22929.87 ms/batch
Step 00102150 L_out=0.318 Acc=0.92 ---46467.99 ms/batch
Step 00102200 L_out=0.211 Acc=0.89 ---70032.39 ms/batch
Step 00102250 L_out=0.436 Acc=0.87 ---93434.62 ms/batch
Step 00102300 L_out=0.268 Acc=0.94 ---116732.76 ms/batch
Step 00102350 L_out=0.330 Acc=0.88 ---140367.31 ms/batch
Step 00102400 L_out=1.725 Acc=0.87 ---163906.48 ms/batch
Step 00102450 L_out=0.610 Acc=0.87 ---187445.05 ms/batch
Step 00102500 L_out=0.762 Acc=0.78 ---210712.50 ms/batch
Step 00102550 L_out=0.358 Acc=0.90 ---234184.38 ms/batch
Step 00102600 L_out=0.169 Acc=0.97 ---257722.57 ms/batch
Step 00102650 L_out=0.252 Acc=0.93 ---281428.52 ms/batch
Step 00102700 L_out=0.182 Acc=0.97 ---305008.13 ms/batch
Round 7 | epoch=3, train costTime=313.465295791626, | total_activation_sum=14946240
Round 7 | ****EPOCH 4****
Step 00102750 L_out=0.457 Acc=0.78 ---15386.25 ms/batch
Step 00102800 L_out=0.223 Acc=0.92 ---39035.14 ms/batch
Step 00102850 L_out=0.075 Acc=0.92 ---62439.61 ms/batch
Step 00102900 L_out=0.418 Acc=0.84 ---86173.41 ms/batch
Step 00102950 L_out=0.300 Acc=0.77 ---109897.22 ms/batch
Step 00103000 L_out=0.510 Acc=0.88 ---133331.11 ms/batch
Step 00103050 L_out=0.152 Acc=0.94 ---156874.52 ms/batch
Step 00103100 L_out=0.211 Acc=0.92 ---180334.82 ms/batch
Step 00103150 L_out=0.237 Acc=0.85 ---203904.68 ms/batch
Step 00103200 L_out=0.200 Acc=0.63 ---227310.61 ms/batch
Step 00103250 L_out=0.068 Acc=0.90 ---250832.74 ms/batch
Step 00103300 L_out=0.283 Acc=0.83 ---274215.48 ms/batch
Step 00103350 L_out=0.480 Acc=0.87 ---297635.34 ms/batch
Round 7 | epoch=4, train costTime=314.06705355644226, | total_activation_sum=14883297
Round 7 | ****EPOCH 5****
Step 00103400 L_out=0.233 Acc=0.92 --- 6992.17 ms/batch
Step 00103450 L_out=0.384 Acc=0.88 ---30512.60 ms/batch
Step 00103500 L_out=0.218 Acc=0.86 ---53956.53 ms/batch
Step 00103550 L_out=0.613 Acc=0.73 ---77581.52 ms/batch
Step 00103600 L_out=0.251 Acc=0.96 ---101035.77 ms/batch
Step 00103650 L_out=0.219 Acc=0.87 ---124634.14 ms/batch
Step 00103700 L_out=0.123 Acc=0.92 ---148110.76 ms/batch
Step 00103750 L_out=0.273 Acc=0.94 ---171402.86 ms/batch
Step 00103800 L_out=0.518 Acc=0.85 ---195122.75 ms/batch
Step 00103850 L_out=0.318 Acc=0.96 ---218687.83 ms/batch
Step 00103900 L_out=0.242 Acc=0.92 ---242224.47 ms/batch
Step 00103950 L_out=0.262 Acc=0.87 ---265802.75 ms/batch
Step 00104000 L_out=0.187 Acc=0.91 ---289342.51 ms/batch
Step 00104050 L_out=0.487 Acc=0.89 ---312710.64 ms/batch
Round 7 | epoch=5, train costTime=313.62010622024536, | total_activation_sum=14841427
Round 7 | ****EPOCH 6****
Step 00104100 L_out=0.285 Acc=0.89 ---22579.69 ms/batch
Step 00104150 L_out=0.108 Acc=0.82 ---46059.24 ms/batch
Step 00104200 L_out=0.161 Acc=0.94 ---69458.80 ms/batch
Step 00104250 L_out=0.255 Acc=0.88 ---93100.88 ms/batch
Step 00104300 L_out=0.244 Acc=0.94 ---116625.35 ms/batch
Step 00104350 L_out=0.585 Acc=0.89 ---140157.19 ms/batch
Step 00104400 L_out=0.124 Acc=0.94 ---163637.71 ms/batch
Step 00104450 L_out=0.180 Acc=0.96 ---187128.64 ms/batch
Step 00104500 L_out=0.099 Acc=0.94 ---210479.45 ms/batch
Step 00104550 L_out=0.256 Acc=0.92 ---234023.91 ms/batch
Step 00104600 L_out=0.227 Acc=0.88 ---257663.85 ms/batch
Step 00104650 L_out=0.566 Acc=0.90 ---281109.94 ms/batch
Step 00104700 L_out=0.124 Acc=0.92 ---304480.30 ms/batch
Round 7 | epoch=6, train costTime=313.381796836853, | total_activation_sum=14861905
Round 7 | ****EPOCH 7****
Step 00104750 L_out=0.159 Acc=0.95 ---14519.43 ms/batch
Step 00104800 L_out=0.644 Acc=0.90 ---38154.93 ms/batch
Step 00104850 L_out=0.187 Acc=0.86 ---61539.48 ms/batch
Step 00104900 L_out=0.244 Acc=0.88 ---84811.75 ms/batch
Step 00104950 L_out=0.251 Acc=0.94 ---108491.18 ms/batch
Step 00105000 L_out=0.157 Acc=0.95 ---132077.39 ms/batch
Step 00105050 L_out=0.303 Acc=0.79 ---155742.47 ms/batch
Step 00105100 L_out=0.194 Acc=0.92 ---179124.55 ms/batch
Step 00105150 L_out=0.262 Acc=0.93 ---202661.54 ms/batch
Step 00105200 L_out=0.168 Acc=0.97 ---226028.48 ms/batch
Step 00105250 L_out=0.322 Acc=0.86 ---249763.47 ms/batch
Step 00105300 L_out=0.331 Acc=0.96 ---273298.54 ms/batch
Step 00105350 L_out=0.151 Acc=0.92 ---296753.56 ms/batch
Round 7 | epoch=7, train costTime=313.57611894607544, | total_activation_sum=14737627
Round 7 | ****EPOCH 8****
Step 00105400 L_out=0.218 Acc=0.97 --- 6670.83 ms/batch
Step 00105450 L_out=0.140 Acc=0.94 ---30236.38 ms/batch
Step 00105500 L_out=0.192 Acc=0.90 ---53636.53 ms/batch
Step 00105550 L_out=0.075 Acc=0.94 ---77196.71 ms/batch
Step 00105600 L_out=0.334 Acc=0.93 ---100761.57 ms/batch
Step 00105650 L_out=0.223 Acc=0.96 ---124286.79 ms/batch
Step 00105700 L_out=0.424 Acc=0.92 ---147898.06 ms/batch
Step 00105750 L_out=0.101 Acc=0.91 ---171456.79 ms/batch
Step 00105800 L_out=0.456 Acc=0.89 ---195030.66 ms/batch
Step 00105850 L_out=0.292 Acc=0.96 ---218546.42 ms/batch
Step 00105900 L_out=0.366 Acc=0.79 ---242140.62 ms/batch
Step 00105950 L_out=0.393 Acc=0.82 ---265714.51 ms/batch
Step 00106000 L_out=0.352 Acc=0.83 ---289276.42 ms/batch
Step 00106050 L_out=0.336 Acc=0.92 ---312627.86 ms/batch
Round 7 | epoch=8, train costTime=314.0450930595398, | total_activation_sum=14937554
Round 7 | ****EPOCH 9****
Step 00106100 L_out=0.135 Acc=0.87 ---22204.28 ms/batch
Step 00106150 L_out=0.129 Acc=0.94 ---45813.95 ms/batch
Step 00106200 L_out=0.305 Acc=0.72 ---69565.79 ms/batch
Step 00106250 L_out=0.760 Acc=0.81 ---92904.22 ms/batch
Step 00106300 L_out=0.189 Acc=0.91 ---116417.60 ms/batch
Step 00106350 L_out=0.299 Acc=0.89 ---139891.68 ms/batch
Step 00106400 L_out=0.197 Acc=0.95 ---163432.34 ms/batch
Step 00106450 L_out=0.258 Acc=0.89 ---187113.64 ms/batch
Step 00106500 L_out=0.306 Acc=0.85 ---210500.10 ms/batch
Step 00106550 L_out=0.310 Acc=0.89 ---234005.29 ms/batch
Step 00106600 L_out=0.494 Acc=0.92 ---257692.66 ms/batch
Step 00106650 L_out=0.259 Acc=0.86 ---281108.21 ms/batch
Step 00106700 L_out=0.222 Acc=0.87 ---304604.22 ms/batch
Round 7 | epoch=9, train costTime=313.96783542633057, | total_activation_sum=14782202
Round 7 | ****EPOCH 10****
Step 00106750 L_out=0.424 Acc=0.93 ---14240.28 ms/batch
Step 00106800 L_out=0.382 Acc=0.95 ---37863.16 ms/batch
Step 00106850 L_out=0.297 Acc=0.67 ---61543.33 ms/batch
Step 00106900 L_out=0.101 Acc=0.77 ---84967.63 ms/batch
Step 00106950 L_out=0.172 Acc=0.78 ---108441.39 ms/batch
Step 00107000 L_out=0.335 Acc=0.90 ---132096.67 ms/batch
Step 00107050 L_out=0.549 Acc=0.94 ---155415.80 ms/batch
Step 00107100 L_out=0.174 Acc=0.94 ---178713.71 ms/batch
Step 00107150 L_out=0.216 Acc=0.93 ---202486.15 ms/batch
Step 00107200 L_out=1.005 Acc=0.60 ---226080.47 ms/batch
Step 00107250 L_out=0.754 Acc=0.88 ---249505.18 ms/batch
Step 00107300 L_out=0.172 Acc=0.97 ---273151.20 ms/batch
Step 00107350 L_out=0.302 Acc=0.96 ---296780.73 ms/batch
Round 7 | epoch=10, train costTime=314.02072858810425, | total_activation_sum=14861031
Round 7 | ****EPOCH 11****
Step 00107400 L_out=0.102 Acc=0.96 --- 6167.40 ms/batch
Step 00107450 L_out=0.106 Acc=0.91 ---29637.08 ms/batch
Step 00107500 L_out=0.438 Acc=0.96 ---53227.64 ms/batch
Step 00107550 L_out=0.165 Acc=0.96 ---76825.04 ms/batch
Step 00107600 L_out=0.320 Acc=0.93 ---100437.33 ms/batch
Step 00107650 L_out=0.199 Acc=0.93 ---123812.55 ms/batch
Step 00107700 L_out=0.446 Acc=0.80 ---147503.64 ms/batch
Step 00107750 L_out=0.296 Acc=0.93 ---171234.30 ms/batch
Step 00107800 L_out=0.194 Acc=0.92 ---194655.49 ms/batch
Step 00107850 L_out=0.248 Acc=0.95 ---218127.10 ms/batch
Step 00107900 L_out=0.466 Acc=0.91 ---241531.94 ms/batch
Step 00107950 L_out=0.180 Acc=0.94 ---265081.40 ms/batch
Step 00108000 L_out=0.125 Acc=0.95 ---288601.54 ms/batch
Step 00108050 L_out=0.079 Acc=0.94 ---311888.77 ms/batch
Round 7 | epoch=11, train costTime=313.78010153770447, | total_activation_sum=14951329
Round 7 | ****EPOCH 12****
Step 00108100 L_out=0.274 Acc=0.85 ---21748.93 ms/batch
Step 00108150 L_out=0.259 Acc=0.94 ---45265.77 ms/batch
Step 00108200 L_out=0.249 Acc=0.94 ---68453.89 ms/batch
Step 00108250 L_out=0.266 Acc=0.93 ---91764.10 ms/batch
Step 00108300 L_out=0.484 Acc=0.89 ---115449.93 ms/batch
Step 00108350 L_out=0.150 Acc=0.94 ---138991.58 ms/batch
Step 00108400 L_out=0.170 Acc=0.95 ---162370.47 ms/batch
Step 00108450 L_out=0.223 Acc=0.95 ---185880.10 ms/batch
Step 00108500 L_out=0.402 Acc=0.93 ---209386.81 ms/batch
Step 00108550 L_out=0.397 Acc=0.95 ---232685.56 ms/batch
Step 00108600 L_out=0.173 Acc=0.93 ---256108.25 ms/batch
Step 00108650 L_out=0.256 Acc=0.94 ---279709.61 ms/batch
Step 00108700 L_out=0.135 Acc=0.95 ---303346.10 ms/batch
Round 7 | epoch=12, train costTime=313.2537639141083, | total_activation_sum=14795176
Round 7 | ****EPOCH 13****
Step 00108750 L_out=0.105 Acc=0.94 ---13702.91 ms/batch
Step 00108800 L_out=0.277 Acc=0.93 ---37017.06 ms/batch
Step 00108850 L_out=0.543 Acc=0.94 ---60541.29 ms/batch
Step 00108900 L_out=0.157 Acc=0.89 ---83964.37 ms/batch
Step 00108950 L_out=0.139 Acc=0.94 ---107341.67 ms/batch
Step 00109000 L_out=0.202 Acc=0.93 ---130883.82 ms/batch
Step 00109050 L_out=0.354 Acc=0.90 ---154446.57 ms/batch
Step 00109100 L_out=0.347 Acc=0.91 ---177889.08 ms/batch
Step 00109150 L_out=0.178 Acc=0.86 ---201523.55 ms/batch
Step 00109200 L_out=0.313 Acc=0.91 ---225048.89 ms/batch
Step 00109250 L_out=0.141 Acc=0.98 ---248495.57 ms/batch
Step 00109300 L_out=0.283 Acc=0.91 ---271976.41 ms/batch
Step 00109350 L_out=0.363 Acc=0.86 ---295537.39 ms/batch
Round 7 | epoch=13, train costTime=313.3623971939087, | total_activation_sum=14799122
Round 7 | ****EPOCH 14****
Step 00109400 L_out=0.255 Acc=0.90 --- 5605.32 ms/batch
Step 00109450 L_out=0.266 Acc=0.96 ---29247.03 ms/batch
Step 00109500 L_out=0.094 Acc=0.95 ---52920.23 ms/batch
Step 00109550 L_out=0.219 Acc=0.90 ---76305.47 ms/batch
Step 00109600 L_out=0.221 Acc=0.84 ---99746.31 ms/batch
Step 00109650 L_out=0.203 Acc=0.90 ---123360.36 ms/batch
Step 00109700 L_out=0.157 Acc=0.92 ---146800.98 ms/batch
Step 00109750 L_out=0.237 Acc=0.94 ---170366.51 ms/batch
Step 00109800 L_out=0.481 Acc=0.94 ---193817.91 ms/batch
Step 00109850 L_out=0.211 Acc=0.96 ---217264.15 ms/batch
Step 00109900 L_out=0.195 Acc=0.94 ---240759.83 ms/batch
Step 00109950 L_out=0.093 Acc=0.89 ---264329.94 ms/batch
Step 00110000 L_out=0.205 Acc=0.81 ---287580.31 ms/batch
Step 00110050 L_out=0.168 Acc=0.96 ---310986.28 ms/batch
Round 7 | epoch=14, train costTime=313.30863761901855, | total_activation_sum=14822591
Round 7 | ****EPOCH 15****
Step 00110100 L_out=0.358 Acc=0.94 ---21185.91 ms/batch
Step 00110150 L_out=0.317 Acc=0.90 ---44573.98 ms/batch
Step 00110200 L_out=0.105 Acc=0.96 ---68201.34 ms/batch
Step 00110250 L_out=0.286 Acc=0.94 ---91851.21 ms/batch
Step 00110300 L_out=0.196 Acc=0.93 ---115375.72 ms/batch
Step 00110350 L_out=0.066 Acc=0.96 ---138813.32 ms/batch
Step 00110400 L_out=0.081 Acc=0.93 ---162264.74 ms/batch
Step 00110450 L_out=0.215 Acc=0.97 ---185872.19 ms/batch
Step 00110500 L_out=0.419 Acc=0.81 ---209391.09 ms/batch
Step 00110550 L_out=0.348 Acc=0.94 ---232915.19 ms/batch
Step 00110600 L_out=0.221 Acc=0.95 ---256287.13 ms/batch
Step 00110650 L_out=0.108 Acc=0.92 ---279913.24 ms/batch
Step 00110700 L_out=0.065 Acc=0.94 ---303291.76 ms/batch
Round 7 | epoch=15, train costTime=313.5769066810608, | total_activation_sum=14796339
Round 7 | ****EPOCH 16****
Step 00110750 L_out=0.120 Acc=0.95 ---13019.82 ms/batch
Step 00110800 L_out=0.364 Acc=0.91 ---36279.90 ms/batch
Step 00110850 L_out=0.449 Acc=0.87 ---59723.27 ms/batch
Step 00110900 L_out=0.585 Acc=0.65 ---83087.61 ms/batch
Step 00110950 L_out=0.090 Acc=0.95 ---106539.74 ms/batch
Step 00111000 L_out=0.139 Acc=0.75 ---130153.02 ms/batch
Step 00111050 L_out=0.483 Acc=0.93 ---153582.16 ms/batch
Step 00111100 L_out=0.131 Acc=0.95 ---177181.94 ms/batch
Step 00111150 L_out=0.089 Acc=0.90 ---200796.17 ms/batch
Step 00111200 L_out=0.337 Acc=0.91 ---224477.06 ms/batch
Step 00111250 L_out=0.287 Acc=0.89 ---248001.50 ms/batch
Step 00111300 L_out=0.303 Acc=0.93 ---271374.48 ms/batch
Step 00111350 L_out=0.306 Acc=0.89 ---294821.54 ms/batch
Round 7 | epoch=16, train costTime=313.20362162590027, | total_activation_sum=14950161
Round 7 | ****EPOCH 17****
Step 00111400 L_out=0.271 Acc=0.93 --- 5083.78 ms/batch
Step 00111450 L_out=0.317 Acc=0.97 ---28417.04 ms/batch
Step 00111500 L_out=0.123 Acc=0.94 ---52014.98 ms/batch
Step 00111550 L_out=0.114 Acc=0.96 ---75612.49 ms/batch
Step 00111600 L_out=0.193 Acc=0.96 ---98917.42 ms/batch
Step 00111650 L_out=0.227 Acc=0.95 ---122199.98 ms/batch
Step 00111700 L_out=0.372 Acc=0.94 ---145655.65 ms/batch
Step 00111750 L_out=0.114 Acc=0.92 ---169097.16 ms/batch
Step 00111800 L_out=0.087 Acc=0.91 ---192696.96 ms/batch
Step 00111850 L_out=0.181 Acc=0.92 ---216308.65 ms/batch
Step 00111900 L_out=0.208 Acc=0.96 ---239884.72 ms/batch
Step 00111950 L_out=0.175 Acc=0.93 ---263409.23 ms/batch
Step 00112000 L_out=0.167 Acc=0.92 ---286961.71 ms/batch
Step 00112050 L_out=0.105 Acc=0.85 ---310775.56 ms/batch
Round 7 | epoch=17, train costTime=313.60854840278625, | total_activation_sum=14705414
Round 7 | epoch=18, current m_iou=0.6986045102962831
Round 7 | Best m_IoU is: 0.699, OA is: 0.920 | val costTime=116.93209433555603
Round 7 | ****EPOCH 18****
Step 00112100 L_out=0.360 Acc=0.86 ---20684.64 ms/batch
Step 00112150 L_out=0.282 Acc=0.95 ---44158.16 ms/batch
Step 00112200 L_out=0.211 Acc=0.92 ---67869.52 ms/batch
Step 00112250 L_out=0.205 Acc=0.90 ---91359.36 ms/batch
Step 00112300 L_out=0.129 Acc=0.95 ---114791.19 ms/batch
Step 00112350 L_out=0.181 Acc=0.95 ---138282.45 ms/batch
Step 00112400 L_out=0.328 Acc=0.93 ---161932.65 ms/batch
Step 00112450 L_out=0.129 Acc=0.94 ---185201.16 ms/batch
Step 00112500 L_out=0.274 Acc=0.95 ---208619.96 ms/batch
Step 00112550 L_out=0.234 Acc=0.95 ---232008.29 ms/batch
Step 00112600 L_out=0.422 Acc=0.67 ---255418.60 ms/batch
Step 00112650 L_out=0.141 Acc=0.92 ---279009.63 ms/batch
Step 00112700 L_out=0.205 Acc=0.93 ---302666.57 ms/batch
Round 7 | epoch=18, train costTime=313.40721583366394, | total_activation_sum=14707709
Round 7 | epoch=19, current m_iou=0.7026903719262789
Round 7 | Best m_IoU is: 0.703, OA is: 0.921 | val costTime=117.61435532569885
Round 7 | ****EPOCH 19****
Step 00112750 L_out=0.135 Acc=0.96 ---12615.82 ms/batch
Step 00112800 L_out=0.157 Acc=0.90 ---35959.91 ms/batch
Step 00112850 L_out=0.186 Acc=0.92 ---59495.26 ms/batch
Step 00112900 L_out=0.168 Acc=0.97 ---83070.17 ms/batch
Step 00112950 L_out=0.125 Acc=0.97 ---106671.04 ms/batch
Step 00113000 L_out=0.045 Acc=0.96 ---130091.60 ms/batch
Step 00113050 L_out=0.050 Acc=0.94 ---153582.31 ms/batch
Step 00113100 L_out=0.343 Acc=0.94 ---177067.44 ms/batch
Step 00113150 L_out=0.080 Acc=0.97 ---200486.01 ms/batch
Step 00113200 L_out=0.051 Acc=0.83 ---223990.56 ms/batch
Step 00113250 L_out=0.146 Acc=0.95 ---247553.19 ms/batch
Step 00113300 L_out=0.219 Acc=0.96 ---271492.74 ms/batch
Step 00113350 L_out=0.110 Acc=0.92 ---294901.92 ms/batch
Round 7 | epoch=19, train costTime=313.6161835193634, | total_activation_sum=15095431
Round 7 | epoch=20, current m_iou=0.7040404703599626
Round 7 | Best m_IoU is: 0.704, OA is: 0.922 | val costTime=117.47395157814026
Round 7 | ****EPOCH 20****
Step 00113400 L_out=0.059 Acc=0.97 --- 4797.85 ms/batch
Step 00113450 L_out=0.274 Acc=0.92 ---28287.19 ms/batch
Step 00113500 L_out=0.177 Acc=0.93 ---51650.78 ms/batch
Step 00113550 L_out=0.305 Acc=0.96 ---75162.13 ms/batch
Step 00113600 L_out=0.251 Acc=0.91 ---98632.66 ms/batch
Step 00113650 L_out=0.316 Acc=0.89 ---122031.56 ms/batch
Step 00113700 L_out=0.214 Acc=0.77 ---145507.77 ms/batch
Step 00113750 L_out=0.709 Acc=0.92 ---169070.64 ms/batch
Step 00113800 L_out=0.130 Acc=0.96 ---192605.28 ms/batch
Step 00113850 L_out=0.248 Acc=0.92 ---216069.63 ms/batch
Step 00113900 L_out=0.170 Acc=0.93 ---239492.73 ms/batch
Step 00113950 L_out=0.226 Acc=0.96 ---263117.08 ms/batch
Step 00114000 L_out=0.253 Acc=0.93 ---286569.92 ms/batch
Step 00114050 L_out=0.168 Acc=0.94 ---310123.67 ms/batch
Round 7 | epoch=20, train costTime=313.4088158607483, | total_activation_sum=14834442
Round 7 | epoch=21, current m_iou=0.7068744237473779
Round 7 | Best m_IoU is: 0.707, OA is: 0.924 | val costTime=117.02954578399658
Round 7 | ****EPOCH 21****
Step 00114100 L_out=0.171 Acc=0.93 ---20186.53 ms/batch
Step 00114150 L_out=0.611 Acc=0.86 ---43717.45 ms/batch
Step 00114200 L_out=0.382 Acc=0.93 ---67171.84 ms/batch
Step 00114250 L_out=0.077 Acc=0.96 ---90716.94 ms/batch
Step 00114300 L_out=0.174 Acc=0.95 ---114043.17 ms/batch
Step 00114350 L_out=0.233 Acc=0.94 ---137529.30 ms/batch
Step 00114400 L_out=0.035 Acc=0.94 ---161035.81 ms/batch
Step 00114450 L_out=0.414 Acc=0.90 ---184444.40 ms/batch
Step 00114500 L_out=0.356 Acc=0.92 ---208116.34 ms/batch
Step 00114550 L_out=0.264 Acc=0.91 ---231556.78 ms/batch
Step 00114600 L_out=0.234 Acc=0.95 ---255235.32 ms/batch
Step 00114650 L_out=0.151 Acc=0.97 ---278860.60 ms/batch
Step 00114700 L_out=0.243 Acc=0.93 ---302492.62 ms/batch
Round 7 | epoch=21, train costTime=313.97165036201477, | total_activation_sum=14781621
Round 7 | epoch=22, current m_iou=0.7049078899881354
Round 7 | Best m_IoU is: 0.707, OA is: 0.924 | val costTime=116.90337109565735
Round 7 | ****EPOCH 22****
Step 00114750 L_out=0.271 Acc=0.93 ---12280.18 ms/batch
Step 00114800 L_out=0.240 Acc=0.94 ---35773.26 ms/batch
Step 00114850 L_out=0.195 Acc=0.84 ---59089.99 ms/batch
Step 00114900 L_out=0.186 Acc=0.94 ---82626.51 ms/batch
Step 00114950 L_out=0.416 Acc=0.88 ---106321.08 ms/batch
Step 00115000 L_out=0.302 Acc=0.96 ---129775.99 ms/batch
Step 00115050 L_out=0.261 Acc=0.86 ---153189.87 ms/batch
Step 00115100 L_out=0.252 Acc=0.94 ---176513.97 ms/batch
Step 00115150 L_out=0.346 Acc=0.95 ---199973.55 ms/batch
Step 00115200 L_out=0.068 Acc=0.98 ---223519.89 ms/batch
Step 00115250 L_out=0.232 Acc=0.89 ---247003.13 ms/batch
Step 00115300 L_out=0.095 Acc=0.94 ---270463.52 ms/batch
Step 00115350 L_out=0.137 Acc=0.91 ---293967.62 ms/batch
Round 7 | epoch=22, train costTime=313.24875473976135, | total_activation_sum=14846984
Round 7 | epoch=23, current m_iou=0.7003144614087258
Round 7 | Best m_IoU is: 0.707, OA is: 0.924 | val costTime=116.74382400512695
Round 7 | ****EPOCH 23****
Step 00115400 L_out=0.133 Acc=0.84 --- 4212.81 ms/batch
Step 00115450 L_out=0.349 Acc=0.92 ---27750.36 ms/batch
Step 00115500 L_out=0.373 Acc=0.92 ---51225.37 ms/batch
Step 00115550 L_out=0.144 Acc=0.96 ---74839.41 ms/batch
Step 00115600 L_out=0.284 Acc=0.97 ---98342.22 ms/batch
Step 00115650 L_out=0.244 Acc=0.90 ---121893.22 ms/batch
Step 00115700 L_out=0.234 Acc=0.96 ---145369.06 ms/batch
Step 00115750 L_out=0.163 Acc=0.96 ---168669.22 ms/batch
Step 00115800 L_out=0.180 Acc=0.94 ---192029.32 ms/batch
Step 00115850 L_out=0.261 Acc=0.93 ---215472.62 ms/batch
Step 00115900 L_out=0.271 Acc=0.91 ---239038.98 ms/batch
Step 00115950 L_out=0.390 Acc=0.93 ---262456.88 ms/batch
Step 00116000 L_out=0.234 Acc=0.92 ---285972.84 ms/batch
Step 00116050 L_out=0.274 Acc=0.92 ---309528.46 ms/batch
Round 7 | epoch=23, train costTime=313.2680685520172, | total_activation_sum=14965177
Round 7 | epoch=24, current m_iou=0.701977142624497
Round 7 | Best m_IoU is: 0.707, OA is: 0.924 | val costTime=116.7861716747284
Round 7 | ****EPOCH 24****
Step 00116100 L_out=0.204 Acc=0.95 ---19648.08 ms/batch
Step 00116150 L_out=0.076 Acc=0.94 ---43342.68 ms/batch
Step 00116200 L_out=0.207 Acc=0.95 ---66978.48 ms/batch
Step 00116250 L_out=0.121 Acc=0.80 ---90375.01 ms/batch
Step 00116300 L_out=0.251 Acc=0.92 ---113936.91 ms/batch
Step 00116350 L_out=0.231 Acc=0.96 ---137508.68 ms/batch
Step 00116400 L_out=0.192 Acc=0.94 ---160881.58 ms/batch
Step 00116450 L_out=0.279 Acc=0.94 ---184352.81 ms/batch
Step 00116500 L_out=0.164 Acc=0.89 ---207812.58 ms/batch
Step 00116550 L_out=0.196 Acc=0.81 ---231454.73 ms/batch
Step 00116600 L_out=0.132 Acc=0.89 ---254999.43 ms/batch
Step 00116650 L_out=0.165 Acc=0.94 ---278544.52 ms/batch
Step 00116700 L_out=0.405 Acc=0.92 ---301890.72 ms/batch
Round 7 | epoch=24, train costTime=313.80725741386414, | total_activation_sum=14783031
Round 7 | epoch=25, current m_iou=0.704307066157255
Round 7 | Best m_IoU is: 0.707, OA is: 0.924 | val costTime=117.45093631744385
Round 7 | ****EPOCH 25****
Step 00116750 L_out=0.206 Acc=0.85 ---11835.47 ms/batch
Step 00116800 L_out=0.241 Acc=0.91 ---35102.98 ms/batch
Step 00116850 L_out=0.168 Acc=0.97 ---58845.25 ms/batch
Step 00116900 L_out=0.084 Acc=0.78 ---82270.55 ms/batch
Step 00116950 L_out=0.182 Acc=0.94 ---105970.10 ms/batch
Step 00117000 L_out=0.307 Acc=0.79 ---129351.76 ms/batch
Step 00117050 L_out=0.191 Acc=0.94 ---152880.12 ms/batch
Step 00117100 L_out=0.104 Acc=0.91 ---176319.46 ms/batch
Step 00117150 L_out=0.185 Acc=0.95 ---199641.59 ms/batch
Step 00117200 L_out=0.111 Acc=0.95 ---223059.95 ms/batch
Step 00117250 L_out=0.246 Acc=0.93 ---246627.26 ms/batch
Step 00117300 L_out=0.131 Acc=0.94 ---270228.49 ms/batch
Step 00117350 L_out=0.271 Acc=0.92 ---293613.20 ms/batch
Round 7 | epoch=25, train costTime=313.21602511405945, | total_activation_sum=14825643
Round 7 | epoch=26, current m_iou=0.7062840380406856
Round 7 | Best m_IoU is: 0.707, OA is: 0.924 | val costTime=117.10425209999084
Round 7 | ****EPOCH 26****
Step 00117400 L_out=0.115 Acc=0.96 --- 3747.24 ms/batch
Step 00117450 L_out=0.154 Acc=0.91 ---27323.87 ms/batch
Step 00117500 L_out=0.145 Acc=0.94 ---50750.97 ms/batch
Step 00117550 L_out=0.126 Acc=0.91 ---74317.13 ms/batch
Step 00117600 L_out=0.240 Acc=0.95 ---97788.83 ms/batch
Step 00117650 L_out=0.142 Acc=0.94 ---121497.13 ms/batch
Step 00117700 L_out=0.399 Acc=0.90 ---144984.79 ms/batch
Step 00117750 L_out=0.187 Acc=0.94 ---168442.82 ms/batch
Step 00117800 L_out=0.166 Acc=0.95 ---191611.29 ms/batch
Step 00117850 L_out=0.357 Acc=0.94 ---215200.85 ms/batch
Step 00117900 L_out=0.097 Acc=0.97 ---238754.24 ms/batch
Step 00117950 L_out=0.146 Acc=0.95 ---262154.52 ms/batch
Step 00118000 L_out=0.285 Acc=0.94 ---285583.50 ms/batch
Step 00118050 L_out=0.398 Acc=0.91 ---308954.49 ms/batch
Round 7 | epoch=26, train costTime=313.1288306713104, | total_activation_sum=14707779
Round 7 | epoch=27, current m_iou=0.7075817560699393
Round 7 | Best m_IoU is: 0.708, OA is: 0.924 | val costTime=117.68946313858032
Round 7 | ****EPOCH 27****
Step 00118100 L_out=0.064 Acc=0.95 ---19241.96 ms/batch
Step 00118150 L_out=0.359 Acc=0.92 ---42924.21 ms/batch
Step 00118200 L_out=0.185 Acc=0.95 ---66479.96 ms/batch
Step 00118250 L_out=0.323 Acc=0.94 ---89786.38 ms/batch
Step 00118300 L_out=0.145 Acc=0.94 ---113394.23 ms/batch
Step 00118350 L_out=0.369 Acc=0.94 ---136883.44 ms/batch
Step 00118400 L_out=0.092 Acc=0.97 ---160245.28 ms/batch
Step 00118450 L_out=0.238 Acc=0.90 ---183599.74 ms/batch
Step 00118500 L_out=0.258 Acc=0.92 ---207142.84 ms/batch
Step 00118550 L_out=0.192 Acc=0.94 ---230426.19 ms/batch
Step 00118600 L_out=0.153 Acc=0.96 ---253650.17 ms/batch
Step 00118650 L_out=0.261 Acc=0.96 ---277294.04 ms/batch
Step 00118700 L_out=0.215 Acc=0.96 ---300964.09 ms/batch
Round 7 | epoch=27, train costTime=313.13511848449707, | total_activation_sum=14852187
Round 7 | epoch=28, current m_iou=0.7080899701859878
Round 7 | Best m_IoU is: 0.708, OA is: 0.924 | val costTime=117.28213834762573
Round 7 | ****EPOCH 28****
Step 00118750 L_out=0.108 Acc=0.89 ---11217.33 ms/batch
Step 00118800 L_out=0.282 Acc=0.95 ---34801.46 ms/batch
Step 00118850 L_out=0.062 Acc=0.94 ---58361.54 ms/batch
Step 00118900 L_out=0.245 Acc=0.92 ---81913.58 ms/batch
Step 00118950 L_out=0.061 Acc=0.85 ---105377.11 ms/batch
Step 00119000 L_out=0.189 Acc=0.92 ---128760.05 ms/batch
Step 00119050 L_out=0.138 Acc=0.97 ---152161.07 ms/batch
Step 00119100 L_out=0.148 Acc=0.92 ---175524.95 ms/batch
Step 00119150 L_out=0.317 Acc=0.90 ---198854.36 ms/batch
Step 00119200 L_out=0.093 Acc=0.89 ---222201.22 ms/batch
Step 00119250 L_out=0.179 Acc=0.91 ---245576.21 ms/batch
Step 00119300 L_out=0.104 Acc=0.88 ---268841.17 ms/batch
Step 00119350 L_out=0.155 Acc=0.95 ---292301.89 ms/batch
Round 7 | epoch=28, train costTime=312.36577224731445, | total_activation_sum=14932680
Round 7 | epoch=29, current m_iou=0.7081053417049599
Round 7 | Best m_IoU is: 0.708, OA is: 0.924 | val costTime=117.1046826839447
Round 7 | ****EPOCH 29****
Step 00119400 L_out=0.192 Acc=0.92 --- 3312.71 ms/batch
Step 00119450 L_out=0.119 Acc=0.95 ---26808.98 ms/batch
Step 00119500 L_out=0.057 Acc=0.94 ---50201.20 ms/batch
Step 00119550 L_out=0.491 Acc=0.68 ---73721.61 ms/batch
Step 00119600 L_out=0.636 Acc=0.90 ---97255.28 ms/batch
Step 00119650 L_out=0.123 Acc=0.97 ---120995.14 ms/batch
Step 00119700 L_out=0.138 Acc=0.93 ---144321.11 ms/batch
Step 00119750 L_out=0.162 Acc=0.95 ---167711.29 ms/batch
Step 00119800 L_out=0.280 Acc=0.94 ---191468.85 ms/batch
Step 00119850 L_out=0.261 Acc=0.93 ---215083.76 ms/batch
Step 00119900 L_out=0.156 Acc=0.97 ---238668.48 ms/batch
Step 00119950 L_out=0.198 Acc=0.91 ---262343.08 ms/batch
Step 00120000 L_out=0.153 Acc=0.82 ---285833.37 ms/batch
Step 00120050 L_out=0.079 Acc=0.98 ---309328.05 ms/batch
Round 7 | epoch=29, train costTime=314.0110046863556, | total_activation_sum=14799817
Round 7 | epoch=30, current m_iou=0.7080054356112331
Round 7 | Best m_IoU is: 0.708, OA is: 0.924 | val costTime=116.93965697288513
Round 7 | ****EPOCH 30****
Round 8 | ****EPOCH 0****
Step 00120100 L_out=0.344 Acc=0.80 ---18761.81 ms/batch
Step 00120150 L_out=1.221 Acc=0.14 ---42401.43 ms/batch
Step 00120200 L_out=2.243 Acc=0.52 ---66007.23 ms/batch
Step 00120250 L_out=0.731 Acc=0.34 ---89583.13 ms/batch
Step 00120300 L_out=1.949 Acc=0.45 ---113189.53 ms/batch
Step 00120350 L_out=0.766 Acc=0.56 ---136914.93 ms/batch
Step 00120400 L_out=0.460 Acc=0.88 ---160449.77 ms/batch
Step 00120450 L_out=1.269 Acc=0.34 ---183920.23 ms/batch
Step 00120500 L_out=0.733 Acc=0.81 ---207492.30 ms/batch
Step 00120550 L_out=1.059 Acc=0.32 ---230882.81 ms/batch
Step 00120600 L_out=0.713 Acc=0.73 ---254481.22 ms/batch
Step 00120650 L_out=0.723 Acc=0.86 ---277898.94 ms/batch
Step 00120700 L_out=0.479 Acc=0.84 ---301319.84 ms/batch
Round 8 | epoch=0, train costTime=314.04636096954346, | total_activation_sum=16372272
Round 8 | ****EPOCH 1****
Step 00120750 L_out=0.197 Acc=0.89 ---10760.33 ms/batch
Step 00120800 L_out=0.681 Acc=0.89 ---34392.84 ms/batch
Step 00120850 L_out=0.528 Acc=0.93 ---57647.54 ms/batch
Step 00120900 L_out=0.588 Acc=0.76 ---81201.61 ms/batch
Step 00120950 L_out=0.461 Acc=0.92 ---104765.33 ms/batch
Step 00121000 L_out=0.613 Acc=0.89 ---128221.43 ms/batch
Step 00121050 L_out=0.403 Acc=0.95 ---151741.03 ms/batch
Step 00121100 L_out=0.634 Acc=0.85 ---175156.93 ms/batch
Step 00121150 L_out=0.438 Acc=0.85 ---198706.43 ms/batch
Step 00121200 L_out=0.358 Acc=0.89 ---222437.99 ms/batch
Step 00121250 L_out=0.218 Acc=0.90 ---245862.95 ms/batch
Step 00121300 L_out=0.356 Acc=0.91 ---269345.41 ms/batch
Step 00121350 L_out=0.989 Acc=0.83 ---292819.42 ms/batch
Round 8 | epoch=1, train costTime=313.42815136909485, | total_activation_sum=17117485
Round 8 | ****EPOCH 2****
Step 00121400 L_out=0.327 Acc=0.88 --- 2846.58 ms/batch
Step 00121450 L_out=0.285 Acc=0.91 ---26264.12 ms/batch
Step 00121500 L_out=0.862 Acc=0.83 ---49546.01 ms/batch
Step 00121550 L_out=0.618 Acc=0.84 ---73025.71 ms/batch
Step 00121600 L_out=0.697 Acc=0.92 ---96469.36 ms/batch
Step 00121650 L_out=0.204 Acc=0.87 ---119968.80 ms/batch
Step 00121700 L_out=0.295 Acc=0.90 ---143356.19 ms/batch
Step 00121750 L_out=0.516 Acc=0.80 ---166710.57 ms/batch
Step 00121800 L_out=0.555 Acc=0.89 ---190210.80 ms/batch
Step 00121850 L_out=0.819 Acc=0.94 ---213935.42 ms/batch
Step 00121900 L_out=0.387 Acc=0.81 ---237278.98 ms/batch
Step 00121950 L_out=0.216 Acc=0.86 ---260834.72 ms/batch
Step 00122000 L_out=0.643 Acc=0.83 ---284208.40 ms/batch
Step 00122050 L_out=0.469 Acc=0.91 ---307517.82 ms/batch
Round 8 | epoch=2, train costTime=312.77068281173706, | total_activation_sum=17192489
Round 8 | ****EPOCH 3****
Step 00122100 L_out=0.438 Acc=0.91 ---18411.49 ms/batch
Step 00122150 L_out=0.475 Acc=0.83 ---41992.22 ms/batch
Step 00122200 L_out=0.161 Acc=0.95 ---65398.11 ms/batch
Step 00122250 L_out=0.560 Acc=0.92 ---88982.07 ms/batch
Step 00122300 L_out=0.466 Acc=0.83 ---112501.13 ms/batch
Step 00122350 L_out=0.143 Acc=0.95 ---135756.88 ms/batch
Step 00122400 L_out=0.361 Acc=0.88 ---159187.93 ms/batch
Step 00122450 L_out=0.199 Acc=0.93 ---182748.62 ms/batch
Step 00122500 L_out=0.170 Acc=0.91 ---206188.18 ms/batch
Step 00122550 L_out=0.299 Acc=0.95 ---229717.08 ms/batch
Step 00122600 L_out=0.623 Acc=0.94 ---253165.22 ms/batch
Step 00122650 L_out=0.328 Acc=0.95 ---276583.33 ms/batch
Step 00122700 L_out=0.407 Acc=0.86 ---300102.99 ms/batch
Round 8 | epoch=3, train costTime=313.3258352279663, | total_activation_sum=17019456
Round 8 | ****EPOCH 4****
Step 00122750 L_out=0.496 Acc=0.94 ---10360.20 ms/batch
Step 00122800 L_out=0.171 Acc=0.92 ---33818.59 ms/batch
Step 00122850 L_out=0.155 Acc=0.92 ---57459.62 ms/batch
Step 00122900 L_out=0.249 Acc=0.89 ---81185.30 ms/batch
Step 00122950 L_out=0.312 Acc=0.94 ---104616.45 ms/batch
Step 00123000 L_out=0.722 Acc=0.90 ---128111.18 ms/batch
Step 00123050 L_out=0.163 Acc=0.89 ---151679.59 ms/batch
Step 00123100 L_out=0.506 Acc=0.90 ---175203.10 ms/batch
Step 00123150 L_out=0.601 Acc=0.93 ---198572.34 ms/batch
Step 00123200 L_out=0.363 Acc=0.90 ---222223.78 ms/batch
Step 00123250 L_out=0.380 Acc=0.92 ---245731.14 ms/batch
Step 00123300 L_out=0.357 Acc=0.82 ---269055.97 ms/batch
Step 00123350 L_out=0.477 Acc=0.91 ---292366.81 ms/batch
Round 8 | epoch=4, train costTime=313.4603431224823, | total_activation_sum=17096577
Round 8 | ****EPOCH 5****
Step 00123400 L_out=0.163 Acc=0.94 --- 2368.85 ms/batch
Step 00123450 L_out=0.355 Acc=0.93 ---25891.91 ms/batch
Step 00123500 L_out=0.171 Acc=0.97 ---49441.08 ms/batch
Step 00123550 L_out=0.100 Acc=0.96 ---72976.17 ms/batch
Step 00123600 L_out=0.279 Acc=0.91 ---96504.66 ms/batch
Step 00123650 L_out=0.470 Acc=0.94 ---120108.24 ms/batch
Step 00123700 L_out=0.223 Acc=0.88 ---143721.74 ms/batch
Step 00123750 L_out=0.240 Acc=0.91 ---167164.86 ms/batch
Step 00123800 L_out=0.615 Acc=0.85 ---190376.87 ms/batch
Step 00123850 L_out=0.359 Acc=0.94 ---213754.21 ms/batch
Step 00123900 L_out=0.059 Acc=0.94 ---237343.45 ms/batch
Step 00123950 L_out=0.119 Acc=0.92 ---260673.03 ms/batch
Step 00124000 L_out=0.186 Acc=0.95 ---284023.60 ms/batch
Step 00124050 L_out=1.562 Acc=0.82 ---307573.32 ms/batch
Round 8 | epoch=5, train costTime=313.1899268627167, | total_activation_sum=17040392
Round 8 | ****EPOCH 6****
Step 00124100 L_out=0.928 Acc=0.76 ---18129.01 ms/batch
Step 00124150 L_out=0.168 Acc=0.95 ---41521.50 ms/batch
Step 00124200 L_out=0.112 Acc=0.95 ---64884.58 ms/batch
Step 00124250 L_out=0.248 Acc=0.96 ---88210.58 ms/batch
Step 00124300 L_out=0.133 Acc=0.93 ---111716.09 ms/batch
Step 00124350 L_out=0.417 Acc=0.95 ---135165.19 ms/batch
Step 00124400 L_out=0.657 Acc=0.83 ---158584.24 ms/batch
Step 00124450 L_out=0.367 Acc=0.95 ---182215.81 ms/batch
Step 00124500 L_out=0.382 Acc=0.90 ---205489.54 ms/batch
Step 00124550 L_out=0.271 Acc=0.93 ---229106.12 ms/batch
Step 00124600 L_out=0.353 Acc=0.92 ---252599.59 ms/batch
Step 00124650 L_out=0.304 Acc=0.93 ---276210.44 ms/batch
Step 00124700 L_out=0.255 Acc=0.88 ---299826.68 ms/batch
Round 8 | epoch=6, train costTime=313.5675585269928, | total_activation_sum=17165329
Round 8 | ****EPOCH 7****
Step 00124750 L_out=0.743 Acc=0.92 --- 9741.73 ms/batch
Step 00124800 L_out=0.304 Acc=0.89 ---33100.07 ms/batch
Step 00124850 L_out=1.042 Acc=0.86 ---56554.37 ms/batch
Step 00124900 L_out=0.646 Acc=0.90 ---80081.51 ms/batch
Step 00124950 L_out=0.164 Acc=0.95 ---103638.48 ms/batch
Step 00125000 L_out=0.280 Acc=0.96 ---127543.97 ms/batch
Step 00125050 L_out=0.094 Acc=0.96 ---151052.72 ms/batch
Step 00125100 L_out=0.395 Acc=0.96 ---174528.10 ms/batch
Step 00125150 L_out=0.305 Acc=0.95 ---197893.68 ms/batch
Step 00125200 L_out=0.706 Acc=0.93 ---221113.33 ms/batch
Step 00125250 L_out=0.132 Acc=0.97 ---244387.01 ms/batch
Step 00125300 L_out=0.206 Acc=0.95 ---267847.20 ms/batch
Step 00125350 L_out=0.243 Acc=0.97 ---291189.58 ms/batch
Round 8 | epoch=7, train costTime=312.6776888370514, | total_activation_sum=16980423
Round 8 | ****EPOCH 8****
Step 00125400 L_out=0.199 Acc=0.93 --- 1919.31 ms/batch
Step 00125450 L_out=0.264 Acc=0.93 ---25477.83 ms/batch
Step 00125500 L_out=0.569 Acc=0.93 ---49011.33 ms/batch
Step 00125550 L_out=0.305 Acc=0.85 ---72533.86 ms/batch
Step 00125600 L_out=0.161 Acc=0.96 ---95914.53 ms/batch
Step 00125650 L_out=0.089 Acc=0.97 ---119385.37 ms/batch
Step 00125700 L_out=0.357 Acc=0.89 ---143068.05 ms/batch
Step 00125750 L_out=0.727 Acc=0.93 ---166699.37 ms/batch
Step 00125800 L_out=0.325 Acc=0.90 ---190048.49 ms/batch
Step 00125850 L_out=0.352 Acc=0.95 ---213325.79 ms/batch
Step 00125900 L_out=0.246 Acc=0.93 ---236788.83 ms/batch
Step 00125950 L_out=0.079 Acc=0.93 ---260371.37 ms/batch
Step 00126000 L_out=0.339 Acc=0.95 ---283938.84 ms/batch
Step 00126050 L_out=0.438 Acc=0.88 ---307374.33 ms/batch
Round 8 | epoch=8, train costTime=313.5100808143616, | total_activation_sum=17254562
Round 8 | ****EPOCH 9****
Step 00126100 L_out=0.396 Acc=0.94 ---17200.68 ms/batch
Step 00126150 L_out=0.617 Acc=0.93 ---40669.50 ms/batch
Step 00126200 L_out=0.351 Acc=0.93 ---64137.54 ms/batch
Step 00126250 L_out=0.281 Acc=0.89 ---87383.85 ms/batch
Step 00126300 L_out=0.157 Acc=0.93 ---110807.87 ms/batch
Step 00126350 L_out=0.293 Acc=0.91 ---134355.88 ms/batch
Step 00126400 L_out=0.268 Acc=0.94 ---157700.20 ms/batch
Step 00126450 L_out=0.593 Acc=0.89 ---181115.76 ms/batch
Step 00126500 L_out=0.190 Acc=0.96 ---204575.80 ms/batch
Step 00126550 L_out=0.211 Acc=0.93 ---228081.06 ms/batch
Step 00126600 L_out=0.247 Acc=0.91 ---251525.03 ms/batch
Step 00126650 L_out=0.161 Acc=0.93 ---275000.78 ms/batch
Step 00126700 L_out=0.304 Acc=0.93 ---298549.63 ms/batch
Round 8 | epoch=9, train costTime=312.7031478881836, | total_activation_sum=16880016
Round 8 | ****EPOCH 10****
Step 00126750 L_out=0.385 Acc=0.93 --- 9378.27 ms/batch
Step 00126800 L_out=0.106 Acc=0.92 ---32944.08 ms/batch
Step 00126850 L_out=0.341 Acc=0.92 ---56466.82 ms/batch
Step 00126900 L_out=0.448 Acc=0.90 ---79880.02 ms/batch
Step 00126950 L_out=0.216 Acc=0.91 ---103204.08 ms/batch
Step 00127000 L_out=0.357 Acc=0.93 ---126781.91 ms/batch
Step 00127050 L_out=0.199 Acc=0.94 ---150309.91 ms/batch
Step 00127100 L_out=0.317 Acc=0.93 ---173783.39 ms/batch
Step 00127150 L_out=0.479 Acc=0.81 ---197120.53 ms/batch
Step 00127200 L_out=0.649 Acc=0.64 ---220683.38 ms/batch
Step 00127250 L_out=0.580 Acc=0.90 ---244284.38 ms/batch
Step 00127300 L_out=0.180 Acc=0.84 ---267918.98 ms/batch
Step 00127350 L_out=0.089 Acc=0.97 ---291211.82 ms/batch
Round 8 | epoch=10, train costTime=313.2437665462494, | total_activation_sum=17076450
Round 8 | ****EPOCH 11****
Step 00127400 L_out=0.108 Acc=0.98 --- 1372.52 ms/batch
Step 00127450 L_out=0.183 Acc=0.95 ---24825.80 ms/batch
Step 00127500 L_out=0.196 Acc=0.94 ---48354.33 ms/batch
Step 00127550 L_out=0.105 Acc=0.94 ---71787.29 ms/batch
Step 00127600 L_out=0.078 Acc=0.95 ---95511.85 ms/batch
Step 00127650 L_out=0.200 Acc=0.89 ---119039.76 ms/batch
Step 00127700 L_out=0.245 Acc=0.92 ---142657.43 ms/batch
Step 00127750 L_out=0.166 Acc=0.95 ---166239.77 ms/batch
Step 00127800 L_out=0.068 Acc=0.95 ---189407.88 ms/batch
Step 00127850 L_out=0.110 Acc=0.96 ---212928.25 ms/batch
Step 00127900 L_out=0.461 Acc=0.86 ---236456.87 ms/batch
Step 00127950 L_out=0.349 Acc=0.96 ---259855.80 ms/batch
Step 00128000 L_out=0.309 Acc=0.94 ---283407.85 ms/batch
Step 00128050 L_out=0.362 Acc=0.93 ---306914.78 ms/batch
Round 8 | epoch=11, train costTime=313.5378017425537, | total_activation_sum=17229352
Round 8 | ****EPOCH 12****
Step 00128100 L_out=0.463 Acc=0.94 ---16853.00 ms/batch
Step 00128150 L_out=0.506 Acc=0.78 ---40394.54 ms/batch
Step 00128200 L_out=0.343 Acc=0.96 ---63864.14 ms/batch
Step 00128250 L_out=0.257 Acc=0.95 ---87201.80 ms/batch
Step 00128300 L_out=0.257 Acc=0.95 ---110611.01 ms/batch
Step 00128350 L_out=0.108 Acc=0.95 ---134105.55 ms/batch
Step 00128400 L_out=0.182 Acc=0.95 ---157816.84 ms/batch
Step 00128450 L_out=0.310 Acc=0.93 ---181408.55 ms/batch
Step 00128500 L_out=0.118 Acc=0.95 ---204883.63 ms/batch
Step 00128550 L_out=0.360 Acc=0.93 ---228305.35 ms/batch
Step 00128600 L_out=0.167 Acc=0.94 ---251751.54 ms/batch
Step 00128650 L_out=0.325 Acc=0.91 ---275803.01 ms/batch
Step 00128700 L_out=0.163 Acc=0.98 ---299083.51 ms/batch
Round 8 | epoch=12, train costTime=313.5013508796692, | total_activation_sum=17048219
Round 8 | ****EPOCH 13****
Step 00128750 L_out=0.243 Acc=0.94 --- 8978.00 ms/batch
Step 00128800 L_out=0.201 Acc=0.97 ---32283.89 ms/batch
Step 00128850 L_out=0.295 Acc=0.90 ---55684.34 ms/batch
Step 00128900 L_out=0.164 Acc=0.94 ---79091.81 ms/batch
Step 00128950 L_out=0.218 Acc=0.97 ---102380.74 ms/batch
Step 00129000 L_out=0.301 Acc=0.93 ---125616.22 ms/batch
Step 00129050 L_out=0.247 Acc=0.93 ---149017.20 ms/batch
Step 00129100 L_out=0.122 Acc=0.92 ---172466.37 ms/batch
Step 00129150 L_out=0.713 Acc=0.91 ---196325.78 ms/batch
Step 00129200 L_out=0.104 Acc=0.96 ---220095.63 ms/batch
Step 00129250 L_out=0.326 Acc=0.95 ---243295.65 ms/batch
Step 00129300 L_out=0.418 Acc=0.94 ---266954.34 ms/batch
Step 00129350 L_out=0.123 Acc=0.63 ---290478.23 ms/batch
Round 8 | epoch=13, train costTime=313.03652000427246, | total_activation_sum=17131236
Round 8 | ****EPOCH 14****
Step 00129400 L_out=0.233 Acc=0.94 ---  910.67 ms/batch
Step 00129450 L_out=0.272 Acc=0.92 ---24233.90 ms/batch
Step 00129500 L_out=0.278 Acc=0.96 ---47524.76 ms/batch
Step 00129550 L_out=0.355 Acc=0.95 ---70982.50 ms/batch
Step 00129600 L_out=0.401 Acc=0.95 ---94319.51 ms/batch
Step 00129650 L_out=0.374 Acc=0.94 ---117889.93 ms/batch
Step 00129700 L_out=0.351 Acc=0.82 ---141398.77 ms/batch
Step 00129750 L_out=0.211 Acc=0.97 ---164746.21 ms/batch
Step 00129800 L_out=0.339 Acc=0.87 ---188104.66 ms/batch
Step 00129850 L_out=0.192 Acc=0.94 ---211278.15 ms/batch
Step 00129900 L_out=0.199 Acc=0.93 ---235124.95 ms/batch
Step 00129950 L_out=0.133 Acc=0.94 ---258605.80 ms/batch
Step 00130000 L_out=0.133 Acc=0.94 ---282157.73 ms/batch
Step 00130050 L_out=1.001 Acc=0.80 ---305588.04 ms/batch
Round 8 | epoch=14, train costTime=312.733195066452, | total_activation_sum=16885362
Round 8 | ****EPOCH 15****
Step 00130100 L_out=0.565 Acc=0.91 ---16319.88 ms/batch
Step 00130150 L_out=0.360 Acc=0.90 ---39988.89 ms/batch
Step 00130200 L_out=0.379 Acc=0.92 ---63482.38 ms/batch
Step 00130250 L_out=0.338 Acc=0.89 ---86659.04 ms/batch
Step 00130300 L_out=0.137 Acc=0.91 ---110053.14 ms/batch
Step 00130350 L_out=0.230 Acc=0.84 ---133383.73 ms/batch
Step 00130400 L_out=0.309 Acc=0.85 ---156893.22 ms/batch
Step 00130450 L_out=0.309 Acc=0.96 ---180298.91 ms/batch
Step 00130500 L_out=0.142 Acc=0.94 ---203743.79 ms/batch
Step 00130550 L_out=0.122 Acc=0.95 ---227160.84 ms/batch
Step 00130600 L_out=0.371 Acc=0.90 ---250664.33 ms/batch
Step 00130650 L_out=0.193 Acc=0.94 ---274345.16 ms/batch
Step 00130700 L_out=0.267 Acc=0.88 ---298028.05 ms/batch
Round 8 | epoch=15, train costTime=313.00747871398926, | total_activation_sum=17049502
Round 8 | ****EPOCH 16****
Step 00130750 L_out=0.429 Acc=0.86 --- 8425.34 ms/batch
Step 00130800 L_out=0.169 Acc=0.91 ---31908.36 ms/batch
Step 00130850 L_out=0.200 Acc=0.92 ---55314.35 ms/batch
Step 00130900 L_out=0.107 Acc=0.97 ---78840.79 ms/batch
Step 00130950 L_out=0.512 Acc=0.88 ---102314.10 ms/batch
Step 00131000 L_out=0.222 Acc=0.90 ---125742.75 ms/batch
Step 00131050 L_out=0.041 Acc=0.95 ---149120.11 ms/batch
Step 00131100 L_out=0.106 Acc=0.95 ---172519.07 ms/batch
Step 00131150 L_out=0.111 Acc=0.96 ---196168.96 ms/batch
Step 00131200 L_out=0.154 Acc=0.97 ---219671.18 ms/batch
Step 00131250 L_out=0.075 Acc=0.95 ---243431.96 ms/batch
Step 00131300 L_out=0.317 Acc=0.92 ---266704.45 ms/batch
Step 00131350 L_out=0.276 Acc=0.94 ---290255.92 ms/batch
Round 8 | epoch=16, train costTime=313.318696975708, | total_activation_sum=17142040
Round 8 | ****EPOCH 17****
Step 00131400 L_out=0.100 Acc=0.94 ---  464.41 ms/batch
Step 00131450 L_out=0.151 Acc=0.92 ---24154.81 ms/batch
Step 00131500 L_out=0.235 Acc=0.93 ---47569.07 ms/batch
Step 00131550 L_out=0.215 Acc=0.95 ---71059.24 ms/batch
Step 00131600 L_out=0.422 Acc=0.94 ---94591.17 ms/batch
Step 00131650 L_out=0.392 Acc=0.94 ---118138.10 ms/batch
Step 00131700 L_out=0.109 Acc=0.95 ---141517.33 ms/batch
Step 00131750 L_out=0.199 Acc=0.94 ---164905.72 ms/batch
Step 00131800 L_out=0.789 Acc=0.80 ---188385.19 ms/batch
Step 00131850 L_out=0.126 Acc=0.97 ---211812.06 ms/batch
Step 00131900 L_out=0.208 Acc=0.92 ---235300.03 ms/batch
Step 00131950 L_out=0.139 Acc=0.94 ---258939.22 ms/batch
Step 00132000 L_out=0.241 Acc=0.94 ---282726.21 ms/batch
Step 00132050 L_out=0.114 Acc=0.95 ---306176.33 ms/batch
Round 8 | epoch=17, train costTime=313.6851553916931, | total_activation_sum=17188025
Round 8 | epoch=18, current m_iou=0.7048672123391613
Round 8 | Best m_IoU is: 0.705, OA is: 0.924 | val costTime=117.35744857788086
Round 8 | ****EPOCH 18****
Step 00132100 L_out=0.140 Acc=0.96 ---16051.84 ms/batch
Step 00132150 L_out=0.275 Acc=0.95 ---39417.12 ms/batch
Step 00132200 L_out=0.099 Acc=0.96 ---62862.71 ms/batch
Step 00132250 L_out=0.145 Acc=0.94 ---86511.10 ms/batch
Step 00132300 L_out=0.205 Acc=0.95 ---110052.95 ms/batch
Step 00132350 L_out=0.168 Acc=0.95 ---133599.10 ms/batch
Step 00132400 L_out=0.298 Acc=0.87 ---157043.13 ms/batch
Step 00132450 L_out=0.100 Acc=0.95 ---180585.31 ms/batch
Step 00132500 L_out=0.092 Acc=0.94 ---204113.97 ms/batch
Step 00132550 L_out=0.362 Acc=0.92 ---227698.84 ms/batch
Step 00132600 L_out=0.237 Acc=0.90 ---251344.41 ms/batch
Step 00132650 L_out=0.268 Acc=0.95 ---274874.06 ms/batch
Step 00132700 L_out=0.350 Acc=0.92 ---298363.73 ms/batch
Round 8 | epoch=18, train costTime=314.1035008430481, | total_activation_sum=17115975
Round 8 | epoch=19, current m_iou=0.7090059638406633
Round 8 | Best m_IoU is: 0.709, OA is: 0.925 | val costTime=118.34887981414795
Round 8 | ****EPOCH 19****
Step 00132750 L_out=0.282 Acc=0.89 --- 8045.49 ms/batch
Step 00132800 L_out=0.131 Acc=0.97 ---31233.21 ms/batch
Step 00132850 L_out=0.266 Acc=0.93 ---54695.31 ms/batch
Step 00132900 L_out=0.219 Acc=0.95 ---78243.16 ms/batch
Step 00132950 L_out=0.155 Acc=0.97 ---101825.11 ms/batch
Step 00133000 L_out=0.093 Acc=0.95 ---125452.48 ms/batch
Step 00133050 L_out=0.253 Acc=0.90 ---148905.22 ms/batch
Step 00133100 L_out=0.119 Acc=0.94 ---172327.12 ms/batch
Step 00133150 L_out=0.239 Acc=0.96 ---195680.99 ms/batch
Step 00133200 L_out=0.162 Acc=0.97 ---219152.71 ms/batch
Step 00133250 L_out=0.155 Acc=0.90 ---242684.74 ms/batch
Step 00133300 L_out=0.040 Acc=0.97 ---266227.89 ms/batch
Step 00133350 L_out=0.195 Acc=0.94 ---289645.51 ms/batch
Step 00133400 L_out=0.290 Acc=0.92 ---312912.33 ms/batch
Round 8 | epoch=19, train costTime=312.9126763343811, | total_activation_sum=17115113
Round 8 | epoch=20, current m_iou=0.7111109046933047
Round 8 | Best m_IoU is: 0.711, OA is: 0.926 | val costTime=118.2907543182373
Round 8 | ****EPOCH 20****
Step 00133450 L_out=0.291 Acc=0.97 ---23496.60 ms/batch
Step 00133500 L_out=0.078 Acc=0.97 ---46898.05 ms/batch
Step 00133550 L_out=0.263 Acc=0.93 ---70398.39 ms/batch
Step 00133600 L_out=0.407 Acc=0.94 ---93697.34 ms/batch
Step 00133650 L_out=0.198 Acc=0.90 ---117146.72 ms/batch
Step 00133700 L_out=0.371 Acc=0.90 ---140741.93 ms/batch
Step 00133750 L_out=0.119 Acc=0.95 ---163961.00 ms/batch
Step 00133800 L_out=0.336 Acc=0.97 ---187491.93 ms/batch
Step 00133850 L_out=0.107 Acc=0.94 ---210896.19 ms/batch
Step 00133900 L_out=0.098 Acc=0.97 ---234369.01 ms/batch
Step 00133950 L_out=0.156 Acc=0.97 ---258085.15 ms/batch
Step 00134000 L_out=0.098 Acc=0.95 ---281470.52 ms/batch
Step 00134050 L_out=0.146 Acc=0.94 ---304941.19 ms/batch
Round 8 | epoch=20, train costTime=312.906729221344, | total_activation_sum=16890455
Round 8 | epoch=21, current m_iou=0.71476721608784
Round 8 | Best m_IoU is: 0.715, OA is: 0.927 | val costTime=117.88906741142273
Round 8 | ****EPOCH 21****
Step 00134100 L_out=0.231 Acc=0.94 ---15480.94 ms/batch
Step 00134150 L_out=0.305 Acc=0.95 ---38764.47 ms/batch
Step 00134200 L_out=0.116 Acc=0.98 ---62162.14 ms/batch
Step 00134250 L_out=0.140 Acc=0.92 ---85493.81 ms/batch
Step 00134300 L_out=0.253 Acc=0.96 ---109054.19 ms/batch
Step 00134350 L_out=0.054 Acc=0.95 ---132556.15 ms/batch
Step 00134400 L_out=0.185 Acc=0.93 ---156137.93 ms/batch
Step 00134450 L_out=0.145 Acc=0.69 ---179760.68 ms/batch
Step 00134500 L_out=0.180 Acc=0.98 ---203454.72 ms/batch
Step 00134550 L_out=0.137 Acc=0.97 ---227022.34 ms/batch
Step 00134600 L_out=0.200 Acc=0.96 ---250607.59 ms/batch
Step 00134650 L_out=0.060 Acc=0.95 ---274050.40 ms/batch
Step 00134700 L_out=0.350 Acc=0.93 ---297370.61 ms/batch
Round 8 | epoch=21, train costTime=313.56216406822205, | total_activation_sum=17002694
Round 8 | epoch=22, current m_iou=0.7088924797371728
Round 8 | Best m_IoU is: 0.715, OA is: 0.927 | val costTime=117.46200823783875
Round 8 | ****EPOCH 22****
Step 00134750 L_out=0.201 Acc=0.95 --- 7563.09 ms/batch
Step 00134800 L_out=0.081 Acc=0.96 ---31311.27 ms/batch
Step 00134850 L_out=0.290 Acc=0.95 ---54681.14 ms/batch
Step 00134900 L_out=0.143 Acc=0.95 ---78193.14 ms/batch
Step 00134950 L_out=0.349 Acc=0.94 ---101804.96 ms/batch
Step 00135000 L_out=0.206 Acc=0.95 ---125340.35 ms/batch
Step 00135050 L_out=0.191 Acc=0.98 ---148770.55 ms/batch
Step 00135100 L_out=0.166 Acc=0.96 ---172235.71 ms/batch
Step 00135150 L_out=0.156 Acc=0.96 ---195717.08 ms/batch
Step 00135200 L_out=0.161 Acc=0.96 ---219332.58 ms/batch
Step 00135250 L_out=0.123 Acc=0.96 ---242906.76 ms/batch
Step 00135300 L_out=0.250 Acc=0.92 ---266441.86 ms/batch
Step 00135350 L_out=0.418 Acc=0.92 ---289900.40 ms/batch
Step 00135400 L_out=0.198 Acc=0.97 ---313326.96 ms/batch
Round 8 | epoch=22, train costTime=313.7917580604553, | total_activation_sum=17112346
Round 8 | epoch=23, current m_iou=0.7144840154448735
Round 8 | Best m_IoU is: 0.715, OA is: 0.927 | val costTime=117.31108856201172
Round 8 | ****EPOCH 23****
Step 00135450 L_out=0.112 Acc=0.95 ---23036.48 ms/batch
Step 00135500 L_out=0.188 Acc=0.95 ---46404.13 ms/batch
Step 00135550 L_out=0.193 Acc=0.96 ---69833.17 ms/batch
Step 00135600 L_out=0.195 Acc=0.95 ---93231.76 ms/batch
Step 00135650 L_out=0.281 Acc=0.91 ---116583.91 ms/batch
Step 00135700 L_out=0.143 Acc=0.77 ---140093.33 ms/batch
Step 00135750 L_out=0.293 Acc=0.94 ---163761.40 ms/batch
Step 00135800 L_out=0.113 Acc=0.97 ---187297.65 ms/batch
Step 00135850 L_out=0.128 Acc=0.96 ---210608.03 ms/batch
Step 00135900 L_out=0.226 Acc=0.97 ---234183.64 ms/batch
Step 00135950 L_out=0.196 Acc=0.96 ---257749.11 ms/batch
Step 00136000 L_out=0.418 Acc=0.92 ---281356.69 ms/batch
Step 00136050 L_out=0.149 Acc=0.84 ---304771.27 ms/batch
Round 8 | epoch=23, train costTime=313.13395071029663, | total_activation_sum=17052254
Round 8 | epoch=24, current m_iou=0.7147444007493243
Round 8 | Best m_IoU is: 0.715, OA is: 0.927 | val costTime=117.25796890258789
Round 8 | ****EPOCH 24****
Step 00136100 L_out=0.127 Acc=0.96 ---15188.50 ms/batch
Step 00136150 L_out=0.753 Acc=0.82 ---38741.86 ms/batch
Step 00136200 L_out=0.243 Acc=0.96 ---62210.64 ms/batch
Step 00136250 L_out=0.153 Acc=0.98 ---85871.73 ms/batch
Step 00136300 L_out=0.151 Acc=0.96 ---109139.18 ms/batch
Step 00136350 L_out=0.293 Acc=0.94 ---132562.54 ms/batch
Step 00136400 L_out=0.222 Acc=0.97 ---156057.83 ms/batch
Step 00136450 L_out=0.080 Acc=0.98 ---179472.64 ms/batch
Step 00136500 L_out=0.063 Acc=0.95 ---203157.63 ms/batch
Step 00136550 L_out=0.408 Acc=0.88 ---226522.12 ms/batch
Step 00136600 L_out=0.055 Acc=0.98 ---249915.44 ms/batch
Step 00136650 L_out=0.159 Acc=0.97 ---273496.67 ms/batch
Step 00136700 L_out=0.237 Acc=0.96 ---296961.56 ms/batch
Round 8 | epoch=24, train costTime=313.2660403251648, | total_activation_sum=17110623
Round 8 | epoch=25, current m_iou=0.7157185593564535
Round 8 | Best m_IoU is: 0.716, OA is: 0.928 | val costTime=118.11621880531311
Round 8 | ****EPOCH 25****
Step 00136750 L_out=0.110 Acc=0.97 --- 7002.73 ms/batch
Step 00136800 L_out=0.390 Acc=0.93 ---30425.21 ms/batch
Step 00136850 L_out=0.127 Acc=0.95 ---53832.10 ms/batch
Step 00136900 L_out=0.273 Acc=0.94 ---77312.22 ms/batch
Step 00136950 L_out=0.186 Acc=0.95 ---100754.64 ms/batch
Step 00137000 L_out=0.330 Acc=0.93 ---124309.60 ms/batch
Step 00137050 L_out=0.433 Acc=0.60 ---147808.97 ms/batch
Step 00137100 L_out=0.177 Acc=0.96 ---171367.73 ms/batch
Step 00137150 L_out=0.081 Acc=0.94 ---194758.40 ms/batch
Step 00137200 L_out=0.242 Acc=0.92 ---218193.98 ms/batch
Step 00137250 L_out=0.168 Acc=0.97 ---241754.63 ms/batch
Step 00137300 L_out=0.252 Acc=0.94 ---265241.42 ms/batch
Step 00137350 L_out=0.151 Acc=0.94 ---288823.21 ms/batch
Step 00137400 L_out=0.069 Acc=0.98 ---312167.98 ms/batch
Round 8 | epoch=25, train costTime=313.1174108982086, | total_activation_sum=17035930
Round 8 | epoch=26, current m_iou=0.7160552247900536
Round 8 | Best m_IoU is: 0.716, OA is: 0.928 | val costTime=118.05672097206116
Round 8 | ****EPOCH 26****
Step 00137450 L_out=0.158 Acc=0.97 ---22701.45 ms/batch
Step 00137500 L_out=0.122 Acc=0.95 ---46018.58 ms/batch
Step 00137550 L_out=0.200 Acc=0.93 ---69395.90 ms/batch
Step 00137600 L_out=0.164 Acc=0.96 ---92838.31 ms/batch
Step 00137650 L_out=0.484 Acc=0.84 ---116240.52 ms/batch
Step 00137700 L_out=0.064 Acc=0.97 ---139594.46 ms/batch
Step 00137750 L_out=0.170 Acc=0.95 ---162954.77 ms/batch
Step 00137800 L_out=0.119 Acc=0.97 ---186321.49 ms/batch
Step 00137850 L_out=0.155 Acc=0.95 ---210053.22 ms/batch
Step 00137900 L_out=0.143 Acc=0.97 ---233427.37 ms/batch
Step 00137950 L_out=0.231 Acc=0.92 ---257002.17 ms/batch
Step 00138000 L_out=0.233 Acc=0.90 ---280463.83 ms/batch
Step 00138050 L_out=0.122 Acc=0.98 ---303844.23 ms/batch
Round 8 | epoch=26, train costTime=312.7364594936371, | total_activation_sum=17078635
Round 8 | epoch=27, current m_iou=0.7150690149153809
Round 8 | Best m_IoU is: 0.716, OA is: 0.928 | val costTime=117.5215802192688
Round 8 | ****EPOCH 27****
Step 00138100 L_out=0.204 Acc=0.95 ---14647.52 ms/batch
Step 00138150 L_out=0.268 Acc=0.96 ---37975.78 ms/batch
Step 00138200 L_out=0.155 Acc=0.93 ---61361.18 ms/batch
Step 00138250 L_out=0.229 Acc=0.94 ---84730.10 ms/batch
Step 00138300 L_out=0.276 Acc=0.94 ---108278.78 ms/batch
Step 00138350 L_out=0.230 Acc=0.94 ---131672.55 ms/batch
Step 00138400 L_out=0.168 Acc=0.95 ---155114.72 ms/batch
Step 00138450 L_out=0.229 Acc=0.96 ---178937.01 ms/batch
Step 00138500 L_out=0.302 Acc=0.97 ---202416.41 ms/batch
Step 00138550 L_out=0.336 Acc=0.93 ---225833.09 ms/batch
Step 00138600 L_out=0.216 Acc=0.92 ---249375.53 ms/batch
Step 00138650 L_out=0.240 Acc=0.95 ---272919.94 ms/batch
Step 00138700 L_out=0.222 Acc=0.96 ---296376.24 ms/batch
Round 8 | epoch=27, train costTime=313.13689827919006, | total_activation_sum=17106338
Round 8 | epoch=28, current m_iou=0.7159660508787664
Round 8 | Best m_IoU is: 0.716, OA is: 0.928 | val costTime=117.37771320343018
Round 8 | ****EPOCH 28****
Step 00138750 L_out=0.180 Acc=0.97 --- 6696.06 ms/batch
Step 00138800 L_out=0.239 Acc=0.96 ---30396.85 ms/batch
Step 00138850 L_out=0.309 Acc=0.94 ---53765.17 ms/batch
Step 00138900 L_out=0.206 Acc=0.96 ---77421.51 ms/batch
Step 00138950 L_out=0.195 Acc=0.97 ---100898.75 ms/batch
Step 00139000 L_out=0.238 Acc=0.95 ---124117.50 ms/batch
Step 00139050 L_out=0.068 Acc=0.90 ---147334.41 ms/batch
Step 00139100 L_out=0.455 Acc=0.91 ---170774.11 ms/batch
Step 00139150 L_out=0.249 Acc=0.96 ---194185.70 ms/batch
Step 00139200 L_out=0.229 Acc=0.94 ---217683.77 ms/batch
Step 00139250 L_out=0.214 Acc=0.93 ---241116.80 ms/batch
Step 00139300 L_out=0.515 Acc=0.94 ---264664.01 ms/batch
Step 00139350 L_out=0.116 Acc=0.96 ---288193.13 ms/batch
Step 00139400 L_out=0.130 Acc=0.97 ---311537.04 ms/batch
Round 8 | epoch=28, train costTime=312.9493169784546, | total_activation_sum=17184671
Round 8 | epoch=29, current m_iou=0.7167226586219242
Round 8 | Best m_IoU is: 0.717, OA is: 0.928 | val costTime=117.56191086769104
Round 8 | ****EPOCH 29****
Step 00139450 L_out=0.104 Acc=0.51 ---22069.01 ms/batch
Step 00139500 L_out=0.117 Acc=0.91 ---45585.88 ms/batch
Step 00139550 L_out=0.304 Acc=0.80 ---68895.77 ms/batch
Step 00139600 L_out=0.044 Acc=0.95 ---92458.58 ms/batch
Step 00139650 L_out=0.170 Acc=0.95 ---115917.13 ms/batch
Step 00139700 L_out=0.341 Acc=0.96 ---139291.89 ms/batch
Step 00139750 L_out=0.335 Acc=0.93 ---162664.31 ms/batch
Step 00139800 L_out=0.301 Acc=0.96 ---186119.14 ms/batch
Step 00139850 L_out=0.032 Acc=0.96 ---209448.23 ms/batch
Step 00139900 L_out=0.415 Acc=0.95 ---232976.99 ms/batch
Step 00139950 L_out=0.186 Acc=0.89 ---256279.70 ms/batch
Step 00140000 L_out=0.188 Acc=0.94 ---279632.09 ms/batch
Step 00140050 L_out=0.525 Acc=0.83 ---303116.15 ms/batch
Round 8 | epoch=29, train costTime=312.42703890800476, | total_activation_sum=17096920
Round 8 | epoch=30, current m_iou=0.7149329200363785
Round 8 | Best m_IoU is: 0.717, OA is: 0.928 | val costTime=117.67384028434753
Round 8 | ****EPOCH 30****
Round 9 | ****EPOCH 0****
Step 00140100 L_out=0.869 Acc=0.85 ---14268.78 ms/batch
Step 00140150 L_out=1.162 Acc=0.51 ---37807.90 ms/batch
Step 00140200 L_out=1.120 Acc=0.62 ---61566.67 ms/batch
Step 00140250 L_out=0.526 Acc=0.89 ---85198.54 ms/batch
Step 00140300 L_out=0.165 Acc=0.96 ---108725.50 ms/batch
Step 00140350 L_out=1.732 Acc=0.45 ---132502.88 ms/batch
Step 00140400 L_out=0.385 Acc=0.75 ---156057.00 ms/batch
Step 00140450 L_out=1.946 Acc=0.70 ---179492.96 ms/batch
Step 00140500 L_out=0.104 Acc=0.86 ---203271.52 ms/batch
Step 00140550 L_out=0.500 Acc=0.95 ---226938.36 ms/batch
Step 00140600 L_out=0.897 Acc=0.69 ---250464.73 ms/batch
Step 00140650 L_out=1.651 Acc=0.77 ---273897.28 ms/batch
Step 00140700 L_out=0.775 Acc=0.84 ---297321.25 ms/batch
Round 9 | epoch=0, train costTime=314.6500678062439, | total_activation_sum=18784264
Round 9 | ****EPOCH 1****
Step 00140750 L_out=0.515 Acc=0.84 --- 6248.37 ms/batch
Step 00140800 L_out=0.318 Acc=0.84 ---29828.84 ms/batch
Step 00140850 L_out=1.101 Acc=0.81 ---53274.45 ms/batch
Step 00140900 L_out=0.329 Acc=0.94 ---76860.99 ms/batch
Step 00140950 L_out=0.942 Acc=0.87 ---100219.33 ms/batch
Step 00141000 L_out=0.481 Acc=0.90 ---123830.47 ms/batch
Step 00141050 L_out=0.329 Acc=0.85 ---147398.73 ms/batch
Step 00141100 L_out=0.631 Acc=0.86 ---170845.67 ms/batch
Step 00141150 L_out=0.531 Acc=0.92 ---194185.98 ms/batch
Step 00141200 L_out=0.630 Acc=0.86 ---217637.94 ms/batch
Step 00141250 L_out=0.752 Acc=0.78 ---241352.63 ms/batch
Step 00141300 L_out=0.581 Acc=0.93 ---265068.66 ms/batch
Step 00141350 L_out=0.400 Acc=0.73 ---288584.89 ms/batch
Step 00141400 L_out=0.591 Acc=0.88 ---312249.24 ms/batch
Round 9 | epoch=1, train costTime=314.1153955459595, | total_activation_sum=19772120
Round 9 | ****EPOCH 2****
Step 00141450 L_out=0.458 Acc=0.86 ---21753.09 ms/batch
Step 00141500 L_out=0.829 Acc=0.90 ---45323.68 ms/batch
Step 00141550 L_out=0.530 Acc=0.93 ---68759.04 ms/batch
Round 2 | ****EPOCH 0****
Step 00000050 L_out=0.126 Acc=0.09 ---29143.46 ms/batch
Step 00000100 L_out=0.297 Acc=0.11 ---56109.17 ms/batch
Step 00000150 L_out=0.413 Acc=0.06 ---82741.77 ms/batch
Step 00000200 L_out=0.121 Acc=0.11 ---109370.79 ms/batch
Step 00000250 L_out=0.259 Acc=0.18 ---136361.04 ms/batch
Step 00000300 L_out=0.025 Acc=0.36 ---163255.22 ms/batch
Step 00000350 L_out=0.324 Acc=0.02 ---190491.52 ms/batch
Step 00000400 L_out=1.309 Acc=0.29 ---217425.01 ms/batch
Step 00000450 L_out=0.113 Acc=0.04 ---244512.56 ms/batch
Step 00000500 L_out=0.025 Acc=0.13 ---271178.58 ms/batch
Step 00000550 L_out=0.078 Acc=0.33 ---298077.97 ms/batch
Step 00000600 L_out=0.047 Acc=0.38 ---325024.03 ms/batch
Step 00000650 L_out=0.279 Acc=0.28 ---351624.43 ms/batch
Round 2 | epoch=0, train costTime=360.68227458000183, | total_activation_sum=3895737
Round 2 | ****EPOCH 1****
Step 00000700 L_out=0.192 Acc=0.49 ---17606.63 ms/batch
Step 00000750 L_out=0.449 Acc=0.56 ---44382.01 ms/batch
Step 00000800 L_out=1.075 Acc=0.52 ---71246.00 ms/batch
Step 00000850 L_out=0.630 Acc=0.52 ---97777.41 ms/batch
Step 00000900 L_out=0.366 Acc=0.37 ---124368.14 ms/batch
Step 00000950 L_out=0.679 Acc=0.32 ---151215.83 ms/batch
Step 00001000 L_out=0.198 Acc=0.28 ---178093.70 ms/batch
Step 00001050 L_out=0.272 Acc=0.46 ---204850.08 ms/batch
Step 00001100 L_out=0.208 Acc=0.30 ---231522.86 ms/batch
Step 00001150 L_out=0.140 Acc=0.54 ---258418.26 ms/batch
Step 00001200 L_out=0.525 Acc=0.39 ---285275.21 ms/batch
Step 00001250 L_out=0.350 Acc=0.37 ---311918.65 ms/batch
Step 00001300 L_out=0.337 Acc=0.31 ---338529.45 ms/batch
Round 2 | epoch=1, train costTime=356.4317145347595, | total_activation_sum=3662888
Round 2 | ****EPOCH 2****
Step 00001350 L_out=0.152 Acc=0.39 --- 8579.89 ms/batch
Step 00001400 L_out=0.088 Acc=0.43 ---35293.90 ms/batch
Step 00001450 L_out=0.279 Acc=0.54 ---62191.12 ms/batch
Step 00001500 L_out=0.172 Acc=0.35 ---88868.75 ms/batch
Step 00001550 L_out=0.135 Acc=0.47 ---115664.58 ms/batch
Step 00001600 L_out=0.452 Acc=0.38 ---142422.72 ms/batch
Step 00001650 L_out=0.374 Acc=0.55 ---169183.27 ms/batch
Step 00001700 L_out=0.047 Acc=0.59 ---195814.44 ms/batch
Step 00001750 L_out=0.811 Acc=0.59 ---222511.75 ms/batch
Step 00001800 L_out=0.266 Acc=0.59 ---249110.48 ms/batch
Step 00001850 L_out=0.249 Acc=0.30 ---275853.55 ms/batch
Step 00001900 L_out=0.655 Acc=0.43 ---302482.78 ms/batch
Step 00001950 L_out=0.211 Acc=0.46 ---329522.49 ms/batch
Step 00002000 L_out=0.271 Acc=0.52 ---356328.32 ms/batch
Round 2 | epoch=2, train costTime=356.866632938385, | total_activation_sum=3736698
Round 2 | ****EPOCH 3****
Step 00002050 L_out=0.131 Acc=0.34 ---26176.06 ms/batch
Step 00002100 L_out=0.341 Acc=0.42 ---52729.18 ms/batch
Step 00002150 L_out=0.432 Acc=0.30 ---79489.79 ms/batch
Step 00002200 L_out=0.572 Acc=0.46 ---105916.29 ms/batch
Step 00002250 L_out=0.965 Acc=0.42 ---132721.34 ms/batch
Step 00002300 L_out=0.381 Acc=0.48 ---159436.49 ms/batch
Step 00002350 L_out=0.557 Acc=0.31 ---186163.49 ms/batch
Step 00002400 L_out=0.130 Acc=0.38 ---212531.06 ms/batch
Step 00002450 L_out=0.275 Acc=0.53 ---239321.11 ms/batch
Step 00002500 L_out=0.551 Acc=0.36 ---265925.09 ms/batch
Step 00002550 L_out=1.259 Acc=0.53 ---292743.90 ms/batch
Step 00002600 L_out=0.321 Acc=0.44 ---319304.08 ms/batch
Step 00002650 L_out=0.335 Acc=0.60 ---345799.36 ms/batch
Round 2 | epoch=3, train costTime=355.34384274482727, | total_activation_sum=3670169
Round 2 | ****EPOCH 4****
Step 00002700 L_out=0.203 Acc=0.70 ---17069.56 ms/batch
Step 00002750 L_out=0.128 Acc=0.20 ---43711.59 ms/batch
Step 00002800 L_out=0.250 Acc=0.40 ---70424.39 ms/batch
Step 00002850 L_out=0.027 Acc=0.37 ---97014.61 ms/batch
Step 00002900 L_out=0.329 Acc=0.49 ---123694.34 ms/batch
Step 00002950 L_out=0.409 Acc=0.37 ---150369.02 ms/batch
Step 00003000 L_out=0.154 Acc=0.37 ---177183.66 ms/batch
Step 00003050 L_out=0.065 Acc=0.38 ---203676.00 ms/batch
Step 00003100 L_out=0.265 Acc=0.45 ---230520.20 ms/batch
Step 00003150 L_out=0.171 Acc=0.58 ---257252.49 ms/batch
Step 00003200 L_out=0.536 Acc=0.42 ---283967.95 ms/batch
Step 00003250 L_out=0.184 Acc=0.53 ---310620.06 ms/batch
Step 00003300 L_out=0.320 Acc=0.51 ---337236.59 ms/batch
Round 2 | epoch=4, train costTime=355.7087388038635, | total_activation_sum=3747728
Round 2 | ****EPOCH 5****
Step 00003350 L_out=0.426 Acc=0.53 --- 7991.43 ms/batch
Step 00003400 L_out=0.481 Acc=0.55 ---34519.57 ms/batch
Step 00003450 L_out=0.560 Acc=0.62 ---61084.35 ms/batch
Step 00003500 L_out=0.222 Acc=0.49 ---87745.89 ms/batch
Step 00003550 L_out=0.432 Acc=0.41 ---114236.62 ms/batch
Step 00003600 L_out=0.156 Acc=0.54 ---140856.92 ms/batch
Step 00003650 L_out=0.366 Acc=0.66 ---167551.75 ms/batch
Step 00003700 L_out=0.342 Acc=0.60 ---194054.77 ms/batch
Step 00003750 L_out=0.607 Acc=0.36 ---220711.81 ms/batch
Step 00003800 L_out=0.339 Acc=0.55 ---247309.05 ms/batch
Step 00003850 L_out=0.041 Acc=0.49 ---273836.39 ms/batch
Step 00003900 L_out=0.420 Acc=0.50 ---300400.88 ms/batch
Step 00003950 L_out=0.458 Acc=0.34 ---327020.05 ms/batch
Step 00004000 L_out=0.500 Acc=0.40 ---353565.82 ms/batch
Round 2 | epoch=5, train costTime=354.659371137619, | total_activation_sum=3651186
Round 2 | ****EPOCH 6****
Step 00004050 L_out=0.062 Acc=0.52 ---25470.58 ms/batch
Step 00004100 L_out=0.247 Acc=0.50 ---52144.48 ms/batch
Step 00004150 L_out=0.188 Acc=0.66 ---78576.26 ms/batch
Step 00004200 L_out=0.466 Acc=0.42 ---105096.01 ms/batch
Step 00004250 L_out=0.154 Acc=0.66 ---131851.17 ms/batch
Step 00004300 L_out=0.133 Acc=0.64 ---158205.69 ms/batch
Step 00004350 L_out=0.656 Acc=0.51 ---184755.15 ms/batch
Step 00004400 L_out=0.190 Acc=0.54 ---211282.98 ms/batch
Step 00004450 L_out=0.323 Acc=0.33 ---238057.65 ms/batch
Step 00004500 L_out=0.084 Acc=0.40 ---264803.11 ms/batch
Step 00004550 L_out=0.228 Acc=0.58 ---291271.58 ms/batch
Step 00004600 L_out=0.417 Acc=0.52 ---317743.86 ms/batch
Step 00004650 L_out=0.345 Acc=0.49 ---344338.42 ms/batch
Round 2 | epoch=6, train costTime=354.4021439552307, | total_activation_sum=3718181
Round 2 | ****EPOCH 7****
Step 00004700 L_out=0.026 Acc=0.48 ---16657.43 ms/batch
Step 00004750 L_out=0.128 Acc=0.57 ---43058.71 ms/batch
Step 00004800 L_out=0.155 Acc=0.45 ---69676.99 ms/batch
Step 00004850 L_out=0.185 Acc=0.50 ---96195.91 ms/batch
Step 00004900 L_out=0.142 Acc=0.55 ---122824.72 ms/batch
Step 00004950 L_out=0.113 Acc=0.75 ---149283.77 ms/batch
Step 00005000 L_out=0.105 Acc=0.37 ---175615.96 ms/batch
Step 00005050 L_out=0.034 Acc=0.67 ---202256.43 ms/batch
Step 00005100 L_out=0.031 Acc=0.47 ---229047.72 ms/batch
Step 00005150 L_out=0.108 Acc=0.67 ---255660.50 ms/batch
Step 00005200 L_out=0.549 Acc=0.57 ---281999.50 ms/batch
Step 00005250 L_out=0.142 Acc=0.69 ---308593.71 ms/batch
Step 00005300 L_out=0.108 Acc=0.48 ---335192.63 ms/batch
Round 2 | epoch=7, train costTime=354.1831018924713, | total_activation_sum=3716083
Round 2 | ****EPOCH 8****
Step 00005350 L_out=0.201 Acc=0.47 --- 7330.91 ms/batch
Step 00005400 L_out=0.473 Acc=0.63 ---33721.48 ms/batch
Step 00005450 L_out=0.074 Acc=0.51 ---60222.07 ms/batch
Step 00005500 L_out=0.225 Acc=0.61 ---86708.17 ms/batch
Step 00005550 L_out=0.353 Acc=0.58 ---113157.16 ms/batch
Step 00005600 L_out=0.147 Acc=0.54 ---139444.95 ms/batch
Step 00005650 L_out=0.398 Acc=0.70 ---165899.26 ms/batch
Step 00005700 L_out=0.050 Acc=0.54 ---192092.91 ms/batch
Step 00005750 L_out=0.032 Acc=0.52 ---218483.30 ms/batch
Step 00005800 L_out=0.398 Acc=0.38 ---245151.68 ms/batch
Step 00005850 L_out=0.087 Acc=0.49 ---271671.72 ms/batch
Step 00005900 L_out=0.175 Acc=0.36 ---297982.69 ms/batch
Step 00005950 L_out=0.183 Acc=0.56 ---324481.13 ms/batch
Step 00006000 L_out=0.035 Acc=0.56 ---350799.86 ms/batch
Round 2 | epoch=8, train costTime=352.3602349758148, | total_activation_sum=3694132
Round 2 | ****EPOCH 9****
Step 00006050 L_out=0.698 Acc=0.52 ---24879.23 ms/batch
Step 00006100 L_out=0.303 Acc=0.62 ---51302.27 ms/batch
Step 00006150 L_out=0.200 Acc=0.67 ---77583.48 ms/batch
Step 00006200 L_out=0.199 Acc=0.67 ---104283.02 ms/batch
Step 00006250 L_out=0.123 Acc=0.53 ---130704.91 ms/batch
Step 00006300 L_out=0.459 Acc=0.74 ---157283.49 ms/batch
Step 00006350 L_out=0.074 Acc=0.62 ---183584.79 ms/batch
Step 00006400 L_out=0.216 Acc=0.57 ---209828.85 ms/batch
Step 00006450 L_out=0.006 Acc=0.70 ---236280.13 ms/batch
Step 00006500 L_out=0.107 Acc=0.49 ---262602.89 ms/batch
Step 00006550 L_out=0.326 Acc=0.60 ---288885.20 ms/batch
Step 00006600 L_out=0.680 Acc=0.30 ---315324.58 ms/batch
Step 00006650 L_out=0.062 Acc=0.61 ---341670.00 ms/batch
Round 2 | epoch=9, train costTime=352.20261883735657, | total_activation_sum=3656765
Round 2 | ****EPOCH 10****
Step 00006700 L_out=0.136 Acc=0.61 ---15777.11 ms/batch
Step 00006750 L_out=0.257 Acc=0.48 ---42141.55 ms/batch
Step 00006800 L_out=0.078 Acc=0.62 ---68732.54 ms/batch
Step 00006850 L_out=0.136 Acc=0.69 ---94841.40 ms/batch
Step 00006900 L_out=0.214 Acc=0.65 ---121074.88 ms/batch
Step 00006950 L_out=0.123 Acc=0.55 ---147368.89 ms/batch
Step 00007000 L_out=0.243 Acc=0.67 ---173613.77 ms/batch
Step 00007050 L_out=0.510 Acc=0.47 ---200026.42 ms/batch
Step 00007100 L_out=0.053 Acc=0.42 ---226272.21 ms/batch
Step 00007150 L_out=0.240 Acc=0.72 ---252737.85 ms/batch
Step 00007200 L_out=0.633 Acc=0.69 ---279228.93 ms/batch
Step 00007250 L_out=0.019 Acc=0.41 ---305471.66 ms/batch
Step 00007300 L_out=0.075 Acc=0.68 ---331737.40 ms/batch
Round 2 | epoch=10, train costTime=351.0465462207794, | total_activation_sum=3695977
Round 2 | ****EPOCH 11****
Step 00007350 L_out=0.209 Acc=0.66 --- 6971.43 ms/batch
Step 00007400 L_out=0.061 Acc=0.69 ---33695.72 ms/batch
Step 00007450 L_out=0.255 Acc=0.69 ---59802.48 ms/batch
Step 00007500 L_out=0.179 Acc=0.59 ---85958.97 ms/batch
Step 00007550 L_out=0.491 Acc=0.74 ---112112.16 ms/batch
Step 00007600 L_out=0.527 Acc=0.71 ---138249.73 ms/batch
Step 00007650 L_out=0.296 Acc=0.67 ---164614.52 ms/batch
Step 00007700 L_out=0.098 Acc=0.44 ---191053.17 ms/batch
Step 00007750 L_out=0.237 Acc=0.64 ---217304.28 ms/batch
Step 00007800 L_out=0.103 Acc=0.66 ---243635.70 ms/batch
Step 00007850 L_out=0.161 Acc=0.75 ---270050.94 ms/batch
Step 00007900 L_out=0.092 Acc=0.61 ---296363.71 ms/batch
Step 00007950 L_out=0.110 Acc=0.66 ---322967.73 ms/batch
Step 00008000 L_out=0.218 Acc=0.44 ---349277.38 ms/batch
Round 2 | epoch=11, train costTime=351.39703941345215, | total_activation_sum=3764805
Round 2 | ****EPOCH 12****
Step 00008050 L_out=0.078 Acc=0.48 ---24096.44 ms/batch
Step 00008100 L_out=0.528 Acc=0.81 ---50177.48 ms/batch
Step 00008150 L_out=0.079 Acc=0.61 ---76353.61 ms/batch
Step 00008200 L_out=0.183 Acc=0.58 ---102441.23 ms/batch
Step 00008250 L_out=0.576 Acc=0.62 ---128831.98 ms/batch
Step 00008300 L_out=0.283 Acc=0.69 ---155207.28 ms/batch
Step 00008350 L_out=0.371 Acc=0.52 ---181644.34 ms/batch
Step 00008400 L_out=0.188 Acc=0.68 ---207788.93 ms/batch
Step 00008450 L_out=0.105 Acc=0.54 ---234001.34 ms/batch
Step 00008500 L_out=0.160 Acc=0.61 ---260323.40 ms/batch
Step 00008550 L_out=0.042 Acc=0.66 ---286492.34 ms/batch
Step 00008600 L_out=0.044 Acc=0.66 ---312439.52 ms/batch
Step 00008650 L_out=0.286 Acc=0.55 ---338700.53 ms/batch
Round 2 | epoch=12, train costTime=349.7062158584595, | total_activation_sum=3672116
Round 2 | ****EPOCH 13****
Step 00008700 L_out=0.257 Acc=0.46 ---15353.30 ms/batch
Step 00008750 L_out=0.298 Acc=0.54 ---41737.48 ms/batch
Step 00008800 L_out=0.078 Acc=0.65 ---68032.94 ms/batch
Step 00008850 L_out=0.083 Acc=0.74 ---94203.40 ms/batch
Step 00008900 L_out=0.069 Acc=0.66 ---120456.36 ms/batch
Step 00008950 L_out=0.053 Acc=0.59 ---146617.34 ms/batch
Step 00009000 L_out=0.085 Acc=0.52 ---172500.76 ms/batch
Step 00009050 L_out=0.027 Acc=0.61 ---198721.34 ms/batch
Step 00009100 L_out=0.478 Acc=0.64 ---224652.17 ms/batch
Step 00009150 L_out=0.322 Acc=0.70 ---251212.51 ms/batch
Step 00009200 L_out=0.053 Acc=0.52 ---277190.81 ms/batch
Step 00009250 L_out=0.128 Acc=0.66 ---303146.71 ms/batch
Step 00009300 L_out=0.171 Acc=0.67 ---329183.44 ms/batch
Round 2 | epoch=13, train costTime=348.84339690208435, | total_activation_sum=3691030
Round 2 | ****EPOCH 14****
Step 00009350 L_out=0.012 Acc=0.76 --- 6220.87 ms/batch
Step 00009400 L_out=0.032 Acc=0.73 ---32390.74 ms/batch
Step 00009450 L_out=0.469 Acc=0.71 ---58349.54 ms/batch
Step 00009500 L_out=0.251 Acc=0.55 ---84644.91 ms/batch
Step 00009550 L_out=0.437 Acc=0.69 ---110867.65 ms/batch
Step 00009600 L_out=0.058 Acc=0.72 ---136987.06 ms/batch
Step 00009650 L_out=0.288 Acc=0.72 ---163238.86 ms/batch
Step 00009700 L_out=0.118 Acc=0.81 ---189155.32 ms/batch
Step 00009750 L_out=0.151 Acc=0.79 ---215220.39 ms/batch
Step 00009800 L_out=0.202 Acc=0.57 ---241254.53 ms/batch
Step 00009850 L_out=0.109 Acc=0.71 ---267445.52 ms/batch
Step 00009900 L_out=0.135 Acc=0.60 ---293682.39 ms/batch
Step 00009950 L_out=0.279 Acc=0.73 ---319707.18 ms/batch
Step 00010000 L_out=0.180 Acc=0.73 ---345789.59 ms/batch
Round 2 | epoch=14, train costTime=348.31567454338074, | total_activation_sum=3651738
Round 2 | ****EPOCH 15****
Step 00010050 L_out=0.236 Acc=0.49 ---23538.36 ms/batch
Step 00010100 L_out=0.265 Acc=0.75 ---49553.58 ms/batch
Step 00010150 L_out=0.244 Acc=0.67 ---75556.77 ms/batch
Step 00010200 L_out=0.605 Acc=0.62 ---101474.58 ms/batch
Step 00010250 L_out=0.236 Acc=0.48 ---127645.57 ms/batch
Step 00010300 L_out=0.194 Acc=0.55 ---153558.75 ms/batch
Step 00010350 L_out=0.075 Acc=0.71 ---179414.90 ms/batch
Step 00010400 L_out=0.221 Acc=0.80 ---205442.18 ms/batch
Step 00010450 L_out=0.354 Acc=0.64 ---231728.83 ms/batch
Step 00010500 L_out=0.078 Acc=0.58 ---257720.90 ms/batch
Step 00010550 L_out=0.240 Acc=0.47 ---283696.98 ms/batch
Step 00010600 L_out=0.143 Acc=0.71 ---309649.71 ms/batch
Step 00010650 L_out=0.192 Acc=0.61 ---335737.93 ms/batch
Round 2 | epoch=15, train costTime=347.1910493373871, | total_activation_sum=3675496
Round 2 | ****EPOCH 16****
Step 00010700 L_out=0.168 Acc=0.81 ---14459.85 ms/batch
Step 00010750 L_out=0.207 Acc=0.50 ---40624.15 ms/batch
Step 00010800 L_out=0.435 Acc=0.53 ---66601.08 ms/batch
Step 00010850 L_out=0.299 Acc=0.75 ---92747.59 ms/batch
Step 00010900 L_out=0.181 Acc=0.75 ---118987.25 ms/batch
Step 00010950 L_out=0.514 Acc=0.64 ---144935.14 ms/batch
Step 00011000 L_out=0.130 Acc=0.46 ---171129.73 ms/batch
Step 00011050 L_out=0.137 Acc=0.79 ---197284.70 ms/batch
Step 00011100 L_out=0.462 Acc=0.49 ---223217.14 ms/batch
Step 00011150 L_out=0.187 Acc=0.64 ---249202.03 ms/batch
Step 00011200 L_out=0.069 Acc=0.66 ---275410.74 ms/batch
Step 00011250 L_out=0.941 Acc=0.65 ---301535.81 ms/batch
Step 00011300 L_out=0.227 Acc=0.79 ---327867.92 ms/batch
Round 2 | epoch=16, train costTime=348.0713222026825, | total_activation_sum=3793222
Round 2 | ****EPOCH 17****
Step 00011350 L_out=0.370 Acc=0.64 --- 5719.41 ms/batch
Step 00011400 L_out=0.103 Acc=0.74 ---31642.47 ms/batch
Step 00011450 L_out=0.163 Acc=0.72 ---57686.91 ms/batch
Step 00011500 L_out=0.112 Acc=0.74 ---83694.52 ms/batch
Step 00011550 L_out=0.241 Acc=0.62 ---109699.88 ms/batch
Step 00011600 L_out=0.155 Acc=0.72 ---135719.47 ms/batch
Step 00011650 L_out=0.166 Acc=0.72 ---161660.12 ms/batch
Step 00011700 L_out=0.081 Acc=0.67 ---187630.51 ms/batch
Step 00011750 L_out=0.040 Acc=0.52 ---213619.04 ms/batch
Step 00011800 L_out=0.409 Acc=0.54 ---239554.28 ms/batch
Step 00011850 L_out=0.016 Acc=0.60 ---265423.24 ms/batch
Step 00011900 L_out=0.082 Acc=0.56 ---291423.68 ms/batch
Step 00011950 L_out=0.266 Acc=0.74 ---317686.97 ms/batch
Step 00012000 L_out=0.061 Acc=0.75 ---343553.42 ms/batch
Round 2 | epoch=17, train costTime=346.75338435173035, | total_activation_sum=3724744
Round 2 | epoch=18, current m_iou=0.473035485958679
Round 2 | Best m_IoU is: 0.473, OA is: 0.753 | val costTime=134.3862533569336
Round 2 | ****EPOCH 18****
Step 00012050 L_out=0.096 Acc=0.85 ---22904.51 ms/batch
Step 00012100 L_out=0.074 Acc=0.71 ---48775.20 ms/batch
Step 00012150 L_out=0.798 Acc=0.70 ---74869.06 ms/batch
Step 00012200 L_out=0.142 Acc=0.82 ---100813.82 ms/batch
Step 00012250 L_out=0.200 Acc=0.45 ---126681.74 ms/batch
Step 00012300 L_out=0.038 Acc=0.73 ---152817.90 ms/batch
Step 00012350 L_out=0.066 Acc=0.68 ---178762.14 ms/batch
Step 00012400 L_out=0.100 Acc=0.66 ---204532.37 ms/batch
Step 00012450 L_out=0.337 Acc=0.73 ---230384.93 ms/batch
Step 00012500 L_out=0.137 Acc=0.83 ---256316.68 ms/batch
Step 00012550 L_out=0.324 Acc=0.59 ---282186.93 ms/batch
Step 00012600 L_out=0.106 Acc=0.74 ---308092.58 ms/batch
Step 00012650 L_out=0.070 Acc=0.82 ---334139.72 ms/batch
Round 2 | epoch=18, train costTime=346.01143860816956, | total_activation_sum=3696006
Round 2 | epoch=19, current m_iou=0.5075580376063085
Round 2 | Best m_IoU is: 0.508, OA is: 0.782 | val costTime=132.49188661575317
Round 2 | ****EPOCH 19****
Step 00012700 L_out=0.010 Acc=0.72 ---14065.04 ms/batch
Step 00012750 L_out=0.355 Acc=0.68 ---39851.75 ms/batch
Step 00012800 L_out=0.381 Acc=0.55 ---65925.75 ms/batch
Step 00012850 L_out=0.172 Acc=0.79 ---91753.45 ms/batch
Step 00012900 L_out=0.070 Acc=0.87 ---117724.95 ms/batch
Step 00012950 L_out=0.281 Acc=0.70 ---143628.62 ms/batch
Step 00013000 L_out=0.034 Acc=0.60 ---169392.87 ms/batch
Step 00013050 L_out=0.049 Acc=0.87 ---195307.78 ms/batch
Step 00013100 L_out=0.073 Acc=0.84 ---221353.89 ms/batch
Step 00013150 L_out=0.079 Acc=0.73 ---247138.81 ms/batch
Step 00013200 L_out=0.070 Acc=0.84 ---273214.16 ms/batch
Step 00013250 L_out=0.068 Acc=0.65 ---299151.89 ms/batch
Step 00013300 L_out=0.142 Acc=0.72 ---324956.43 ms/batch
Round 2 | epoch=19, train costTime=345.715044260025, | total_activation_sum=3712522
Round 2 | epoch=20, current m_iou=0.5147810556872718
Round 2 | Best m_IoU is: 0.515, OA is: 0.804 | val costTime=132.3343460559845
Round 2 | ****EPOCH 20****
Step 00013350 L_out=0.176 Acc=0.73 --- 5129.28 ms/batch
Step 00013400 L_out=0.066 Acc=0.76 ---31120.83 ms/batch
Step 00013450 L_out=0.047 Acc=0.72 ---56853.22 ms/batch
Step 00013500 L_out=0.302 Acc=0.68 ---82677.09 ms/batch
Step 00013550 L_out=0.006 Acc=0.85 ---108713.68 ms/batch
Step 00013600 L_out=0.014 Acc=0.73 ---134570.25 ms/batch
Step 00013650 L_out=0.110 Acc=0.63 ---160327.88 ms/batch
Step 00013700 L_out=0.153 Acc=0.81 ---186259.50 ms/batch
Step 00013750 L_out=0.090 Acc=0.68 ---212084.52 ms/batch
Step 00013800 L_out=0.050 Acc=0.67 ---238273.01 ms/batch
Step 00013850 L_out=0.233 Acc=0.79 ---264258.77 ms/batch
Step 00013900 L_out=0.136 Acc=0.71 ---290072.91 ms/batch
Step 00013950 L_out=0.122 Acc=0.61 ---315927.45 ms/batch
Step 00014000 L_out=0.244 Acc=0.68 ---342150.56 ms/batch
Round 2 | epoch=20, train costTime=345.76111245155334, | total_activation_sum=3715195
Round 2 | epoch=21, current m_iou=0.48973722345600607
Round 2 | Best m_IoU is: 0.515, OA is: 0.804 | val costTime=132.2177770137787
Round 2 | ****EPOCH 21****
Step 00014050 L_out=0.156 Acc=0.75 ---22022.58 ms/batch
Step 00014100 L_out=0.052 Acc=0.81 ---47803.24 ms/batch
Step 00014150 L_out=0.123 Acc=0.72 ---73607.27 ms/batch
Step 00014200 L_out=0.381 Acc=0.47 ---99408.67 ms/batch
Step 00014250 L_out=0.323 Acc=0.75 ---125148.34 ms/batch
Step 00014300 L_out=0.134 Acc=0.74 ---150987.95 ms/batch
Step 00014350 L_out=0.090 Acc=0.67 ---176893.90 ms/batch
Step 00014400 L_out=0.228 Acc=0.70 ---202805.79 ms/batch
Step 00014450 L_out=0.093 Acc=0.73 ---228467.74 ms/batch
Step 00014500 L_out=0.200 Acc=0.54 ---254250.32 ms/batch
Step 00014550 L_out=0.163 Acc=0.60 ---279937.44 ms/batch
Step 00014600 L_out=0.028 Acc=0.68 ---305758.30 ms/batch
Step 00014650 L_out=0.125 Acc=0.60 ---331517.19 ms/batch
Round 2 | epoch=21, train costTime=343.867826461792, | total_activation_sum=3697080
Round 2 | epoch=22, current m_iou=0.5155637863825306
Round 2 | Best m_IoU is: 0.516, OA is: 0.809 | val costTime=132.03651404380798
Round 2 | ****EPOCH 22****
Step 00014700 L_out=0.022 Acc=0.61 ---13491.75 ms/batch
Step 00014750 L_out=0.049 Acc=0.73 ---39212.36 ms/batch
Step 00014800 L_out=0.111 Acc=0.74 ---64849.36 ms/batch
Step 00014850 L_out=0.026 Acc=0.68 ---90607.33 ms/batch
Step 00014900 L_out=0.086 Acc=0.73 ---116492.04 ms/batch
Step 00014950 L_out=0.040 Acc=0.78 ---142336.64 ms/batch
Step 00015000 L_out=0.067 Acc=0.60 ---168042.64 ms/batch
Step 00015050 L_out=0.109 Acc=0.71 ---193953.39 ms/batch
Step 00015100 L_out=0.106 Acc=0.52 ---219702.68 ms/batch
Step 00015150 L_out=0.063 Acc=0.77 ---245343.67 ms/batch
Step 00015200 L_out=0.138 Acc=0.75 ---271325.78 ms/batch
Step 00015250 L_out=0.163 Acc=0.73 ---297215.26 ms/batch
Step 00015300 L_out=0.085 Acc=0.75 ---323332.22 ms/batch
Round 2 | epoch=22, train costTime=344.4692471027374, | total_activation_sum=3680714
Round 2 | epoch=23, current m_iou=0.5088828870226683
Round 2 | Best m_IoU is: 0.516, OA is: 0.809 | val costTime=131.46208906173706
Round 2 | ****EPOCH 23****
Step 00015350 L_out=0.129 Acc=0.55 --- 4735.24 ms/batch
Step 00015400 L_out=0.079 Acc=0.73 ---30357.81 ms/batch
Step 00015450 L_out=0.094 Acc=0.80 ---56041.41 ms/batch
Step 00015500 L_out=0.153 Acc=0.71 ---81565.11 ms/batch
Step 00015550 L_out=0.170 Acc=0.65 ---107379.68 ms/batch
Step 00015600 L_out=0.025 Acc=0.83 ---133092.85 ms/batch
Step 00015650 L_out=0.117 Acc=0.78 ---158815.25 ms/batch
Step 00015700 L_out=0.161 Acc=0.83 ---184604.53 ms/batch
Step 00015750 L_out=0.137 Acc=0.74 ---210460.32 ms/batch
Step 00015800 L_out=0.113 Acc=0.86 ---236177.79 ms/batch
Step 00015850 L_out=0.136 Acc=0.80 ---261968.99 ms/batch
Step 00015900 L_out=0.033 Acc=0.87 ---287576.81 ms/batch
Step 00015950 L_out=0.377 Acc=0.59 ---313385.45 ms/batch
Step 00016000 L_out=0.254 Acc=0.67 ---339060.74 ms/batch
Round 2 | epoch=23, train costTime=343.1732521057129, | total_activation_sum=3710784
Round 2 | epoch=24, current m_iou=0.49145587589848294
Round 2 | Best m_IoU is: 0.516, OA is: 0.809 | val costTime=131.78556561470032
Round 2 | ****EPOCH 24****
Step 00016050 L_out=0.080 Acc=0.60 ---21372.30 ms/batch
Step 00016100 L_out=0.065 Acc=0.62 ---46812.83 ms/batch
Step 00016150 L_out=0.204 Acc=0.71 ---72285.43 ms/batch
Step 00016200 L_out=0.348 Acc=0.65 ---97844.07 ms/batch
Step 00016250 L_out=0.517 Acc=0.74 ---123173.70 ms/batch
Step 00016300 L_out=0.052 Acc=0.50 ---148673.22 ms/batch
Step 00016350 L_out=0.094 Acc=0.80 ---174212.19 ms/batch
Step 00016400 L_out=0.044 Acc=0.86 ---199860.53 ms/batch
Step 00016450 L_out=0.211 Acc=0.63 ---225478.83 ms/batch
Step 00016500 L_out=0.121 Acc=0.81 ---251358.18 ms/batch
Step 00016550 L_out=0.010 Acc=0.61 ---277116.14 ms/batch
Step 00016600 L_out=0.100 Acc=0.85 ---302811.76 ms/batch
Step 00016650 L_out=0.066 Acc=0.42 ---328536.31 ms/batch
Round 2 | epoch=24, train costTime=341.31579637527466, | total_activation_sum=3709762
Round 2 | epoch=25, current m_iou=0.5106436323091295
Round 2 | Best m_IoU is: 0.516, OA is: 0.809 | val costTime=132.13730549812317
Round 2 | ****EPOCH 25****
Step 00016700 L_out=0.024 Acc=0.76 ---12849.85 ms/batch
Step 00016750 L_out=0.047 Acc=0.68 ---38636.64 ms/batch
Step 00016800 L_out=0.201 Acc=0.73 ---64457.75 ms/batch
Step 00016850 L_out=0.098 Acc=0.61 ---90023.23 ms/batch
Step 00016900 L_out=0.097 Acc=0.66 ---115568.74 ms/batch
Step 00016950 L_out=0.118 Acc=0.73 ---141241.36 ms/batch
Step 00017000 L_out=0.041 Acc=0.80 ---166622.03 ms/batch
Step 00017050 L_out=0.083 Acc=0.75 ---192166.17 ms/batch
Step 00017100 L_out=0.011 Acc=0.70 ---217750.30 ms/batch
Step 00017150 L_out=0.073 Acc=0.85 ---243266.95 ms/batch
Step 00017200 L_out=0.010 Acc=0.74 ---269095.83 ms/batch
Step 00017250 L_out=0.061 Acc=0.86 ---294716.89 ms/batch
Step 00017300 L_out=0.135 Acc=0.82 ---320472.04 ms/batch
Round 2 | epoch=25, train costTime=341.9765520095825, | total_activation_sum=3619043
Round 2 | epoch=26, current m_iou=0.5314375393962505
Round 2 | Best m_IoU is: 0.531, OA is: 0.800 | val costTime=131.84111952781677
Round 2 | ****EPOCH 26****
Step 00017350 L_out=0.081 Acc=0.77 --- 4119.74 ms/batch
Step 00017400 L_out=0.088 Acc=0.76 ---29772.72 ms/batch
Step 00017450 L_out=0.061 Acc=0.67 ---55349.89 ms/batch
Step 00017500 L_out=0.027 Acc=0.74 ---80939.38 ms/batch
Step 00017550 L_out=0.191 Acc=0.74 ---106673.93 ms/batch
Step 00017600 L_out=0.107 Acc=0.68 ---132408.72 ms/batch
Step 00017650 L_out=0.077 Acc=0.78 ---157924.81 ms/batch
Step 00017700 L_out=0.108 Acc=0.83 ---183521.50 ms/batch
Step 00017750 L_out=0.081 Acc=0.59 ---208853.78 ms/batch
Step 00017800 L_out=0.296 Acc=0.66 ---234414.89 ms/batch
Step 00017850 L_out=0.204 Acc=0.76 ---260456.41 ms/batch
Step 00017900 L_out=0.114 Acc=0.78 ---286389.50 ms/batch
Step 00017950 L_out=0.079 Acc=0.58 ---311793.30 ms/batch
Step 00018000 L_out=0.154 Acc=0.77 ---337386.09 ms/batch
Round 2 | epoch=26, train costTime=342.0326659679413, | total_activation_sum=3729369
Round 2 | epoch=27, current m_iou=0.5177465183342278
Round 2 | Best m_IoU is: 0.531, OA is: 0.800 | val costTime=133.71208214759827
Round 2 | ****EPOCH 27****
Step 00018050 L_out=0.054 Acc=0.81 ---20735.51 ms/batch
Step 00018100 L_out=0.109 Acc=0.83 ---46049.09 ms/batch
Step 00018150 L_out=0.112 Acc=0.60 ---72168.58 ms/batch
Step 00018200 L_out=0.075 Acc=0.74 ---98497.95 ms/batch
Step 00018250 L_out=0.124 Acc=0.73 ---123964.64 ms/batch
Step 00018300 L_out=0.011 Acc=0.78 ---149501.74 ms/batch
Step 00018350 L_out=0.041 Acc=0.76 ---175176.05 ms/batch
Step 00018400 L_out=0.035 Acc=0.78 ---200571.44 ms/batch
Step 00018450 L_out=0.051 Acc=0.72 ---225977.62 ms/batch
Step 00018500 L_out=0.032 Acc=0.63 ---251440.65 ms/batch
Step 00018550 L_out=0.024 Acc=0.69 ---277063.69 ms/batch
Step 00018600 L_out=0.118 Acc=0.68 ---302501.20 ms/batch
Step 00018650 L_out=0.101 Acc=0.78 ---327921.13 ms/batch
Round 2 | epoch=27, train costTime=341.1459231376648, | total_activation_sum=3712974
Round 2 | epoch=28, current m_iou=0.5279267231327078
Round 2 | Best m_IoU is: 0.531, OA is: 0.800 | val costTime=131.58222198486328
Round 2 | ****EPOCH 28****
Step 00018700 L_out=0.298 Acc=0.72 ---12198.47 ms/batch
Step 00018750 L_out=0.058 Acc=0.79 ---37612.11 ms/batch
Step 00018800 L_out=0.025 Acc=0.72 ---63164.99 ms/batch
Step 00018850 L_out=0.084 Acc=0.86 ---88729.18 ms/batch
Step 00018900 L_out=0.037 Acc=0.76 ---114232.94 ms/batch
Step 00018950 L_out=0.028 Acc=0.81 ---139734.96 ms/batch
Step 00019000 L_out=0.173 Acc=0.64 ---165265.32 ms/batch
Step 00019050 L_out=0.080 Acc=0.67 ---190828.46 ms/batch
Step 00019100 L_out=0.049 Acc=0.69 ---216502.57 ms/batch
Step 00019150 L_out=0.093 Acc=0.57 ---242080.12 ms/batch
Step 00019200 L_out=0.144 Acc=0.74 ---267604.94 ms/batch
Step 00019250 L_out=0.055 Acc=0.69 ---292993.84 ms/batch
Step 00019300 L_out=0.208 Acc=0.87 ---318502.57 ms/batch
Round 2 | epoch=28, train costTime=340.47370076179504, | total_activation_sum=3654263
Round 2 | epoch=29, current m_iou=0.5358829744352238
