Round 2 | ****EPOCH 0****
Step 00000050 L_out=0.403 Acc=0.28 ---25870.17 ms/batch
Step 00000100 L_out=0.097 Acc=0.37 ---49628.77 ms/batch
Step 00000150 L_out=0.216 Acc=0.11 ---73192.56 ms/batch
Step 00000200 L_out=0.333 Acc=0.39 ---96967.83 ms/batch
Step 00000250 L_out=0.462 Acc=0.24 ---120837.53 ms/batch
Step 00000300 L_out=0.192 Acc=0.67 ---144634.17 ms/batch
Step 00000350 L_out=0.918 Acc=0.31 ---168683.23 ms/batch
Step 00000400 L_out=0.053 Acc=0.45 ---192416.62 ms/batch
Step 00000450 L_out=1.160 Acc=0.37 ---216145.83 ms/batch
Step 00000500 L_out=0.274 Acc=0.77 ---239908.80 ms/batch
Step 00000550 L_out=0.132 Acc=0.34 ---263516.10 ms/batch
Step 00000600 L_out=0.380 Acc=0.70 ---287121.03 ms/batch
Step 00000650 L_out=0.180 Acc=0.59 ---310792.83 ms/batch
Round 2 | epoch=0, train costTime=318.9412999153137, | total_activation_sum=5532622
Round 2 | ****EPOCH 1****
Step 00000700 L_out=0.451 Acc=0.59 ---15606.84 ms/batch
Step 00000750 L_out=0.332 Acc=0.72 ---39054.52 ms/batch
Step 00000800 L_out=0.206 Acc=0.44 ---62807.04 ms/batch
Step 00000850 L_out=0.433 Acc=0.51 ---86640.77 ms/batch
Step 00000900 L_out=0.475 Acc=0.45 ---110329.72 ms/batch
Step 00000950 L_out=0.283 Acc=0.51 ---134194.85 ms/batch
Step 00001000 L_out=0.331 Acc=0.66 ---158029.66 ms/batch
Step 00001050 L_out=0.298 Acc=0.35 ---181729.87 ms/batch
Step 00001100 L_out=0.151 Acc=0.66 ---205344.80 ms/batch
Step 00001150 L_out=0.525 Acc=0.68 ---228863.69 ms/batch
Step 00001200 L_out=0.160 Acc=0.68 ---252744.54 ms/batch
Step 00001250 L_out=0.167 Acc=0.42 ---276440.24 ms/batch
Step 00001300 L_out=0.142 Acc=0.65 ---300076.51 ms/batch
Round 2 | epoch=1, train costTime=315.9967200756073, | total_activation_sum=5749935
Round 2 | ****EPOCH 2****
Step 00001350 L_out=0.198 Acc=0.56 --- 7562.26 ms/batch
Step 00001400 L_out=0.110 Acc=0.43 ---30995.36 ms/batch
Step 00001450 L_out=0.507 Acc=0.44 ---54441.07 ms/batch
Step 00001500 L_out=0.064 Acc=0.53 ---78182.71 ms/batch
Step 00001550 L_out=0.114 Acc=0.51 ---101557.11 ms/batch
Step 00001600 L_out=0.235 Acc=0.43 ---125027.65 ms/batch
Step 00001650 L_out=0.459 Acc=0.54 ---148675.07 ms/batch
Step 00001700 L_out=0.072 Acc=0.44 ---172512.87 ms/batch
Step 00001750 L_out=0.394 Acc=0.39 ---196375.02 ms/batch
Step 00001800 L_out=0.279 Acc=0.42 ---220098.06 ms/batch
Step 00001850 L_out=0.483 Acc=0.67 ---243779.07 ms/batch
Step 00001900 L_out=0.098 Acc=0.58 ---267337.95 ms/batch
Step 00001950 L_out=0.924 Acc=0.74 ---290855.34 ms/batch
Step 00002000 L_out=0.530 Acc=0.43 ---314333.95 ms/batch
Round 2 | epoch=2, train costTime=314.7983822822571, | total_activation_sum=5685907
Round 2 | ****EPOCH 3****
Step 00002050 L_out=0.096 Acc=0.62 ---23142.24 ms/batch
Step 00002100 L_out=0.620 Acc=0.63 ---46826.49 ms/batch
Step 00002150 L_out=0.235 Acc=0.89 ---70526.00 ms/batch
Step 00002200 L_out=0.150 Acc=0.55 ---93981.83 ms/batch
Step 00002250 L_out=0.267 Acc=0.65 ---117477.89 ms/batch
Step 00002300 L_out=0.105 Acc=0.74 ---140976.23 ms/batch
Step 00002350 L_out=0.350 Acc=0.89 ---164544.81 ms/batch
Step 00002400 L_out=0.063 Acc=0.68 ---188243.64 ms/batch
Step 00002450 L_out=0.265 Acc=0.58 ---211873.59 ms/batch
Step 00002500 L_out=0.200 Acc=0.45 ---235450.81 ms/batch
Step 00002550 L_out=0.160 Acc=0.72 ---258987.51 ms/batch
Step 00002600 L_out=0.112 Acc=0.47 ---282534.74 ms/batch
Step 00002650 L_out=0.190 Acc=0.49 ---306347.81 ms/batch
Round 2 | epoch=3, train costTime=314.86214900016785, | total_activation_sum=5724929
Round 2 | ****EPOCH 4****
Step 00002700 L_out=0.190 Acc=0.76 ---15031.98 ms/batch
Step 00002750 L_out=0.148 Acc=0.39 ---38773.50 ms/batch
Step 00002800 L_out=0.125 Acc=0.68 ---62507.32 ms/batch
Step 00002850 L_out=0.248 Acc=0.70 ---86132.66 ms/batch
Step 00002900 L_out=0.092 Acc=0.69 ---109456.60 ms/batch
Step 00002950 L_out=0.493 Acc=0.46 ---132987.79 ms/batch
Step 00003000 L_out=0.175 Acc=0.82 ---156600.90 ms/batch
Step 00003050 L_out=0.262 Acc=0.75 ---180092.53 ms/batch
Step 00003100 L_out=0.068 Acc=0.83 ---203665.41 ms/batch
Step 00003150 L_out=0.154 Acc=0.73 ---227321.69 ms/batch
Step 00003200 L_out=0.296 Acc=0.67 ---251056.76 ms/batch
Step 00003250 L_out=0.063 Acc=0.78 ---274611.83 ms/batch
Step 00003300 L_out=0.072 Acc=0.72 ---298250.04 ms/batch
Round 2 | epoch=4, train costTime=314.79384207725525, | total_activation_sum=5703604
Round 2 | ****EPOCH 5****
Step 00003350 L_out=0.447 Acc=0.74 --- 7017.28 ms/batch
Step 00003400 L_out=0.330 Acc=0.57 ---30651.51 ms/batch
Step 00003450 L_out=0.064 Acc=0.69 ---54299.47 ms/batch
Step 00003500 L_out=0.966 Acc=0.83 ---77900.02 ms/batch
Step 00003550 L_out=0.167 Acc=0.75 ---101344.51 ms/batch
Step 00003600 L_out=0.085 Acc=0.84 ---125096.24 ms/batch
Step 00003650 L_out=0.188 Acc=0.73 ---148873.68 ms/batch
Step 00003700 L_out=0.157 Acc=0.57 ---172666.82 ms/batch
Step 00003750 L_out=0.153 Acc=0.50 ---196373.05 ms/batch
Step 00003800 L_out=0.295 Acc=0.76 ---220051.51 ms/batch
Step 00003850 L_out=0.302 Acc=0.62 ---243480.65 ms/batch
Step 00003900 L_out=0.485 Acc=0.80 ---267252.45 ms/batch
Step 00003950 L_out=0.323 Acc=0.62 ---291080.71 ms/batch
Step 00004000 L_out=0.109 Acc=0.54 ---314442.71 ms/batch
Round 2 | epoch=5, train costTime=315.4050419330597, | total_activation_sum=5679921
Round 2 | ****EPOCH 6****
Step 00004050 L_out=0.135 Acc=0.75 ---22689.73 ms/batch
Step 00004100 L_out=0.141 Acc=0.78 ---46206.25 ms/batch
Step 00004150 L_out=0.039 Acc=0.71 ---69901.69 ms/batch
Step 00004200 L_out=0.512 Acc=0.74 ---93530.36 ms/batch
Step 00004250 L_out=0.172 Acc=0.71 ---116830.25 ms/batch
Step 00004300 L_out=0.101 Acc=0.71 ---140457.83 ms/batch
Step 00004350 L_out=0.082 Acc=0.63 ---164094.51 ms/batch
Step 00004400 L_out=0.212 Acc=0.48 ---187607.58 ms/batch
Step 00004450 L_out=0.086 Acc=0.72 ---211349.22 ms/batch
Step 00004500 L_out=0.394 Acc=0.63 ---234707.83 ms/batch
Step 00004550 L_out=0.536 Acc=0.56 ---258191.60 ms/batch
Step 00004600 L_out=0.041 Acc=0.87 ---281778.90 ms/batch
Step 00004650 L_out=0.417 Acc=0.65 ---305324.20 ms/batch
Round 2 | epoch=6, train costTime=314.39141726493835, | total_activation_sum=5737168
Round 2 | ****EPOCH 7****
Step 00004700 L_out=0.174 Acc=0.61 ---14779.11 ms/batch
Step 00004750 L_out=0.283 Acc=0.63 ---38694.08 ms/batch
Step 00004800 L_out=0.171 Acc=0.83 ---62047.96 ms/batch
Step 00004850 L_out=0.379 Acc=0.70 ---85640.25 ms/batch
Step 00004900 L_out=0.204 Acc=0.75 ---109407.25 ms/batch
Step 00004950 L_out=0.036 Acc=0.82 ---132716.54 ms/batch
Step 00005000 L_out=0.144 Acc=0.65 ---156510.13 ms/batch
Step 00005050 L_out=0.211 Acc=0.75 ---180279.58 ms/batch
Step 00005100 L_out=0.214 Acc=0.66 ---204013.19 ms/batch
Step 00005150 L_out=0.373 Acc=0.59 ---227728.95 ms/batch
Step 00005200 L_out=0.168 Acc=0.76 ---251435.83 ms/batch
Step 00005250 L_out=0.120 Acc=0.67 ---275282.98 ms/batch
Step 00005300 L_out=0.190 Acc=0.72 ---298837.34 ms/batch
Round 2 | epoch=7, train costTime=315.8924551010132, | total_activation_sum=5691532
Round 2 | ****EPOCH 8****
Step 00005350 L_out=0.242 Acc=0.71 --- 6703.34 ms/batch
Step 00005400 L_out=0.256 Acc=0.77 ---30074.09 ms/batch
Step 00005450 L_out=0.090 Acc=0.70 ---53757.03 ms/batch
Step 00005500 L_out=0.055 Acc=0.69 ---77355.33 ms/batch
Step 00005550 L_out=0.510 Acc=0.75 ---100999.20 ms/batch
Step 00005600 L_out=0.325 Acc=0.61 ---124561.17 ms/batch
Step 00005650 L_out=0.138 Acc=0.72 ---148274.45 ms/batch
Step 00005700 L_out=0.331 Acc=0.71 ---171830.97 ms/batch
Step 00005750 L_out=0.214 Acc=0.66 ---195511.95 ms/batch
Step 00005800 L_out=0.155 Acc=0.73 ---219127.23 ms/batch
Step 00005850 L_out=0.209 Acc=0.69 ---242543.18 ms/batch
Step 00005900 L_out=0.830 Acc=0.76 ---266136.65 ms/batch
Step 00005950 L_out=0.157 Acc=0.86 ---289860.19 ms/batch
Step 00006000 L_out=0.084 Acc=0.78 ---313282.42 ms/batch
Round 2 | epoch=8, train costTime=314.6709990501404, | total_activation_sum=5683083
Round 2 | ****EPOCH 9****
Step 00006050 L_out=0.154 Acc=0.59 ---22288.90 ms/batch
Step 00006100 L_out=0.356 Acc=0.74 ---46122.35 ms/batch
Step 00006150 L_out=0.238 Acc=0.88 ---69800.22 ms/batch
Step 00006200 L_out=0.217 Acc=0.72 ---93457.49 ms/batch
Step 00006250 L_out=0.281 Acc=0.80 ---117145.20 ms/batch
Step 00006300 L_out=0.303 Acc=0.77 ---140655.61 ms/batch
Step 00006350 L_out=0.063 Acc=0.90 ---164136.15 ms/batch
Step 00006400 L_out=0.195 Acc=0.79 ---187842.72 ms/batch
Step 00006450 L_out=0.803 Acc=0.57 ---211605.35 ms/batch
Step 00006500 L_out=0.069 Acc=0.80 ---235132.08 ms/batch
Step 00006550 L_out=0.058 Acc=0.78 ---258559.17 ms/batch
Step 00006600 L_out=0.061 Acc=0.81 ---282132.74 ms/batch
Step 00006650 L_out=0.088 Acc=0.74 ---305775.01 ms/batch
Round 2 | epoch=9, train costTime=315.123300075531, | total_activation_sum=5695236
Round 2 | ****EPOCH 10****
Step 00006700 L_out=0.349 Acc=0.72 ---14189.21 ms/batch
Step 00006750 L_out=0.181 Acc=0.69 ---37912.43 ms/batch
Step 00006800 L_out=0.245 Acc=0.76 ---61396.88 ms/batch
Step 00006850 L_out=0.116 Acc=0.82 ---84947.07 ms/batch
Step 00006900 L_out=0.306 Acc=0.33 ---108589.14 ms/batch
Step 00006950 L_out=0.157 Acc=0.49 ---132260.51 ms/batch
Step 00007000 L_out=0.151 Acc=0.78 ---155784.50 ms/batch
Step 00007050 L_out=0.182 Acc=0.76 ---179373.12 ms/batch
Step 00007100 L_out=0.088 Acc=0.69 ---202776.31 ms/batch
Step 00007150 L_out=0.070 Acc=0.70 ---226427.13 ms/batch
Step 00007200 L_out=0.269 Acc=0.83 ---249956.83 ms/batch
Step 00007250 L_out=0.082 Acc=0.80 ---273472.44 ms/batch
Step 00007300 L_out=0.091 Acc=0.79 ---296809.83 ms/batch
Round 2 | epoch=10, train costTime=314.17474913597107, | total_activation_sum=5731948
Round 2 | ****EPOCH 11****
Step 00007350 L_out=0.082 Acc=0.77 --- 6099.29 ms/batch
Step 00007400 L_out=0.114 Acc=0.73 ---29854.08 ms/batch
Step 00007450 L_out=0.046 Acc=0.72 ---53696.72 ms/batch
Step 00007500 L_out=0.377 Acc=0.69 ---77393.81 ms/batch
Step 00007550 L_out=0.175 Acc=0.86 ---101057.29 ms/batch
Step 00007600 L_out=0.073 Acc=0.92 ---124488.13 ms/batch
Step 00007650 L_out=0.062 Acc=0.56 ---148177.81 ms/batch
Step 00007700 L_out=0.055 Acc=0.81 ---171667.91 ms/batch
Step 00007750 L_out=0.201 Acc=0.83 ---195134.19 ms/batch
Step 00007800 L_out=0.180 Acc=0.66 ---218519.67 ms/batch
Step 00007850 L_out=0.151 Acc=0.81 ---242207.82 ms/batch
Step 00007900 L_out=0.247 Acc=0.76 ---265848.78 ms/batch
Step 00007950 L_out=0.362 Acc=0.76 ---289714.08 ms/batch
Step 00008000 L_out=0.163 Acc=0.78 ---313282.15 ms/batch
Round 2 | epoch=11, train costTime=315.1350154876709, | total_activation_sum=5699373
Round 2 | ****EPOCH 12****
Step 00008050 L_out=0.050 Acc=0.82 ---21832.70 ms/batch
Step 00008100 L_out=0.203 Acc=0.82 ---45269.73 ms/batch
Step 00008150 L_out=0.069 Acc=0.74 ---68708.83 ms/batch
Step 00008200 L_out=0.122 Acc=0.82 ---92429.06 ms/batch
Step 00008250 L_out=0.271 Acc=0.58 ---115947.05 ms/batch
Step 00008300 L_out=0.076 Acc=0.70 ---139691.16 ms/batch
Step 00008350 L_out=0.149 Acc=0.84 ---163053.19 ms/batch
Step 00008400 L_out=0.087 Acc=0.83 ---186469.06 ms/batch
Step 00008450 L_out=0.237 Acc=0.67 ---210198.99 ms/batch
Step 00008500 L_out=0.170 Acc=0.87 ---233838.58 ms/batch
Step 00008550 L_out=0.174 Acc=0.76 ---257615.49 ms/batch
Step 00008600 L_out=0.066 Acc=0.84 ---281013.90 ms/batch
Step 00008650 L_out=0.070 Acc=0.80 ---304676.86 ms/batch
Round 2 | epoch=12, train costTime=314.50218057632446, | total_activation_sum=5684551
Round 2 | ****EPOCH 13****
Step 00008700 L_out=0.066 Acc=0.85 ---13626.88 ms/batch
Step 00008750 L_out=0.101 Acc=0.77 ---37101.76 ms/batch
Step 00008800 L_out=0.046 Acc=0.82 ---60752.03 ms/batch
Step 00008850 L_out=0.276 Acc=0.83 ---84531.75 ms/batch
Step 00008900 L_out=0.270 Acc=0.76 ---107988.57 ms/batch
Step 00008950 L_out=0.223 Acc=0.70 ---131625.66 ms/batch
Step 00009000 L_out=0.065 Acc=0.87 ---155085.97 ms/batch
Step 00009050 L_out=0.083 Acc=0.74 ---178659.42 ms/batch
Step 00009100 L_out=0.183 Acc=0.83 ---202320.09 ms/batch
Step 00009150 L_out=0.063 Acc=0.72 ---226032.66 ms/batch
Step 00009200 L_out=0.096 Acc=0.68 ---249548.55 ms/batch
Step 00009250 L_out=0.146 Acc=0.70 ---273427.01 ms/batch
Step 00009300 L_out=0.247 Acc=0.75 ---296942.89 ms/batch
Round 2 | epoch=13, train costTime=314.8862717151642, | total_activation_sum=5737414
Round 2 | ****EPOCH 14****
Step 00009350 L_out=0.018 Acc=0.82 --- 5669.45 ms/batch
Step 00009400 L_out=0.082 Acc=0.74 ---29400.12 ms/batch
Step 00009450 L_out=0.283 Acc=0.68 ---53001.26 ms/batch
Step 00009500 L_out=0.234 Acc=0.86 ---76750.95 ms/batch
Step 00009550 L_out=0.084 Acc=0.76 ---100299.75 ms/batch
Step 00009600 L_out=0.219 Acc=0.62 ---123908.41 ms/batch
Step 00009650 L_out=0.335 Acc=0.78 ---147332.79 ms/batch
Step 00009700 L_out=0.198 Acc=0.71 ---170885.32 ms/batch
Step 00009750 L_out=0.385 Acc=0.69 ---194401.80 ms/batch
Step 00009800 L_out=0.027 Acc=0.83 ---218201.39 ms/batch
Step 00009850 L_out=0.056 Acc=0.70 ---241825.43 ms/batch
Step 00009900 L_out=0.119 Acc=0.81 ---265416.83 ms/batch
Step 00009950 L_out=0.083 Acc=0.75 ---288957.01 ms/batch
Step 00010000 L_out=0.100 Acc=0.89 ---312579.97 ms/batch
Round 2 | epoch=14, train costTime=315.02247858047485, | total_activation_sum=5673527
Round 2 | ****EPOCH 15****
Step 00010050 L_out=0.328 Acc=0.77 ---21154.83 ms/batch
Step 00010100 L_out=0.064 Acc=0.77 ---44556.56 ms/batch
Step 00010150 L_out=0.054 Acc=0.80 ---68232.29 ms/batch
Step 00010200 L_out=0.136 Acc=0.79 ---91886.29 ms/batch
Step 00010250 L_out=0.310 Acc=0.67 ---115586.34 ms/batch
Step 00010300 L_out=0.074 Acc=0.61 ---139402.10 ms/batch
Step 00010350 L_out=0.199 Acc=0.82 ---163106.22 ms/batch
Step 00010400 L_out=0.091 Acc=0.77 ---186779.37 ms/batch
Step 00010450 L_out=0.113 Acc=0.83 ---210061.46 ms/batch
Step 00010500 L_out=0.055 Acc=0.76 ---233616.80 ms/batch
Step 00010550 L_out=0.183 Acc=0.55 ---257275.06 ms/batch
Step 00010600 L_out=0.113 Acc=0.83 ---280905.33 ms/batch
Step 00010650 L_out=0.139 Acc=0.87 ---304501.35 ms/batch
Round 2 | epoch=15, train costTime=314.7585623264313, | total_activation_sum=5704523
Round 2 | ****EPOCH 16****
Step 00010700 L_out=0.048 Acc=0.80 ---13350.16 ms/batch
Step 00010750 L_out=0.160 Acc=0.43 ---37142.83 ms/batch
Step 00010800 L_out=0.069 Acc=0.85 ---60753.37 ms/batch
Step 00010850 L_out=0.159 Acc=0.81 ---84382.61 ms/batch
Step 00010900 L_out=0.063 Acc=0.87 ---108100.79 ms/batch
Step 00010950 L_out=0.319 Acc=0.85 ---131810.97 ms/batch
Step 00011000 L_out=0.211 Acc=0.71 ---155533.44 ms/batch
Step 00011050 L_out=0.104 Acc=0.86 ---179194.44 ms/batch
Step 00011100 L_out=0.042 Acc=0.84 ---202931.63 ms/batch
Step 00011150 L_out=0.164 Acc=0.66 ---226689.18 ms/batch
Step 00011200 L_out=0.059 Acc=0.85 ---250128.12 ms/batch
Step 00011250 L_out=0.085 Acc=0.72 ---273783.20 ms/batch
Step 00011300 L_out=0.164 Acc=0.83 ---297445.06 ms/batch
Round 2 | epoch=16, train costTime=315.72913932800293, | total_activation_sum=5749586
Round 2 | ****EPOCH 17****
Step 00011350 L_out=0.198 Acc=0.83 --- 5288.96 ms/batch
Step 00011400 L_out=0.045 Acc=0.79 ---28863.87 ms/batch
Step 00011450 L_out=0.352 Acc=0.42 ---52605.02 ms/batch
Step 00011500 L_out=0.092 Acc=0.89 ---76544.19 ms/batch
Step 00011550 L_out=0.322 Acc=0.54 ---100213.74 ms/batch
Step 00011600 L_out=0.044 Acc=0.77 ---123795.33 ms/batch
Step 00011650 L_out=0.037 Acc=0.86 ---147401.97 ms/batch
Step 00011700 L_out=0.409 Acc=0.74 ---171047.43 ms/batch
Step 00011750 L_out=0.035 Acc=0.85 ---194552.77 ms/batch
Step 00011800 L_out=0.029 Acc=0.82 ---218103.98 ms/batch
Step 00011850 L_out=0.102 Acc=0.70 ---241770.29 ms/batch
Step 00011900 L_out=0.054 Acc=0.83 ---265330.79 ms/batch
Step 00011950 L_out=0.108 Acc=0.90 ---288710.73 ms/batch
Step 00012000 L_out=0.056 Acc=0.91 ---312411.46 ms/batch
Round 2 | epoch=17, train costTime=315.2045249938965, | total_activation_sum=5722506
Round 2 | epoch=18, current m_iou=0.5545625381891901
Round 2 | Best m_IoU is: 0.555, OA is: 0.858 | val costTime=119.26292157173157
Round 2 | ****EPOCH 18****
Step 00012050 L_out=0.080 Acc=0.69 ---20840.81 ms/batch
Step 00012100 L_out=0.072 Acc=0.77 ---44378.36 ms/batch
Step 00012150 L_out=0.081 Acc=0.75 ---67985.44 ms/batch
Step 00012200 L_out=0.171 Acc=0.59 ---91773.50 ms/batch
Step 00012250 L_out=0.183 Acc=0.87 ---115538.29 ms/batch
Step 00012300 L_out=0.253 Acc=0.66 ---139106.24 ms/batch
Step 00012350 L_out=0.078 Acc=0.91 ---162616.73 ms/batch
Step 00012400 L_out=0.095 Acc=0.81 ---186314.98 ms/batch
Step 00012450 L_out=0.144 Acc=0.85 ---209929.67 ms/batch
Step 00012500 L_out=0.065 Acc=0.85 ---233430.49 ms/batch
Step 00012550 L_out=0.067 Acc=0.73 ---256877.28 ms/batch
Step 00012600 L_out=0.024 Acc=0.85 ---280709.52 ms/batch
Step 00012650 L_out=0.088 Acc=0.92 ---304223.31 ms/batch
Round 2 | epoch=18, train costTime=315.1611397266388, | total_activation_sum=5622465
Round 2 | epoch=19, current m_iou=0.5939067931493452
Round 2 | Best m_IoU is: 0.594, OA is: 0.865 | val costTime=117.87350225448608
Round 2 | ****EPOCH 19****
Step 00012700 L_out=0.059 Acc=0.81 ---12755.47 ms/batch
Step 00012750 L_out=0.091 Acc=0.84 ---36222.62 ms/batch
Step 00012800 L_out=0.032 Acc=0.80 ---59778.73 ms/batch
Step 00012850 L_out=0.066 Acc=0.88 ---83235.51 ms/batch
Step 00012900 L_out=0.063 Acc=0.86 ---106757.97 ms/batch
Step 00012950 L_out=0.128 Acc=0.90 ---130252.94 ms/batch
Step 00013000 L_out=0.162 Acc=0.76 ---153897.36 ms/batch
Step 00013050 L_out=0.036 Acc=0.70 ---177437.71 ms/batch
Step 00013100 L_out=0.088 Acc=0.86 ---200832.25 ms/batch
Step 00013150 L_out=0.425 Acc=0.62 ---224671.27 ms/batch
Step 00013200 L_out=0.380 Acc=0.76 ---248090.55 ms/batch
Step 00013250 L_out=0.220 Acc=0.76 ---271628.42 ms/batch
Step 00013300 L_out=0.102 Acc=0.89 ---295093.81 ms/batch
Round 2 | epoch=19, train costTime=313.98797059059143, | total_activation_sum=5729471
Round 2 | epoch=20, current m_iou=0.6210274294172156
Round 2 | Best m_IoU is: 0.621, OA is: 0.879 | val costTime=117.76117897033691
Round 2 | ****EPOCH 20****
Step 00013350 L_out=0.142 Acc=0.78 --- 4792.39 ms/batch
Step 00013400 L_out=0.040 Acc=0.86 ---28415.62 ms/batch
Step 00013450 L_out=0.146 Acc=0.77 ---51954.45 ms/batch
Step 00013500 L_out=0.079 Acc=0.83 ---75656.01 ms/batch
Step 00013550 L_out=0.098 Acc=0.81 ---99172.76 ms/batch
Step 00013600 L_out=0.041 Acc=0.91 ---122827.69 ms/batch
Step 00013650 L_out=0.132 Acc=0.79 ---146253.04 ms/batch
Step 00013700 L_out=0.178 Acc=0.87 ---169784.75 ms/batch
Step 00013750 L_out=0.035 Acc=0.94 ---193319.72 ms/batch
Step 00013800 L_out=0.059 Acc=0.87 ---216807.43 ms/batch
Step 00013850 L_out=0.042 Acc=0.82 ---240533.20 ms/batch
Step 00013900 L_out=0.056 Acc=0.88 ---264147.06 ms/batch
Step 00013950 L_out=0.118 Acc=0.87 ---287798.88 ms/batch
Step 00014000 L_out=0.019 Acc=0.81 ---311549.78 ms/batch
Round 2 | epoch=20, train costTime=314.8014898300171, | total_activation_sum=5711628
Round 2 | epoch=21, current m_iou=0.61686968706427
Round 2 | Best m_IoU is: 0.621, OA is: 0.879 | val costTime=117.07312965393066
Round 2 | ****EPOCH 21****
Step 00014050 L_out=0.039 Acc=0.90 ---20368.41 ms/batch
Step 00014100 L_out=0.132 Acc=0.83 ---43870.28 ms/batch
Step 00014150 L_out=0.077 Acc=0.90 ---67481.09 ms/batch
Step 00014200 L_out=0.138 Acc=0.68 ---91219.74 ms/batch
Step 00014250 L_out=0.154 Acc=0.84 ---114954.94 ms/batch
Step 00014300 L_out=0.106 Acc=0.84 ---138583.69 ms/batch
Step 00014350 L_out=0.199 Acc=0.91 ---162235.49 ms/batch
Step 00014400 L_out=0.110 Acc=0.84 ---185686.96 ms/batch
Step 00014450 L_out=0.035 Acc=0.88 ---209353.13 ms/batch
Step 00014500 L_out=0.205 Acc=0.76 ---233084.23 ms/batch
Step 00014550 L_out=0.036 Acc=0.88 ---256696.26 ms/batch
Step 00014600 L_out=0.267 Acc=0.88 ---280399.69 ms/batch
Step 00014650 L_out=0.206 Acc=0.86 ---304015.20 ms/batch
Round 2 | epoch=21, train costTime=315.40656304359436, | total_activation_sum=5710748
Round 2 | epoch=22, current m_iou=0.6254912282995442
Round 2 | Best m_IoU is: 0.625, OA is: 0.883 | val costTime=117.14078211784363
Round 2 | ****EPOCH 22****
Step 00014700 L_out=0.134 Acc=0.80 ---12328.94 ms/batch
Step 00014750 L_out=0.031 Acc=0.92 ---35860.50 ms/batch
Step 00014800 L_out=0.075 Acc=0.87 ---59608.88 ms/batch
Step 00014850 L_out=0.132 Acc=0.82 ---82939.42 ms/batch
Step 00014900 L_out=0.155 Acc=0.71 ---106414.43 ms/batch
Step 00014950 L_out=0.215 Acc=0.76 ---129882.37 ms/batch
Step 00015000 L_out=0.045 Acc=0.87 ---153536.97 ms/batch
Step 00015050 L_out=0.096 Acc=0.84 ---177150.87 ms/batch
Step 00015100 L_out=0.101 Acc=0.81 ---200496.16 ms/batch
Step 00015150 L_out=0.046 Acc=0.86 ---224394.81 ms/batch
Step 00015200 L_out=0.049 Acc=0.93 ---248043.49 ms/batch
Step 00015250 L_out=0.118 Acc=0.91 ---271389.36 ms/batch
Step 00015300 L_out=0.138 Acc=0.90 ---294807.40 ms/batch
Round 2 | epoch=22, train costTime=314.2067356109619, | total_activation_sum=5806069
Round 2 | epoch=23, current m_iou=0.6257466410109431
Round 2 | Best m_IoU is: 0.626, OA is: 0.883 | val costTime=117.81369304656982
Round 2 | ****EPOCH 23****
Step 00015350 L_out=0.067 Acc=0.90 --- 4277.56 ms/batch
Step 00015400 L_out=0.043 Acc=0.84 ---27873.19 ms/batch
Step 00015450 L_out=0.262 Acc=0.66 ---51518.79 ms/batch
Step 00015500 L_out=0.083 Acc=0.72 ---75379.95 ms/batch
Step 00015550 L_out=0.061 Acc=0.85 ---98759.09 ms/batch
Step 00015600 L_out=0.059 Acc=0.93 ---122198.26 ms/batch
Step 00015650 L_out=0.082 Acc=0.87 ---145686.45 ms/batch
Step 00015700 L_out=0.209 Acc=0.74 ---169142.96 ms/batch
Step 00015750 L_out=0.085 Acc=0.87 ---192852.20 ms/batch
Step 00015800 L_out=0.095 Acc=0.93 ---216351.13 ms/batch
Step 00015850 L_out=0.029 Acc=0.92 ---239924.03 ms/batch
Step 00015900 L_out=0.178 Acc=0.77 ---263599.52 ms/batch
Step 00015950 L_out=0.059 Acc=0.88 ---287217.06 ms/batch
Step 00016000 L_out=0.105 Acc=0.69 ---311059.69 ms/batch
Round 2 | epoch=23, train costTime=314.83934330940247, | total_activation_sum=5649368
Round 2 | epoch=24, current m_iou=0.6271235733221451
Round 2 | Best m_IoU is: 0.627, OA is: 0.882 | val costTime=116.32516860961914
Round 2 | ****EPOCH 24****
Step 00016050 L_out=0.092 Acc=0.94 ---19612.38 ms/batch
Step 00016100 L_out=0.081 Acc=0.88 ---43193.25 ms/batch
Step 00016150 L_out=0.099 Acc=0.88 ---66881.40 ms/batch
Step 00016200 L_out=0.074 Acc=0.92 ---90557.31 ms/batch
Step 00016250 L_out=0.079 Acc=0.89 ---114373.68 ms/batch
Step 00016300 L_out=0.064 Acc=0.88 ---138063.85 ms/batch
Step 00016350 L_out=0.239 Acc=0.93 ---161814.49 ms/batch
Step 00016400 L_out=0.051 Acc=0.86 ---185546.27 ms/batch
Step 00016450 L_out=0.083 Acc=0.70 ---209156.17 ms/batch
Step 00016500 L_out=0.058 Acc=0.82 ---232787.21 ms/batch
Step 00016550 L_out=0.146 Acc=0.78 ---256608.40 ms/batch
Step 00016600 L_out=0.057 Acc=0.88 ---280251.40 ms/batch
Step 00016650 L_out=0.129 Acc=0.84 ---304025.72 ms/batch
Round 2 | epoch=24, train costTime=315.8432059288025, | total_activation_sum=5740939
Round 2 | epoch=25, current m_iou=0.6209864217656844
Round 2 | Best m_IoU is: 0.627, OA is: 0.882 | val costTime=117.14641284942627
Round 2 | ****EPOCH 25****
Step 00016700 L_out=0.040 Acc=0.80 ---11830.07 ms/batch
Step 00016750 L_out=0.092 Acc=0.88 ---35372.88 ms/batch
Step 00016800 L_out=0.039 Acc=0.92 ---58938.18 ms/batch
Step 00016850 L_out=0.035 Acc=0.94 ---82564.18 ms/batch
Step 00016900 L_out=0.012 Acc=0.91 ---106267.53 ms/batch
Step 00016950 L_out=0.142 Acc=0.76 ---130077.26 ms/batch
Step 00017000 L_out=0.063 Acc=0.94 ---153631.04 ms/batch
Step 00017050 L_out=0.066 Acc=0.90 ---177271.21 ms/batch
Step 00017100 L_out=0.048 Acc=0.89 ---200873.26 ms/batch
Step 00017150 L_out=0.047 Acc=0.91 ---224448.72 ms/batch
Step 00017200 L_out=0.101 Acc=0.87 ---248046.90 ms/batch
Step 00017250 L_out=0.095 Acc=0.71 ---271661.15 ms/batch
Step 00017300 L_out=0.077 Acc=0.87 ---295042.74 ms/batch
Round 2 | epoch=25, train costTime=314.93321204185486, | total_activation_sum=5678668
Round 2 | epoch=26, current m_iou=0.6384970598027366
Round 2 | Best m_IoU is: 0.638, OA is: 0.889 | val costTime=117.38824391365051
Round 2 | ****EPOCH 26****
Step 00017350 L_out=0.054 Acc=0.65 --- 3774.32 ms/batch
Step 00017400 L_out=0.227 Acc=0.91 ---27384.55 ms/batch
Step 00017450 L_out=0.057 Acc=0.88 ---51132.69 ms/batch
Step 00017500 L_out=0.066 Acc=0.78 ---74805.86 ms/batch
Step 00017550 L_out=0.138 Acc=0.86 ---98679.88 ms/batch
Step 00017600 L_out=0.070 Acc=0.65 ---122552.08 ms/batch
Step 00017650 L_out=0.194 Acc=0.65 ---146039.07 ms/batch
Step 00017700 L_out=0.115 Acc=0.90 ---169931.46 ms/batch
Step 00017750 L_out=0.071 Acc=0.85 ---193679.49 ms/batch
Step 00017800 L_out=0.100 Acc=0.69 ---217383.56 ms/batch
Step 00017850 L_out=0.031 Acc=0.88 ---240861.88 ms/batch
Step 00017900 L_out=0.261 Acc=0.74 ---264320.55 ms/batch
Step 00017950 L_out=0.087 Acc=0.88 ---288151.50 ms/batch
Step 00018000 L_out=0.061 Acc=0.90 ---311816.02 ms/batch
Round 2 | epoch=26, train costTime=316.03261733055115, | total_activation_sum=5741416
Round 2 | epoch=27, current m_iou=0.6354717069457645
Round 2 | Best m_IoU is: 0.638, OA is: 0.889 | val costTime=117.51992130279541
Round 2 | ****EPOCH 27****
Step 00018050 L_out=0.097 Acc=0.95 ---19532.18 ms/batch
Step 00018100 L_out=0.089 Acc=0.85 ---43002.85 ms/batch
Step 00018150 L_out=0.085 Acc=0.88 ---66432.98 ms/batch
Step 00018200 L_out=0.136 Acc=0.93 ---90107.59 ms/batch
Step 00018250 L_out=0.026 Acc=0.75 ---113533.79 ms/batch
Step 00018300 L_out=0.101 Acc=0.76 ---137029.41 ms/batch
Step 00018350 L_out=0.046 Acc=0.81 ---160784.74 ms/batch
Step 00018400 L_out=0.109 Acc=0.89 ---184209.55 ms/batch
Step 00018450 L_out=0.078 Acc=0.86 ---207837.73 ms/batch
Step 00018500 L_out=0.033 Acc=0.85 ---231428.77 ms/batch
Step 00018550 L_out=0.164 Acc=0.77 ---255117.72 ms/batch
Step 00018600 L_out=0.151 Acc=0.87 ---278764.65 ms/batch
Step 00018650 L_out=0.066 Acc=0.88 ---302450.64 ms/batch
Round 2 | epoch=27, train costTime=314.6204912662506, | total_activation_sum=5704713
Round 2 | epoch=28, current m_iou=0.6362676615930931
Round 2 | Best m_IoU is: 0.638, OA is: 0.889 | val costTime=116.42047429084778
Round 2 | ****EPOCH 28****
Step 00018700 L_out=0.078 Acc=0.88 ---11274.88 ms/batch
Step 00018750 L_out=0.064 Acc=0.89 ---34847.67 ms/batch
Step 00018800 L_out=0.031 Acc=0.91 ---58545.10 ms/batch
Step 00018850 L_out=0.098 Acc=0.80 ---82058.00 ms/batch
Step 00018900 L_out=0.048 Acc=0.90 ---105671.26 ms/batch
Step 00018950 L_out=0.117 Acc=0.82 ---129407.77 ms/batch
Step 00019000 L_out=0.095 Acc=0.88 ---152869.35 ms/batch
Step 00019050 L_out=0.111 Acc=0.88 ---176428.72 ms/batch
Step 00019100 L_out=0.223 Acc=0.83 ---199959.17 ms/batch
Step 00019150 L_out=0.058 Acc=0.94 ---223677.63 ms/batch
Step 00019200 L_out=0.149 Acc=0.83 ---247151.47 ms/batch
Step 00019250 L_out=0.097 Acc=0.87 ---270851.49 ms/batch
Step 00019300 L_out=0.039 Acc=0.87 ---294563.12 ms/batch
Round 2 | epoch=28, train costTime=315.0898082256317, | total_activation_sum=5650043
Round 2 | epoch=29, current m_iou=0.6366833002911763
Round 2 | Best m_IoU is: 0.638, OA is: 0.889 | val costTime=117.34228777885437
Round 2 | ****EPOCH 29****
Step 00019350 L_out=0.312 Acc=0.83 --- 3345.36 ms/batch
Step 00019400 L_out=0.197 Acc=0.81 ---26941.52 ms/batch
Step 00019450 L_out=0.119 Acc=0.80 ---50535.41 ms/batch
Step 00019500 L_out=0.083 Acc=0.80 ---74152.51 ms/batch
Step 00019550 L_out=0.116 Acc=0.90 ---97770.00 ms/batch
Step 00019600 L_out=0.045 Acc=0.89 ---121389.58 ms/batch
Step 00019650 L_out=0.048 Acc=0.91 ---145039.82 ms/batch
Step 00019700 L_out=0.110 Acc=0.77 ---168730.57 ms/batch
Step 00019750 L_out=0.046 Acc=0.71 ---192263.93 ms/batch
Step 00019800 L_out=0.048 Acc=0.95 ---215792.55 ms/batch
Step 00019850 L_out=0.143 Acc=0.94 ---239360.01 ms/batch
Step 00019900 L_out=0.039 Acc=0.89 ---262915.93 ms/batch
Step 00019950 L_out=0.053 Acc=0.84 ---286492.07 ms/batch
Step 00020000 L_out=0.060 Acc=0.90 ---309969.62 ms/batch
Round 2 | epoch=29, train costTime=314.763623714447, | total_activation_sum=5720006
Round 2 | epoch=30, current m_iou=0.6330311417665958
Round 2 | Best m_IoU is: 0.638, OA is: 0.889 | val costTime=117.10644507408142
Round 2 | ****EPOCH 30****
Round 3 | ****EPOCH 0****
Step 00020050 L_out=0.175 Acc=0.53 ---19119.80 ms/batch
Step 00020100 L_out=0.220 Acc=0.50 ---42774.66 ms/batch
Step 00020150 L_out=0.245 Acc=0.53 ---66468.61 ms/batch
Step 00020200 L_out=0.107 Acc=0.73 ---89982.76 ms/batch
Step 00020250 L_out=0.392 Acc=0.86 ---113840.34 ms/batch
Step 00020300 L_out=0.259 Acc=0.78 ---137665.29 ms/batch
Step 00020350 L_out=0.347 Acc=0.93 ---161812.55 ms/batch
Step 00020400 L_out=0.315 Acc=0.69 ---185383.79 ms/batch
Step 00020450 L_out=0.208 Acc=0.63 ---209185.07 ms/batch
Step 00020500 L_out=0.178 Acc=0.84 ---232813.72 ms/batch
Step 00020550 L_out=0.228 Acc=0.88 ---256352.24 ms/batch
Step 00020600 L_out=0.145 Acc=0.79 ---280011.01 ms/batch
Step 00020650 L_out=0.075 Acc=0.87 ---303427.25 ms/batch
Round 3 | epoch=0, train costTime=316.270316362381, | total_activation_sum=9707708
Round 3 | ****EPOCH 1****
Step 00020700 L_out=0.348 Acc=0.71 ---10839.46 ms/batch
Step 00020750 L_out=0.294 Acc=0.69 ---34484.25 ms/batch
Step 00020800 L_out=0.202 Acc=0.78 ---58193.53 ms/batch
Step 00020850 L_out=0.308 Acc=0.80 ---82126.56 ms/batch
Step 00020900 L_out=0.239 Acc=0.79 ---105790.74 ms/batch
Step 00020950 L_out=0.177 Acc=0.80 ---129596.76 ms/batch
Step 00021000 L_out=0.346 Acc=0.51 ---153128.89 ms/batch
Step 00021050 L_out=0.339 Acc=0.77 ---176781.48 ms/batch
Step 00021100 L_out=0.265 Acc=0.66 ---200277.09 ms/batch
Step 00021150 L_out=0.336 Acc=0.73 ---223642.98 ms/batch
Step 00021200 L_out=0.176 Acc=0.87 ---247201.91 ms/batch
Step 00021250 L_out=0.400 Acc=0.73 ---270818.34 ms/batch
Step 00021300 L_out=0.171 Acc=0.89 ---294499.25 ms/batch
Round 3 | epoch=1, train costTime=315.3327987194061, | total_activation_sum=9995474
Round 3 | ****EPOCH 2****
Step 00021350 L_out=0.232 Acc=0.74 --- 2818.39 ms/batch
Step 00021400 L_out=0.175 Acc=0.82 ---26391.07 ms/batch
Step 00021450 L_out=0.188 Acc=0.82 ---50069.14 ms/batch
Step 00021500 L_out=0.245 Acc=0.86 ---73554.64 ms/batch
Step 00021550 L_out=0.961 Acc=0.85 ---97083.43 ms/batch
Step 00021600 L_out=0.235 Acc=0.72 ---120661.69 ms/batch
Step 00021650 L_out=0.290 Acc=0.89 ---144125.15 ms/batch
Step 00021700 L_out=0.280 Acc=0.82 ---167500.96 ms/batch
Step 00021750 L_out=0.049 Acc=0.87 ---191105.59 ms/batch
Step 00021800 L_out=0.079 Acc=0.72 ---214627.05 ms/batch
Step 00021850 L_out=0.084 Acc=0.88 ---238110.50 ms/batch
Step 00021900 L_out=0.065 Acc=0.64 ---261746.05 ms/batch
Step 00021950 L_out=0.040 Acc=0.75 ---285587.64 ms/batch
Step 00022000 L_out=0.215 Acc=0.79 ---309022.43 ms/batch
Round 3 | epoch=2, train costTime=314.1935787200928, | total_activation_sum=10037328
Round 3 | ****EPOCH 3****
Step 00022050 L_out=0.473 Acc=0.86 ---18329.39 ms/batch
Step 00022100 L_out=0.082 Acc=0.89 ---41943.80 ms/batch
Step 00022150 L_out=0.349 Acc=0.91 ---65780.04 ms/batch
Step 00022200 L_out=0.850 Acc=0.58 ---89447.92 ms/batch
Step 00022250 L_out=0.095 Acc=0.83 ---113015.04 ms/batch
Step 00022300 L_out=0.105 Acc=0.78 ---136666.94 ms/batch
Step 00022350 L_out=0.340 Acc=0.76 ---160449.64 ms/batch
Step 00022400 L_out=0.323 Acc=0.80 ---184075.71 ms/batch
Step 00022450 L_out=0.379 Acc=0.82 ---207591.68 ms/batch
Step 00022500 L_out=0.115 Acc=0.87 ---231298.31 ms/batch
Step 00022550 L_out=0.140 Acc=0.78 ---255000.44 ms/batch
Step 00022600 L_out=0.536 Acc=0.91 ---278801.54 ms/batch
Step 00022650 L_out=0.160 Acc=0.81 ---302300.75 ms/batch
Round 3 | epoch=3, train costTime=315.45164680480957, | total_activation_sum=9843177
Round 3 | ****EPOCH 4****
Step 00022700 L_out=0.126 Acc=0.79 ---10309.67 ms/batch
Step 00022750 L_out=0.385 Acc=0.70 ---34072.39 ms/batch
Step 00022800 L_out=0.675 Acc=0.72 ---57536.25 ms/batch
Step 00022850 L_out=0.145 Acc=0.79 ---80985.14 ms/batch
Step 00022900 L_out=0.552 Acc=0.77 ---104544.83 ms/batch
Step 00022950 L_out=0.371 Acc=0.81 ---128135.51 ms/batch
Step 00023000 L_out=0.147 Acc=0.82 ---151713.86 ms/batch
Step 00023050 L_out=0.362 Acc=0.81 ---175147.22 ms/batch
Step 00023100 L_out=0.414 Acc=0.88 ---198817.15 ms/batch
Step 00023150 L_out=0.152 Acc=0.78 ---222561.41 ms/batch
Step 00023200 L_out=0.195 Acc=0.80 ---246052.01 ms/batch
Step 00023250 L_out=0.449 Acc=0.85 ---269731.42 ms/batch
Step 00023300 L_out=0.146 Acc=0.89 ---293121.12 ms/batch
Round 3 | epoch=4, train costTime=314.3933062553406, | total_activation_sum=9946868
Round 3 | ****EPOCH 5****
Step 00023350 L_out=0.086 Acc=0.87 --- 2323.93 ms/batch
Step 00023400 L_out=0.146 Acc=0.87 ---25811.32 ms/batch
Step 00023450 L_out=0.411 Acc=0.85 ---49477.51 ms/batch
Step 00023500 L_out=0.089 Acc=0.76 ---73047.05 ms/batch
Step 00023550 L_out=0.145 Acc=0.89 ---96618.34 ms/batch
Step 00023600 L_out=0.122 Acc=0.89 ---120114.06 ms/batch
Step 00023650 L_out=0.131 Acc=0.90 ---143819.30 ms/batch
Step 00023700 L_out=0.236 Acc=0.89 ---167394.42 ms/batch
Step 00023750 L_out=0.173 Acc=0.77 ---190742.93 ms/batch
Step 00023800 L_out=0.151 Acc=0.87 ---214201.54 ms/batch
Step 00023850 L_out=0.107 Acc=0.81 ---237828.14 ms/batch
Step 00023900 L_out=0.286 Acc=0.37 ---261746.20 ms/batch
Step 00023950 L_out=0.127 Acc=0.55 ---285485.37 ms/batch
Step 00024000 L_out=0.399 Acc=0.80 ---309026.66 ms/batch
Round 3 | epoch=5, train costTime=314.6559910774231, | total_activation_sum=9957917
Round 3 | ****EPOCH 6****
Step 00024050 L_out=0.094 Acc=0.87 ---17871.32 ms/batch
Step 00024100 L_out=0.292 Acc=0.91 ---41235.68 ms/batch
Step 00024150 L_out=0.404 Acc=0.92 ---64758.36 ms/batch
Step 00024200 L_out=0.378 Acc=0.78 ---88448.62 ms/batch
Step 00024250 L_out=0.163 Acc=0.85 ---111938.83 ms/batch
Step 00024300 L_out=0.460 Acc=0.91 ---135608.12 ms/batch
Step 00024350 L_out=0.264 Acc=0.68 ---159295.37 ms/batch
Step 00024400 L_out=0.152 Acc=0.89 ---182976.47 ms/batch
Step 00024450 L_out=0.267 Acc=0.69 ---206718.89 ms/batch
Step 00024500 L_out=0.269 Acc=0.90 ---230290.88 ms/batch
Step 00024550 L_out=0.161 Acc=0.83 ---253844.78 ms/batch
Step 00024600 L_out=0.199 Acc=0.70 ---277343.22 ms/batch
Step 00024650 L_out=0.214 Acc=0.84 ---301159.25 ms/batch
Round 3 | epoch=6, train costTime=314.7337067127228, | total_activation_sum=9854712
Round 3 | ****EPOCH 7****
Step 00024700 L_out=0.193 Acc=0.85 ---10006.14 ms/batch
Step 00024750 L_out=0.224 Acc=0.92 ---33490.50 ms/batch
Step 00024800 L_out=0.102 Acc=0.94 ---57162.01 ms/batch
Step 00024850 L_out=0.164 Acc=0.84 ---80743.57 ms/batch
Step 00024900 L_out=0.113 Acc=0.85 ---104209.18 ms/batch
Step 00024950 L_out=0.054 Acc=0.80 ---127853.72 ms/batch
Step 00025000 L_out=0.231 Acc=0.81 ---151374.26 ms/batch
Step 00025050 L_out=0.127 Acc=0.76 ---175192.80 ms/batch
Step 00025100 L_out=0.104 Acc=0.86 ---198837.72 ms/batch
Step 00025150 L_out=0.412 Acc=0.82 ---222441.26 ms/batch
Step 00025200 L_out=0.102 Acc=0.86 ---245997.94 ms/batch
Step 00025250 L_out=0.193 Acc=0.88 ---269663.01 ms/batch
Step 00025300 L_out=0.389 Acc=0.55 ---293323.22 ms/batch
Round 3 | epoch=7, train costTime=314.9928517341614, | total_activation_sum=10079474
Round 3 | ****EPOCH 8****
Step 00025350 L_out=0.392 Acc=0.49 --- 1848.47 ms/batch
Step 00025400 L_out=0.231 Acc=0.68 ---25412.38 ms/batch
Step 00025450 L_out=0.092 Acc=0.90 ---49088.65 ms/batch
Step 00025500 L_out=0.040 Acc=0.89 ---72709.78 ms/batch
Step 00025550 L_out=0.093 Acc=0.94 ---96274.80 ms/batch
Step 00025600 L_out=0.101 Acc=0.89 ---119947.16 ms/batch
Step 00025650 L_out=0.213 Acc=0.67 ---143655.86 ms/batch
Step 00025700 L_out=0.198 Acc=0.83 ---167393.14 ms/batch
Step 00025750 L_out=0.066 Acc=0.81 ---190791.03 ms/batch
Step 00025800 L_out=0.258 Acc=0.74 ---214574.79 ms/batch
Step 00025850 L_out=0.137 Acc=0.87 ---237995.46 ms/batch
Step 00025900 L_out=0.282 Acc=0.89 ---261449.63 ms/batch
Step 00025950 L_out=0.071 Acc=0.95 ---284950.71 ms/batch
Step 00026000 L_out=0.183 Acc=0.60 ---308705.74 ms/batch
Round 3 | epoch=8, train costTime=314.87497663497925, | total_activation_sum=10081939
Round 3 | ****EPOCH 9****
Step 00026050 L_out=0.148 Acc=0.90 ---17496.92 ms/batch
Step 00026100 L_out=0.090 Acc=0.90 ---41125.07 ms/batch
Step 00026150 L_out=0.085 Acc=0.75 ---64750.91 ms/batch
Step 00026200 L_out=0.418 Acc=0.78 ---88340.01 ms/batch
Step 00026250 L_out=0.096 Acc=0.79 ---111839.70 ms/batch
Step 00026300 L_out=0.168 Acc=0.69 ---135519.77 ms/batch
Step 00026350 L_out=0.290 Acc=0.90 ---158968.31 ms/batch
Step 00026400 L_out=0.167 Acc=0.86 ---182387.85 ms/batch
Step 00026450 L_out=0.370 Acc=0.90 ---205966.12 ms/batch
Step 00026500 L_out=0.157 Acc=0.88 ---229517.53 ms/batch
Step 00026550 L_out=0.092 Acc=0.91 ---253154.70 ms/batch
Step 00026600 L_out=0.099 Acc=0.88 ---276810.07 ms/batch
Step 00026650 L_out=0.443 Acc=0.72 ---300276.05 ms/batch
Round 3 | epoch=9, train costTime=314.6684124469757, | total_activation_sum=9835805
Round 3 | ****EPOCH 10****
Step 00026700 L_out=0.113 Acc=0.89 --- 9306.12 ms/batch
Step 00026750 L_out=0.465 Acc=0.84 ---32878.51 ms/batch
Step 00026800 L_out=0.190 Acc=0.86 ---56547.46 ms/batch
Step 00026850 L_out=0.547 Acc=0.83 ---80082.96 ms/batch
Step 00026900 L_out=0.225 Acc=0.89 ---103490.04 ms/batch
Step 00026950 L_out=0.421 Acc=0.82 ---127204.96 ms/batch
Step 00027000 L_out=0.112 Acc=0.75 ---150863.81 ms/batch
Step 00027050 L_out=0.470 Acc=0.85 ---174445.32 ms/batch
Step 00027100 L_out=0.305 Acc=0.86 ---197988.01 ms/batch
Step 00027150 L_out=0.199 Acc=0.78 ---221531.44 ms/batch
Step 00027200 L_out=0.178 Acc=0.95 ---245108.63 ms/batch
Step 00027250 L_out=0.078 Acc=0.76 ---268566.64 ms/batch
Step 00027300 L_out=0.141 Acc=0.81 ---292282.72 ms/batch
Round 3 | epoch=10, train costTime=314.44466066360474, | total_activation_sum=9873824
Round 3 | ****EPOCH 11****
Step 00027350 L_out=0.140 Acc=0.83 --- 1394.18 ms/batch
Step 00027400 L_out=0.380 Acc=0.76 ---25076.85 ms/batch
Step 00027450 L_out=0.071 Acc=0.90 ---48564.48 ms/batch
Step 00027500 L_out=0.376 Acc=0.79 ---72389.22 ms/batch
Step 00027550 L_out=0.111 Acc=0.82 ---95966.91 ms/batch
Step 00027600 L_out=0.127 Acc=0.87 ---119719.41 ms/batch
Step 00027650 L_out=0.288 Acc=0.86 ---143137.04 ms/batch
Step 00027700 L_out=0.247 Acc=0.77 ---166746.21 ms/batch
Step 00027750 L_out=0.139 Acc=0.90 ---190330.21 ms/batch
Step 00027800 L_out=0.241 Acc=0.78 ---213844.20 ms/batch
Step 00027850 L_out=0.367 Acc=0.92 ---237440.78 ms/batch
Step 00027900 L_out=0.081 Acc=0.88 ---260902.78 ms/batch
Step 00027950 L_out=0.181 Acc=0.80 ---284362.25 ms/batch
Step 00028000 L_out=0.147 Acc=0.85 ---307696.14 ms/batch
Round 3 | epoch=11, train costTime=314.2868230342865, | total_activation_sum=9979787
Round 3 | ****EPOCH 12****
Step 00028050 L_out=0.166 Acc=0.91 ---16940.94 ms/batch
Step 00028100 L_out=0.092 Acc=0.88 ---40669.21 ms/batch
Step 00028150 L_out=0.149 Acc=0.94 ---64169.74 ms/batch
Step 00028200 L_out=0.105 Acc=0.92 ---87993.35 ms/batch
Step 00028250 L_out=0.185 Acc=0.93 ---111632.10 ms/batch
Step 00028300 L_out=0.047 Acc=0.87 ---135119.29 ms/batch
Step 00028350 L_out=0.106 Acc=0.82 ---159040.98 ms/batch
Step 00028400 L_out=0.142 Acc=0.89 ---182913.77 ms/batch
Step 00028450 L_out=0.309 Acc=0.88 ---206532.52 ms/batch
Step 00028500 L_out=0.111 Acc=0.86 ---230088.92 ms/batch
Step 00028550 L_out=0.424 Acc=0.87 ---253668.45 ms/batch
Step 00028600 L_out=0.161 Acc=0.75 ---277227.80 ms/batch
Step 00028650 L_out=0.054 Acc=0.89 ---300798.03 ms/batch
Round 3 | epoch=12, train costTime=315.4265367984772, | total_activation_sum=9980593
Round 3 | ****EPOCH 13****
Step 00028700 L_out=0.305 Acc=0.88 --- 8968.14 ms/batch
Step 00028750 L_out=0.108 Acc=0.87 ---32524.84 ms/batch
Step 00028800 L_out=0.046 Acc=0.91 ---56100.14 ms/batch
Step 00028850 L_out=0.287 Acc=0.81 ---79532.45 ms/batch
Step 00028900 L_out=0.081 Acc=0.91 ---103113.27 ms/batch
Step 00028950 L_out=0.131 Acc=0.89 ---126683.51 ms/batch
Step 00029000 L_out=0.053 Acc=0.94 ---150601.58 ms/batch
Step 00029050 L_out=0.226 Acc=0.87 ---174114.95 ms/batch
Step 00029100 L_out=0.043 Acc=0.93 ---197863.54 ms/batch
Step 00029150 L_out=0.440 Acc=0.87 ---221485.27 ms/batch
Step 00029200 L_out=0.220 Acc=0.86 ---245236.35 ms/batch
Step 00029250 L_out=0.095 Acc=0.86 ---268402.95 ms/batch
Step 00029300 L_out=0.030 Acc=0.88 ---291949.00 ms/batch
Round 3 | epoch=13, train costTime=314.584632396698, | total_activation_sum=9965692
Round 3 | ****EPOCH 14****
Step 00029350 L_out=0.059 Acc=0.92 ---  918.17 ms/batch
Step 00029400 L_out=0.133 Acc=0.83 ---24461.38 ms/batch
Step 00029450 L_out=0.153 Acc=0.88 ---48119.13 ms/batch
Step 00029500 L_out=0.220 Acc=0.91 ---71898.38 ms/batch
Step 00029550 L_out=0.166 Acc=0.84 ---95449.61 ms/batch
Step 00029600 L_out=0.124 Acc=0.91 ---119108.22 ms/batch
Step 00029650 L_out=0.103 Acc=0.91 ---142780.23 ms/batch
Step 00029700 L_out=0.056 Acc=0.90 ---166245.02 ms/batch
Step 00029750 L_out=0.084 Acc=0.88 ---190010.88 ms/batch
Step 00029800 L_out=0.101 Acc=0.85 ---213528.79 ms/batch
Step 00029850 L_out=0.140 Acc=0.85 ---237108.38 ms/batch
Step 00029900 L_out=0.096 Acc=0.75 ---260807.80 ms/batch
Step 00029950 L_out=0.064 Acc=0.94 ---284508.06 ms/batch
Step 00030000 L_out=0.176 Acc=0.81 ---307916.13 ms/batch
Round 3 | epoch=14, train costTime=315.1235158443451, | total_activation_sum=9933169
Round 3 | ****EPOCH 15****
Step 00030050 L_out=0.077 Acc=0.95 ---16494.62 ms/batch
Step 00030100 L_out=0.191 Acc=0.91 ---39663.90 ms/batch
Step 00030150 L_out=0.140 Acc=0.92 ---63373.60 ms/batch
Step 00030200 L_out=0.297 Acc=0.85 ---86752.74 ms/batch
Step 00030250 L_out=0.165 Acc=0.88 ---110250.91 ms/batch
Step 00030300 L_out=0.157 Acc=0.91 ---133684.26 ms/batch
Step 00030350 L_out=0.271 Acc=0.86 ---157369.60 ms/batch
Step 00030400 L_out=0.032 Acc=0.85 ---180756.07 ms/batch
Step 00030450 L_out=0.276 Acc=0.64 ---204388.97 ms/batch
Step 00030500 L_out=0.117 Acc=0.96 ---228120.18 ms/batch
Step 00030550 L_out=0.155 Acc=0.85 ---251758.43 ms/batch
Step 00030600 L_out=0.110 Acc=0.82 ---275363.05 ms/batch
Step 00030650 L_out=0.238 Acc=0.91 ---299104.25 ms/batch
Round 3 | epoch=15, train costTime=314.19204449653625, | total_activation_sum=9960604
Round 3 | ****EPOCH 16****
Step 00030700 L_out=0.076 Acc=0.86 --- 8439.77 ms/batch
Step 00030750 L_out=0.168 Acc=0.82 ---31991.46 ms/batch
Step 00030800 L_out=0.259 Acc=0.86 ---55376.61 ms/batch
Step 00030850 L_out=0.060 Acc=0.93 ---79286.01 ms/batch
Step 00030900 L_out=0.057 Acc=0.88 ---102864.38 ms/batch
Step 00030950 L_out=0.076 Acc=0.90 ---126412.11 ms/batch
Step 00031000 L_out=0.069 Acc=0.79 ---149919.77 ms/batch
Step 00031050 L_out=0.059 Acc=0.87 ---173569.26 ms/batch
Step 00031100 L_out=0.100 Acc=0.88 ---197203.39 ms/batch
Step 00031150 L_out=0.052 Acc=0.91 ---220786.82 ms/batch
Step 00031200 L_out=0.163 Acc=0.86 ---244565.42 ms/batch
Step 00031250 L_out=0.221 Acc=0.88 ---268207.19 ms/batch
Step 00031300 L_out=0.082 Acc=0.92 ---291787.39 ms/batch
Round 3 | epoch=16, train costTime=314.8896539211273, | total_activation_sum=9891977
Round 3 | ****EPOCH 17****
Step 00031350 L_out=0.256 Acc=0.90 ---  455.86 ms/batch
Step 00031400 L_out=0.208 Acc=0.84 ---23941.87 ms/batch
Step 00031450 L_out=0.293 Acc=0.86 ---47369.34 ms/batch
Step 00031500 L_out=0.112 Acc=0.91 ---71185.15 ms/batch
Step 00031550 L_out=0.109 Acc=0.85 ---94724.10 ms/batch
Step 00031600 L_out=0.092 Acc=0.91 ---118152.52 ms/batch
Step 00031650 L_out=0.036 Acc=0.85 ---141550.55 ms/batch
Step 00031700 L_out=0.033 Acc=0.92 ---165145.54 ms/batch
Step 00031750 L_out=0.113 Acc=0.93 ---188979.38 ms/batch
Step 00031800 L_out=0.132 Acc=0.79 ---212668.94 ms/batch
Step 00031850 L_out=0.258 Acc=0.90 ---236308.38 ms/batch
Step 00031900 L_out=0.251 Acc=0.79 ---260086.76 ms/batch
Step 00031950 L_out=0.187 Acc=0.94 ---283678.36 ms/batch
Step 00032000 L_out=0.065 Acc=0.90 ---307417.27 ms/batch
Round 3 | epoch=17, train costTime=314.91009998321533, | total_activation_sum=9950508
Round 3 | epoch=18, current m_iou=0.6626150890158266
Round 3 | Best m_IoU is: 0.663, OA is: 0.902 | val costTime=116.92326068878174
Round 3 | ****EPOCH 18****
Step 00032050 L_out=0.153 Acc=0.88 ---15980.13 ms/batch
Step 00032100 L_out=0.123 Acc=0.94 ---39413.10 ms/batch
Step 00032150 L_out=0.097 Acc=0.91 ---63064.63 ms/batch
Step 00032200 L_out=0.162 Acc=0.88 ---86595.41 ms/batch
Step 00032250 L_out=0.177 Acc=0.90 ---110296.29 ms/batch
Step 00032300 L_out=0.177 Acc=0.85 ---133834.54 ms/batch
Step 00032350 L_out=0.147 Acc=0.86 ---157356.61 ms/batch
Step 00032400 L_out=0.364 Acc=0.84 ---180881.43 ms/batch
Step 00032450 L_out=0.234 Acc=0.87 ---204447.15 ms/batch
Step 00032500 L_out=0.198 Acc=0.73 ---228090.16 ms/batch
Step 00032550 L_out=0.233 Acc=0.89 ---251529.41 ms/batch
Step 00032600 L_out=0.119 Acc=0.92 ---275009.00 ms/batch
Step 00032650 L_out=0.511 Acc=0.80 ---298499.40 ms/batch
Round 3 | epoch=18, train costTime=314.1535177230835, | total_activation_sum=9985220
Round 3 | epoch=19, current m_iou=0.6632509421691792
Round 3 | Best m_IoU is: 0.663, OA is: 0.906 | val costTime=116.96149444580078
Round 3 | ****EPOCH 19****
Step 00032700 L_out=0.090 Acc=0.88 --- 7942.62 ms/batch
Step 00032750 L_out=0.075 Acc=0.89 ---31717.21 ms/batch
Step 00032800 L_out=0.232 Acc=0.88 ---55227.64 ms/batch
Step 00032850 L_out=0.157 Acc=0.86 ---78682.39 ms/batch
Step 00032900 L_out=0.072 Acc=0.95 ---102291.75 ms/batch
Step 00032950 L_out=0.104 Acc=0.88 ---125894.29 ms/batch
Step 00033000 L_out=0.111 Acc=0.94 ---149549.64 ms/batch
Step 00033050 L_out=0.115 Acc=0.94 ---173232.50 ms/batch
Step 00033100 L_out=0.177 Acc=0.89 ---196693.46 ms/batch
Step 00033150 L_out=0.185 Acc=0.85 ---220227.38 ms/batch
Step 00033200 L_out=0.068 Acc=0.92 ---243936.56 ms/batch
Step 00033250 L_out=0.153 Acc=0.91 ---267187.30 ms/batch
Step 00033300 L_out=0.134 Acc=0.90 ---290835.72 ms/batch
Step 00033350 L_out=0.061 Acc=0.91 ---314594.86 ms/batch
Round 3 | epoch=19, train costTime=314.5950789451599, | total_activation_sum=9941098
Round 3 | epoch=20, current m_iou=0.6673383818958826
Round 3 | Best m_IoU is: 0.667, OA is: 0.911 | val costTime=117.32697129249573
Round 3 | ****EPOCH 20****
Step 00033400 L_out=0.041 Acc=0.90 ---23569.39 ms/batch
Step 00033450 L_out=0.045 Acc=0.93 ---47133.95 ms/batch
Step 00033500 L_out=0.157 Acc=0.86 ---70818.00 ms/batch
Step 00033550 L_out=0.093 Acc=0.90 ---94580.32 ms/batch
Step 00033600 L_out=0.139 Acc=0.90 ---117988.05 ms/batch
Step 00033650 L_out=0.088 Acc=0.89 ---141765.50 ms/batch
Step 00033700 L_out=0.056 Acc=0.91 ---165444.24 ms/batch
Step 00033750 L_out=0.092 Acc=0.86 ---189215.14 ms/batch
Step 00033800 L_out=0.039 Acc=0.95 ---212756.58 ms/batch
Step 00033850 L_out=0.088 Acc=0.92 ---236205.58 ms/batch
Step 00033900 L_out=0.138 Acc=0.93 ---259807.74 ms/batch
Step 00033950 L_out=0.113 Acc=0.92 ---283377.37 ms/batch
Step 00034000 L_out=0.160 Acc=0.94 ---306822.13 ms/batch
Round 3 | epoch=20, train costTime=315.0081527233124, | total_activation_sum=10009052
Round 3 | epoch=21, current m_iou=0.66705484507579
Round 3 | Best m_IoU is: 0.667, OA is: 0.911 | val costTime=116.7426974773407
Round 3 | ****EPOCH 21****
Step 00034050 L_out=0.084 Acc=0.94 ---15531.10 ms/batch
Step 00034100 L_out=0.257 Acc=0.76 ---38917.19 ms/batch
Step 00034150 L_out=0.044 Acc=0.88 ---62546.17 ms/batch
Step 00034200 L_out=0.076 Acc=0.87 ---86139.37 ms/batch
Step 00034250 L_out=0.116 Acc=0.85 ---109665.74 ms/batch
Step 00034300 L_out=0.140 Acc=0.92 ---133329.93 ms/batch
Step 00034350 L_out=0.196 Acc=0.78 ---157012.26 ms/batch
Step 00034400 L_out=0.039 Acc=0.88 ---180878.96 ms/batch
Step 00034450 L_out=0.131 Acc=0.79 ---204526.61 ms/batch
Step 00034500 L_out=0.117 Acc=0.92 ---228170.95 ms/batch
Step 00034550 L_out=0.065 Acc=0.92 ---251741.66 ms/batch
Step 00034600 L_out=0.164 Acc=0.89 ---275077.09 ms/batch
Step 00034650 L_out=0.363 Acc=0.69 ---298688.11 ms/batch
Round 3 | epoch=21, train costTime=314.8068869113922, | total_activation_sum=9953191
Round 3 | epoch=22, current m_iou=0.6634840319567341
Round 3 | Best m_IoU is: 0.667, OA is: 0.911 | val costTime=117.54829716682434
Round 3 | ****EPOCH 22****
Step 00034700 L_out=0.065 Acc=0.80 --- 7476.09 ms/batch
Step 00034750 L_out=0.178 Acc=0.94 ---31371.80 ms/batch
Step 00034800 L_out=0.052 Acc=0.91 ---54888.22 ms/batch
Step 00034850 L_out=0.083 Acc=0.93 ---78602.73 ms/batch
Step 00034900 L_out=0.104 Acc=0.83 ---102001.94 ms/batch
Step 00034950 L_out=0.086 Acc=0.77 ---125423.86 ms/batch
Step 00035000 L_out=0.057 Acc=0.91 ---149012.24 ms/batch
Step 00035050 L_out=0.555 Acc=0.87 ---172632.19 ms/batch
Step 00035100 L_out=0.183 Acc=0.88 ---196103.08 ms/batch
Step 00035150 L_out=0.169 Acc=0.84 ---220082.51 ms/batch
Step 00035200 L_out=0.043 Acc=0.92 ---243786.75 ms/batch
Step 00035250 L_out=0.573 Acc=0.78 ---267250.48 ms/batch
Step 00035300 L_out=0.103 Acc=0.86 ---290654.80 ms/batch
Step 00035350 L_out=0.234 Acc=0.88 ---314387.58 ms/batch
Round 3 | epoch=22, train costTime=314.84700536727905, | total_activation_sum=9974444
Round 3 | epoch=23, current m_iou=0.6707509551058395
Round 3 | Best m_IoU is: 0.671, OA is: 0.913 | val costTime=117.13000774383545
Round 3 | ****EPOCH 23****
Step 00035400 L_out=0.082 Acc=0.91 ---23176.21 ms/batch
Step 00035450 L_out=0.038 Acc=0.85 ---46901.21 ms/batch
Step 00035500 L_out=0.407 Acc=0.81 ---70529.44 ms/batch
Step 00035550 L_out=0.192 Acc=0.89 ---94023.64 ms/batch
Step 00035600 L_out=0.080 Acc=0.94 ---117477.51 ms/batch
Step 00035650 L_out=0.089 Acc=0.82 ---141128.52 ms/batch
Step 00035700 L_out=0.044 Acc=0.93 ---164745.23 ms/batch
Step 00035750 L_out=0.262 Acc=0.90 ---188359.82 ms/batch
Step 00035800 L_out=0.056 Acc=0.91 ---212020.57 ms/batch
Step 00035850 L_out=0.079 Acc=0.95 ---235606.54 ms/batch
Step 00035900 L_out=0.029 Acc=0.86 ---259273.42 ms/batch
Step 00035950 L_out=0.072 Acc=0.91 ---282725.95 ms/batch
Step 00036000 L_out=0.268 Acc=0.94 ---306176.79 ms/batch
Round 3 | epoch=23, train costTime=314.68691539764404, | total_activation_sum=9843118
Round 3 | epoch=24, current m_iou=0.6670109822550595
Round 3 | Best m_IoU is: 0.671, OA is: 0.913 | val costTime=117.44049215316772
Round 3 | ****EPOCH 24****
Step 00036050 L_out=0.171 Acc=0.89 ---15240.48 ms/batch
Step 00036100 L_out=0.050 Acc=0.95 ---38793.72 ms/batch
Step 00036150 L_out=0.051 Acc=0.91 ---62356.33 ms/batch
Step 00036200 L_out=0.026 Acc=0.93 ---85967.85 ms/batch
Step 00036250 L_out=0.074 Acc=0.90 ---109569.93 ms/batch
Step 00036300 L_out=0.086 Acc=0.92 ---133077.56 ms/batch
Step 00036350 L_out=0.182 Acc=0.92 ---156620.66 ms/batch
Step 00036400 L_out=0.072 Acc=0.96 ---180176.58 ms/batch
Step 00036450 L_out=0.054 Acc=0.94 ---203857.99 ms/batch
Step 00036500 L_out=0.378 Acc=0.88 ---227592.97 ms/batch
Step 00036550 L_out=0.072 Acc=0.91 ---251227.27 ms/batch
Step 00036600 L_out=0.311 Acc=0.94 ---274658.50 ms/batch
Step 00036650 L_out=0.073 Acc=0.83 ---298202.80 ms/batch
Round 3 | epoch=24, train costTime=314.5567750930786, | total_activation_sum=9944067
Round 3 | epoch=25, current m_iou=0.6630110673938863
Round 3 | Best m_IoU is: 0.671, OA is: 0.913 | val costTime=116.62928795814514
Round 3 | ****EPOCH 25****
Step 00036700 L_out=0.131 Acc=0.92 --- 7120.88 ms/batch
Step 00036750 L_out=0.258 Acc=0.94 ---30589.35 ms/batch
Step 00036800 L_out=0.258 Acc=0.88 ---54003.30 ms/batch
Step 00036850 L_out=0.045 Acc=0.96 ---77328.77 ms/batch
Step 00036900 L_out=0.077 Acc=0.95 ---101149.82 ms/batch
Step 00036950 L_out=0.813 Acc=0.74 ---124812.98 ms/batch
Step 00037000 L_out=0.101 Acc=0.89 ---148443.24 ms/batch
Step 00037050 L_out=0.181 Acc=0.87 ---172023.04 ms/batch
Step 00037100 L_out=0.059 Acc=0.87 ---195625.65 ms/batch
Step 00037150 L_out=0.064 Acc=0.85 ---219375.03 ms/batch
Step 00037200 L_out=0.178 Acc=0.90 ---242955.37 ms/batch
Step 00037250 L_out=0.092 Acc=0.87 ---266582.23 ms/batch
Step 00037300 L_out=0.053 Acc=0.92 ---290305.49 ms/batch
Step 00037350 L_out=0.027 Acc=0.91 ---313795.77 ms/batch
Round 3 | epoch=25, train costTime=314.74592423439026, | total_activation_sum=9939351
Round 3 | epoch=26, current m_iou=0.6642121837140806
Round 3 | Best m_IoU is: 0.671, OA is: 0.913 | val costTime=117.3202166557312
Round 3 | ****EPOCH 26****
Step 00037400 L_out=0.139 Acc=0.89 ---22583.56 ms/batch
Step 00037450 L_out=0.173 Acc=0.87 ---46220.68 ms/batch
Step 00037500 L_out=0.265 Acc=0.86 ---69685.76 ms/batch
Step 00037550 L_out=0.294 Acc=0.80 ---93131.28 ms/batch
Step 00037600 L_out=0.113 Acc=0.95 ---116643.02 ms/batch
Step 00037650 L_out=0.065 Acc=0.92 ---140490.83 ms/batch
Step 00037700 L_out=0.083 Acc=0.93 ---164095.03 ms/batch
Step 00037750 L_out=0.177 Acc=0.84 ---187705.83 ms/batch
Step 00037800 L_out=0.107 Acc=0.95 ---211610.60 ms/batch
Step 00037850 L_out=0.103 Acc=0.85 ---235241.69 ms/batch
Step 00037900 L_out=0.180 Acc=0.91 ---258704.32 ms/batch
Step 00037950 L_out=0.056 Acc=0.85 ---282393.30 ms/batch
Step 00038000 L_out=0.036 Acc=0.88 ---306037.98 ms/batch
Round 3 | epoch=26, train costTime=315.03645753860474, | total_activation_sum=9931174
Round 3 | epoch=27, current m_iou=0.6629144505738476
Round 3 | Best m_IoU is: 0.671, OA is: 0.913 | val costTime=116.90401554107666
Round 3 | ****EPOCH 27****
Step 00038050 L_out=0.099 Acc=0.73 ---14490.68 ms/batch
Step 00038100 L_out=0.084 Acc=0.89 ---38214.00 ms/batch
Step 00038150 L_out=0.111 Acc=0.95 ---61666.82 ms/batch
Step 00038200 L_out=0.039 Acc=0.85 ---85253.83 ms/batch
Step 00038250 L_out=0.182 Acc=0.91 ---108937.42 ms/batch
Step 00038300 L_out=0.110 Acc=0.89 ---132539.36 ms/batch
Step 00038350 L_out=0.124 Acc=0.86 ---156104.65 ms/batch
Step 00038400 L_out=0.155 Acc=0.89 ---179597.81 ms/batch
Step 00038450 L_out=0.125 Acc=0.83 ---203242.73 ms/batch
Step 00038500 L_out=0.049 Acc=0.92 ---226945.57 ms/batch
Step 00038550 L_out=0.119 Acc=0.92 ---250411.92 ms/batch
Step 00038600 L_out=0.108 Acc=0.89 ---274092.15 ms/batch
Step 00038650 L_out=0.102 Acc=0.93 ---297931.24 ms/batch
Round 3 | epoch=27, train costTime=314.87856101989746, | total_activation_sum=10047944
Round 3 | epoch=28, current m_iou=0.668670301880522
Round 3 | Best m_IoU is: 0.671, OA is: 0.913 | val costTime=116.79256129264832
Round 3 | ****EPOCH 28****
Step 00038700 L_out=0.068 Acc=0.89 --- 6650.79 ms/batch
Step 00038750 L_out=0.106 Acc=0.90 ---30172.58 ms/batch
Step 00038800 L_out=0.085 Acc=0.88 ---53586.84 ms/batch
Step 00038850 L_out=0.022 Acc=0.97 ---77142.31 ms/batch
Step 00038900 L_out=0.067 Acc=0.90 ---100760.72 ms/batch
Step 00038950 L_out=0.036 Acc=0.92 ---124235.46 ms/batch
Step 00039000 L_out=0.069 Acc=0.91 ---147824.60 ms/batch
Step 00039050 L_out=0.067 Acc=0.92 ---171500.43 ms/batch
Step 00039100 L_out=0.065 Acc=0.95 ---194911.72 ms/batch
Step 00039150 L_out=0.031 Acc=0.94 ---218542.93 ms/batch
Step 00039200 L_out=0.011 Acc=0.92 ---242133.72 ms/batch
Step 00039250 L_out=0.093 Acc=0.91 ---265721.66 ms/batch
Step 00039300 L_out=0.051 Acc=0.85 ---289178.11 ms/batch
Step 00039350 L_out=0.091 Acc=0.94 ---312635.01 ms/batch
Round 3 | epoch=28, train costTime=314.03595876693726, | total_activation_sum=9892876
Round 3 | epoch=29, current m_iou=0.6708746758574684
Round 3 | Best m_IoU is: 0.671, OA is: 0.910 | val costTime=117.31183314323425
Round 3 | ****EPOCH 29****
Step 00039400 L_out=0.074 Acc=0.92 ---22345.12 ms/batch
Step 00039450 L_out=0.031 Acc=0.94 ---46167.63 ms/batch
Step 00039500 L_out=0.216 Acc=0.89 ---69599.41 ms/batch
Step 00039550 L_out=0.056 Acc=0.93 ---92959.78 ms/batch
Step 00039600 L_out=0.208 Acc=0.88 ---116547.31 ms/batch
Step 00039650 L_out=0.044 Acc=0.96 ---140100.30 ms/batch
Step 00039700 L_out=0.103 Acc=0.94 ---163716.35 ms/batch
Step 00039750 L_out=0.144 Acc=0.91 ---187290.98 ms/batch
Step 00039800 L_out=0.023 Acc=0.94 ---211148.86 ms/batch
Step 00039850 L_out=0.178 Acc=0.89 ---234580.66 ms/batch
Step 00039900 L_out=0.040 Acc=0.91 ---258056.75 ms/batch
Step 00039950 L_out=0.166 Acc=0.93 ---281623.66 ms/batch
Step 00040000 L_out=0.108 Acc=0.87 ---305431.33 ms/batch
Round 3 | epoch=29, train costTime=314.9009063243866, | total_activation_sum=9889602
Round 3 | epoch=30, current m_iou=0.6720094707348758
Round 3 | Best m_IoU is: 0.672, OA is: 0.913 | val costTime=116.46809148788452
Round 3 | ****EPOCH 30****
Round 4 | ****EPOCH 0****
Step 00040050 L_out=0.221 Acc=0.76 ---14114.48 ms/batch
Step 00040100 L_out=0.327 Acc=0.62 ---37659.52 ms/batch
Step 00040150 L_out=1.496 Acc=0.48 ---61329.81 ms/batch
Step 00040200 L_out=0.561 Acc=0.72 ---85053.95 ms/batch
Step 00040250 L_out=0.363 Acc=0.53 ---108631.00 ms/batch
Step 00040300 L_out=1.284 Acc=0.24 ---132323.36 ms/batch
Step 00040350 L_out=0.458 Acc=0.79 ---156465.47 ms/batch
Step 00040400 L_out=0.432 Acc=0.75 ---180353.47 ms/batch
Step 00040450 L_out=0.559 Acc=0.86 ---203940.98 ms/batch
Step 00040500 L_out=0.313 Acc=0.81 ---227502.18 ms/batch
Step 00040550 L_out=0.105 Acc=0.82 ---251040.89 ms/batch
Step 00040600 L_out=0.360 Acc=0.83 ---274625.78 ms/batch
Step 00040650 L_out=0.326 Acc=0.80 ---298243.89 ms/batch
Round 4 | epoch=0, train costTime=315.52873277664185, | total_activation_sum=13451467
Round 4 | ****EPOCH 1****
Step 00040700 L_out=0.529 Acc=0.82 --- 6175.31 ms/batch
Step 00040750 L_out=0.807 Acc=0.83 ---29845.27 ms/batch
Step 00040800 L_out=0.207 Acc=0.84 ---53382.55 ms/batch
Step 00040850 L_out=0.196 Acc=0.82 ---77084.59 ms/batch
Step 00040900 L_out=0.095 Acc=0.95 ---100769.50 ms/batch
Step 00040950 L_out=0.320 Acc=0.73 ---124163.10 ms/batch
Step 00041000 L_out=0.495 Acc=0.77 ---147964.98 ms/batch
Step 00041050 L_out=0.349 Acc=0.82 ---171479.24 ms/batch
Step 00041100 L_out=0.509 Acc=0.49 ---195109.38 ms/batch
Step 00041150 L_out=0.319 Acc=0.91 ---218707.85 ms/batch
Step 00041200 L_out=0.474 Acc=0.81 ---242219.00 ms/batch
Step 00041250 L_out=0.613 Acc=0.91 ---265666.57 ms/batch
Step 00041300 L_out=0.168 Acc=0.82 ---289089.30 ms/batch
Step 00041350 L_out=0.304 Acc=0.90 ---312733.04 ms/batch
Round 4 | epoch=1, train costTime=314.544677734375, | total_activation_sum=13876697
Round 4 | ****EPOCH 2****
Step 00041400 L_out=0.260 Acc=0.92 ---21767.17 ms/batch
Step 00041450 L_out=0.225 Acc=0.95 ---45169.22 ms/batch
Step 00041500 L_out=0.782 Acc=0.80 ---68902.07 ms/batch
Step 00041550 L_out=0.428 Acc=0.90 ---92177.46 ms/batch
Step 00041600 L_out=0.556 Acc=0.88 ---115759.89 ms/batch
Step 00041650 L_out=0.067 Acc=0.86 ---139324.90 ms/batch
Step 00041700 L_out=0.239 Acc=0.87 ---162836.09 ms/batch
Step 00041750 L_out=0.155 Acc=0.87 ---186178.33 ms/batch
Step 00041800 L_out=0.473 Acc=0.90 ---209770.68 ms/batch
Step 00041850 L_out=0.256 Acc=0.82 ---233264.70 ms/batch
Step 00041900 L_out=0.535 Acc=0.74 ---256932.91 ms/batch
Step 00041950 L_out=0.101 Acc=0.88 ---280333.32 ms/batch
Step 00042000 L_out=0.797 Acc=0.80 ---304054.18 ms/batch
Round 4 | epoch=2, train costTime=313.9677982330322, | total_activation_sum=13727847
Round 4 | ****EPOCH 3****
Step 00042050 L_out=0.417 Acc=0.88 ---13620.97 ms/batch
Step 00042100 L_out=0.220 Acc=0.85 ---37091.24 ms/batch
Step 00042150 L_out=0.451 Acc=0.75 ---60554.39 ms/batch
Step 00042200 L_out=0.163 Acc=0.86 ---84151.76 ms/batch
Step 00042250 L_out=0.100 Acc=0.89 ---107643.97 ms/batch
Step 00042300 L_out=0.181 Acc=0.82 ---131265.43 ms/batch
Step 00042350 L_out=0.086 Acc=0.89 ---154647.40 ms/batch
Step 00042400 L_out=0.520 Acc=0.87 ---178352.83 ms/batch
Step 00042450 L_out=0.127 Acc=0.82 ---201772.37 ms/batch
Step 00042500 L_out=0.130 Acc=0.92 ---225229.32 ms/batch
Step 00042550 L_out=0.334 Acc=0.85 ---248863.51 ms/batch
Step 00042600 L_out=0.552 Acc=0.74 ---272600.04 ms/batch
Step 00042650 L_out=0.240 Acc=0.82 ---296259.37 ms/batch
Round 4 | epoch=3, train costTime=314.25708532333374, | total_activation_sum=13788055
Round 4 | ****EPOCH 4****
Step 00042700 L_out=0.309 Acc=0.83 --- 5635.03 ms/batch
Step 00042750 L_out=0.165 Acc=0.94 ---29226.39 ms/batch
Step 00042800 L_out=0.722 Acc=0.75 ---52854.20 ms/batch
Step 00042850 L_out=0.284 Acc=0.88 ---76513.78 ms/batch
Step 00042900 L_out=0.060 Acc=0.84 ---100011.81 ms/batch
Step 00042950 L_out=0.145 Acc=0.79 ---123529.25 ms/batch
Step 00043000 L_out=0.084 Acc=0.94 ---147238.83 ms/batch
Step 00043050 L_out=0.132 Acc=0.90 ---170883.73 ms/batch
Step 00043100 L_out=0.252 Acc=0.94 ---194290.96 ms/batch
Step 00043150 L_out=0.439 Acc=0.91 ---217823.71 ms/batch
Step 00043200 L_out=0.195 Acc=0.88 ---241391.71 ms/batch
Step 00043250 L_out=0.109 Acc=0.87 ---264898.33 ms/batch
Step 00043300 L_out=0.097 Acc=0.93 ---288550.81 ms/batch
Step 00043350 L_out=0.256 Acc=0.90 ---312194.31 ms/batch
Round 4 | epoch=4, train costTime=314.4813907146454, | total_activation_sum=13852836
Round 4 | ****EPOCH 5****
Step 00043400 L_out=0.153 Acc=0.92 ---21333.27 ms/batch
Step 00043450 L_out=0.284 Acc=0.87 ---45071.25 ms/batch
Step 00043500 L_out=0.087 Acc=0.79 ---68498.86 ms/batch
Step 00043550 L_out=0.332 Acc=0.89 ---92070.28 ms/batch
Step 00043600 L_out=0.423 Acc=0.87 ---115559.95 ms/batch
Step 00043650 L_out=0.556 Acc=0.79 ---139191.72 ms/batch
Step 00043700 L_out=0.195 Acc=0.92 ---162635.37 ms/batch
Step 00043750 L_out=0.206 Acc=0.92 ---186058.39 ms/batch
Step 00043800 L_out=0.206 Acc=0.84 ---209622.75 ms/batch
Step 00043850 L_out=0.577 Acc=0.90 ---233134.67 ms/batch
Step 00043900 L_out=0.783 Acc=0.91 ---256734.71 ms/batch
Step 00043950 L_out=0.159 Acc=0.94 ---280228.47 ms/batch
Step 00044000 L_out=0.128 Acc=0.92 ---303967.42 ms/batch
Round 4 | epoch=5, train costTime=314.4891664981842, | total_activation_sum=13697275
Round 4 | ****EPOCH 6****
Step 00044050 L_out=0.505 Acc=0.73 ---13124.91 ms/batch
Step 00044100 L_out=0.641 Acc=0.69 ---36752.79 ms/batch
Step 00044150 L_out=0.212 Acc=0.93 ---60309.65 ms/batch
Step 00044200 L_out=0.397 Acc=0.86 ---83733.65 ms/batch
Step 00044250 L_out=0.217 Acc=0.92 ---107342.48 ms/batch
Step 00044300 L_out=0.480 Acc=0.78 ---130889.46 ms/batch
Step 00044350 L_out=0.419 Acc=0.79 ---154286.32 ms/batch
Step 00044400 L_out=0.712 Acc=0.83 ---178053.42 ms/batch
Step 00044450 L_out=0.085 Acc=0.87 ---201312.35 ms/batch
Step 00044500 L_out=0.163 Acc=0.90 ---224819.20 ms/batch
Step 00044550 L_out=0.260 Acc=0.88 ---248128.16 ms/batch
Step 00044600 L_out=0.155 Acc=0.86 ---271964.83 ms/batch
Step 00044650 L_out=0.175 Acc=0.94 ---295622.00 ms/batch
Round 4 | epoch=6, train costTime=314.0792384147644, | total_activation_sum=13784239
Round 4 | ****EPOCH 7****
Step 00044700 L_out=0.201 Acc=0.96 --- 5127.78 ms/batch
Step 00044750 L_out=0.143 Acc=0.94 ---28925.37 ms/batch
Step 00044800 L_out=0.567 Acc=0.50 ---52612.94 ms/batch
Step 00044850 L_out=0.112 Acc=0.91 ---76250.90 ms/batch
Step 00044900 L_out=0.157 Acc=0.86 ---99805.20 ms/batch
Step 00044950 L_out=0.152 Acc=0.85 ---123389.92 ms/batch
Step 00045000 L_out=0.479 Acc=0.85 ---146922.47 ms/batch
Step 00045050 L_out=0.041 Acc=0.96 ---170792.52 ms/batch
Step 00045100 L_out=0.150 Acc=0.93 ---194379.73 ms/batch
Step 00045150 L_out=0.949 Acc=0.77 ---217681.52 ms/batch
Step 00045200 L_out=0.426 Acc=0.76 ---241246.76 ms/batch
Step 00045250 L_out=0.152 Acc=0.94 ---264834.37 ms/batch
Step 00045300 L_out=0.171 Acc=0.88 ---288269.75 ms/batch
Step 00045350 L_out=0.512 Acc=0.79 ---311767.63 ms/batch
Round 4 | epoch=7, train costTime=314.57031989097595, | total_activation_sum=13811090
Round 4 | ****EPOCH 8****
Step 00045400 L_out=0.196 Acc=0.90 ---20987.77 ms/batch
Step 00045450 L_out=0.048 Acc=0.94 ---44367.09 ms/batch
Step 00045500 L_out=0.231 Acc=0.90 ---67963.18 ms/batch
Step 00045550 L_out=0.296 Acc=0.93 ---91711.63 ms/batch
Step 00045600 L_out=0.104 Acc=0.94 ---115477.78 ms/batch
Step 00045650 L_out=0.038 Acc=0.94 ---138865.33 ms/batch
Step 00045700 L_out=0.135 Acc=0.94 ---162305.98 ms/batch
Step 00045750 L_out=0.370 Acc=0.90 ---185905.61 ms/batch
Step 00045800 L_out=0.255 Acc=0.84 ---209324.86 ms/batch
Step 00045850 L_out=0.255 Acc=0.88 ---232886.74 ms/batch
Step 00045900 L_out=0.105 Acc=0.90 ---256584.60 ms/batch
Step 00045950 L_out=0.229 Acc=0.91 ---280163.36 ms/batch
Step 00046000 L_out=0.221 Acc=0.91 ---303781.87 ms/batch
Round 4 | epoch=8, train costTime=314.636919260025, | total_activation_sum=13790473
Round 4 | ****EPOCH 9****
Step 00046050 L_out=0.182 Acc=0.93 ---12777.66 ms/batch
Step 00046100 L_out=0.347 Acc=0.82 ---36512.73 ms/batch
Step 00046150 L_out=0.156 Acc=0.93 ---60013.74 ms/batch
Step 00046200 L_out=0.076 Acc=0.92 ---83648.00 ms/batch
Step 00046250 L_out=0.119 Acc=0.90 ---107209.50 ms/batch
Step 00046300 L_out=0.096 Acc=0.95 ---130567.32 ms/batch
Step 00046350 L_out=0.132 Acc=0.90 ---154221.76 ms/batch
Step 00046400 L_out=0.076 Acc=0.96 ---177933.90 ms/batch
Step 00046450 L_out=0.046 Acc=0.93 ---201376.89 ms/batch
Step 00046500 L_out=0.088 Acc=0.96 ---224815.14 ms/batch
Step 00046550 L_out=0.383 Acc=0.89 ---248581.26 ms/batch
Step 00046600 L_out=0.310 Acc=0.88 ---272165.99 ms/batch
Step 00046650 L_out=0.099 Acc=0.86 ---295517.52 ms/batch
Round 4 | epoch=9, train costTime=314.44954347610474, | total_activation_sum=13747860
Round 4 | ****EPOCH 10****
Step 00046700 L_out=0.089 Acc=0.98 --- 4768.44 ms/batch
Step 00046750 L_out=0.241 Acc=0.71 ---28573.39 ms/batch
Step 00046800 L_out=0.226 Acc=0.89 ---51889.49 ms/batch
Step 00046850 L_out=0.067 Acc=0.89 ---75420.81 ms/batch
Step 00046900 L_out=0.115 Acc=0.93 ---98885.98 ms/batch
Step 00046950 L_out=0.268 Acc=0.93 ---122538.33 ms/batch
Step 00047000 L_out=0.189 Acc=0.85 ---145917.60 ms/batch
Step 00047050 L_out=0.173 Acc=0.92 ---169520.26 ms/batch
Step 00047100 L_out=0.263 Acc=0.92 ---193055.54 ms/batch
Step 00047150 L_out=0.143 Acc=0.90 ---216597.10 ms/batch
Step 00047200 L_out=0.181 Acc=0.93 ---240248.20 ms/batch
Step 00047250 L_out=0.136 Acc=0.88 ---263728.97 ms/batch
Step 00047300 L_out=0.224 Acc=0.85 ---287318.09 ms/batch
Step 00047350 L_out=0.036 Acc=0.87 ---311008.99 ms/batch
Round 4 | epoch=10, train costTime=314.22989320755005, | total_activation_sum=13770273
Round 4 | ****EPOCH 11****
Step 00047400 L_out=0.298 Acc=0.74 ---20385.20 ms/batch
Step 00047450 L_out=0.200 Acc=0.90 ---44062.87 ms/batch
Step 00047500 L_out=0.215 Acc=0.91 ---67525.97 ms/batch
Step 00047550 L_out=0.191 Acc=0.94 ---91299.86 ms/batch
Step 00047600 L_out=0.154 Acc=0.93 ---114914.35 ms/batch
Step 00047650 L_out=0.102 Acc=0.90 ---138537.49 ms/batch
Step 00047700 L_out=0.081 Acc=0.88 ---161971.81 ms/batch
Step 00047750 L_out=0.521 Acc=0.95 ---185524.34 ms/batch
Step 00047800 L_out=0.201 Acc=0.92 ---209093.77 ms/batch
Step 00047850 L_out=0.123 Acc=0.85 ---232763.12 ms/batch
Step 00047900 L_out=0.051 Acc=0.96 ---256319.14 ms/batch
Step 00047950 L_out=0.197 Acc=0.90 ---279979.94 ms/batch
Step 00048000 L_out=0.549 Acc=0.77 ---303763.08 ms/batch
Round 4 | epoch=11, train costTime=314.91001772880554, | total_activation_sum=13711521
Round 4 | ****EPOCH 12****
Step 00048050 L_out=0.086 Acc=0.93 ---12262.47 ms/batch
Step 00048100 L_out=0.095 Acc=0.92 ---35831.73 ms/batch
Step 00048150 L_out=0.172 Acc=0.87 ---59556.90 ms/batch
Step 00048200 L_out=0.382 Acc=0.89 ---83284.37 ms/batch
Step 00048250 L_out=0.217 Acc=0.91 ---106880.83 ms/batch
Step 00048300 L_out=0.059 Acc=0.90 ---130403.92 ms/batch
Step 00048350 L_out=0.167 Acc=0.95 ---153964.26 ms/batch
Step 00048400 L_out=0.136 Acc=0.93 ---177438.55 ms/batch
Step 00048450 L_out=0.050 Acc=0.96 ---201132.75 ms/batch
Step 00048500 L_out=0.354 Acc=0.92 ---224668.43 ms/batch
Step 00048550 L_out=1.103 Acc=0.58 ---248188.04 ms/batch
Step 00048600 L_out=0.224 Acc=0.85 ---271788.64 ms/batch
Step 00048650 L_out=0.240 Acc=0.92 ---295490.67 ms/batch
Round 4 | epoch=12, train costTime=315.04216408729553, | total_activation_sum=13884677
Round 4 | ****EPOCH 13****
Step 00048700 L_out=0.267 Acc=0.91 --- 4174.89 ms/batch
Step 00048750 L_out=0.170 Acc=0.92 ---27620.76 ms/batch
Step 00048800 L_out=0.157 Acc=0.92 ---51188.29 ms/batch
Step 00048850 L_out=0.061 Acc=0.88 ---74657.99 ms/batch
Step 00048900 L_out=0.107 Acc=0.89 ---98161.38 ms/batch
Step 00048950 L_out=0.335 Acc=0.90 ---121699.15 ms/batch
Step 00049000 L_out=0.093 Acc=0.93 ---145442.12 ms/batch
Step 00049050 L_out=0.153 Acc=0.94 ---168988.04 ms/batch
Step 00049100 L_out=0.113 Acc=0.81 ---192413.95 ms/batch
Step 00049150 L_out=0.219 Acc=0.89 ---216078.81 ms/batch
Step 00049200 L_out=0.141 Acc=0.95 ---239482.28 ms/batch
Step 00049250 L_out=0.286 Acc=0.92 ---263248.31 ms/batch
Step 00049300 L_out=0.095 Acc=0.93 ---286995.91 ms/batch
Step 00049350 L_out=0.237 Acc=0.93 ---310592.29 ms/batch
Round 4 | epoch=13, train costTime=314.5204620361328, | total_activation_sum=13693962
Round 4 | ****EPOCH 14****
Step 00049400 L_out=0.246 Acc=0.87 ---19818.54 ms/batch
Step 00049450 L_out=0.132 Acc=0.89 ---43453.97 ms/batch
Step 00049500 L_out=0.120 Acc=0.90 ---67094.10 ms/batch
Step 00049550 L_out=0.322 Acc=0.71 ---90488.89 ms/batch
Step 00049600 L_out=0.506 Acc=0.89 ---113925.17 ms/batch
Step 00049650 L_out=0.108 Acc=0.93 ---137671.05 ms/batch
Step 00049700 L_out=0.202 Acc=0.94 ---161088.89 ms/batch
Step 00049750 L_out=0.051 Acc=0.88 ---184464.23 ms/batch
Step 00049800 L_out=0.056 Acc=0.93 ---208026.87 ms/batch
Step 00049850 L_out=0.212 Acc=0.94 ---231333.50 ms/batch
Step 00049900 L_out=0.068 Acc=0.97 ---254826.85 ms/batch
Step 00049950 L_out=0.328 Acc=0.80 ---278173.61 ms/batch
Step 00050000 L_out=0.081 Acc=0.90 ---301712.54 ms/batch
Round 4 | epoch=14, train costTime=313.4356243610382, | total_activation_sum=13877139
Round 4 | ****EPOCH 15****
Step 00050050 L_out=0.086 Acc=0.92 ---11707.52 ms/batch
Step 00050100 L_out=0.053 Acc=0.94 ---35276.50 ms/batch
Step 00050150 L_out=0.091 Acc=0.92 ---58683.84 ms/batch
Step 00050200 L_out=0.178 Acc=0.89 ---82344.67 ms/batch
Step 00050250 L_out=0.293 Acc=0.91 ---105979.48 ms/batch
Step 00050300 L_out=0.238 Acc=0.95 ---129671.87 ms/batch
Step 00050350 L_out=0.043 Acc=0.96 ---153427.06 ms/batch
Step 00050400 L_out=0.060 Acc=0.94 ---176910.57 ms/batch
Step 00050450 L_out=0.326 Acc=0.84 ---200290.27 ms/batch
Step 00050500 L_out=0.290 Acc=0.88 ---223870.06 ms/batch
Step 00050550 L_out=0.109 Acc=0.93 ---247532.96 ms/batch
Step 00050600 L_out=0.189 Acc=0.94 ---270984.06 ms/batch
Step 00050650 L_out=0.107 Acc=0.85 ---294417.43 ms/batch
Round 4 | epoch=15, train costTime=314.1938407421112, | total_activation_sum=13862781
Round 4 | ****EPOCH 16****
Step 00050700 L_out=0.130 Acc=0.90 --- 3799.12 ms/batch
Step 00050750 L_out=0.242 Acc=0.87 ---27621.04 ms/batch
Step 00050800 L_out=0.106 Acc=0.91 ---51304.88 ms/batch
Step 00050850 L_out=0.055 Acc=0.92 ---74773.10 ms/batch
Step 00050900 L_out=0.174 Acc=0.96 ---98336.75 ms/batch
Step 00050950 L_out=0.198 Acc=0.90 ---121420.03 ms/batch
Step 00051000 L_out=0.363 Acc=0.83 ---143506.24 ms/batch
Step 00051050 L_out=0.112 Acc=0.90 ---166846.11 ms/batch
Step 00051100 L_out=0.297 Acc=0.88 ---190272.93 ms/batch
Step 00051150 L_out=0.079 Acc=0.95 ---214049.95 ms/batch
Step 00051200 L_out=0.183 Acc=0.82 ---237791.27 ms/batch
Step 00051250 L_out=0.073 Acc=0.97 ---261289.40 ms/batch
Step 00051300 L_out=0.097 Acc=0.85 ---284978.04 ms/batch
Step 00051350 L_out=0.156 Acc=0.92 ---308567.38 ms/batch
Round 4 | epoch=16, train costTime=312.8973548412323, | total_activation_sum=13583012
Round 4 | ****EPOCH 17****
Step 00051400 L_out=0.079 Acc=0.96 ---19269.03 ms/batch
Step 00051450 L_out=0.178 Acc=0.93 ---42737.00 ms/batch
Step 00051500 L_out=0.048 Acc=0.95 ---66129.96 ms/batch
Step 00051550 L_out=0.090 Acc=0.96 ---89439.38 ms/batch
Step 00051600 L_out=0.626 Acc=0.79 ---113105.84 ms/batch
Step 00051650 L_out=0.117 Acc=0.95 ---136564.75 ms/batch
Step 00051700 L_out=0.138 Acc=0.97 ---160100.72 ms/batch
Step 00051750 L_out=0.301 Acc=0.87 ---183768.66 ms/batch
Step 00051800 L_out=0.057 Acc=0.86 ---207375.33 ms/batch
Step 00051850 L_out=0.329 Acc=0.95 ---231066.08 ms/batch
Step 00051900 L_out=0.105 Acc=0.89 ---254638.13 ms/batch
Step 00051950 L_out=0.079 Acc=0.91 ---278337.29 ms/batch
Step 00052000 L_out=0.124 Acc=0.94 ---301812.20 ms/batch
Round 4 | epoch=17, train costTime=314.08602261543274, | total_activation_sum=13920049
Round 4 | epoch=18, current m_iou=0.6688865566917439
Round 4 | Best m_IoU is: 0.669, OA is: 0.911 | val costTime=116.74468994140625
Round 4 | ****EPOCH 18****
Step 00052050 L_out=0.198 Acc=0.85 ---11203.67 ms/batch
Step 00052100 L_out=0.142 Acc=0.87 ---34715.92 ms/batch
Step 00052150 L_out=0.247 Acc=0.94 ---58332.05 ms/batch
Step 00052200 L_out=0.095 Acc=0.96 ---81949.82 ms/batch
Step 00052250 L_out=0.190 Acc=0.93 ---105430.12 ms/batch
Step 00052300 L_out=0.117 Acc=0.93 ---129073.20 ms/batch
Step 00052350 L_out=0.302 Acc=0.92 ---152668.27 ms/batch
Step 00052400 L_out=0.158 Acc=0.90 ---176273.98 ms/batch
Step 00052450 L_out=0.071 Acc=0.97 ---199967.09 ms/batch
Step 00052500 L_out=0.197 Acc=0.89 ---223569.45 ms/batch
Step 00052550 L_out=0.132 Acc=0.85 ---247107.35 ms/batch
Step 00052600 L_out=0.229 Acc=0.92 ---270547.09 ms/batch
Step 00052650 L_out=0.154 Acc=0.85 ---294030.61 ms/batch
Round 4 | epoch=18, train costTime=314.2319178581238, | total_activation_sum=13782348
Round 4 | epoch=19, current m_iou=0.6865123892303221
Round 4 | Best m_IoU is: 0.687, OA is: 0.920 | val costTime=116.66640424728394
Round 4 | ****EPOCH 19****
Step 00052700 L_out=0.066 Acc=0.95 --- 3333.55 ms/batch
Step 00052750 L_out=0.055 Acc=0.94 ---26795.62 ms/batch
Step 00052800 L_out=0.236 Acc=0.89 ---50156.17 ms/batch
Step 00052850 L_out=0.037 Acc=0.96 ---73707.69 ms/batch
Step 00052900 L_out=0.315 Acc=0.94 ---97153.20 ms/batch
Step 00052950 L_out=0.095 Acc=0.92 ---120611.44 ms/batch
Step 00053000 L_out=0.210 Acc=0.93 ---144180.59 ms/batch
Step 00053050 L_out=0.076 Acc=0.96 ---167955.33 ms/batch
Step 00053100 L_out=0.204 Acc=0.92 ---191212.68 ms/batch
Step 00053150 L_out=0.065 Acc=0.91 ---214917.39 ms/batch
Step 00053200 L_out=0.071 Acc=0.93 ---238519.90 ms/batch
Step 00053250 L_out=0.210 Acc=0.91 ---262260.23 ms/batch
Step 00053300 L_out=0.061 Acc=0.89 ---285896.62 ms/batch
Step 00053350 L_out=0.211 Acc=0.89 ---309504.85 ms/batch
Round 4 | epoch=19, train costTime=314.14276027679443, | total_activation_sum=13657357
Round 4 | epoch=20, current m_iou=0.682392608271125
Round 4 | Best m_IoU is: 0.687, OA is: 0.920 | val costTime=117.0557816028595
Round 4 | ****EPOCH 20****
Step 00053400 L_out=0.141 Acc=0.94 ---18713.77 ms/batch
Step 00053450 L_out=0.122 Acc=0.93 ---42033.17 ms/batch
Step 00053500 L_out=0.254 Acc=0.93 ---65842.29 ms/batch
Step 00053550 L_out=0.093 Acc=0.96 ---89570.88 ms/batch
Step 00053600 L_out=0.073 Acc=0.92 ---113295.84 ms/batch
Step 00053650 L_out=0.485 Acc=0.92 ---136842.29 ms/batch
Step 00053700 L_out=0.048 Acc=0.95 ---160449.73 ms/batch
Step 00053750 L_out=0.105 Acc=0.94 ---184050.33 ms/batch
Step 00053800 L_out=0.368 Acc=0.93 ---207720.00 ms/batch
Step 00053850 L_out=0.249 Acc=0.88 ---231351.58 ms/batch
Step 00053900 L_out=0.200 Acc=0.87 ---255172.56 ms/batch
Step 00053950 L_out=0.455 Acc=0.86 ---279035.98 ms/batch
Step 00054000 L_out=0.210 Acc=0.96 ---302625.29 ms/batch
Round 4 | epoch=20, train costTime=315.4224865436554, | total_activation_sum=13908128
Round 4 | epoch=21, current m_iou=0.6741356407688356
Round 4 | Best m_IoU is: 0.687, OA is: 0.920 | val costTime=116.57880663871765
Round 4 | ****EPOCH 21****
Step 00054050 L_out=0.336 Acc=0.92 ---11068.84 ms/batch
Step 00054100 L_out=0.100 Acc=0.90 ---34825.11 ms/batch
Step 00054150 L_out=0.589 Acc=0.86 ---58564.11 ms/batch
Step 00054200 L_out=0.082 Acc=0.95 ---82239.32 ms/batch
Step 00054250 L_out=0.057 Acc=0.95 ---105887.15 ms/batch
Step 00054300 L_out=0.064 Acc=0.93 ---129528.64 ms/batch
Step 00054350 L_out=0.189 Acc=0.92 ---153206.84 ms/batch
Step 00054400 L_out=0.079 Acc=0.96 ---176613.84 ms/batch
Step 00054450 L_out=0.087 Acc=0.95 ---200059.39 ms/batch
Step 00054500 L_out=0.316 Acc=0.86 ---223561.59 ms/batch
Step 00054550 L_out=0.092 Acc=0.97 ---247126.98 ms/batch
Step 00054600 L_out=0.102 Acc=0.92 ---270928.33 ms/batch
Step 00054650 L_out=0.098 Acc=0.87 ---294553.60 ms/batch
Round 4 | epoch=21, train costTime=315.2484953403473, | total_activation_sum=13507355
Round 4 | epoch=22, current m_iou=0.6860768496862638
Round 4 | Best m_IoU is: 0.687, OA is: 0.920 | val costTime=116.71661520004272
Round 4 | ****EPOCH 22****
Step 00054700 L_out=0.202 Acc=0.87 --- 2788.53 ms/batch
Step 00054750 L_out=0.044 Acc=0.91 ---26382.69 ms/batch
Step 00054800 L_out=0.184 Acc=0.91 ---49955.65 ms/batch
Step 00054850 L_out=0.127 Acc=0.94 ---73514.11 ms/batch
Step 00054900 L_out=0.333 Acc=0.90 ---96978.77 ms/batch
Step 00054950 L_out=0.063 Acc=0.96 ---120539.03 ms/batch
Step 00055000 L_out=0.131 Acc=0.95 ---144218.34 ms/batch
Step 00055050 L_out=0.312 Acc=0.94 ---167840.16 ms/batch
Step 00055100 L_out=0.100 Acc=0.90 ---191246.40 ms/batch
Step 00055150 L_out=0.128 Acc=0.87 ---215060.99 ms/batch
Step 00055200 L_out=0.042 Acc=0.92 ---238805.32 ms/batch
Step 00055250 L_out=0.069 Acc=0.94 ---262328.89 ms/batch
Step 00055300 L_out=0.098 Acc=0.95 ---285864.73 ms/batch
Step 00055350 L_out=0.053 Acc=0.94 ---309521.39 ms/batch
Round 4 | epoch=22, train costTime=314.6582269668579, | total_activation_sum=13923883
Round 4 | epoch=23, current m_iou=0.6834138488770273
Round 4 | Best m_IoU is: 0.687, OA is: 0.920 | val costTime=116.80728840827942
Round 4 | ****EPOCH 23****
Step 00055400 L_out=0.049 Acc=0.93 ---18476.73 ms/batch
Step 00055450 L_out=0.023 Acc=0.98 ---42328.12 ms/batch
Step 00055500 L_out=0.139 Acc=0.92 ---66104.21 ms/batch
Step 00055550 L_out=0.038 Acc=0.94 ---89664.10 ms/batch
Step 00055600 L_out=0.163 Acc=0.97 ---113253.91 ms/batch
Step 00055650 L_out=0.086 Acc=0.93 ---136978.90 ms/batch
Step 00055700 L_out=0.116 Acc=0.95 ---160747.24 ms/batch
Step 00055750 L_out=0.070 Acc=0.94 ---184282.92 ms/batch
Step 00055800 L_out=0.117 Acc=0.91 ---208067.27 ms/batch
Step 00055850 L_out=0.063 Acc=0.91 ---231850.04 ms/batch
Step 00055900 L_out=0.307 Acc=0.80 ---255264.54 ms/batch
Step 00055950 L_out=0.205 Acc=0.93 ---278685.98 ms/batch
Step 00056000 L_out=0.152 Acc=0.88 ---302363.26 ms/batch
Round 4 | epoch=23, train costTime=315.75031042099, | total_activation_sum=13674370
Round 4 | epoch=24, current m_iou=0.6798139240493744
Round 4 | Best m_IoU is: 0.687, OA is: 0.920 | val costTime=115.93286681175232
Round 4 | ****EPOCH 24****
Step 00056050 L_out=0.172 Acc=0.95 ---10264.89 ms/batch
Step 00056100 L_out=0.139 Acc=0.92 ---33571.93 ms/batch
Step 00056150 L_out=0.054 Acc=0.94 ---57026.73 ms/batch
Step 00056200 L_out=0.087 Acc=0.93 ---80460.62 ms/batch
Step 00056250 L_out=0.242 Acc=0.90 ---103934.56 ms/batch
Step 00056300 L_out=0.120 Acc=0.95 ---127235.26 ms/batch
Step 00056350 L_out=0.083 Acc=0.95 ---150822.36 ms/batch
Step 00056400 L_out=0.116 Acc=0.96 ---174526.92 ms/batch
Step 00056450 L_out=0.070 Acc=0.84 ---198259.58 ms/batch
Step 00056500 L_out=0.071 Acc=0.97 ---221824.09 ms/batch
Step 00056550 L_out=0.760 Acc=0.85 ---245361.69 ms/batch
Step 00056600 L_out=0.211 Acc=0.90 ---268844.74 ms/batch
Step 00056650 L_out=0.144 Acc=0.93 ---292352.04 ms/batch
Round 4 | epoch=24, train costTime=313.7947447299957, | total_activation_sum=13883482
Round 4 | epoch=25, current m_iou=0.6785422759492551
Round 4 | Best m_IoU is: 0.687, OA is: 0.920 | val costTime=116.63449597358704
Round 4 | ****EPOCH 25****
Step 00056700 L_out=0.076 Acc=0.89 --- 2305.74 ms/batch
Step 00056750 L_out=0.996 Acc=0.40 ---25825.03 ms/batch
Step 00056800 L_out=0.030 Acc=0.95 ---49595.35 ms/batch
Step 00056850 L_out=0.410 Acc=0.91 ---73144.34 ms/batch
Step 00056900 L_out=0.049 Acc=0.92 ---96630.11 ms/batch
Step 00056950 L_out=0.029 Acc=0.91 ---120443.70 ms/batch
Step 00057000 L_out=0.096 Acc=0.96 ---143963.66 ms/batch
Step 00057050 L_out=0.040 Acc=0.96 ---168068.85 ms/batch
Step 00057100 L_out=0.088 Acc=0.97 ---191668.90 ms/batch
Step 00057150 L_out=0.125 Acc=0.93 ---215223.56 ms/batch
Step 00057200 L_out=0.345 Acc=0.91 ---238992.86 ms/batch
Step 00057250 L_out=0.100 Acc=0.91 ---262505.92 ms/batch
Step 00057300 L_out=0.175 Acc=0.92 ---286002.30 ms/batch
Step 00057350 L_out=0.066 Acc=0.96 ---309349.21 ms/batch
Round 4 | epoch=25, train costTime=315.00644183158875, | total_activation_sum=13928132
Round 4 | epoch=26, current m_iou=0.6799281158399035
Round 4 | Best m_IoU is: 0.687, OA is: 0.920 | val costTime=117.24037313461304
Round 4 | ****EPOCH 26****
Step 00057400 L_out=0.053 Acc=0.97 ---17976.30 ms/batch
Step 00057450 L_out=0.103 Acc=0.94 ---41432.28 ms/batch
Step 00057500 L_out=0.203 Acc=0.93 ---65065.28 ms/batch
Step 00057550 L_out=0.030 Acc=0.94 ---88835.67 ms/batch
Step 00057600 L_out=0.063 Acc=0.98 ---112373.82 ms/batch
Step 00057650 L_out=0.215 Acc=0.94 ---135982.26 ms/batch
Step 00057700 L_out=0.112 Acc=0.92 ---159617.72 ms/batch
Step 00057750 L_out=0.474 Acc=0.84 ---182835.24 ms/batch
Step 00057800 L_out=0.353 Acc=0.91 ---206363.76 ms/batch
Step 00057850 L_out=0.166 Acc=0.95 ---229898.33 ms/batch
Step 00057900 L_out=0.054 Acc=0.96 ---253657.61 ms/batch
Step 00057950 L_out=0.051 Acc=0.95 ---277413.50 ms/batch
Step 00058000 L_out=0.324 Acc=0.89 ---301183.38 ms/batch
Round 4 | epoch=26, train costTime=314.83101749420166, | total_activation_sum=13806733
Round 4 | epoch=27, current m_iou=0.6805944007799323
Round 4 | Best m_IoU is: 0.687, OA is: 0.920 | val costTime=115.97383975982666
Round 4 | ****EPOCH 27****
Step 00058050 L_out=0.531 Acc=0.88 --- 9923.30 ms/batch
Step 00058100 L_out=0.064 Acc=0.95 ---33696.23 ms/batch
Step 00058150 L_out=0.101 Acc=0.95 ---57117.79 ms/batch
Step 00058200 L_out=0.063 Acc=0.91 ---80713.65 ms/batch
Step 00058250 L_out=0.139 Acc=0.94 ---104363.06 ms/batch
Step 00058300 L_out=0.108 Acc=0.93 ---127869.94 ms/batch
Step 00058350 L_out=0.152 Acc=0.93 ---151426.91 ms/batch
Step 00058400 L_out=0.064 Acc=0.97 ---174988.44 ms/batch
Step 00058450 L_out=0.107 Acc=0.94 ---198347.81 ms/batch
Step 00058500 L_out=0.191 Acc=0.91 ---222098.57 ms/batch
Step 00058550 L_out=0.025 Acc=0.93 ---245595.57 ms/batch
Step 00058600 L_out=0.219 Acc=0.91 ---269129.56 ms/batch
Step 00058650 L_out=0.051 Acc=0.94 ---292641.75 ms/batch
Round 4 | epoch=27, train costTime=314.1991808414459, | total_activation_sum=13778132
Round 4 | epoch=28, current m_iou=0.6815527883054739
Round 4 | Best m_IoU is: 0.687, OA is: 0.920 | val costTime=115.87000703811646
Round 4 | ****EPOCH 28****
Step 00058700 L_out=0.060 Acc=0.95 --- 1902.75 ms/batch
Step 00058750 L_out=0.046 Acc=0.97 ---25492.99 ms/batch
Step 00058800 L_out=0.093 Acc=0.96 ---48980.18 ms/batch
Step 00058850 L_out=0.071 Acc=0.95 ---72652.58 ms/batch
Step 00058900 L_out=0.082 Acc=0.98 ---96010.12 ms/batch
Step 00058950 L_out=0.081 Acc=0.91 ---119671.51 ms/batch
Step 00059000 L_out=0.082 Acc=0.92 ---143026.61 ms/batch
Step 00059050 L_out=0.128 Acc=0.93 ---166816.01 ms/batch
Step 00059100 L_out=0.123 Acc=0.93 ---190561.59 ms/batch
Step 00059150 L_out=0.095 Acc=0.93 ---214143.25 ms/batch
Step 00059200 L_out=0.056 Acc=0.93 ---237910.78 ms/batch
Step 00059250 L_out=0.220 Acc=0.86 ---261627.28 ms/batch
Step 00059300 L_out=0.184 Acc=0.88 ---285532.74 ms/batch
Step 00059350 L_out=0.219 Acc=0.90 ---308923.71 ms/batch
Round 4 | epoch=28, train costTime=315.01906967163086, | total_activation_sum=13696909
Round 4 | epoch=29, current m_iou=0.6846111698485827
Round 4 | Best m_IoU is: 0.687, OA is: 0.920 | val costTime=116.44368934631348
Round 4 | ****EPOCH 29****
Step 00059400 L_out=0.165 Acc=0.91 ---17337.04 ms/batch
Step 00059450 L_out=0.205 Acc=0.92 ---40813.61 ms/batch
Step 00059500 L_out=0.160 Acc=0.90 ---64436.59 ms/batch
Step 00059550 L_out=0.196 Acc=0.89 ---88027.34 ms/batch
Step 00059600 L_out=0.040 Acc=0.95 ---111764.22 ms/batch
Step 00059650 L_out=0.081 Acc=0.93 ---135290.40 ms/batch
Step 00059700 L_out=0.199 Acc=0.89 ---158710.71 ms/batch
Step 00059750 L_out=0.067 Acc=0.92 ---182251.65 ms/batch
Step 00059800 L_out=0.133 Acc=0.97 ---205674.74 ms/batch
Step 00059850 L_out=0.045 Acc=0.96 ---229348.18 ms/batch
Step 00059900 L_out=0.103 Acc=0.92 ---252860.48 ms/batch
Step 00059950 L_out=0.394 Acc=0.90 ---276421.21 ms/batch
Step 00060000 L_out=0.203 Acc=0.92 ---300085.54 ms/batch
Round 4 | epoch=29, train costTime=314.25579023361206, | total_activation_sum=13741113
Round 4 | epoch=30, current m_iou=0.6873253675122455
Round 4 | Best m_IoU is: 0.687, OA is: 0.919 | val costTime=116.45024371147156
Round 4 | ****EPOCH 30****
Round 5 | ****EPOCH 0****
Step 00060050 L_out=0.327 Acc=0.77 --- 9515.17 ms/batch
Step 00060100 L_out=1.319 Acc=0.36 ---33481.12 ms/batch
Step 00060150 L_out=0.507 Acc=0.57 ---57009.48 ms/batch
Step 00060200 L_out=0.561 Acc=0.80 ---80654.08 ms/batch
Step 00060250 L_out=0.752 Acc=0.75 ---104243.59 ms/batch
Step 00060300 L_out=0.226 Acc=0.81 ---127836.85 ms/batch
Step 00060350 L_out=1.044 Acc=0.64 ---151663.59 ms/batch
Step 00060400 L_out=0.336 Acc=0.79 ---175372.66 ms/batch
Step 00060450 L_out=0.513 Acc=0.90 ---198773.87 ms/batch
Step 00060500 L_out=0.339 Acc=0.92 ---222550.96 ms/batch
Step 00060550 L_out=0.216 Acc=0.61 ---245985.46 ms/batch
Step 00060600 L_out=0.460 Acc=0.92 ---269426.27 ms/batch
Step 00060650 L_out=0.346 Acc=0.71 ---293045.80 ms/batch
Round 5 | epoch=0, train costTime=315.26818895339966, | total_activation_sum=17170722
Round 5 | ****EPOCH 1****
Step 00060700 L_out=0.601 Acc=0.79 --- 1413.15 ms/batch
Step 00060750 L_out=0.655 Acc=0.71 ---25064.96 ms/batch
Step 00060800 L_out=0.232 Acc=0.88 ---48595.52 ms/batch
Step 00060850 L_out=0.378 Acc=0.94 ---72171.68 ms/batch
Step 00060900 L_out=0.174 Acc=0.90 ---95596.20 ms/batch
Step 00060950 L_out=0.342 Acc=0.93 ---119403.83 ms/batch
Step 00061000 L_out=0.861 Acc=0.73 ---142750.81 ms/batch
Step 00061050 L_out=0.413 Acc=0.79 ---166312.50 ms/batch
Step 00061100 L_out=0.201 Acc=0.86 ---189876.70 ms/batch
Step 00061150 L_out=0.315 Acc=0.93 ---213302.99 ms/batch
Step 00061200 L_out=0.522 Acc=0.91 ---236885.49 ms/batch
Step 00061250 L_out=0.160 Acc=0.98 ---260273.25 ms/batch
Step 00061300 L_out=0.272 Acc=0.79 ---283790.99 ms/batch
Step 00061350 L_out=0.811 Acc=0.79 ---307290.98 ms/batch
Round 5 | epoch=1, train costTime=313.8886032104492, | total_activation_sum=17611350
Round 5 | ****EPOCH 2****
Step 00061400 L_out=0.157 Acc=0.85 ---16790.03 ms/batch
Step 00061450 L_out=0.285 Acc=0.89 ---40201.70 ms/batch
Step 00061500 L_out=0.255 Acc=0.83 ---63796.04 ms/batch
Step 00061550 L_out=0.270 Acc=0.90 ---87297.62 ms/batch
Step 00061600 L_out=0.099 Acc=0.92 ---110941.62 ms/batch
Step 00061650 L_out=0.193 Acc=0.78 ---134401.78 ms/batch
Step 00061700 L_out=0.326 Acc=0.92 ---157946.33 ms/batch
Step 00061750 L_out=0.337 Acc=0.91 ---181433.59 ms/batch
Step 00061800 L_out=0.293 Acc=0.84 ---205103.24 ms/batch
Step 00061850 L_out=0.315 Acc=0.92 ---228592.07 ms/batch
Step 00061900 L_out=0.156 Acc=0.90 ---252255.19 ms/batch
Step 00061950 L_out=0.174 Acc=0.93 ---276095.85 ms/batch
Step 00062000 L_out=0.521 Acc=0.93 ---299744.16 ms/batch
Round 5 | epoch=2, train costTime=314.4126012325287, | total_activation_sum=17645833
Round 5 | ****EPOCH 3****
Step 00062050 L_out=0.203 Acc=0.94 --- 8970.00 ms/batch
Step 00062100 L_out=0.298 Acc=0.89 ---32386.23 ms/batch
Step 00062150 L_out=0.198 Acc=0.94 ---55801.36 ms/batch
Step 00062200 L_out=0.232 Acc=0.90 ---79306.03 ms/batch
Step 00062250 L_out=0.071 Acc=0.94 ---103089.22 ms/batch
Step 00062300 L_out=0.209 Acc=0.93 ---126744.84 ms/batch
Step 00062350 L_out=0.382 Acc=0.87 ---150215.84 ms/batch
Step 00062400 L_out=0.082 Acc=0.97 ---174078.18 ms/batch
Step 00062450 L_out=0.298 Acc=0.93 ---197810.64 ms/batch
Step 00062500 L_out=0.256 Acc=0.88 ---221300.96 ms/batch
Step 00062550 L_out=0.331 Acc=0.88 ---244884.19 ms/batch
Step 00062600 L_out=0.521 Acc=0.86 ---268726.70 ms/batch
Step 00062650 L_out=0.208 Acc=0.91 ---292339.84 ms/batch
Round 5 | epoch=3, train costTime=314.96150612831116, | total_activation_sum=17780964
Round 5 | ****EPOCH 4****
Step 00062700 L_out=0.216 Acc=0.92 ---  916.45 ms/batch
Step 00062750 L_out=0.156 Acc=0.92 ---24397.50 ms/batch
Step 00062800 L_out=0.088 Acc=0.95 ---47890.34 ms/batch
Step 00062850 L_out=0.383 Acc=0.86 ---71582.23 ms/batch
Step 00062900 L_out=0.133 Acc=0.82 ---95221.61 ms/batch
Step 00062950 L_out=0.272 Acc=0.84 ---118723.33 ms/batch
Step 00063000 L_out=0.316 Acc=0.96 ---142386.91 ms/batch
Step 00063050 L_out=0.294 Acc=0.79 ---166024.33 ms/batch
Step 00063100 L_out=0.250 Acc=0.88 ---189501.50 ms/batch
Step 00063150 L_out=0.409 Acc=0.94 ---212896.63 ms/batch
Step 00063200 L_out=0.336 Acc=0.80 ---236367.01 ms/batch
Step 00063250 L_out=0.236 Acc=0.95 ---259924.24 ms/batch
Step 00063300 L_out=0.583 Acc=0.91 ---283337.23 ms/batch
Step 00063350 L_out=0.404 Acc=0.79 ---306784.14 ms/batch
Round 5 | epoch=4, train costTime=313.90852427482605, | total_activation_sum=17537897
Round 5 | ****EPOCH 5****
Step 00063400 L_out=0.203 Acc=0.90 ---16560.48 ms/batch
Step 00063450 L_out=0.176 Acc=0.80 ---40033.69 ms/batch
Step 00063500 L_out=0.147 Acc=0.90 ---63685.00 ms/batch
Step 00063550 L_out=0.416 Acc=0.91 ---87017.71 ms/batch
Step 00063600 L_out=0.502 Acc=0.80 ---110652.23 ms/batch
Step 00063650 L_out=0.131 Acc=0.92 ---134380.71 ms/batch
Step 00063700 L_out=0.044 Acc=0.96 ---157932.61 ms/batch
Step 00063750 L_out=0.306 Acc=0.91 ---181377.81 ms/batch
Step 00063800 L_out=0.134 Acc=0.85 ---204973.80 ms/batch
Step 00063850 L_out=0.083 Acc=0.91 ---228795.63 ms/batch
Step 00063900 L_out=0.150 Acc=0.84 ---252259.06 ms/batch
Step 00063950 L_out=0.110 Acc=0.94 ---275727.40 ms/batch
Step 00064000 L_out=0.127 Acc=0.95 ---299470.36 ms/batch
Round 5 | epoch=5, train costTime=314.59757566452026, | total_activation_sum=17436907
Round 5 | ****EPOCH 6****
Step 00064050 L_out=0.409 Acc=0.87 --- 8448.31 ms/batch
Step 00064100 L_out=0.208 Acc=0.96 ---32171.97 ms/batch
Step 00064150 L_out=0.374 Acc=0.82 ---55743.48 ms/batch
Step 00064200 L_out=0.109 Acc=0.94 ---79284.05 ms/batch
Step 00064250 L_out=0.120 Acc=0.93 ---102840.62 ms/batch
Step 00064300 L_out=0.152 Acc=0.93 ---126362.45 ms/batch
Step 00064350 L_out=0.325 Acc=0.87 ---149956.21 ms/batch
Step 00064400 L_out=0.171 Acc=0.90 ---173494.92 ms/batch
Step 00064450 L_out=0.176 Acc=0.94 ---197005.34 ms/batch
Step 00064500 L_out=0.094 Acc=0.95 ---220531.82 ms/batch
Step 00064550 L_out=0.195 Acc=0.93 ---244075.65 ms/batch
Step 00064600 L_out=0.410 Acc=0.88 ---267615.46 ms/batch
Step 00064650 L_out=0.272 Acc=0.87 ---290997.82 ms/batch
Round 5 | epoch=6, train costTime=314.1250193119049, | total_activation_sum=17687725
Round 5 | ****EPOCH 7****
Step 00064700 L_out=0.077 Acc=0.95 ---  467.10 ms/batch
Step 00064750 L_out=0.301 Acc=0.85 ---24061.17 ms/batch
Step 00064800 L_out=0.115 Acc=0.92 ---47402.03 ms/batch
Step 00064850 L_out=0.090 Acc=0.98 ---70973.17 ms/batch
Step 00064900 L_out=0.169 Acc=0.93 ---94645.28 ms/batch
Step 00064950 L_out=0.279 Acc=0.95 ---118316.67 ms/batch
Step 00065000 L_out=0.033 Acc=0.96 ---141872.35 ms/batch
Step 00065050 L_out=0.185 Acc=0.91 ---165388.64 ms/batch
Step 00065100 L_out=0.265 Acc=0.90 ---188936.81 ms/batch
Step 00065150 L_out=0.070 Acc=0.93 ---212424.50 ms/batch
Step 00065200 L_out=0.091 Acc=0.94 ---235957.18 ms/batch
Step 00065250 L_out=0.080 Acc=0.96 ---259564.96 ms/batch
Step 00065300 L_out=0.096 Acc=0.89 ---283044.73 ms/batch
Step 00065350 L_out=0.163 Acc=0.92 ---306761.09 ms/batch
Round 5 | epoch=7, train costTime=314.3106074333191, | total_activation_sum=17480730
Round 5 | ****EPOCH 8****
Step 00065400 L_out=0.184 Acc=0.87 ---15812.12 ms/batch
Step 00065450 L_out=0.183 Acc=0.93 ---39264.71 ms/batch
Step 00065500 L_out=0.194 Acc=0.87 ---62780.65 ms/batch
Step 00065550 L_out=0.133 Acc=0.91 ---86313.35 ms/batch
Step 00065600 L_out=0.302 Acc=0.83 ---109807.43 ms/batch
Step 00065650 L_out=0.099 Acc=0.92 ---133298.13 ms/batch
Step 00065700 L_out=0.124 Acc=0.96 ---157139.19 ms/batch
Step 00065750 L_out=0.258 Acc=0.89 ---180649.04 ms/batch
Step 00065800 L_out=0.054 Acc=0.96 ---204473.33 ms/batch
Step 00065850 L_out=0.228 Acc=0.86 ---228132.22 ms/batch
Step 00065900 L_out=0.349 Acc=0.87 ---251619.99 ms/batch
Step 00065950 L_out=0.150 Acc=0.86 ---275452.74 ms/batch
Step 00066000 L_out=0.248 Acc=0.80 ---298904.49 ms/batch
Round 5 | epoch=8, train costTime=314.39985156059265, | total_activation_sum=17720344
Round 5 | ****EPOCH 9****
Step 00066050 L_out=0.295 Acc=0.94 --- 7938.58 ms/batch
Step 00066100 L_out=0.329 Acc=0.93 ---31614.18 ms/batch
Step 00066150 L_out=0.038 Acc=0.94 ---55275.69 ms/batch
Step 00066200 L_out=0.050 Acc=0.96 ---78807.01 ms/batch
Step 00066250 L_out=0.187 Acc=0.90 ---102597.72 ms/batch
Step 00066300 L_out=0.267 Acc=0.95 ---126025.73 ms/batch
Step 00066350 L_out=0.380 Acc=0.94 ---149680.49 ms/batch
Step 00066400 L_out=0.220 Acc=0.90 ---173380.61 ms/batch
Step 00066450 L_out=0.550 Acc=0.89 ---197254.90 ms/batch
Step 00066500 L_out=0.232 Acc=0.96 ---220852.56 ms/batch
Step 00066550 L_out=0.105 Acc=0.93 ---244424.50 ms/batch
Step 00066600 L_out=0.167 Acc=0.98 ---267800.40 ms/batch
Step 00066650 L_out=0.091 Acc=0.92 ---291504.77 ms/batch
Step 00066700 L_out=0.161 Acc=0.89 ---314923.46 ms/batch
Round 5 | epoch=9, train costTime=314.9264245033264, | total_activation_sum=17722113
Round 5 | ****EPOCH 10****
Step 00066750 L_out=0.295 Acc=0.95 ---23849.00 ms/batch
Step 00066800 L_out=0.898 Acc=0.88 ---47596.68 ms/batch
Step 00066850 L_out=0.226 Acc=0.88 ---71157.98 ms/batch
Step 00066900 L_out=0.152 Acc=0.94 ---94769.32 ms/batch
Step 00066950 L_out=0.326 Acc=0.91 ---118590.17 ms/batch
Step 00067000 L_out=0.074 Acc=0.95 ---142078.67 ms/batch
Step 00067050 L_out=0.312 Acc=0.97 ---165721.88 ms/batch
Step 00067100 L_out=0.190 Acc=0.93 ---189284.28 ms/batch
Step 00067150 L_out=0.111 Acc=0.95 ---212741.06 ms/batch
Step 00067200 L_out=0.068 Acc=0.97 ---236345.34 ms/batch
Step 00067250 L_out=0.064 Acc=0.98 ---259911.31 ms/batch
Step 00067300 L_out=0.204 Acc=0.93 ---283406.16 ms/batch
Step 00067350 L_out=0.079 Acc=0.92 ---306999.18 ms/batch
Round 5 | epoch=10, train costTime=315.02026867866516, | total_activation_sum=17569046
Round 5 | ****EPOCH 11****
Step 00067400 L_out=0.737 Acc=0.82 ---15610.32 ms/batch
Step 00067450 L_out=0.165 Acc=0.81 ---39209.13 ms/batch
Step 00067500 L_out=0.251 Acc=0.95 ---62707.73 ms/batch
Step 00067550 L_out=0.339 Acc=0.92 ---86240.54 ms/batch
Step 00067600 L_out=0.194 Acc=0.80 ---109697.34 ms/batch
Step 00067650 L_out=0.126 Acc=0.92 ---133505.13 ms/batch
Step 00067700 L_out=0.215 Acc=0.89 ---157028.90 ms/batch
Step 00067750 L_out=0.161 Acc=0.95 ---180630.00 ms/batch
Step 00067800 L_out=0.669 Acc=0.89 ---204204.72 ms/batch
Step 00067850 L_out=0.309 Acc=0.92 ---227905.72 ms/batch
Step 00067900 L_out=0.446 Acc=0.87 ---251481.07 ms/batch
Step 00067950 L_out=0.136 Acc=0.93 ---275034.83 ms/batch
Step 00068000 L_out=0.273 Acc=0.90 ---299008.65 ms/batch
Round 5 | epoch=11, train costTime=314.7873649597168, | total_activation_sum=17555083
Round 5 | ****EPOCH 12****
Step 00068050 L_out=0.139 Acc=0.90 --- 7619.39 ms/batch
Step 00068100 L_out=0.096 Acc=0.92 ---31110.32 ms/batch
Step 00068150 L_out=0.044 Acc=0.95 ---54677.73 ms/batch
Step 00068200 L_out=0.181 Acc=0.95 ---78044.20 ms/batch
Step 00068250 L_out=0.133 Acc=0.96 ---101521.24 ms/batch
Step 00068300 L_out=0.191 Acc=0.92 ---125155.75 ms/batch
Step 00068350 L_out=0.131 Acc=0.95 ---148720.79 ms/batch
Step 00068400 L_out=0.138 Acc=0.90 ---172335.67 ms/batch
Step 00068450 L_out=0.085 Acc=0.95 ---195685.31 ms/batch
Step 00068500 L_out=0.326 Acc=0.94 ---219444.78 ms/batch
Step 00068550 L_out=0.037 Acc=0.95 ---243154.37 ms/batch
Step 00068600 L_out=0.075 Acc=0.91 ---266808.68 ms/batch
Step 00068650 L_out=0.166 Acc=0.91 ---290373.14 ms/batch
Step 00068700 L_out=0.117 Acc=0.95 ---313592.99 ms/batch
Round 5 | epoch=12, train costTime=314.06455421447754, | total_activation_sum=17644526
Round 5 | ****EPOCH 13****
Step 00068750 L_out=0.351 Acc=0.70 ---23348.91 ms/batch
Step 00068800 L_out=0.188 Acc=0.93 ---46998.97 ms/batch
Step 00068850 L_out=0.186 Acc=0.89 ---70655.27 ms/batch
Step 00068900 L_out=0.050 Acc=0.93 ---94046.49 ms/batch
Step 00068950 L_out=0.123 Acc=0.87 ---117755.59 ms/batch
Step 00069000 L_out=0.109 Acc=0.97 ---141422.18 ms/batch
Step 00069050 L_out=0.130 Acc=0.93 ---164787.12 ms/batch
Step 00069100 L_out=0.295 Acc=0.93 ---188350.23 ms/batch
Step 00069150 L_out=0.139 Acc=0.96 ---211889.84 ms/batch
Step 00069200 L_out=0.167 Acc=0.95 ---235281.40 ms/batch
Step 00069250 L_out=0.124 Acc=0.93 ---258970.31 ms/batch
Step 00069300 L_out=0.116 Acc=0.86 ---282582.64 ms/batch
Step 00069350 L_out=0.300 Acc=0.84 ---306049.06 ms/batch
Round 5 | epoch=13, train costTime=314.5309672355652, | total_activation_sum=17560783
Round 5 | ****EPOCH 14****
Step 00069400 L_out=0.103 Acc=0.96 ---15064.75 ms/batch
Step 00069450 L_out=0.094 Acc=0.96 ---38486.91 ms/batch
Step 00069500 L_out=0.358 Acc=0.82 ---61897.42 ms/batch
Step 00069550 L_out=0.684 Acc=0.89 ---85368.19 ms/batch
Step 00069600 L_out=0.102 Acc=0.94 ---108875.45 ms/batch
Step 00069650 L_out=0.510 Acc=0.87 ---132462.40 ms/batch
Step 00069700 L_out=0.042 Acc=0.97 ---156022.92 ms/batch
Step 00069750 L_out=0.093 Acc=0.96 ---179454.43 ms/batch
Step 00069800 L_out=0.259 Acc=0.93 ---203061.01 ms/batch
Step 00069850 L_out=0.184 Acc=0.94 ---226818.50 ms/batch
Step 00069900 L_out=0.089 Acc=0.95 ---250288.98 ms/batch
Step 00069950 L_out=0.215 Acc=0.95 ---273855.23 ms/batch
Step 00070000 L_out=0.330 Acc=0.87 ---297362.92 ms/batch
Round 5 | epoch=14, train costTime=313.8744637966156, | total_activation_sum=17544240
Round 5 | ****EPOCH 15****
Step 00070050 L_out=0.114 Acc=0.94 --- 7068.25 ms/batch
Step 00070100 L_out=0.200 Acc=0.92 ---30746.83 ms/batch
Step 00070150 L_out=0.123 Acc=0.94 ---54215.93 ms/batch
Step 00070200 L_out=0.455 Acc=0.64 ---77769.89 ms/batch
Step 00070250 L_out=0.301 Acc=0.95 ---101348.73 ms/batch
Step 00070300 L_out=0.176 Acc=0.90 ---125061.06 ms/batch
Step 00070350 L_out=0.160 Acc=0.86 ---148572.94 ms/batch
Step 00070400 L_out=0.085 Acc=0.88 ---172015.80 ms/batch
Step 00070450 L_out=0.040 Acc=0.99 ---195603.92 ms/batch
Step 00070500 L_out=0.179 Acc=0.91 ---219231.02 ms/batch
Step 00070550 L_out=0.155 Acc=0.93 ---242944.23 ms/batch
Step 00070600 L_out=0.136 Acc=0.90 ---266400.57 ms/batch
Step 00070650 L_out=0.150 Acc=0.92 ---289879.28 ms/batch
Step 00070700 L_out=0.177 Acc=0.91 ---313795.84 ms/batch
Round 5 | epoch=15, train costTime=314.7607510089874, | total_activation_sum=17672952
Round 5 | ****EPOCH 16****
Step 00070750 L_out=0.188 Acc=0.93 ---22565.68 ms/batch
Step 00070800 L_out=0.209 Acc=0.95 ---46255.15 ms/batch
Step 00070850 L_out=0.176 Acc=0.90 ---69642.72 ms/batch
Step 00070900 L_out=0.622 Acc=0.89 ---93011.42 ms/batch
Step 00070950 L_out=0.194 Acc=0.87 ---116601.85 ms/batch
Step 00071000 L_out=0.538 Acc=0.85 ---140251.24 ms/batch
Step 00071050 L_out=0.196 Acc=0.95 ---163605.99 ms/batch
Step 00071100 L_out=0.168 Acc=0.95 ---187140.26 ms/batch
Step 00071150 L_out=0.222 Acc=0.95 ---210561.77 ms/batch
Step 00071200 L_out=0.208 Acc=0.93 ---234134.57 ms/batch
Step 00071250 L_out=0.160 Acc=0.97 ---257758.34 ms/batch
Step 00071300 L_out=0.198 Acc=0.93 ---281496.33 ms/batch
Step 00071350 L_out=0.157 Acc=0.92 ---304910.37 ms/batch
Round 5 | epoch=16, train costTime=313.9110052585602, | total_activation_sum=17610846
Round 5 | ****EPOCH 17****
Step 00071400 L_out=0.176 Acc=0.93 ---14503.27 ms/batch
Step 00071450 L_out=0.086 Acc=0.83 ---38069.76 ms/batch
Step 00071500 L_out=0.092 Acc=0.97 ---61664.24 ms/batch
Step 00071550 L_out=0.102 Acc=0.92 ---85119.21 ms/batch
Step 00071600 L_out=0.205 Acc=0.91 ---108646.30 ms/batch
Step 00071650 L_out=0.203 Acc=0.94 ---132071.10 ms/batch
Step 00071700 L_out=0.160 Acc=0.95 ---155700.41 ms/batch
Step 00071750 L_out=0.198 Acc=0.94 ---179264.55 ms/batch
Step 00071800 L_out=0.151 Acc=0.90 ---202787.48 ms/batch
Step 00071850 L_out=0.048 Acc=0.90 ---226360.70 ms/batch
Step 00071900 L_out=0.237 Acc=0.91 ---250044.74 ms/batch
Step 00071950 L_out=0.073 Acc=0.95 ---273571.65 ms/batch
Step 00072000 L_out=0.082 Acc=0.93 ---297215.18 ms/batch
Round 5 | epoch=17, train costTime=314.3132236003876, | total_activation_sum=17623776
Round 5 | epoch=18, current m_iou=0.6866475350920449
Round 5 | Best m_IoU is: 0.687, OA is: 0.919 | val costTime=117.37751317024231
Round 5 | ****EPOCH 18****
Step 00072050 L_out=0.037 Acc=0.96 --- 6562.48 ms/batch
Step 00072100 L_out=0.081 Acc=0.89 ---30023.18 ms/batch
Step 00072150 L_out=0.045 Acc=0.97 ---53524.67 ms/batch
Step 00072200 L_out=0.147 Acc=0.96 ---77031.62 ms/batch
Step 00072250 L_out=0.107 Acc=0.97 ---100473.06 ms/batch
Step 00072300 L_out=0.181 Acc=0.91 ---123935.83 ms/batch
Step 00072350 L_out=0.409 Acc=0.82 ---147417.39 ms/batch
Step 00072400 L_out=0.083 Acc=0.97 ---171074.17 ms/batch
Step 00072450 L_out=0.083 Acc=0.95 ---194681.45 ms/batch
Step 00072500 L_out=0.219 Acc=0.90 ---218230.52 ms/batch
Step 00072550 L_out=0.079 Acc=0.94 ---241855.58 ms/batch
Step 00072600 L_out=0.163 Acc=0.94 ---265198.23 ms/batch
Step 00072650 L_out=0.113 Acc=0.93 ---288564.19 ms/batch
Step 00072700 L_out=0.210 Acc=0.78 ---312186.52 ms/batch
Round 5 | epoch=18, train costTime=313.54783844947815, | total_activation_sum=17709013
Round 5 | epoch=19, current m_iou=0.681892752043741
Round 5 | Best m_IoU is: 0.687, OA is: 0.919 | val costTime=116.38066840171814
Round 5 | ****EPOCH 19****
Step 00072750 L_out=0.239 Acc=0.85 ---22160.19 ms/batch
Step 00072800 L_out=0.113 Acc=0.90 ---45800.55 ms/batch
Step 00072850 L_out=0.361 Acc=0.90 ---69261.30 ms/batch
Step 00072900 L_out=0.155 Acc=0.96 ---92591.89 ms/batch
Step 00072950 L_out=0.173 Acc=0.93 ---116297.21 ms/batch
Step 00073000 L_out=0.090 Acc=0.91 ---139945.59 ms/batch
Step 00073050 L_out=0.168 Acc=0.92 ---163460.54 ms/batch
Step 00073100 L_out=0.056 Acc=0.94 ---187008.50 ms/batch
Step 00073150 L_out=0.128 Acc=0.93 ---210423.69 ms/batch
Step 00073200 L_out=0.180 Acc=0.96 ---233706.15 ms/batch
Step 00073250 L_out=0.077 Acc=0.97 ---257241.03 ms/batch
Step 00073300 L_out=0.142 Acc=0.94 ---280739.73 ms/batch
Step 00073350 L_out=0.171 Acc=0.89 ---304205.90 ms/batch
Round 5 | epoch=19, train costTime=313.5531828403473, | total_activation_sum=17627051
Round 5 | epoch=20, current m_iou=0.6810084399784848
Round 5 | Best m_IoU is: 0.687, OA is: 0.919 | val costTime=116.5176694393158
Round 5 | ****EPOCH 20****
Step 00073400 L_out=0.172 Acc=0.90 ---14044.45 ms/batch
Step 00073450 L_out=0.087 Acc=0.95 ---37479.29 ms/batch
Step 00073500 L_out=0.121 Acc=0.95 ---60987.72 ms/batch
Step 00073550 L_out=0.094 Acc=0.91 ---84748.31 ms/batch
Step 00073600 L_out=0.094 Acc=0.96 ---108401.23 ms/batch
Step 00073650 L_out=0.119 Acc=0.96 ---132049.53 ms/batch
Step 00073700 L_out=0.072 Acc=0.97 ---155636.76 ms/batch
Step 00073750 L_out=0.095 Acc=0.92 ---179246.33 ms/batch
Step 00073800 L_out=0.231 Acc=0.95 ---202867.19 ms/batch
Step 00073850 L_out=0.147 Acc=0.95 ---226239.51 ms/batch
Step 00073900 L_out=0.056 Acc=0.92 ---249531.29 ms/batch
Step 00073950 L_out=0.104 Acc=0.93 ---272957.35 ms/batch
Step 00074000 L_out=0.107 Acc=0.94 ---296475.10 ms/batch
Round 5 | epoch=20, train costTime=313.88411927223206, | total_activation_sum=17584289
Round 5 | epoch=21, current m_iou=0.6789144947382063
Round 5 | Best m_IoU is: 0.687, OA is: 0.919 | val costTime=116.80739521980286
Round 5 | ****EPOCH 21****
Step 00074050 L_out=0.152 Acc=0.96 --- 6090.71 ms/batch
Step 00074100 L_out=0.100 Acc=0.97 ---29509.62 ms/batch
Step 00074150 L_out=0.264 Acc=0.93 ---53137.34 ms/batch
Step 00074200 L_out=0.175 Acc=0.97 ---76722.13 ms/batch
Step 00074250 L_out=0.111 Acc=0.96 ---100337.63 ms/batch
Step 00074300 L_out=0.133 Acc=0.95 ---123696.62 ms/batch
Step 00074350 L_out=0.201 Acc=0.92 ---147288.51 ms/batch
Step 00074400 L_out=0.699 Acc=0.82 ---170762.83 ms/batch
Step 00074450 L_out=0.128 Acc=0.95 ---194208.79 ms/batch
Step 00074500 L_out=0.093 Acc=0.96 ---218024.67 ms/batch
Step 00074550 L_out=0.632 Acc=0.90 ---241567.75 ms/batch
Step 00074600 L_out=0.638 Acc=0.85 ---265001.30 ms/batch
Step 00074650 L_out=0.129 Acc=0.95 ---288477.75 ms/batch
Step 00074700 L_out=0.192 Acc=0.98 ---312068.21 ms/batch
Round 5 | epoch=21, train costTime=313.98420095443726, | total_activation_sum=17665409
Round 5 | epoch=22, current m_iou=0.6793204350368787
Round 5 | Best m_IoU is: 0.687, OA is: 0.919 | val costTime=117.40636968612671
Round 5 | ****EPOCH 22****
Step 00074750 L_out=0.031 Acc=0.96 ---21590.17 ms/batch
Step 00074800 L_out=0.074 Acc=0.95 ---45149.57 ms/batch
Step 00074850 L_out=0.101 Acc=0.96 ---68727.43 ms/batch
Step 00074900 L_out=0.055 Acc=0.96 ---92329.12 ms/batch
Step 00074950 L_out=0.131 Acc=0.88 ---115932.19 ms/batch
Step 00075000 L_out=0.048 Acc=0.97 ---139305.98 ms/batch
Step 00075050 L_out=0.133 Acc=0.96 ---162789.13 ms/batch
Step 00075100 L_out=0.282 Acc=0.92 ---186444.80 ms/batch
Step 00075150 L_out=0.316 Acc=0.91 ---209967.34 ms/batch
Step 00075200 L_out=0.317 Acc=0.97 ---233750.18 ms/batch
Step 00075250 L_out=0.109 Acc=0.94 ---257188.07 ms/batch
Step 00075300 L_out=0.098 Acc=0.91 ---280849.57 ms/batch
Step 00075350 L_out=0.087 Acc=0.91 ---304565.70 ms/batch
Round 5 | epoch=22, train costTime=314.5217640399933, | total_activation_sum=17453291
Round 5 | epoch=23, current m_iou=0.6863432880272141
Round 5 | Best m_IoU is: 0.687, OA is: 0.919 | val costTime=116.40523266792297
Round 5 | ****EPOCH 23****
Step 00075400 L_out=0.122 Acc=0.94 ---13622.58 ms/batch
Step 00075450 L_out=0.026 Acc=0.96 ---37149.02 ms/batch
Step 00075500 L_out=0.032 Acc=0.97 ---60597.74 ms/batch
Step 00075550 L_out=0.296 Acc=0.85 ---84365.92 ms/batch
Step 00075600 L_out=0.359 Acc=0.94 ---107935.32 ms/batch
Step 00075650 L_out=0.112 Acc=0.93 ---131594.12 ms/batch
Step 00075700 L_out=0.083 Acc=0.90 ---154994.85 ms/batch
Step 00075750 L_out=0.563 Acc=0.70 ---178748.86 ms/batch
Step 00075800 L_out=0.119 Acc=0.95 ---202375.14 ms/batch
Step 00075850 L_out=0.075 Acc=0.98 ---226244.53 ms/batch
Step 00075900 L_out=0.464 Acc=0.91 ---249881.15 ms/batch
Step 00075950 L_out=0.066 Acc=0.93 ---273515.60 ms/batch
Step 00076000 L_out=0.071 Acc=0.97 ---297180.09 ms/batch
Round 5 | epoch=23, train costTime=315.0372359752655, | total_activation_sum=17640231
Round 5 | epoch=24, current m_iou=0.6866170701941816
Round 5 | Best m_IoU is: 0.687, OA is: 0.919 | val costTime=116.25124740600586
Round 5 | ****EPOCH 24****
Step 00076050 L_out=0.185 Acc=0.95 --- 5578.86 ms/batch
Step 00076100 L_out=0.122 Acc=0.93 ---29204.54 ms/batch
Step 00076150 L_out=0.080 Acc=0.97 ---52656.50 ms/batch
Step 00076200 L_out=0.386 Acc=0.89 ---76287.58 ms/batch
Step 00076250 L_out=0.090 Acc=0.94 ---99966.27 ms/batch
Step 00076300 L_out=0.062 Acc=0.95 ---123606.74 ms/batch
Step 00076350 L_out=0.135 Acc=0.95 ---147093.63 ms/batch
Step 00076400 L_out=0.104 Acc=0.96 ---170642.19 ms/batch
Step 00076450 L_out=0.190 Acc=0.95 ---194215.14 ms/batch
Step 00076500 L_out=0.112 Acc=0.96 ---217942.49 ms/batch
Step 00076550 L_out=0.058 Acc=0.95 ---241605.68 ms/batch
Step 00076600 L_out=0.046 Acc=0.95 ---265057.27 ms/batch
Step 00076650 L_out=0.109 Acc=0.95 ---288590.74 ms/batch
Step 00076700 L_out=0.155 Acc=0.94 ---312057.13 ms/batch
Round 5 | epoch=24, train costTime=314.3941535949707, | total_activation_sum=17687116
Round 5 | epoch=25, current m_iou=0.6900314144185965
Round 5 | Best m_IoU is: 0.690, OA is: 0.922 | val costTime=117.2180848121643
Round 5 | ****EPOCH 25****
Step 00076750 L_out=0.257 Acc=0.87 ---21212.71 ms/batch
Step 00076800 L_out=0.049 Acc=0.94 ---44691.95 ms/batch
Step 00076850 L_out=0.163 Acc=0.95 ---68323.95 ms/batch
Step 00076900 L_out=0.061 Acc=0.93 ---92078.95 ms/batch
Step 00076950 L_out=0.490 Acc=0.85 ---115592.43 ms/batch
Step 00077000 L_out=0.079 Acc=0.93 ---139159.57 ms/batch
Step 00077050 L_out=0.122 Acc=0.95 ---162707.31 ms/batch
Step 00077100 L_out=0.248 Acc=0.90 ---186359.20 ms/batch
Step 00077150 L_out=0.073 Acc=0.94 ---209927.96 ms/batch
Step 00077200 L_out=0.090 Acc=0.95 ---233618.24 ms/batch
Step 00077250 L_out=0.228 Acc=0.93 ---257208.38 ms/batch
Step 00077300 L_out=0.063 Acc=0.95 ---280625.12 ms/batch
Step 00077350 L_out=0.332 Acc=0.90 ---304106.63 ms/batch
Round 5 | epoch=25, train costTime=314.5179588794708, | total_activation_sum=17494434
Round 5 | epoch=26, current m_iou=0.6920650555132919
Round 5 | Best m_IoU is: 0.692, OA is: 0.922 | val costTime=117.12919330596924
Round 5 | ****EPOCH 26****
Step 00077400 L_out=0.080 Acc=0.93 ---13370.25 ms/batch
Step 00077450 L_out=0.124 Acc=0.94 ---36961.76 ms/batch
Step 00077500 L_out=0.125 Acc=0.94 ---60551.93 ms/batch
Step 00077550 L_out=0.181 Acc=0.93 ---84205.74 ms/batch
Step 00077600 L_out=0.027 Acc=0.95 ---107875.00 ms/batch
Step 00077650 L_out=0.151 Acc=0.93 ---131206.01 ms/batch
Step 00077700 L_out=0.070 Acc=0.92 ---154726.59 ms/batch
Step 00077750 L_out=0.332 Acc=0.92 ---178112.43 ms/batch
Step 00077800 L_out=0.088 Acc=0.91 ---201898.40 ms/batch
Step 00077850 L_out=0.161 Acc=0.94 ---225287.78 ms/batch
Step 00077900 L_out=0.117 Acc=0.94 ---248694.82 ms/batch
Step 00077950 L_out=0.210 Acc=0.96 ---272254.94 ms/batch
Step 00078000 L_out=0.072 Acc=0.97 ---295995.46 ms/batch
Round 5 | epoch=26, train costTime=314.22952461242676, | total_activation_sum=17696909
Round 5 | epoch=27, current m_iou=0.6914956976389182
Round 5 | Best m_IoU is: 0.692, OA is: 0.922 | val costTime=116.02826380729675
Round 5 | ****EPOCH 27****
Step 00078050 L_out=0.043 Acc=0.93 --- 5338.58 ms/batch
Step 00078100 L_out=0.075 Acc=0.91 ---28805.19 ms/batch
Step 00078150 L_out=0.444 Acc=0.91 ---52087.11 ms/batch
Step 00078200 L_out=0.097 Acc=0.96 ---75559.53 ms/batch
Step 00078250 L_out=0.907 Acc=0.76 ---99051.47 ms/batch
Step 00078300 L_out=0.228 Acc=0.95 ---122694.56 ms/batch
Step 00078350 L_out=0.103 Acc=0.96 ---146019.41 ms/batch
Step 00078400 L_out=0.151 Acc=0.98 ---169546.30 ms/batch
Step 00078450 L_out=0.116 Acc=0.93 ---193328.45 ms/batch
Step 00078500 L_out=0.238 Acc=0.91 ---217001.66 ms/batch
Step 00078550 L_out=0.248 Acc=0.95 ---240531.06 ms/batch
Step 00078600 L_out=0.057 Acc=0.94 ---264111.14 ms/batch
Step 00078650 L_out=0.035 Acc=0.97 ---287671.39 ms/batch
Step 00078700 L_out=0.216 Acc=0.93 ---311132.76 ms/batch
Round 5 | epoch=27, train costTime=313.8606152534485, | total_activation_sum=17630419
Round 5 | epoch=28, current m_iou=0.6945844870542939
Round 5 | Best m_IoU is: 0.695, OA is: 0.922 | val costTime=115.97420287132263
Round 5 | ****EPOCH 28****
Step 00078750 L_out=0.179 Acc=0.90 ---20901.89 ms/batch
Step 00078800 L_out=0.053 Acc=0.96 ---44317.77 ms/batch
Step 00078850 L_out=0.038 Acc=0.93 ---67862.91 ms/batch
Step 00078900 L_out=0.096 Acc=0.96 ---91643.43 ms/batch
Step 00078950 L_out=0.038 Acc=0.91 ---115381.36 ms/batch
Step 00079000 L_out=0.230 Acc=0.92 ---139025.47 ms/batch
Step 00079050 L_out=0.208 Acc=0.93 ---162509.97 ms/batch
Step 00079100 L_out=0.191 Acc=0.97 ---185955.12 ms/batch
Step 00079150 L_out=0.102 Acc=0.91 ---209175.11 ms/batch
Step 00079200 L_out=0.192 Acc=0.95 ---232619.12 ms/batch
Step 00079250 L_out=0.074 Acc=0.93 ---256072.46 ms/batch
Step 00079300 L_out=0.112 Acc=0.98 ---279721.28 ms/batch
Step 00079350 L_out=0.352 Acc=0.92 ---303237.06 ms/batch
Round 5 | epoch=28, train costTime=314.15623140335083, | total_activation_sum=17463975
Round 5 | epoch=29, current m_iou=0.6939738699219843
Round 5 | Best m_IoU is: 0.695, OA is: 0.922 | val costTime=117.19418931007385
Round 5 | ****EPOCH 29****
Step 00079400 L_out=0.173 Acc=0.93 ---12653.12 ms/batch
Step 00079450 L_out=0.087 Acc=0.94 ---36167.74 ms/batch
Step 00079500 L_out=0.088 Acc=0.94 ---59645.11 ms/batch
Step 00079550 L_out=0.115 Acc=0.95 ---83165.36 ms/batch
Step 00079600 L_out=0.088 Acc=0.96 ---106491.71 ms/batch
Step 00079650 L_out=0.239 Acc=0.93 ---130068.10 ms/batch
Step 00079700 L_out=0.193 Acc=0.95 ---153602.80 ms/batch
Step 00079750 L_out=0.224 Acc=0.94 ---177027.81 ms/batch
Step 00079800 L_out=0.123 Acc=0.87 ---200759.94 ms/batch
Step 00079850 L_out=0.284 Acc=0.92 ---224256.60 ms/batch
Step 00079900 L_out=0.085 Acc=0.91 ---247705.33 ms/batch
Step 00079950 L_out=0.140 Acc=0.89 ---271354.64 ms/batch
Step 00080000 L_out=0.252 Acc=0.89 ---294870.37 ms/batch
Round 5 | epoch=29, train costTime=313.67215609550476, | total_activation_sum=17613642
Round 5 | epoch=30, current m_iou=0.6954258480131039
Round 5 | Best m_IoU is: 0.695, OA is: 0.923 | val costTime=116.57549595832825
Round 5 | ****EPOCH 30****
Round 6 | ****EPOCH 0****
Step 00080050 L_out=0.379 Acc=0.81 --- 4719.48 ms/batch
Step 00080100 L_out=1.282 Acc=0.55 ---28209.43 ms/batch
Step 00080150 L_out=0.748 Acc=0.85 ---51926.99 ms/batch
Step 00080200 L_out=0.577 Acc=0.57 ---75821.19 ms/batch
Step 00080250 L_out=0.639 Acc=0.67 ---99448.29 ms/batch
Step 00080300 L_out=0.433 Acc=0.69 ---123156.53 ms/batch
Step 00080350 L_out=0.212 Acc=0.86 ---146861.60 ms/batch
Step 00080400 L_out=0.783 Acc=0.71 ---170506.59 ms/batch
Step 00080450 L_out=1.232 Acc=0.43 ---194264.94 ms/batch
Step 00080500 L_out=0.567 Acc=0.83 ---217748.37 ms/batch
Step 00080550 L_out=0.568 Acc=0.69 ---241562.25 ms/batch
Step 00080600 L_out=0.587 Acc=0.68 ---265173.75 ms/batch
Step 00080650 L_out=0.473 Acc=0.78 ---288769.00 ms/batch
Step 00080700 L_out=0.448 Acc=0.86 ---312249.13 ms/batch
Round 6 | epoch=0, train costTime=315.48717761039734, | total_activation_sum=20953204
Round 6 | ****EPOCH 1****
Step 00080750 L_out=0.715 Acc=0.84 ---20068.31 ms/batch
Step 00080800 L_out=0.583 Acc=0.69 ---43622.53 ms/batch
Step 00080850 L_out=0.757 Acc=0.83 ---67231.13 ms/batch
Step 00080900 L_out=0.511 Acc=0.80 ---90729.84 ms/batch
Step 00080950 L_out=0.497 Acc=0.82 ---114452.83 ms/batch
Step 00081000 L_out=0.386 Acc=0.88 ---137949.08 ms/batch
Step 00081050 L_out=0.305 Acc=0.82 ---161327.35 ms/batch
Step 00081100 L_out=0.438 Acc=0.87 ---184975.91 ms/batch
Step 00081150 L_out=0.489 Acc=0.91 ---208605.67 ms/batch
Step 00081200 L_out=0.162 Acc=0.91 ---231928.01 ms/batch
Step 00081250 L_out=0.134 Acc=0.92 ---255399.38 ms/batch
Step 00081300 L_out=0.130 Acc=0.91 ---279007.74 ms/batch
Step 00081350 L_out=0.124 Acc=0.90 ---302798.37 ms/batch
Round 6 | epoch=1, train costTime=314.17836713790894, | total_activation_sum=21307298
Round 6 | ****EPOCH 2****
Step 00081400 L_out=0.108 Acc=0.87 ---12296.08 ms/batch
Step 00081450 L_out=0.168 Acc=0.81 ---35867.20 ms/batch
Step 00081500 L_out=0.211 Acc=0.91 ---59543.45 ms/batch
Step 00081550 L_out=0.433 Acc=0.83 ---83121.58 ms/batch
Step 00081600 L_out=0.145 Acc=0.88 ---106852.62 ms/batch
Step 00081650 L_out=0.487 Acc=0.91 ---130141.34 ms/batch
Step 00081700 L_out=0.367 Acc=0.86 ---153813.27 ms/batch
Step 00081750 L_out=0.290 Acc=0.88 ---177310.12 ms/batch
Step 00081800 L_out=0.222 Acc=0.73 ---201277.76 ms/batch
Step 00081850 L_out=0.360 Acc=0.86 ---224756.53 ms/batch
Step 00081900 L_out=0.897 Acc=0.76 ---248195.16 ms/batch
Step 00081950 L_out=0.633 Acc=0.88 ---271786.23 ms/batch
Step 00082000 L_out=0.637 Acc=0.89 ---295124.23 ms/batch
Round 6 | epoch=2, train costTime=314.404177904129, | total_activation_sum=21858385
Round 6 | ****EPOCH 3****
Step 00082050 L_out=0.213 Acc=0.90 --- 4181.07 ms/batch
Step 00082100 L_out=0.539 Acc=0.77 ---27834.39 ms/batch
Step 00082150 L_out=0.813 Acc=0.95 ---51297.16 ms/batch
Step 00082200 L_out=0.364 Acc=0.93 ---74674.76 ms/batch
Step 00082250 L_out=0.149 Acc=0.94 ---98181.82 ms/batch
Step 00082300 L_out=0.128 Acc=0.93 ---121614.99 ms/batch
Step 00082350 L_out=0.226 Acc=0.89 ---144973.70 ms/batch
Step 00082400 L_out=0.037 Acc=0.94 ---168278.62 ms/batch
Step 00082450 L_out=0.642 Acc=0.95 ---191628.38 ms/batch
Step 00082500 L_out=0.165 Acc=0.92 ---215050.11 ms/batch
Step 00082550 L_out=0.212 Acc=0.89 ---238391.27 ms/batch
Step 00082600 L_out=0.173 Acc=0.97 ---262036.04 ms/batch
Step 00082650 L_out=0.394 Acc=0.87 ---285453.31 ms/batch
Step 00082700 L_out=0.209 Acc=0.96 ---309004.42 ms/batch
Round 6 | epoch=3, train costTime=312.7609341144562, | total_activation_sum=21456363
Round 6 | ****EPOCH 4****
Step 00082750 L_out=0.126 Acc=0.95 ---19776.38 ms/batch
Step 00082800 L_out=0.255 Acc=0.89 ---43532.74 ms/batch
Step 00082850 L_out=1.316 Acc=0.74 ---66836.13 ms/batch
Step 00082900 L_out=0.521 Acc=0.91 ---90527.11 ms/batch
Step 00082950 L_out=0.375 Acc=0.96 ---114100.32 ms/batch
Step 00083000 L_out=0.393 Acc=0.94 ---137648.15 ms/batch
Step 00083050 L_out=0.106 Acc=0.93 ---160928.33 ms/batch
Step 00083100 L_out=0.409 Acc=0.94 ---184472.51 ms/batch
Step 00083150 L_out=0.078 Acc=0.90 ---207933.37 ms/batch
Step 00083200 L_out=0.193 Acc=0.93 ---231458.03 ms/batch
Step 00083250 L_out=0.183 Acc=0.92 ---254801.53 ms/batch
Step 00083300 L_out=0.298 Acc=0.93 ---278307.31 ms/batch
Step 00083350 L_out=0.142 Acc=0.96 ---301886.68 ms/batch
Round 6 | epoch=4, train costTime=313.53942608833313, | total_activation_sum=21554903
Round 6 | ****EPOCH 5****
Step 00083400 L_out=0.343 Acc=0.96 ---11826.62 ms/batch
Step 00083450 L_out=0.485 Acc=0.96 ---35539.28 ms/batch
Step 00083500 L_out=0.144 Acc=0.88 ---59014.88 ms/batch
Step 00083550 L_out=0.193 Acc=0.93 ---82688.68 ms/batch
Step 00083600 L_out=0.107 Acc=0.94 ---106203.57 ms/batch
Step 00083650 L_out=0.172 Acc=0.92 ---129502.29 ms/batch
Step 00083700 L_out=0.087 Acc=0.94 ---153024.41 ms/batch
Step 00083750 L_out=0.218 Acc=0.92 ---176586.62 ms/batch
Step 00083800 L_out=0.673 Acc=0.86 ---200109.01 ms/batch
Step 00083850 L_out=0.207 Acc=0.94 ---223476.18 ms/batch
Step 00083900 L_out=0.563 Acc=0.89 ---246955.77 ms/batch
Step 00083950 L_out=0.118 Acc=0.94 ---270560.37 ms/batch
Step 00084000 L_out=0.297 Acc=0.89 ---294016.89 ms/batch
Round 6 | epoch=5, train costTime=313.7428047657013, | total_activation_sum=21145028
Round 6 | ****EPOCH 6****
Step 00084050 L_out=0.279 Acc=0.95 --- 3658.03 ms/batch
Step 00084100 L_out=0.438 Acc=0.88 ---27204.87 ms/batch
Step 00084150 L_out=0.313 Acc=0.84 ---50724.56 ms/batch
Step 00084200 L_out=0.233 Acc=0.91 ---74413.45 ms/batch
Step 00084250 L_out=0.073 Acc=0.95 ---97920.54 ms/batch
Step 00084300 L_out=0.281 Acc=0.95 ---121545.07 ms/batch
Step 00084350 L_out=0.142 Acc=0.94 ---145047.61 ms/batch
Step 00084400 L_out=0.108 Acc=0.89 ---168517.31 ms/batch
Step 00084450 L_out=0.092 Acc=0.95 ---192050.29 ms/batch
Step 00084500 L_out=0.474 Acc=0.95 ---215521.17 ms/batch
Step 00084550 L_out=0.176 Acc=0.96 ---239040.61 ms/batch
Step 00084600 L_out=0.249 Acc=0.93 ---262540.11 ms/batch
Step 00084650 L_out=0.121 Acc=0.94 ---286239.70 ms/batch
Step 00084700 L_out=0.103 Acc=0.95 ---309612.72 ms/batch
Round 6 | epoch=6, train costTime=313.9174916744232, | total_activation_sum=21469173
Round 6 | ****EPOCH 7****
Step 00084750 L_out=0.238 Acc=0.98 ---19230.81 ms/batch
Step 00084800 L_out=0.209 Acc=0.93 ---42706.77 ms/batch
Step 00084850 L_out=0.118 Acc=0.93 ---66093.68 ms/batch
Step 00084900 L_out=0.566 Acc=0.92 ---89525.96 ms/batch
Step 00084950 L_out=0.205 Acc=0.90 ---113165.72 ms/batch
Step 00085000 L_out=0.113 Acc=0.93 ---136849.10 ms/batch
Step 00085050 L_out=0.478 Acc=0.89 ---160370.40 ms/batch
Step 00085100 L_out=0.186 Acc=0.90 ---183866.19 ms/batch
Step 00085150 L_out=0.164 Acc=0.87 ---207229.80 ms/batch
Step 00085200 L_out=0.272 Acc=0.93 ---230712.58 ms/batch
Step 00085250 L_out=0.087 Acc=0.90 ---254317.82 ms/batch
Step 00085300 L_out=0.159 Acc=0.91 ---277894.99 ms/batch
Step 00085350 L_out=0.073 Acc=0.95 ---301684.84 ms/batch
Round 6 | epoch=7, train costTime=313.8260848522186, | total_activation_sum=21584238
Round 6 | ****EPOCH 8****
Step 00085400 L_out=0.275 Acc=0.93 ---11240.12 ms/batch
Step 00085450 L_out=0.129 Acc=0.95 ---35198.60 ms/batch
Step 00085500 L_out=0.449 Acc=0.93 ---58632.16 ms/batch
Step 00085550 L_out=0.497 Acc=0.93 ---82215.94 ms/batch
Step 00085600 L_out=0.129 Acc=0.89 ---105536.67 ms/batch
Step 00085650 L_out=0.358 Acc=0.91 ---128832.15 ms/batch
Step 00085700 L_out=0.203 Acc=0.92 ---152391.98 ms/batch
Step 00085750 L_out=0.258 Acc=0.96 ---175809.80 ms/batch
Step 00085800 L_out=0.496 Acc=0.88 ---199507.51 ms/batch
Step 00085850 L_out=0.723 Acc=0.90 ---223026.39 ms/batch
Step 00085900 L_out=0.176 Acc=0.85 ---246429.63 ms/batch
Step 00085950 L_out=0.098 Acc=0.94 ---269769.16 ms/batch
Step 00086000 L_out=0.140 Acc=0.94 ---293358.24 ms/batch
Round 6 | epoch=8, train costTime=313.55009388923645, | total_activation_sum=21433046
Round 6 | ****EPOCH 9****
Step 00086050 L_out=0.182 Acc=0.93 --- 3271.56 ms/batch
Step 00086100 L_out=0.094 Acc=0.86 ---26709.92 ms/batch
Step 00086150 L_out=0.082 Acc=0.98 ---49987.09 ms/batch
Step 00086200 L_out=0.093 Acc=0.93 ---73498.56 ms/batch
Step 00086250 L_out=0.276 Acc=0.92 ---96884.09 ms/batch
Step 00086300 L_out=0.084 Acc=0.92 ---120460.09 ms/batch
Step 00086350 L_out=0.189 Acc=0.96 ---143925.27 ms/batch
Step 00086400 L_out=0.273 Acc=0.96 ---167722.30 ms/batch
Step 00086450 L_out=0.231 Acc=0.88 ---191181.74 ms/batch
Step 00086500 L_out=0.809 Acc=0.66 ---214649.04 ms/batch
Step 00086550 L_out=0.282 Acc=0.87 ---238177.95 ms/batch
Step 00086600 L_out=0.108 Acc=0.94 ---261631.48 ms/batch
Step 00086650 L_out=0.133 Acc=0.94 ---285281.78 ms/batch
Step 00086700 L_out=0.208 Acc=0.93 ---308659.62 ms/batch
Round 6 | epoch=9, train costTime=313.3381521701813, | total_activation_sum=21562480
Round 6 | ****EPOCH 10****
Step 00086750 L_out=0.191 Acc=0.96 ---18701.22 ms/batch
Step 00086800 L_out=0.203 Acc=0.90 ---42356.60 ms/batch
Step 00086850 L_out=0.382 Acc=0.92 ---65965.72 ms/batch
Step 00086900 L_out=0.230 Acc=0.94 ---89416.46 ms/batch
Step 00086950 L_out=0.126 Acc=0.94 ---112903.75 ms/batch
Step 00087000 L_out=0.285 Acc=0.95 ---136397.33 ms/batch
Step 00087050 L_out=0.179 Acc=0.95 ---159762.61 ms/batch
Step 00087100 L_out=0.085 Acc=0.93 ---183331.91 ms/batch
Step 00087150 L_out=0.168 Acc=0.92 ---206748.82 ms/batch
Step 00087200 L_out=0.275 Acc=0.97 ---230035.69 ms/batch
Step 00087250 L_out=0.174 Acc=0.92 ---253595.70 ms/batch
Step 00087300 L_out=0.031 Acc=0.95 ---277411.97 ms/batch
Step 00087350 L_out=0.098 Acc=0.93 ---301092.67 ms/batch
Round 6 | epoch=10, train costTime=313.69434118270874, | total_activation_sum=21460396
Round 6 | ****EPOCH 11****
Step 00087400 L_out=0.201 Acc=0.89 ---10697.03 ms/batch
Step 00087450 L_out=0.128 Acc=0.94 ---34186.57 ms/batch
Step 00087500 L_out=0.213 Acc=0.93 ---57431.13 ms/batch
Step 00087550 L_out=0.268 Acc=0.91 ---80958.78 ms/batch
Step 00087600 L_out=0.161 Acc=0.91 ---104556.22 ms/batch
Step 00087650 L_out=0.500 Acc=0.79 ---128031.43 ms/batch
Step 00087700 L_out=0.486 Acc=0.85 ---151333.93 ms/batch
Step 00087750 L_out=0.481 Acc=0.91 ---174867.19 ms/batch
Step 00087800 L_out=0.324 Acc=0.93 ---198470.95 ms/batch
Step 00087850 L_out=0.254 Acc=0.89 ---222187.54 ms/batch
Step 00087900 L_out=0.244 Acc=0.96 ---245879.67 ms/batch
Step 00087950 L_out=0.191 Acc=0.94 ---269577.15 ms/batch
Step 00088000 L_out=0.176 Acc=0.92 ---293221.39 ms/batch
Round 6 | epoch=11, train costTime=313.8640561103821, | total_activation_sum=21486016
Round 6 | ****EPOCH 12****
Step 00088050 L_out=0.200 Acc=0.93 --- 2767.35 ms/batch
Step 00088100 L_out=0.136 Acc=0.91 ---26433.29 ms/batch
Step 00088150 L_out=0.075 Acc=0.93 ---49823.72 ms/batch
Step 00088200 L_out=0.083 Acc=0.98 ---73129.80 ms/batch
Step 00088250 L_out=0.267 Acc=0.91 ---96652.34 ms/batch
Step 00088300 L_out=0.166 Acc=0.92 ---120345.71 ms/batch
Step 00088350 L_out=0.112 Acc=0.94 ---143976.42 ms/batch
Step 00088400 L_out=0.144 Acc=0.97 ---167528.42 ms/batch
Step 00088450 L_out=0.712 Acc=0.88 ---190935.94 ms/batch
Step 00088500 L_out=0.246 Acc=0.94 ---214598.97 ms/batch
Step 00088550 L_out=0.207 Acc=0.95 ---238013.43 ms/batch
Step 00088600 L_out=0.127 Acc=0.96 ---261606.58 ms/batch
Step 00088650 L_out=0.203 Acc=0.96 ---285168.81 ms/batch
Step 00088700 L_out=0.106 Acc=0.96 ---308625.04 ms/batch
Round 6 | epoch=12, train costTime=313.71481370925903, | total_activation_sum=21455530
Round 6 | ****EPOCH 13****
Step 00088750 L_out=0.546 Acc=0.88 ---18201.40 ms/batch
Step 00088800 L_out=0.098 Acc=0.90 ---41885.56 ms/batch
Step 00088850 L_out=0.078 Acc=0.95 ---65461.01 ms/batch
Step 00088900 L_out=0.056 Acc=0.98 ---89095.05 ms/batch
Step 00088950 L_out=0.312 Acc=0.95 ---112627.92 ms/batch
Step 00089000 L_out=1.585 Acc=0.82 ---136073.75 ms/batch
Step 00089050 L_out=0.122 Acc=0.92 ---159296.78 ms/batch
Step 00089100 L_out=0.079 Acc=0.95 ---182795.45 ms/batch
Step 00089150 L_out=0.423 Acc=0.85 ---206258.24 ms/batch
Step 00089200 L_out=0.194 Acc=0.96 ---229906.46 ms/batch
Step 00089250 L_out=0.163 Acc=0.97 ---253296.63 ms/batch
Step 00089300 L_out=0.351 Acc=0.89 ---277088.52 ms/batch
Step 00089350 L_out=0.059 Acc=0.97 ---300522.86 ms/batch
Round 6 | epoch=13, train costTime=313.8466856479645, | total_activation_sum=21545595
Round 6 | ****EPOCH 14****
Step 00089400 L_out=0.180 Acc=0.96 ---10447.08 ms/batch
Step 00089450 L_out=0.094 Acc=0.97 ---33880.49 ms/batch
Step 00089500 L_out=0.516 Acc=0.91 ---57461.71 ms/batch
Step 00089550 L_out=0.077 Acc=0.96 ---80961.29 ms/batch
Step 00089600 L_out=0.254 Acc=0.78 ---104474.89 ms/batch
Step 00089650 L_out=0.101 Acc=0.95 ---128005.86 ms/batch
Step 00089700 L_out=0.171 Acc=0.97 ---151601.00 ms/batch
Step 00089750 L_out=0.124 Acc=0.94 ---175133.28 ms/batch
Step 00089800 L_out=0.085 Acc=0.89 ---198600.54 ms/batch
Step 00089850 L_out=0.487 Acc=0.90 ---222031.89 ms/batch
Step 00089900 L_out=0.166 Acc=0.96 ---245341.00 ms/batch
Step 00089950 L_out=0.130 Acc=0.90 ---269059.31 ms/batch
Step 00090000 L_out=0.227 Acc=0.92 ---292542.77 ms/batch
Round 6 | epoch=14, train costTime=313.58539605140686, | total_activation_sum=21430090
Round 6 | ****EPOCH 15****
Step 00090050 L_out=0.142 Acc=0.91 --- 2391.67 ms/batch
Step 00090100 L_out=0.244 Acc=0.94 ---25991.39 ms/batch
Step 00090150 L_out=0.821 Acc=0.94 ---49464.67 ms/batch
Step 00090200 L_out=0.523 Acc=0.86 ---72866.54 ms/batch
Step 00090250 L_out=0.115 Acc=0.96 ---96377.66 ms/batch
Step 00090300 L_out=0.171 Acc=0.85 ---119792.12 ms/batch
Step 00090350 L_out=0.208 Acc=0.98 ---143446.89 ms/batch
Step 00090400 L_out=0.062 Acc=0.91 ---166937.64 ms/batch
Step 00090450 L_out=0.046 Acc=0.98 ---190610.80 ms/batch
Step 00090500 L_out=0.243 Acc=0.91 ---214223.41 ms/batch
Step 00090550 L_out=0.059 Acc=0.98 ---237849.20 ms/batch
Step 00090600 L_out=0.102 Acc=0.90 ---261544.07 ms/batch
Step 00090650 L_out=0.311 Acc=0.95 ---285117.45 ms/batch
Step 00090700 L_out=0.603 Acc=0.90 ---308795.78 ms/batch
Round 6 | epoch=15, train costTime=314.4063754081726, | total_activation_sum=21523068
Round 6 | ****EPOCH 16****
Step 00090750 L_out=0.146 Acc=0.92 ---17892.86 ms/batch
Step 00090800 L_out=0.117 Acc=0.96 ---41504.98 ms/batch
Step 00090850 L_out=0.101 Acc=0.98 ---65158.45 ms/batch
Step 00090900 L_out=0.254 Acc=0.97 ---88534.17 ms/batch
Step 00090950 L_out=0.370 Acc=0.92 ---112085.08 ms/batch
Step 00091000 L_out=0.058 Acc=0.96 ---135563.66 ms/batch
Step 00091050 L_out=0.384 Acc=0.90 ---158784.13 ms/batch
Step 00091100 L_out=0.136 Acc=0.96 ---182230.66 ms/batch
Step 00091150 L_out=0.218 Acc=0.84 ---205648.28 ms/batch
Step 00091200 L_out=0.163 Acc=0.93 ---229176.53 ms/batch
Step 00091250 L_out=0.099 Acc=0.97 ---252939.41 ms/batch
Step 00091300 L_out=0.094 Acc=0.93 ---276477.78 ms/batch
Step 00091350 L_out=0.126 Acc=0.96 ---300041.52 ms/batch
Round 6 | epoch=16, train costTime=313.71363735198975, | total_activation_sum=21443224
Round 6 | ****EPOCH 17****
Step 00091400 L_out=0.188 Acc=0.97 --- 9855.51 ms/batch
Step 00091450 L_out=0.151 Acc=0.95 ---33559.55 ms/batch
Step 00091500 L_out=0.317 Acc=0.95 ---57144.81 ms/batch
Step 00091550 L_out=0.230 Acc=0.93 ---80656.36 ms/batch
Step 00091600 L_out=0.055 Acc=0.93 ---102798.59 ms/batch
Step 00091650 L_out=0.039 Acc=0.91 ---125718.06 ms/batch
Step 00091700 L_out=0.403 Acc=0.93 ---149432.77 ms/batch
Step 00091750 L_out=0.193 Acc=0.94 ---173018.57 ms/batch
Step 00091800 L_out=0.082 Acc=0.96 ---196418.24 ms/batch
Step 00091850 L_out=0.223 Acc=0.92 ---219906.75 ms/batch
Step 00091900 L_out=0.156 Acc=0.91 ---243405.85 ms/batch
Step 00091950 L_out=0.113 Acc=0.88 ---266727.03 ms/batch
Step 00092000 L_out=0.129 Acc=0.99 ---290245.28 ms/batch
Round 6 | epoch=17, train costTime=312.0140976905823, | total_activation_sum=21382138
Round 6 | epoch=18, current m_iou=0.690303870298767
Round 6 | Best m_IoU is: 0.690, OA is: 0.920 | val costTime=116.18984389305115
Round 6 | ****EPOCH 18****
Step 00092050 L_out=0.174 Acc=0.96 --- 1937.93 ms/batch
Step 00092100 L_out=0.086 Acc=0.96 ---25813.29 ms/batch
Step 00092150 L_out=0.053 Acc=0.94 ---49464.92 ms/batch
Step 00092200 L_out=0.037 Acc=0.96 ---72901.33 ms/batch
Step 00092250 L_out=0.106 Acc=0.97 ---96481.08 ms/batch
Step 00092300 L_out=0.112 Acc=0.95 ---120190.74 ms/batch
Step 00092350 L_out=0.058 Acc=0.95 ---143649.57 ms/batch
Step 00092400 L_out=0.065 Acc=0.96 ---167315.75 ms/batch
Step 00092450 L_out=0.102 Acc=0.94 ---190905.94 ms/batch
Step 00092500 L_out=0.315 Acc=0.90 ---214425.27 ms/batch
Step 00092550 L_out=0.177 Acc=0.92 ---238230.62 ms/batch
Step 00092600 L_out=0.080 Acc=0.94 ---261609.52 ms/batch
Step 00092650 L_out=0.136 Acc=0.91 ---285248.68 ms/batch
Step 00092700 L_out=0.176 Acc=0.92 ---309024.69 ms/batch
Round 6 | epoch=18, train costTime=315.11089634895325, | total_activation_sum=21559621
Round 6 | epoch=19, current m_iou=0.699975978083714
Round 6 | Best m_IoU is: 0.700, OA is: 0.924 | val costTime=115.99930453300476
Round 6 | ****EPOCH 19****
Step 00092750 L_out=0.564 Acc=0.91 ---17438.32 ms/batch
Step 00092800 L_out=0.071 Acc=0.94 ---41078.27 ms/batch
Step 00092850 L_out=0.152 Acc=0.91 ---64565.81 ms/batch
Step 00092900 L_out=0.125 Acc=0.98 ---88199.61 ms/batch
Step 00092950 L_out=0.099 Acc=0.92 ---111750.85 ms/batch
Step 00093000 L_out=0.090 Acc=0.95 ---135397.74 ms/batch
Step 00093050 L_out=0.592 Acc=0.94 ---159010.46 ms/batch
Step 00093100 L_out=0.332 Acc=0.90 ---182690.98 ms/batch
Step 00093150 L_out=0.214 Acc=0.92 ---206172.07 ms/batch
Step 00093200 L_out=0.107 Acc=0.93 ---229716.97 ms/batch
Step 00093250 L_out=0.104 Acc=0.95 ---253253.24 ms/batch
Step 00093300 L_out=0.170 Acc=0.95 ---276719.26 ms/batch
Step 00093350 L_out=0.081 Acc=0.98 ---300177.63 ms/batch
Round 6 | epoch=19, train costTime=314.45708417892456, | total_activation_sum=21450065
Round 6 | epoch=20, current m_iou=0.6977867620497722
Round 6 | Best m_IoU is: 0.700, OA is: 0.924 | val costTime=116.91703605651855
Round 6 | ****EPOCH 20****
Step 00093400 L_out=0.154 Acc=0.93 --- 9394.01 ms/batch
Step 00093450 L_out=0.108 Acc=0.96 ---32829.48 ms/batch
Step 00093500 L_out=0.077 Acc=0.93 ---56226.28 ms/batch
Step 00093550 L_out=0.289 Acc=0.98 ---79879.47 ms/batch
Step 00093600 L_out=0.096 Acc=0.92 ---103399.03 ms/batch
Step 00093650 L_out=0.117 Acc=0.94 ---126988.02 ms/batch
Step 00093700 L_out=0.030 Acc=0.97 ---150548.98 ms/batch
Step 00093750 L_out=0.105 Acc=0.89 ---173891.00 ms/batch
Step 00093800 L_out=0.106 Acc=0.96 ---197588.28 ms/batch
Step 00093850 L_out=0.118 Acc=0.93 ---221052.23 ms/batch
Step 00093900 L_out=0.150 Acc=0.97 ---245053.72 ms/batch
Step 00093950 L_out=0.211 Acc=0.90 ---268733.40 ms/batch
Step 00094000 L_out=0.045 Acc=0.97 ---292106.78 ms/batch
Round 6 | epoch=20, train costTime=314.21047377586365, | total_activation_sum=21372682
Round 6 | epoch=21, current m_iou=0.6949152380274979
Round 6 | Best m_IoU is: 0.700, OA is: 0.924 | val costTime=116.036940574646
Round 6 | ****EPOCH 21****
Step 00094050 L_out=0.187 Acc=0.96 --- 1415.01 ms/batch
Step 00094100 L_out=0.271 Acc=0.92 ---25166.05 ms/batch
Step 00094150 L_out=0.067 Acc=0.94 ---48711.52 ms/batch
Step 00094200 L_out=0.046 Acc=0.97 ---72279.72 ms/batch
Step 00094250 L_out=0.215 Acc=0.95 ---95757.41 ms/batch
Step 00094300 L_out=0.278 Acc=0.95 ---119259.33 ms/batch
Step 00094350 L_out=0.382 Acc=0.93 ---142527.10 ms/batch
Step 00094400 L_out=0.186 Acc=0.95 ---166057.16 ms/batch
Step 00094450 L_out=0.387 Acc=0.94 ---189623.44 ms/batch
Step 00094500 L_out=0.190 Acc=0.98 ---213019.99 ms/batch
Step 00094550 L_out=0.148 Acc=0.93 ---236578.16 ms/batch
Step 00094600 L_out=0.059 Acc=0.95 ---260140.53 ms/batch
Step 00094650 L_out=0.231 Acc=0.92 ---283698.41 ms/batch
Step 00094700 L_out=0.295 Acc=0.80 ---307235.02 ms/batch
Round 6 | epoch=21, train costTime=313.73073840141296, | total_activation_sum=21504074
Round 6 | epoch=22, current m_iou=0.6920091815478256
Round 6 | Best m_IoU is: 0.700, OA is: 0.924 | val costTime=116.45114970207214
Round 6 | ****EPOCH 22****
Step 00094750 L_out=0.072 Acc=0.97 ---17012.88 ms/batch
Step 00094800 L_out=0.074 Acc=0.95 ---40702.38 ms/batch
Step 00094850 L_out=0.256 Acc=0.96 ---64428.22 ms/batch
Step 00094900 L_out=0.450 Acc=0.88 ---88098.74 ms/batch
Step 00094950 L_out=0.215 Acc=0.92 ---111622.64 ms/batch
Step 00095000 L_out=0.162 Acc=0.90 ---134999.98 ms/batch
Step 00095050 L_out=0.088 Acc=0.98 ---158469.57 ms/batch
Step 00095100 L_out=0.390 Acc=0.96 ---182019.11 ms/batch
Step 00095150 L_out=0.210 Acc=0.92 ---205419.45 ms/batch
Step 00095200 L_out=0.077 Acc=0.96 ---228934.53 ms/batch
Step 00095250 L_out=0.067 Acc=0.95 ---252304.51 ms/batch
Step 00095300 L_out=0.108 Acc=0.95 ---276013.38 ms/batch
Step 00095350 L_out=0.030 Acc=0.98 ---299525.71 ms/batch
Round 6 | epoch=22, train costTime=314.1110532283783, | total_activation_sum=21470105
Round 6 | epoch=23, current m_iou=0.6958968275018389
Round 6 | Best m_IoU is: 0.700, OA is: 0.924 | val costTime=115.98303985595703
Round 6 | ****EPOCH 23****
Step 00095400 L_out=0.456 Acc=0.95 --- 8934.25 ms/batch
Step 00095450 L_out=0.095 Acc=0.97 ---32409.12 ms/batch
Step 00095500 L_out=0.160 Acc=0.96 ---55793.32 ms/batch
Step 00095550 L_out=0.090 Acc=0.96 ---79105.46 ms/batch
Step 00095600 L_out=0.134 Acc=0.95 ---102543.01 ms/batch
Step 00095650 L_out=0.155 Acc=0.96 ---125965.49 ms/batch
Step 00095700 L_out=0.160 Acc=0.93 ---149309.85 ms/batch
Step 00095750 L_out=0.147 Acc=0.92 ---173058.52 ms/batch
Step 00095800 L_out=0.090 Acc=0.97 ---196582.07 ms/batch
Step 00095850 L_out=0.122 Acc=0.93 ---220073.32 ms/batch
Step 00095900 L_out=0.200 Acc=0.90 ---243533.53 ms/batch
Step 00095950 L_out=0.297 Acc=0.97 ---266785.50 ms/batch
Step 00096000 L_out=0.092 Acc=0.98 ---290357.14 ms/batch
Round 6 | epoch=23, train costTime=313.0673236846924, | total_activation_sum=21288041
Round 6 | epoch=24, current m_iou=0.6974119807594844
Round 6 | Best m_IoU is: 0.700, OA is: 0.924 | val costTime=116.44148302078247
Round 6 | ****EPOCH 24****
Step 00096050 L_out=0.151 Acc=0.90 ---  949.37 ms/batch
Step 00096100 L_out=0.186 Acc=0.91 ---24554.31 ms/batch
Step 00096150 L_out=0.119 Acc=0.95 ---48302.78 ms/batch
Step 00096200 L_out=0.152 Acc=0.95 ---71720.20 ms/batch
Step 00096250 L_out=0.138 Acc=0.88 ---95541.13 ms/batch
Step 00096300 L_out=0.069 Acc=0.98 ---119022.30 ms/batch
Step 00096350 L_out=0.076 Acc=0.95 ---142410.51 ms/batch
Step 00096400 L_out=0.084 Acc=0.95 ---166056.56 ms/batch
Step 00096450 L_out=0.235 Acc=0.96 ---189455.12 ms/batch
Step 00096500 L_out=0.258 Acc=0.92 ---213182.48 ms/batch
Step 00096550 L_out=0.053 Acc=0.97 ---236734.66 ms/batch
Step 00096600 L_out=0.256 Acc=0.92 ---260135.53 ms/batch
Step 00096650 L_out=0.280 Acc=0.96 ---283584.82 ms/batch
Step 00096700 L_out=0.171 Acc=0.96 ---307177.39 ms/batch
Round 6 | epoch=24, train costTime=314.12887597084045, | total_activation_sum=21615072
Round 6 | epoch=25, current m_iou=0.6929310882672581
Round 6 | Best m_IoU is: 0.700, OA is: 0.924 | val costTime=116.77103972434998
Round 6 | ****EPOCH 25****
Step 00096750 L_out=0.045 Acc=0.97 ---16424.27 ms/batch
Step 00096800 L_out=0.402 Acc=0.93 ---39873.82 ms/batch
Step 00096850 L_out=0.237 Acc=0.94 ---63335.76 ms/batch
Step 00096900 L_out=0.111 Acc=0.95 ---86837.24 ms/batch
Step 00096950 L_out=0.182 Acc=0.95 ---110355.24 ms/batch
Step 00097000 L_out=0.149 Acc=0.98 ---134062.86 ms/batch
Step 00097050 L_out=0.065 Acc=0.93 ---157890.53 ms/batch
Step 00097100 L_out=0.225 Acc=0.93 ---181324.53 ms/batch
Step 00097150 L_out=0.073 Acc=0.94 ---205041.70 ms/batch
Step 00097200 L_out=0.215 Acc=0.93 ---228474.01 ms/batch
Step 00097250 L_out=0.035 Acc=0.98 ---252166.60 ms/batch
Step 00097300 L_out=0.082 Acc=0.93 ---275563.53 ms/batch
Step 00097350 L_out=0.102 Acc=0.95 ---299095.05 ms/batch
Round 6 | epoch=25, train costTime=314.1041305065155, | total_activation_sum=21331854
Round 6 | epoch=26, current m_iou=0.6919393396850974
Round 6 | Best m_IoU is: 0.700, OA is: 0.924 | val costTime=116.26309823989868
Round 6 | ****EPOCH 26****
Step 00097400 L_out=0.056 Acc=0.95 --- 8527.64 ms/batch
Step 00097450 L_out=0.036 Acc=0.96 ---31948.96 ms/batch
Step 00097500 L_out=0.176 Acc=0.94 ---55636.49 ms/batch
Step 00097550 L_out=0.192 Acc=0.95 ---79211.47 ms/batch
Step 00097600 L_out=0.226 Acc=0.91 ---102759.04 ms/batch
Step 00097650 L_out=0.362 Acc=0.95 ---126387.98 ms/batch
Step 00097700 L_out=0.020 Acc=0.96 ---150009.94 ms/batch
Step 00097750 L_out=0.303 Acc=0.96 ---173539.93 ms/batch
Step 00097800 L_out=0.014 Acc=0.97 ---197226.79 ms/batch
Step 00097850 L_out=0.030 Acc=0.97 ---221012.61 ms/batch
Step 00097900 L_out=0.095 Acc=0.90 ---244603.74 ms/batch
Step 00097950 L_out=0.236 Acc=0.97 ---268166.80 ms/batch
Step 00098000 L_out=0.304 Acc=0.97 ---291610.89 ms/batch
Round 6 | epoch=26, train costTime=314.86953830718994, | total_activation_sum=21553503
Round 6 | epoch=27, current m_iou=0.6946876560690067
Round 6 | Best m_IoU is: 0.700, OA is: 0.924 | val costTime=116.02792000770569
Round 6 | ****EPOCH 27****
Step 00098050 L_out=0.062 Acc=0.97 ---  468.99 ms/batch
Step 00098100 L_out=0.221 Acc=0.93 ---23752.57 ms/batch
Step 00098150 L_out=0.213 Acc=0.94 ---47136.95 ms/batch
Step 00098200 L_out=0.218 Acc=0.84 ---70688.16 ms/batch
Step 00098250 L_out=0.629 Acc=0.92 ---94422.40 ms/batch
Step 00098300 L_out=0.102 Acc=0.97 ---118028.98 ms/batch
Step 00098350 L_out=0.148 Acc=0.94 ---141493.75 ms/batch
Step 00098400 L_out=0.292 Acc=0.94 ---165169.82 ms/batch
Step 00098450 L_out=0.097 Acc=0.97 ---188821.52 ms/batch
Step 00098500 L_out=0.151 Acc=0.96 ---212808.82 ms/batch
Step 00098550 L_out=0.054 Acc=0.96 ---236508.42 ms/batch
Step 00098600 L_out=0.243 Acc=0.93 ---259885.77 ms/batch
Step 00098650 L_out=0.034 Acc=0.98 ---283423.15 ms/batch
Step 00098700 L_out=0.209 Acc=0.92 ---306869.77 ms/batch
Round 6 | epoch=27, train costTime=314.392826795578, | total_activation_sum=21524347
Round 6 | epoch=28, current m_iou=0.691216982699033
Round 6 | Best m_IoU is: 0.700, OA is: 0.924 | val costTime=115.84494757652283
Round 6 | ****EPOCH 28****
Step 00098750 L_out=0.200 Acc=0.97 ---16178.84 ms/batch
Step 00098800 L_out=0.093 Acc=0.96 ---39493.22 ms/batch
Step 00098850 L_out=0.044 Acc=0.97 ---63155.05 ms/batch
Step 00098900 L_out=0.097 Acc=0.95 ---86680.31 ms/batch
Step 00098950 L_out=0.136 Acc=0.95 ---110217.79 ms/batch
Step 00099000 L_out=0.059 Acc=0.97 ---133929.18 ms/batch
Step 00099050 L_out=0.207 Acc=0.95 ---157341.20 ms/batch
Step 00099100 L_out=0.168 Acc=0.94 ---180776.47 ms/batch
Step 00099150 L_out=0.241 Acc=0.95 ---204409.12 ms/batch
Step 00099200 L_out=0.160 Acc=0.96 ---227842.78 ms/batch
Step 00099250 L_out=0.210 Acc=0.89 ---251428.82 ms/batch
Step 00099300 L_out=0.242 Acc=0.96 ---274989.02 ms/batch
Step 00099350 L_out=0.019 Acc=0.96 ---298639.07 ms/batch
Round 6 | epoch=28, train costTime=314.05086970329285, | total_activation_sum=21458621
Round 6 | epoch=29, current m_iou=0.6930512668704294
Round 6 | Best m_IoU is: 0.700, OA is: 0.924 | val costTime=115.94652318954468
Round 6 | ****EPOCH 29****
Step 00099400 L_out=0.092 Acc=0.91 --- 8024.89 ms/batch
Step 00099450 L_out=0.061 Acc=0.93 ---31504.05 ms/batch
Step 00099500 L_out=0.414 Acc=0.89 ---55044.55 ms/batch
Step 00099550 L_out=0.169 Acc=0.95 ---78599.61 ms/batch
Step 00099600 L_out=0.130 Acc=0.94 ---102434.74 ms/batch
Step 00099650 L_out=0.106 Acc=0.92 ---125971.30 ms/batch
Step 00099700 L_out=0.101 Acc=0.93 ---149626.39 ms/batch
Step 00099750 L_out=0.068 Acc=0.98 ---173334.89 ms/batch
Step 00099800 L_out=0.244 Acc=0.95 ---196824.72 ms/batch
Step 00099850 L_out=0.211 Acc=0.93 ---220315.77 ms/batch
Step 00099900 L_out=0.192 Acc=0.94 ---243991.35 ms/batch
Step 00099950 L_out=0.428 Acc=0.93 ---267603.62 ms/batch
Step 00100000 L_out=0.148 Acc=0.95 ---291029.55 ms/batch
Step 00100050 L_out=0.044 Acc=0.97 ---314609.41 ms/batch
Round 6 | epoch=29, train costTime=314.6097135543823, | total_activation_sum=21590115
Round 6 | epoch=30, current m_iou=0.6946389959896735
Round 6 | Best m_IoU is: 0.700, OA is: 0.924 | val costTime=116.77999496459961
Round 6 | ****EPOCH 30****
Round 7 | ****EPOCH 0****
Step 00100100 L_out=0.582 Acc=0.83 ---23765.54 ms/batch
Step 00100150 L_out=0.397 Acc=0.93 ---47746.41 ms/batch
Step 00100200 L_out=0.393 Acc=0.79 ---71325.99 ms/batch
Step 00100250 L_out=0.674 Acc=0.84 ---95008.16 ms/batch
Step 00100300 L_out=0.656 Acc=0.73 ---118708.93 ms/batch
Step 00100350 L_out=1.006 Acc=0.78 ---142368.98 ms/batch
Step 00100400 L_out=0.210 Acc=0.91 ---166151.66 ms/batch
Step 00100450 L_out=0.412 Acc=0.86 ---189634.22 ms/batch
Step 00100500 L_out=0.658 Acc=0.91 ---213091.18 ms/batch
Step 00100550 L_out=0.839 Acc=0.92 ---236791.97 ms/batch
Step 00100600 L_out=0.462 Acc=0.86 ---260477.77 ms/batch
Step 00100650 L_out=0.700 Acc=0.85 ---284062.28 ms/batch
Step 00100700 L_out=0.210 Acc=0.89 ---307459.43 ms/batch
Round 7 | epoch=0, train costTime=315.381796836853, | total_activation_sum=24715414
Round 7 | ****EPOCH 1****
Step 00100750 L_out=0.147 Acc=0.88 ---15395.06 ms/batch
Step 00100800 L_out=0.168 Acc=0.89 ---39014.94 ms/batch
Step 00100850 L_out=0.223 Acc=0.94 ---62575.54 ms/batch
Step 00100900 L_out=0.248 Acc=0.94 ---86160.32 ms/batch
Step 00100950 L_out=0.311 Acc=0.96 ---109733.84 ms/batch
Step 00101000 L_out=0.259 Acc=0.87 ---133224.35 ms/batch
Step 00101050 L_out=0.299 Acc=0.93 ---156754.02 ms/batch
Step 00101100 L_out=0.434 Acc=0.90 ---180421.93 ms/batch
Step 00101150 L_out=0.223 Acc=0.94 ---204113.22 ms/batch
Step 00101200 L_out=0.357 Acc=0.94 ---227532.81 ms/batch
Step 00101250 L_out=0.183 Acc=0.88 ---251030.43 ms/batch
Step 00101300 L_out=0.928 Acc=0.94 ---274371.56 ms/batch
Step 00101350 L_out=0.408 Acc=0.95 ---297739.58 ms/batch
Round 7 | epoch=1, train costTime=313.69200372695923, | total_activation_sum=25436692
Round 7 | ****EPOCH 2****
Step 00101400 L_out=0.205 Acc=0.85 --- 7482.64 ms/batch
Step 00101450 L_out=0.252 Acc=0.86 ---30961.93 ms/batch
Step 00101500 L_out=0.213 Acc=0.94 ---54512.95 ms/batch
Step 00101550 L_out=0.315 Acc=0.95 ---78038.35 ms/batch
Step 00101600 L_out=0.150 Acc=0.92 ---101549.04 ms/batch
Step 00101650 L_out=0.224 Acc=0.93 ---124933.57 ms/batch
Step 00101700 L_out=0.413 Acc=0.95 ---148622.84 ms/batch
Step 00101750 L_out=0.483 Acc=0.91 ---172410.36 ms/batch
Step 00101800 L_out=0.486 Acc=0.83 ---195979.71 ms/batch
Step 00101850 L_out=0.644 Acc=0.84 ---219515.70 ms/batch
Step 00101900 L_out=0.160 Acc=0.94 ---243185.13 ms/batch
Step 00101950 L_out=0.151 Acc=0.90 ---266785.75 ms/batch
Step 00102000 L_out=0.068 Acc=0.96 ---290097.12 ms/batch
Step 00102050 L_out=0.562 Acc=0.91 ---313451.70 ms/batch
Round 7 | epoch=2, train costTime=313.93511939048767, | total_activation_sum=25392408
Round 7 | ****EPOCH 3****
Step 00102100 L_out=0.066 Acc=0.96 ---23041.64 ms/batch
Step 00102150 L_out=0.443 Acc=0.84 ---46645.62 ms/batch
Step 00102200 L_out=0.543 Acc=0.93 ---70011.84 ms/batch
Step 00102250 L_out=0.468 Acc=0.92 ---93365.70 ms/batch
Step 00102300 L_out=0.204 Acc=0.93 ---117043.07 ms/batch
Step 00102350 L_out=0.234 Acc=0.97 ---140475.48 ms/batch
Step 00102400 L_out=0.797 Acc=0.90 ---164045.53 ms/batch
Step 00102450 L_out=0.293 Acc=0.94 ---187623.42 ms/batch
Step 00102500 L_out=0.268 Acc=0.90 ---211162.63 ms/batch
Step 00102550 L_out=0.441 Acc=0.84 ---234415.28 ms/batch
Step 00102600 L_out=0.060 Acc=0.93 ---258015.37 ms/batch
Step 00102650 L_out=0.428 Acc=0.89 ---281640.60 ms/batch
Step 00102700 L_out=0.177 Acc=0.92 ---305162.98 ms/batch
Round 7 | epoch=3, train costTime=313.5407466888428, | total_activation_sum=25361364
Round 7 | ****EPOCH 4****
Step 00102750 L_out=0.232 Acc=0.95 ---14889.18 ms/batch
Step 00102800 L_out=0.134 Acc=0.93 ---38372.32 ms/batch
Step 00102850 L_out=0.203 Acc=0.92 ---61996.61 ms/batch
Step 00102900 L_out=0.852 Acc=0.93 ---85530.41 ms/batch
Step 00102950 L_out=0.277 Acc=0.86 ---109096.11 ms/batch
Step 00103000 L_out=0.207 Acc=0.95 ---132823.58 ms/batch
Step 00103050 L_out=1.009 Acc=0.89 ---156157.60 ms/batch
Step 00103100 L_out=0.135 Acc=0.91 ---179626.41 ms/batch
Step 00103150 L_out=0.051 Acc=0.97 ---203204.60 ms/batch
Step 00103200 L_out=0.140 Acc=0.90 ---226727.61 ms/batch
Step 00103250 L_out=0.214 Acc=0.94 ---250090.99 ms/batch
Step 00103300 L_out=0.113 Acc=0.97 ---273555.69 ms/batch
Step 00103350 L_out=0.335 Acc=0.84 ---297253.52 ms/batch
Round 7 | epoch=4, train costTime=313.78856015205383, | total_activation_sum=25287770
Round 7 | ****EPOCH 5****
Step 00103400 L_out=0.272 Acc=0.93 --- 6971.56 ms/batch
Step 00103450 L_out=0.736 Acc=0.91 ---30437.57 ms/batch
Step 00103500 L_out=0.319 Acc=0.95 ---54118.82 ms/batch
Step 00103550 L_out=0.243 Acc=0.82 ---77764.23 ms/batch
Step 00103600 L_out=0.852 Acc=0.93 ---101209.02 ms/batch
Step 00103650 L_out=1.136 Acc=0.95 ---124794.29 ms/batch
Step 00103700 L_out=0.316 Acc=0.89 ---148259.65 ms/batch
Step 00103750 L_out=0.895 Acc=0.92 ---171645.65 ms/batch
Step 00103800 L_out=0.421 Acc=0.93 ---195306.76 ms/batch
Step 00103850 L_out=0.794 Acc=0.83 ---218712.82 ms/batch
Step 00103900 L_out=0.179 Acc=0.95 ---242058.46 ms/batch
Step 00103950 L_out=0.416 Acc=0.91 ---265708.74 ms/batch
Step 00104000 L_out=0.116 Acc=0.88 ---289243.88 ms/batch
Step 00104050 L_out=0.226 Acc=0.94 ---312573.44 ms/batch
Round 7 | epoch=5, train costTime=313.51878809928894, | total_activation_sum=25319295
Round 7 | ****EPOCH 6****
Step 00104100 L_out=0.115 Acc=0.96 ---22543.79 ms/batch
Step 00104150 L_out=0.218 Acc=0.92 ---46097.60 ms/batch
Step 00104200 L_out=0.487 Acc=0.91 ---69434.02 ms/batch
Step 00104250 L_out=0.202 Acc=0.94 ---93184.89 ms/batch
Step 00104300 L_out=0.279 Acc=0.89 ---116494.97 ms/batch
Step 00104350 L_out=0.118 Acc=0.97 ---139832.59 ms/batch
Step 00104400 L_out=0.099 Acc=0.97 ---163299.08 ms/batch
Step 00104450 L_out=0.330 Acc=0.94 ---186747.89 ms/batch
Step 00104500 L_out=0.237 Acc=0.93 ---210261.56 ms/batch
Step 00104550 L_out=0.258 Acc=0.92 ---233602.51 ms/batch
Step 00104600 L_out=0.203 Acc=0.97 ---256887.74 ms/batch
Step 00104650 L_out=0.344 Acc=0.93 ---280558.29 ms/batch
Step 00104700 L_out=0.523 Acc=0.92 ---304247.98 ms/batch
Round 7 | epoch=6, train costTime=313.16280031204224, | total_activation_sum=25420366
Round 7 | ****EPOCH 7****
Step 00104750 L_out=0.206 Acc=0.93 ---14499.36 ms/batch
Step 00104800 L_out=0.082 Acc=0.92 ---38206.87 ms/batch
Step 00104850 L_out=0.286 Acc=0.95 ---61621.23 ms/batch
Step 00104900 L_out=0.169 Acc=0.96 ---85175.09 ms/batch
Step 00104950 L_out=0.462 Acc=0.94 ---108675.68 ms/batch
