Round 1 | ****EPOCH 0****
Step 00000050 L_out=10.167 Acc=0.34 ---25930.88 ms/batch
Step 00000100 L_out=7.719 Acc=0.43 ---49653.95 ms/batch
Step 00000150 L_out=8.770 Acc=0.33 ---73666.89 ms/batch
Step 00000200 L_out=8.627 Acc=0.55 ---97664.01 ms/batch
Step 00000250 L_out=7.918 Acc=0.41 ---121651.65 ms/batch
Step 00000300 L_out=13.142 Acc=0.14 ---145611.48 ms/batch
Step 00000350 L_out=11.043 Acc=0.27 ---169450.84 ms/batch
Step 00000400 L_out=15.855 Acc=0.35 ---193298.86 ms/batch
Step 00000450 L_out=13.720 Acc=0.12 ---217029.05 ms/batch
Step 00000500 L_out=8.405 Acc=0.66 ---240735.97 ms/batch
Step 00000550 L_out=13.584 Acc=0.59 ---264738.38 ms/batch
Step 00000600 L_out=9.658 Acc=0.54 ---288564.75 ms/batch
Step 00000650 L_out=13.119 Acc=0.42 ---312574.60 ms/batch
Round 1 | epoch=0, train costTime=320.6186065673828, | total_activation_sum=131137536
Round 1 | ****EPOCH 1****
Step 00000700 L_out=8.436 Acc=0.39 ---15787.99 ms/batch
Step 00000750 L_out=9.181 Acc=0.10 ---39483.73 ms/batch
Step 00000800 L_out=5.775 Acc=0.57 ---63389.06 ms/batch
Step 00000850 L_out=11.063 Acc=0.21 ---87115.72 ms/batch
Step 00000900 L_out=15.026 Acc=0.47 ---110872.91 ms/batch
Step 00000950 L_out=9.008 Acc=0.27 ---134689.27 ms/batch
Step 00001000 L_out=9.127 Acc=0.30 ---158494.48 ms/batch
Step 00001050 L_out=12.339 Acc=0.46 ---182365.51 ms/batch
Step 00001100 L_out=8.604 Acc=0.31 ---206442.19 ms/batch
Step 00001150 L_out=7.415 Acc=0.43 ---230573.07 ms/batch
Step 00001200 L_out=10.461 Acc=0.33 ---254129.52 ms/batch
Step 00001250 L_out=6.608 Acc=0.62 ---278057.73 ms/batch
Step 00001300 L_out=9.199 Acc=0.62 ---301703.83 ms/batch
Round 1 | epoch=1, train costTime=318.00524139404297, | total_activation_sum=131137536
Round 1 | ****EPOCH 2****
Step 00001350 L_out=6.365 Acc=0.50 --- 7518.22 ms/batch
Step 00001400 L_out=7.718 Acc=0.64 ---31462.74 ms/batch
Step 00001450 L_out=8.828 Acc=0.46 ---55515.92 ms/batch
Step 00001500 L_out=7.102 Acc=0.51 ---79209.43 ms/batch
Step 00001550 L_out=4.753 Acc=0.69 ---103036.03 ms/batch
Step 00001600 L_out=5.408 Acc=0.47 ---126947.82 ms/batch
Step 00001650 L_out=5.135 Acc=0.56 ---150826.15 ms/batch
Step 00001700 L_out=5.118 Acc=0.51 ---174641.04 ms/batch
Step 00001750 L_out=7.698 Acc=0.51 ---198710.11 ms/batch
Step 00001800 L_out=5.734 Acc=0.58 ---222534.25 ms/batch
Step 00001850 L_out=9.488 Acc=0.52 ---246338.96 ms/batch
Step 00001900 L_out=6.736 Acc=0.52 ---270165.97 ms/batch
Step 00001950 L_out=5.736 Acc=0.57 ---293782.69 ms/batch
Step 00002000 L_out=4.390 Acc=0.68 ---317796.75 ms/batch
Round 1 | epoch=2, train costTime=318.2737669944763, | total_activation_sum=131137536
Round 1 | ****EPOCH 3****
Step 00002050 L_out=7.691 Acc=0.63 ---23333.92 ms/batch
Step 00002100 L_out=4.494 Acc=0.64 ---47230.60 ms/batch
Step 00002150 L_out=7.899 Acc=0.64 ---71278.90 ms/batch
Step 00002200 L_out=4.587 Acc=0.63 ---95199.92 ms/batch
Step 00002250 L_out=5.751 Acc=0.67 ---119106.32 ms/batch
Step 00002300 L_out=8.448 Acc=0.56 ---142688.12 ms/batch
Step 00002350 L_out=5.024 Acc=0.74 ---166494.01 ms/batch
Step 00002400 L_out=6.024 Acc=0.64 ---190457.47 ms/batch
Step 00002450 L_out=5.877 Acc=0.61 ---214277.98 ms/batch
Step 00002500 L_out=10.407 Acc=0.29 ---237991.41 ms/batch
Step 00002550 L_out=4.357 Acc=0.83 ---261906.38 ms/batch
Step 00002600 L_out=6.711 Acc=0.74 ---285855.86 ms/batch
Step 00002650 L_out=5.624 Acc=0.72 ---309755.51 ms/batch
Round 1 | epoch=3, train costTime=318.3453507423401, | total_activation_sum=131137536
Round 1 | ****EPOCH 4****
Step 00002700 L_out=6.337 Acc=0.62 ---15222.20 ms/batch
Step 00002750 L_out=3.726 Acc=0.65 ---39011.07 ms/batch
Step 00002800 L_out=5.526 Acc=0.83 ---62894.99 ms/batch
Step 00002850 L_out=9.175 Acc=0.43 ---86813.94 ms/batch
Step 00002900 L_out=6.617 Acc=0.75 ---110599.25 ms/batch
Step 00002950 L_out=4.187 Acc=0.79 ---134254.85 ms/batch
Step 00003000 L_out=3.683 Acc=0.62 ---158125.58 ms/batch
Step 00003050 L_out=6.458 Acc=0.78 ---181745.19 ms/batch
Step 00003100 L_out=4.307 Acc=0.64 ---205440.81 ms/batch
Step 00003150 L_out=4.145 Acc=0.79 ---229333.45 ms/batch
Step 00003200 L_out=7.636 Acc=0.61 ---253344.52 ms/batch
Step 00003250 L_out=3.004 Acc=0.89 ---277341.09 ms/batch
Step 00003300 L_out=7.078 Acc=0.59 ---301032.76 ms/batch
Round 1 | epoch=4, train costTime=317.9351394176483, | total_activation_sum=131137536
Round 1 | ****EPOCH 5****
Step 00003350 L_out=6.183 Acc=0.74 --- 7105.55 ms/batch
Step 00003400 L_out=5.435 Acc=0.61 ---31078.66 ms/batch
Step 00003450 L_out=4.539 Acc=0.70 ---54859.78 ms/batch
Step 00003500 L_out=4.337 Acc=0.69 ---78674.90 ms/batch
Step 00003550 L_out=7.882 Acc=0.44 ---102479.00 ms/batch
Step 00003600 L_out=4.934 Acc=0.80 ---126462.43 ms/batch
Step 00003650 L_out=3.266 Acc=0.75 ---150218.76 ms/batch
Step 00003700 L_out=3.843 Acc=0.79 ---173780.60 ms/batch
Step 00003750 L_out=3.599 Acc=0.72 ---197487.77 ms/batch
Step 00003800 L_out=9.988 Acc=0.79 ---221233.43 ms/batch
Step 00003850 L_out=2.514 Acc=0.85 ---245220.25 ms/batch
Step 00003900 L_out=2.996 Acc=0.70 ---269087.29 ms/batch
Step 00003950 L_out=5.832 Acc=0.50 ---292798.05 ms/batch
Step 00004000 L_out=3.865 Acc=0.72 ---316570.67 ms/batch
Round 1 | epoch=5, train costTime=317.4917151927948, | total_activation_sum=131137536
Round 1 | ****EPOCH 6****
Step 00004050 L_out=3.651 Acc=0.82 ---22876.62 ms/batch
Step 00004100 L_out=3.226 Acc=0.85 ---46697.79 ms/batch
Step 00004150 L_out=2.851 Acc=0.81 ---70450.85 ms/batch
Step 00004200 L_out=5.099 Acc=0.79 ---94155.48 ms/batch
Step 00004250 L_out=3.815 Acc=0.73 ---118322.20 ms/batch
Step 00004300 L_out=5.485 Acc=0.66 ---142109.74 ms/batch
Step 00004350 L_out=5.795 Acc=0.59 ---165747.19 ms/batch
Step 00004400 L_out=4.014 Acc=0.85 ---189551.45 ms/batch
Step 00004450 L_out=4.263 Acc=0.87 ---213515.37 ms/batch
Step 00004500 L_out=2.959 Acc=0.89 ---237201.29 ms/batch
Step 00004550 L_out=4.676 Acc=0.81 ---261112.76 ms/batch
Step 00004600 L_out=4.140 Acc=0.83 ---284841.43 ms/batch
Step 00004650 L_out=5.377 Acc=0.71 ---308600.50 ms/batch
Round 1 | epoch=6, train costTime=317.6928987503052, | total_activation_sum=131137536
Round 1 | ****EPOCH 7****
Step 00004700 L_out=4.478 Acc=0.76 ---14847.38 ms/batch
Step 00004750 L_out=5.124 Acc=0.60 ---38662.19 ms/batch
Step 00004800 L_out=6.581 Acc=0.43 ---62488.05 ms/batch
Step 00004850 L_out=3.139 Acc=0.82 ---86679.69 ms/batch
Step 00004900 L_out=6.107 Acc=0.59 ---110455.35 ms/batch
Step 00004950 L_out=5.711 Acc=0.52 ---134293.56 ms/batch
Step 00005000 L_out=4.807 Acc=0.80 ---158136.22 ms/batch
Step 00005050 L_out=3.340 Acc=0.86 ---181885.25 ms/batch
Step 00005100 L_out=5.018 Acc=0.85 ---205630.23 ms/batch
Step 00005150 L_out=3.819 Acc=0.90 ---229676.97 ms/batch
Step 00005200 L_out=3.621 Acc=0.73 ---253401.75 ms/batch
Step 00005250 L_out=3.640 Acc=0.82 ---277099.53 ms/batch
Step 00005300 L_out=1.879 Acc=0.88 ---300960.55 ms/batch
Round 1 | epoch=7, train costTime=317.9850552082062, | total_activation_sum=131137536
Round 1 | ****EPOCH 8****
Step 00005350 L_out=5.003 Acc=0.64 --- 6794.45 ms/batch
Step 00005400 L_out=5.038 Acc=0.62 ---30513.19 ms/batch
Step 00005450 L_out=5.343 Acc=0.77 ---54300.35 ms/batch
Step 00005500 L_out=3.754 Acc=0.83 ---78028.89 ms/batch
Step 00005550 L_out=4.153 Acc=0.84 ---101929.43 ms/batch
Step 00005600 L_out=2.220 Acc=0.88 ---125757.06 ms/batch
Step 00005650 L_out=3.894 Acc=0.85 ---149502.95 ms/batch
Step 00005700 L_out=3.732 Acc=0.83 ---173400.58 ms/batch
Step 00005750 L_out=2.684 Acc=0.75 ---197176.08 ms/batch
Step 00005800 L_out=2.860 Acc=0.86 ---221065.15 ms/batch
Step 00005850 L_out=3.749 Acc=0.68 ---244862.60 ms/batch
Step 00005900 L_out=3.570 Acc=0.91 ---268674.81 ms/batch
Step 00005950 L_out=4.044 Acc=0.87 ---292343.76 ms/batch
Step 00006000 L_out=3.492 Acc=0.89 ---316053.78 ms/batch
Round 1 | epoch=8, train costTime=317.4255154132843, | total_activation_sum=131137536
Round 1 | ****EPOCH 9****
Step 00006050 L_out=2.919 Acc=0.94 ---22531.62 ms/batch
Step 00006100 L_out=3.167 Acc=0.81 ---46270.16 ms/batch
Step 00006150 L_out=3.076 Acc=0.80 ---70028.11 ms/batch
Step 00006200 L_out=2.332 Acc=0.92 ---93687.78 ms/batch
Step 00006250 L_out=4.549 Acc=0.77 ---117679.64 ms/batch
Step 00006300 L_out=3.682 Acc=0.87 ---141492.21 ms/batch
Step 00006350 L_out=3.839 Acc=0.85 ---165341.78 ms/batch
Step 00006400 L_out=2.461 Acc=0.91 ---189216.71 ms/batch
Step 00006450 L_out=3.801 Acc=0.89 ---213008.67 ms/batch
Step 00006500 L_out=2.265 Acc=0.85 ---236695.98 ms/batch
Step 00006550 L_out=4.882 Acc=0.76 ---260543.82 ms/batch
Step 00006600 L_out=3.081 Acc=0.79 ---284633.67 ms/batch
Step 00006650 L_out=3.111 Acc=0.84 ---308436.45 ms/batch
Round 1 | epoch=9, train costTime=317.98158073425293, | total_activation_sum=131137536
Round 1 | ****EPOCH 10****
Step 00006700 L_out=7.238 Acc=0.80 ---14173.51 ms/batch
Step 00006750 L_out=3.835 Acc=0.83 ---37899.63 ms/batch
Step 00006800 L_out=3.606 Acc=0.84 ---61668.68 ms/batch
Step 00006850 L_out=3.732 Acc=0.75 ---85551.75 ms/batch
Step 00006900 L_out=5.565 Acc=0.78 ---109356.11 ms/batch
Step 00006950 L_out=2.404 Acc=0.95 ---133226.40 ms/batch
Step 00007000 L_out=3.477 Acc=0.77 ---156800.32 ms/batch
Step 00007050 L_out=1.368 Acc=0.90 ---180485.76 ms/batch
Step 00007100 L_out=2.100 Acc=0.83 ---204230.81 ms/batch
Step 00007150 L_out=1.478 Acc=0.93 ---228207.89 ms/batch
Step 00007200 L_out=1.909 Acc=0.82 ---251933.96 ms/batch
Step 00007250 L_out=2.779 Acc=0.79 ---275623.75 ms/batch
Step 00007300 L_out=2.365 Acc=0.85 ---299354.37 ms/batch
Round 1 | epoch=10, train costTime=316.95600724220276, | total_activation_sum=131137536
Round 1 | ****EPOCH 11****
Step 00007350 L_out=2.835 Acc=0.89 --- 6209.73 ms/batch
Step 00007400 L_out=7.799 Acc=0.79 ---30012.98 ms/batch
Step 00007450 L_out=1.989 Acc=0.89 ---53794.28 ms/batch
Step 00007500 L_out=2.487 Acc=0.80 ---77681.52 ms/batch
Step 00007550 L_out=1.756 Acc=0.88 ---101445.81 ms/batch
Step 00007600 L_out=2.158 Acc=0.91 ---125141.25 ms/batch
Step 00007650 L_out=2.351 Acc=0.86 ---148968.13 ms/batch
Step 00007700 L_out=5.061 Acc=0.69 ---172825.51 ms/batch
Step 00007750 L_out=2.545 Acc=0.90 ---196594.87 ms/batch
Step 00007800 L_out=2.904 Acc=0.89 ---220529.40 ms/batch
Step 00007850 L_out=2.887 Acc=0.79 ---244539.37 ms/batch
Step 00007900 L_out=3.334 Acc=0.83 ---268110.46 ms/batch
Step 00007950 L_out=4.419 Acc=0.81 ---291811.05 ms/batch
Step 00008000 L_out=2.551 Acc=0.92 ---315785.65 ms/batch
Round 1 | epoch=11, train costTime=317.6927649974823, | total_activation_sum=131137536
Round 1 | ****EPOCH 12****
Step 00008050 L_out=2.496 Acc=0.94 ---21799.86 ms/batch
Step 00008100 L_out=3.743 Acc=0.83 ---45650.97 ms/batch
Step 00008150 L_out=1.588 Acc=0.95 ---69312.36 ms/batch
Step 00008200 L_out=1.781 Acc=0.91 ---93013.11 ms/batch
Step 00008250 L_out=2.309 Acc=0.93 ---116973.74 ms/batch
Step 00008300 L_out=2.600 Acc=0.80 ---140709.08 ms/batch
Step 00008350 L_out=2.021 Acc=0.84 ---164570.10 ms/batch
Step 00008400 L_out=1.791 Acc=0.89 ---188334.14 ms/batch
Step 00008450 L_out=3.887 Acc=0.78 ---211866.65 ms/batch
Step 00008500 L_out=1.846 Acc=0.88 ---235786.12 ms/batch
Step 00008550 L_out=2.286 Acc=0.83 ---259567.17 ms/batch
Step 00008600 L_out=2.954 Acc=0.84 ---283210.04 ms/batch
Step 00008650 L_out=3.711 Acc=0.88 ---307082.39 ms/batch
Round 1 | epoch=12, train costTime=317.0793173313141, | total_activation_sum=131137536
Round 1 | ****EPOCH 13****
Step 00008700 L_out=2.105 Acc=0.93 ---13769.70 ms/batch
Step 00008750 L_out=3.179 Acc=0.89 ---37477.66 ms/batch
Step 00008800 L_out=2.019 Acc=0.85 ---61338.80 ms/batch
Step 00008850 L_out=2.352 Acc=0.82 ---85321.62 ms/batch
Step 00008900 L_out=3.303 Acc=0.90 ---109171.27 ms/batch
Step 00008950 L_out=3.876 Acc=0.81 ---133019.27 ms/batch
Step 00009000 L_out=6.235 Acc=0.72 ---156972.49 ms/batch
Step 00009050 L_out=3.331 Acc=0.92 ---180816.92 ms/batch
Step 00009100 L_out=1.871 Acc=0.89 ---204382.18 ms/batch
Step 00009150 L_out=2.212 Acc=0.87 ---228028.21 ms/batch
Step 00009200 L_out=1.502 Acc=0.92 ---251982.36 ms/batch
Step 00009250 L_out=3.735 Acc=0.87 ---275613.74 ms/batch
Step 00009300 L_out=1.516 Acc=0.93 ---299567.32 ms/batch
Round 1 | epoch=13, train costTime=317.50369024276733, | total_activation_sum=131137536
Round 1 | ****EPOCH 14****
Step 00009350 L_out=28.077 Acc=0.49 --- 5628.81 ms/batch
Step 00009400 L_out=3.976 Acc=0.85 ---29373.09 ms/batch
Step 00009450 L_out=2.789 Acc=0.90 ---53007.84 ms/batch
Step 00009500 L_out=1.641 Acc=0.92 ---76816.06 ms/batch
Step 00009550 L_out=2.283 Acc=0.90 ---100490.68 ms/batch
Step 00009600 L_out=3.094 Acc=0.93 ---124392.93 ms/batch
Step 00009650 L_out=2.269 Acc=0.82 ---148354.26 ms/batch
Step 00009700 L_out=1.082 Acc=0.93 ---172105.77 ms/batch
Step 00009750 L_out=2.501 Acc=0.95 ---195881.21 ms/batch
Step 00009800 L_out=1.821 Acc=0.92 ---219697.48 ms/batch
Step 00009850 L_out=2.008 Acc=0.90 ---243808.62 ms/batch
Step 00009900 L_out=5.278 Acc=0.79 ---267676.09 ms/batch
Step 00009950 L_out=2.217 Acc=0.86 ---291552.57 ms/batch
Step 00010000 L_out=1.890 Acc=0.93 ---315217.98 ms/batch
Round 1 | epoch=14, train costTime=317.60135531425476, | total_activation_sum=131137536
Round 1 | ****EPOCH 15****
Step 00010050 L_out=2.443 Acc=0.85 ---21425.44 ms/batch
Step 00010100 L_out=2.973 Acc=0.87 ---45209.11 ms/batch
Step 00010150 L_out=2.492 Acc=0.85 ---69086.61 ms/batch
Step 00010200 L_out=3.570 Acc=0.91 ---93158.04 ms/batch
Step 00010250 L_out=2.235 Acc=0.96 ---117069.74 ms/batch
Step 00010300 L_out=3.065 Acc=0.88 ---140893.45 ms/batch
Step 00010350 L_out=1.619 Acc=0.94 ---164688.80 ms/batch
Step 00010400 L_out=2.593 Acc=0.81 ---188527.20 ms/batch
Step 00010450 L_out=2.489 Acc=0.97 ---212441.55 ms/batch
Step 00010500 L_out=4.686 Acc=0.71 ---236332.66 ms/batch
Step 00010550 L_out=1.613 Acc=0.89 ---260219.75 ms/batch
Step 00010600 L_out=1.669 Acc=0.94 ---283916.52 ms/batch
Step 00010650 L_out=1.458 Acc=0.97 ---307875.21 ms/batch
Round 1 | epoch=15, train costTime=318.42069721221924, | total_activation_sum=131137536
Round 1 | ****EPOCH 16****
Step 00010700 L_out=5.042 Acc=0.82 ---13407.09 ms/batch
Step 00010750 L_out=1.631 Acc=0.95 ---37408.86 ms/batch
Step 00010800 L_out=1.254 Acc=0.92 ---61432.55 ms/batch
Step 00010850 L_out=3.629 Acc=0.90 ---85420.56 ms/batch
Step 00010900 L_out=2.345 Acc=0.87 ---109165.21 ms/batch
Step 00010950 L_out=2.300 Acc=0.93 ---132881.22 ms/batch
Step 00011000 L_out=1.039 Acc=0.94 ---156676.90 ms/batch
Step 00011050 L_out=3.486 Acc=0.87 ---180525.75 ms/batch
Step 00011100 L_out=2.398 Acc=0.90 ---204161.54 ms/batch
Step 00011150 L_out=0.468 Acc=0.99 ---227784.17 ms/batch
Step 00011200 L_out=1.977 Acc=0.95 ---251445.99 ms/batch
Step 00011250 L_out=1.992 Acc=0.90 ---275425.50 ms/batch
Step 00011300 L_out=1.911 Acc=0.92 ---299185.11 ms/batch
Round 1 | epoch=16, train costTime=317.7658531665802, | total_activation_sum=131137536
Round 1 | ****EPOCH 17****
Step 00011350 L_out=2.603 Acc=0.85 --- 5146.96 ms/batch
Step 00011400 L_out=1.170 Acc=0.96 ---28988.26 ms/batch
Step 00011450 L_out=2.627 Acc=0.93 ---52902.48 ms/batch
Step 00011500 L_out=3.565 Acc=0.85 ---76589.63 ms/batch
Step 00011550 L_out=3.679 Acc=0.83 ---100424.97 ms/batch
Step 00011600 L_out=1.891 Acc=0.93 ---124017.89 ms/batch
Step 00011650 L_out=2.805 Acc=0.92 ---147814.68 ms/batch
Step 00011700 L_out=1.299 Acc=0.97 ---171599.16 ms/batch
Step 00011750 L_out=2.910 Acc=0.83 ---195396.93 ms/batch
Step 00011800 L_out=3.275 Acc=0.81 ---219485.35 ms/batch
Step 00011850 L_out=1.282 Acc=0.96 ---243386.44 ms/batch
Step 00011900 L_out=2.862 Acc=0.91 ---267122.87 ms/batch
Step 00011950 L_out=0.990 Acc=0.96 ---290771.57 ms/batch
Step 00012000 L_out=2.270 Acc=0.92 ---314456.51 ms/batch
Round 1 | epoch=17, train costTime=317.31082677841187, | total_activation_sum=131137536
Round 1 | epoch=18, current m_iou=0.6869514339433709
Round 1 | Best m_IoU is: 0.687, OA is: 0.917 | val costTime=118.47798299789429
Round 1 | ****EPOCH 18****
Step 00012050 L_out=4.527 Acc=0.78 ---20954.67 ms/batch
Step 00012100 L_out=2.168 Acc=0.85 ---45103.40 ms/batch
Step 00012150 L_out=1.917 Acc=0.92 ---69228.64 ms/batch
Step 00012200 L_out=1.467 Acc=0.94 ---92887.38 ms/batch
Step 00012250 L_out=2.713 Acc=0.80 ---116667.10 ms/batch
Step 00012300 L_out=1.458 Acc=0.94 ---140510.69 ms/batch
Step 00012350 L_out=2.153 Acc=0.92 ---164267.79 ms/batch
Step 00012400 L_out=2.270 Acc=0.90 ---187865.85 ms/batch
Step 00012450 L_out=2.412 Acc=0.87 ---211576.13 ms/batch
Step 00012500 L_out=2.303 Acc=0.92 ---235507.54 ms/batch
Step 00012550 L_out=1.374 Acc=0.94 ---259216.27 ms/batch
Step 00012600 L_out=2.791 Acc=0.90 ---283006.28 ms/batch
Step 00012650 L_out=2.478 Acc=0.90 ---306810.95 ms/batch
Round 1 | epoch=18, train costTime=317.6884250640869, | total_activation_sum=131137536
Round 1 | epoch=19, current m_iou=0.6871828576570409
Round 1 | Best m_IoU is: 0.687, OA is: 0.916 | val costTime=117.157151222229
Round 1 | ****EPOCH 19****
Step 00012700 L_out=0.866 Acc=0.96 ---12904.19 ms/batch
Step 00012750 L_out=2.594 Acc=0.90 ---36793.48 ms/batch
Step 00012800 L_out=1.406 Acc=0.93 ---60620.09 ms/batch
Step 00012850 L_out=1.224 Acc=0.94 ---84164.21 ms/batch
Step 00012900 L_out=2.085 Acc=0.93 ---108055.44 ms/batch
Step 00012950 L_out=1.755 Acc=0.94 ---131987.90 ms/batch
Step 00013000 L_out=1.853 Acc=0.90 ---155682.37 ms/batch
Step 00013050 L_out=4.220 Acc=0.92 ---179432.67 ms/batch
Step 00013100 L_out=1.615 Acc=0.92 ---203265.24 ms/batch
Step 00013150 L_out=1.502 Acc=0.96 ---227031.31 ms/batch
Step 00013200 L_out=1.733 Acc=0.89 ---250962.57 ms/batch
Step 00013250 L_out=0.914 Acc=0.95 ---274675.64 ms/batch
Step 00013300 L_out=2.029 Acc=0.94 ---298596.54 ms/batch
Round 1 | epoch=19, train costTime=317.6196098327637, | total_activation_sum=131137536
Round 1 | epoch=20, current m_iou=0.674793198763469
Round 1 | Best m_IoU is: 0.687, OA is: 0.916 | val costTime=117.49411106109619
Round 1 | ****EPOCH 20****
Step 00013350 L_out=1.127 Acc=0.96 --- 4816.55 ms/batch
Step 00013400 L_out=1.234 Acc=0.94 ---28751.91 ms/batch
Step 00013450 L_out=1.082 Acc=0.96 ---52494.10 ms/batch
Step 00013500 L_out=1.349 Acc=0.92 ---76030.19 ms/batch
Step 00013550 L_out=1.953 Acc=0.92 ---99999.35 ms/batch
Step 00013600 L_out=2.995 Acc=0.91 ---123796.96 ms/batch
Step 00013650 L_out=3.738 Acc=0.73 ---147461.78 ms/batch
Step 00013700 L_out=1.493 Acc=0.95 ---171408.45 ms/batch
Step 00013750 L_out=2.225 Acc=0.89 ---195199.62 ms/batch
Step 00013800 L_out=2.026 Acc=0.91 ---219275.30 ms/batch
Step 00013850 L_out=1.147 Acc=0.92 ---243233.90 ms/batch
Step 00013900 L_out=2.024 Acc=0.90 ---266995.13 ms/batch
Step 00013950 L_out=1.028 Acc=0.94 ---290855.65 ms/batch
Step 00014000 L_out=1.599 Acc=0.95 ---314880.37 ms/batch
Round 1 | epoch=20, train costTime=318.2292625904083, | total_activation_sum=131137536
Round 1 | epoch=21, current m_iou=0.6895496187374567
Round 1 | Best m_IoU is: 0.690, OA is: 0.921 | val costTime=118.36392140388489
Round 1 | ****EPOCH 21****
Step 00014050 L_out=1.838 Acc=0.91 ---20390.24 ms/batch
Step 00014100 L_out=2.109 Acc=0.90 ---44091.70 ms/batch
Step 00014150 L_out=1.779 Acc=0.91 ---67764.56 ms/batch
Step 00014200 L_out=2.540 Acc=0.94 ---91467.13 ms/batch
Step 00014250 L_out=1.892 Acc=0.91 ---115070.99 ms/batch
Step 00014300 L_out=2.105 Acc=0.92 ---138685.29 ms/batch
Step 00014350 L_out=1.946 Acc=0.94 ---162456.39 ms/batch
Step 00014400 L_out=2.164 Acc=0.93 ---186096.35 ms/batch
Step 00014450 L_out=1.518 Acc=0.96 ---209926.12 ms/batch
Step 00014500 L_out=1.986 Acc=0.89 ---233557.49 ms/batch
Step 00014550 L_out=1.098 Acc=0.96 ---257302.74 ms/batch
Step 00014600 L_out=1.713 Acc=0.94 ---280972.98 ms/batch
Step 00014650 L_out=1.082 Acc=0.94 ---305023.55 ms/batch
Round 1 | epoch=21, train costTime=316.44615483283997, | total_activation_sum=131137536
Round 1 | epoch=22, current m_iou=0.6972435296611844
Round 1 | Best m_IoU is: 0.697, OA is: 0.922 | val costTime=117.209707736969
Round 1 | ****EPOCH 22****
Step 00014700 L_out=1.556 Acc=0.93 ---12314.62 ms/batch
Step 00014750 L_out=2.084 Acc=0.90 ---36171.06 ms/batch
Step 00014800 L_out=1.364 Acc=0.96 ---60042.85 ms/batch
Step 00014850 L_out=2.075 Acc=0.88 ---83810.81 ms/batch
Step 00014900 L_out=1.548 Acc=0.96 ---107514.87 ms/batch
Step 00014950 L_out=0.906 Acc=0.96 ---131537.98 ms/batch
Step 00015000 L_out=1.218 Acc=0.96 ---155192.68 ms/batch
Step 00015050 L_out=2.761 Acc=0.89 ---178947.05 ms/batch
Step 00015100 L_out=1.647 Acc=0.95 ---202753.16 ms/batch
Step 00015150 L_out=2.136 Acc=0.92 ---226517.54 ms/batch
Step 00015200 L_out=1.943 Acc=0.88 ---250408.27 ms/batch
Step 00015250 L_out=1.662 Acc=0.94 ---274443.80 ms/batch
Step 00015300 L_out=1.033 Acc=0.96 ---298180.03 ms/batch
Round 1 | epoch=22, train costTime=317.58011746406555, | total_activation_sum=131137536
Round 1 | epoch=23, current m_iou=0.6927537909146348
Round 1 | Best m_IoU is: 0.697, OA is: 0.922 | val costTime=117.51060247421265
Round 1 | ****EPOCH 23****
Step 00015350 L_out=1.595 Acc=0.92 --- 4310.98 ms/batch
Step 00015400 L_out=1.643 Acc=0.94 ---27985.66 ms/batch
Step 00015450 L_out=1.539 Acc=0.91 ---51790.43 ms/batch
Step 00015500 L_out=1.626 Acc=0.94 ---75461.91 ms/batch
Step 00015550 L_out=2.321 Acc=0.88 ---99015.51 ms/batch
Step 00015600 L_out=1.884 Acc=0.94 ---122753.45 ms/batch
Step 00015650 L_out=1.079 Acc=0.96 ---146451.24 ms/batch
Step 00015700 L_out=1.716 Acc=0.96 ---169963.51 ms/batch
Step 00015750 L_out=1.358 Acc=0.94 ---193671.61 ms/batch
Step 00015800 L_out=2.437 Acc=0.93 ---217586.72 ms/batch
Step 00015850 L_out=1.247 Acc=0.94 ---241544.06 ms/batch
Step 00015900 L_out=2.443 Acc=0.91 ---265251.36 ms/batch
Step 00015950 L_out=1.693 Acc=0.92 ---289048.22 ms/batch
Step 00016000 L_out=1.581 Acc=0.93 ---312777.94 ms/batch
Round 1 | epoch=23, train costTime=316.4924786090851, | total_activation_sum=131137536
Round 1 | epoch=24, current m_iou=0.6930640112513109
Round 1 | Best m_IoU is: 0.697, OA is: 0.922 | val costTime=116.94330382347107
Round 1 | ****EPOCH 24****
Step 00016050 L_out=1.273 Acc=0.94 ---20064.64 ms/batch
Step 00016100 L_out=2.095 Acc=0.93 ---43749.96 ms/batch
Step 00016150 L_out=1.378 Acc=0.94 ---67357.54 ms/batch
Step 00016200 L_out=1.414 Acc=0.94 ---91331.90 ms/batch
Step 00016250 L_out=1.349 Acc=0.97 ---115352.11 ms/batch
Step 00016300 L_out=2.072 Acc=0.93 ---139364.46 ms/batch
Step 00016350 L_out=1.646 Acc=0.93 ---163135.76 ms/batch
Step 00016400 L_out=1.186 Acc=0.92 ---186986.93 ms/batch
Step 00016450 L_out=1.638 Acc=0.94 ---210746.99 ms/batch
Step 00016500 L_out=0.982 Acc=0.97 ---234691.56 ms/batch
Step 00016550 L_out=6.628 Acc=0.88 ---258471.22 ms/batch
Step 00016600 L_out=3.221 Acc=0.90 ---282234.26 ms/batch
Step 00016650 L_out=1.365 Acc=0.96 ---305951.01 ms/batch
Round 1 | epoch=24, train costTime=317.8968050479889, | total_activation_sum=131137536
Round 1 | epoch=25, current m_iou=0.6933232466144176
Round 1 | Best m_IoU is: 0.697, OA is: 0.922 | val costTime=116.7983808517456
Round 1 | ****EPOCH 25****
Step 00016700 L_out=1.628 Acc=0.86 ---12052.41 ms/batch
Step 00016750 L_out=1.020 Acc=0.95 ---35816.07 ms/batch
Step 00016800 L_out=0.624 Acc=0.95 ---59733.13 ms/batch
Step 00016850 L_out=1.302 Acc=0.95 ---83536.02 ms/batch
Step 00016900 L_out=1.295 Acc=0.98 ---107308.59 ms/batch
Step 00016950 L_out=2.244 Acc=0.91 ---130903.96 ms/batch
Step 00017000 L_out=1.080 Acc=0.97 ---154810.72 ms/batch
Step 00017050 L_out=1.418 Acc=0.95 ---178804.02 ms/batch
Step 00017100 L_out=0.610 Acc=0.97 ---202583.40 ms/batch
Step 00017150 L_out=1.356 Acc=0.95 ---226275.50 ms/batch
Step 00017200 L_out=0.816 Acc=0.95 ---249809.51 ms/batch
Step 00017250 L_out=0.808 Acc=0.96 ---273550.93 ms/batch
Step 00017300 L_out=0.832 Acc=0.97 ---297503.49 ms/batch
Round 1 | epoch=25, train costTime=317.47913694381714, | total_activation_sum=131137536
Round 1 | epoch=26, current m_iou=0.6931942301159529
Round 1 | Best m_IoU is: 0.697, OA is: 0.922 | val costTime=117.43406534194946
Round 1 | ****EPOCH 26****
Step 00017350 L_out=1.327 Acc=0.93 --- 3840.81 ms/batch
Step 00017400 L_out=1.369 Acc=0.90 ---27663.26 ms/batch
Step 00017450 L_out=0.996 Acc=0.98 ---51335.30 ms/batch
Step 00017500 L_out=1.673 Acc=0.92 ---75172.10 ms/batch
Step 00017550 L_out=1.522 Acc=0.95 ---98921.74 ms/batch
Step 00017600 L_out=0.815 Acc=0.96 ---122673.74 ms/batch
Step 00017650 L_out=0.827 Acc=0.96 ---146639.83 ms/batch
Step 00017700 L_out=2.448 Acc=0.87 ---170562.60 ms/batch
Step 00017750 L_out=0.759 Acc=0.98 ---194273.35 ms/batch
Step 00017800 L_out=1.348 Acc=0.97 ---217800.43 ms/batch
Step 00017850 L_out=1.513 Acc=0.93 ---241583.81 ms/batch
Step 00017900 L_out=1.131 Acc=0.96 ---265339.45 ms/batch
Step 00017950 L_out=0.743 Acc=0.97 ---289521.81 ms/batch
Step 00018000 L_out=0.990 Acc=0.95 ---313368.45 ms/batch
Round 1 | epoch=26, train costTime=317.5909740924835, | total_activation_sum=131137536
Round 1 | epoch=27, current m_iou=0.6952090649405698
Round 1 | Best m_IoU is: 0.697, OA is: 0.922 | val costTime=117.90422320365906
Round 1 | ****EPOCH 27****
Step 00018050 L_out=1.308 Acc=0.94 ---19554.07 ms/batch
Step 00018100 L_out=1.612 Acc=0.92 ---43499.00 ms/batch
Step 00018150 L_out=1.572 Acc=0.88 ---67328.09 ms/batch
Step 00018200 L_out=1.657 Acc=0.93 ---91215.94 ms/batch
Step 00018250 L_out=1.474 Acc=0.93 ---114894.40 ms/batch
Step 00018300 L_out=1.101 Acc=0.96 ---138707.39 ms/batch
Step 00018350 L_out=1.217 Acc=0.96 ---162520.48 ms/batch
Step 00018400 L_out=1.625 Acc=0.97 ---186503.71 ms/batch
Step 00018450 L_out=1.724 Acc=0.96 ---210276.19 ms/batch
Step 00018500 L_out=2.724 Acc=0.92 ---233825.15 ms/batch
Step 00018550 L_out=1.874 Acc=0.94 ---257578.67 ms/batch
Step 00018600 L_out=1.678 Acc=0.95 ---281185.96 ms/batch
Step 00018650 L_out=1.655 Acc=0.91 ---304948.65 ms/batch
Round 1 | epoch=27, train costTime=317.22108364105225, | total_activation_sum=131137536
Round 1 | epoch=28, current m_iou=0.6921484571854061
Round 1 | Best m_IoU is: 0.697, OA is: 0.922 | val costTime=117.75467896461487
Round 1 | ****EPOCH 28****
Step 00018700 L_out=1.559 Acc=0.95 ---11435.71 ms/batch
Step 00018750 L_out=1.098 Acc=0.97 ---35149.77 ms/batch
Step 00018800 L_out=1.573 Acc=0.95 ---58854.84 ms/batch
Step 00018850 L_out=2.381 Acc=0.85 ---82389.34 ms/batch
Step 00018900 L_out=1.552 Acc=0.94 ---106211.42 ms/batch
Step 00018950 L_out=0.878 Acc=0.96 ---130060.26 ms/batch
Step 00019000 L_out=3.277 Acc=0.94 ---153625.06 ms/batch
Step 00019050 L_out=1.257 Acc=0.95 ---177445.03 ms/batch
Step 00019100 L_out=0.766 Acc=0.94 ---201371.71 ms/batch
Step 00019150 L_out=1.651 Acc=0.95 ---225306.14 ms/batch
Step 00019200 L_out=1.471 Acc=0.94 ---248947.30 ms/batch
Step 00019250 L_out=1.977 Acc=0.93 ---272829.01 ms/batch
Step 00019300 L_out=1.266 Acc=0.96 ---296599.65 ms/batch
Round 1 | epoch=28, train costTime=317.1934061050415, | total_activation_sum=131137536
Round 1 | epoch=29, current m_iou=0.6933472128964755
Round 1 | Best m_IoU is: 0.697, OA is: 0.922 | val costTime=117.22744727134705
Round 1 | ****EPOCH 29****
Step 00019350 L_out=1.130 Acc=0.96 --- 3327.02 ms/batch
Step 00019400 L_out=2.858 Acc=0.85 ---27042.49 ms/batch
Step 00019450 L_out=1.240 Acc=0.95 ---50709.42 ms/batch
Step 00019500 L_out=2.416 Acc=0.93 ---74437.18 ms/batch
Step 00019550 L_out=2.516 Acc=0.89 ---98201.96 ms/batch
Step 00019600 L_out=1.141 Acc=0.96 ---121923.63 ms/batch
Step 00019650 L_out=1.166 Acc=0.97 ---145668.73 ms/batch
Step 00019700 L_out=1.514 Acc=0.96 ---169548.61 ms/batch
Step 00019750 L_out=0.737 Acc=0.94 ---193281.77 ms/batch
Step 00019800 L_out=1.135 Acc=0.97 ---217000.19 ms/batch
Step 00019850 L_out=1.033 Acc=0.96 ---240905.92 ms/batch
Step 00019900 L_out=1.907 Acc=0.91 ---264622.93 ms/batch
Step 00019950 L_out=1.217 Acc=0.92 ---288441.90 ms/batch
Step 00020000 L_out=2.563 Acc=0.91 ---311950.21 ms/batch
Round 1 | epoch=29, train costTime=316.7326681613922, | total_activation_sum=131137536
Round 1 | epoch=30, current m_iou=0.6930897117049258
Round 1 | Best m_IoU is: 0.697, OA is: 0.922 | val costTime=116.60268354415894
Round 1 | ****EPOCH 30****
