This project is practice to learn pytorch.
Followed pytorch tutorial and implement below paper.
Train Epoch: 1 [0/60000 (0%)] Loss: 2.322105
Train Epoch: 1 [32000/60000 (53%)] Loss: 0.854237
avg_loss : 0.003283941186964512
Train Epoch: 2 [0/60000 (0%)] Loss: 0.626946
Train Epoch: 2 [32000/60000 (53%)] Loss: 0.309972
avg_loss : 0.0018488781061023474
Train Epoch: 3 [0/60000 (0%)] Loss: 0.415800
Train Epoch: 3 [32000/60000 (53%)] Loss: 0.136305
avg_loss : 0.001668571843765676
Train Epoch: 4 [0/60000 (0%)] Loss: 0.159677
Train Epoch: 4 [32000/60000 (53%)] Loss: 0.187449
avg_loss : 0.0016289399936795235
Train Epoch: 5 [0/60000 (0%)] Loss: 0.213525
Train Epoch: 5 [32000/60000 (53%)] Loss: 0.196870
avg_loss : 0.001238086842931807
Train Epoch: 6 [0/60000 (0%)] Loss: 0.121757
Train Epoch: 6 [32000/60000 (53%)] Loss: 0.104535
avg_loss : 0.0013602470280602574
Train Epoch: 7 [0/60000 (0%)] Loss: 0.194563
Train Epoch: 7 [32000/60000 (53%)] Loss: 0.199748
avg_loss : 0.001136988284997642
Train Epoch: 8 [0/60000 (0%)] Loss: 0.090843
Train Epoch: 8 [32000/60000 (53%)] Loss: 0.174476
avg_loss : 0.0008116168901324272
Train Epoch: 9 [0/60000 (0%)] Loss: 0.052138
Train Epoch: 9 [32000/60000 (53%)] Loss: 0.126910
avg_loss : 0.0009767187293618917
Train Epoch: 10 [0/60000 (0%)] Loss: 0.218725
Train Epoch: 10 [32000/60000 (53%)] Loss: 0.161133
avg_loss : 0.0007857843302190304
Train Epoch: 11 [0/60000 (0%)] Loss: 0.121423
Train Epoch: 11 [32000/60000 (53%)] Loss: 0.115775
avg_loss : 0.0007974308100529015
Train Epoch: 12 [0/60000 (0%)] Loss: 0.074311
Train Epoch: 12 [32000/60000 (53%)] Loss: 0.064777
avg_loss : 0.0016709471819922328
Train Epoch: 13 [0/60000 (0%)] Loss: 0.174114
Train Epoch: 13 [32000/60000 (53%)] Loss: 0.228250
avg_loss : 0.0010728255147114396
Train Epoch: 14 [0/60000 (0%)] Loss: 0.150837
Train Epoch: 14 [32000/60000 (53%)] Loss: 0.057710
avg_loss : 0.0007651737541891634
Train Epoch: 15 [0/60000 (0%)] Loss: 0.026097
Train Epoch: 15 [32000/60000 (53%)] Loss: 0.100670
avg_loss : 0.0006887036142870784
Train Epoch: 16 [0/60000 (0%)] Loss: 0.285278
Train Epoch: 16 [32000/60000 (53%)] Loss: 0.206445
avg_loss : 0.0007379432790912688
Train Epoch: 17 [0/60000 (0%)] Loss: 0.179871
Train Epoch: 17 [32000/60000 (53%)] Loss: 0.068141
avg_loss : 0.0008548949263058603
Train Epoch: 18 [0/60000 (0%)] Loss: 0.214126
Train Epoch: 18 [32000/60000 (53%)] Loss: 0.129469
avg_loss : 0.0007858016761019826
Train Epoch: 19 [0/60000 (0%)] Loss: 0.060790
Train Epoch: 19 [32000/60000 (53%)] Loss: 0.045781
avg_loss : 0.000683565333019942
Train Epoch: 20 [0/60000 (0%)] Loss: 0.211438
Train Epoch: 20 [32000/60000 (53%)] Loss: 0.057592
avg_loss : 0.0006947038345970213
Process finished with exit code 0
