I changed the loss of the original lenet5 handwirtten Network:softmax loss.I use the cos-loss replace of it.
The resout acc on test data is higher than the original softmax loss 98.57%.
one:batch 100, 40000steps,the acc on test data is 98.62%.
two:batch 500,8000steps,the acc on test data is 98.95%