인공 신경망

introduction

• chain rule
• gradient descent
• structure of neural network
• backpropagation
• singular value decomposition
• principal component analysis

memo

• https://en.wikipedia.org/wiki/Gradient_descent
• https://en.wikipedia.org/wiki/Stochastic_gradient_descent
• http://playground.tensorflow.org/#activation=tanh&batchSize=10&dataset=circle&regDataset=reg-plane&learningRate=0.03&regularizationRate=0&noise=0&networkShape=4,2&seed=0.05287&showTestData=false&discretize=false&percTrainData=50&x=true&y=true&xTimesY=false&xSquared=false&ySquared=false&cosX=false&sinX=false&cosY=false&sinY=false&collectStats=false&problem=classification&initZero=false

related items

• Chainer