Hi! I am a computer science student and this repository is where I am keeping my neural network I am building from scratch! I am doing this project to gain a deeper (pun intended) understanding of neural networks.
The only libraries you need to have are listed below with their pip installations. Numpy is used for linear algebra and tqdm is used to monitor training progress.
pip install numpy
pip install tqdm
- Multiple hidden layers
- Backpropagation
- Multiple activation functions
- Learning rate scheduler
- High level network builder
- Save/Load model architecture and weights (customized file formats)
- Regularization
- Test/Train split
- Dense
- Dropout
- Memory
- Recurrent
- Gradient Descent
- Momentum
- Stochastic Gradient Descent
- Nesterov Accelerated Gradient
- RMSProp
- Adam