Skip to content

42-AI/bootcamp_deep-learning

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 

Repository files navigation

Bootcamp Deep Learning

⚠️ Note: Work in progress; details subject to change ⚠️

Notions of the bootcamp

  • classification tasks
  • supervised learning
  • discriminative deep learning models
  • artificial neural networks (ANNs)
  • deep neural networks (DNNs)

Description

The Deep Learning Bootcamp serves as an extension of the existing 42AI bootcamps: Python & Machine Learning, aiming to introduce participants to advanced concepts in deep learning. Emphasizing consistency with former bootcamps, this program focuses on introducing new notions and concepts specific to deep learning.

Two key considerations include maintaining alignment with past bootcamps and adjusting difficulty levels accordingly.

Given its nature as an extension, the bootcamp may not revisit fundamental concepts already covered in previous bootcamps. Instead, it will delve into more advanced topics across five modules. These modules will include hands-on practices on building neural networks “from scratch” using Python code.

Each module is structured to span one day, although the complexity of the content may necessitate additional time for thorough understanding and application. Adjustments in the duration of each module will be made based on the difficulty of the material covered to ensure comprehensive learning experiences for participants.



Table of Contents


This project is a Deep Learning bootcamp WORKING IN PROGRESS by 42 AI.

As notions seen during this bootcamp can be complex, we very strongly advise students to have previously done the following bootcamps:

42 Artificial Intelligence is a student organization of the Paris campus of the school 42. Our purpose is to foster discussion, learning, and interest in the field of artificial intelligence, by organizing various activities such as lectures and workshops.


Curriculum

Module 10 - Logistic Regression as a Perceptron

  • sigmoid
  • forward
  • predict
  • binary cross entorpy loss
  • deriviatives
  • perceptron

Module 11 - Multilayer Perceptron

  • relu
  • dense layer
  • sgd optimization
  • MLP class
  • training
  • evaluation
  • binary classification

Module 12 - Deep Neural Networks

Delve into Deep Neural Networks (DNNs), understanding their architecture, training process, and applications.

  • tanh
  • normalization: z-score, minmax
  • momentum optimization
  • DNN class
  • binary classification

Module 13 - Multiclass Classification

Understand the principles and techniques for classifying data into multiple categories.

  • lecky relu
  • softmax
  • cross entropy loss
  • RMSProp optimization
  • model architecture
  • multiclass classification

Module 14 - Hyperparameter Tuning and Regularization

Learn to optimize model performance through effective tuning and regularization strategies.

  • heyperprameter tuning: grid, random search
  • regularization: dropout, l2
  • bias-variance trade-off

⚠️ Note: Work in progress; details subject to change ⚠️

Questions?
Email: lab@42ai.fr
Discord: cjung_mo
Slack: cjung-mo
(Jungmoo Cheon, Head of Laboratory at 42AI)

About

Work in Progress

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •