Skip to content

Latest commit

 

History

History
111 lines (73 loc) · 4.19 KB

README.md

File metadata and controls

111 lines (73 loc) · 4.19 KB

Bootcamp Deep Learning

⚠️ Note: Work in progress; details subject to change ⚠️

Notions of the bootcamp

  • classification tasks
  • supervised learning
  • discriminative deep learning models
  • artificial neural networks (ANNs)
  • deep neural networks (DNNs)

Description

The Deep Learning Bootcamp serves as an extension of the existing 42AI bootcamps: Python & Machine Learning, aiming to introduce participants to advanced concepts in deep learning. Emphasizing consistency with former bootcamps, this program focuses on introducing new notions and concepts specific to deep learning.

Two key considerations include maintaining alignment with past bootcamps and adjusting difficulty levels accordingly.

Given its nature as an extension, the bootcamp may not revisit fundamental concepts already covered in previous bootcamps. Instead, it will delve into more advanced topics across five modules. These modules will include hands-on practices on building neural networks “from scratch” using Python code.

Each module is structured to span one day, although the complexity of the content may necessitate additional time for thorough understanding and application. Adjustments in the duration of each module will be made based on the difficulty of the material covered to ensure comprehensive learning experiences for participants.



Table of Contents


This project is a Deep Learning bootcamp WORKING IN PROGRESS by 42 AI.

As notions seen during this bootcamp can be complex, we very strongly advise students to have previously done the following bootcamps:

42 Artificial Intelligence is a student organization of the Paris campus of the school 42. Our purpose is to foster discussion, learning, and interest in the field of artificial intelligence, by organizing various activities such as lectures and workshops.

Curriculum

Module 10 - Stepping Into Deep Learning

Introduction to Deep Learning, covering fundamental concepts and principles.

Loss functions, Cost functions
Activation function (sigmoid)
Vectorization
Model evaluation metrics (accuracy)


Module 11 - Optimization

Explore optimization techniques that enhance the training process of deep learning models.

Gradient descent
Advanced optimization techniques (momentum, RMSprop, adam)
Optimization algorithms (SGD)
Normalization


Module 12 - Deep Neural Networks

Delve into Deep Neural Networks (DNNs), understanding their architecture, training process, and applications.

Binary classification
Dense layer, Forward, Backpropagation
Training deep networks


Module 13 - Multiclass Classification

Understand the principles and techniques for classifying data into multiple categories.

Multiclass classification
Model architectures
Softmax, Cross-entropy


Module 14 - Hyperparameter Tuning and Regularization

Learn to optimize model performance through effective tuning and regularization strategies.

Hyperparameter Tuning, Grid Search, Random Search
Regularization, Dropout, Regularization techniques (L2 regularization)
Bias vs. Variance


⚠️ Note: Work in progress; details subject to change ⚠️

Questions?
Email: [email protected]
Discord: cjung_mo
Slack: cjung-mo
(Jungmoo Cheon, Head of Laboratory at 42AI)