> Trying to organise the vast majority of Deep Learning resources that I encounter.
If you want to contribute, feel free to make a pull request.
The Readme currently gets generated based on the Lnkr API from Zero to Singularity at [https: // lnkr.zerotosingularity.com](https: // lnkr.zerotosingularity.com) which is currently not publicly available yet. Feel free to contact me at [email protected] if you would like to contribute.
- Aws
- Benchmarking
- Blogs
- Books
- Build Your Own Dl Machine
- Communities
- Conferences
- Datasets
- Docker
- Face Recognition
- Frameworks
- Gan
- Github Repositories
- Infrastructure
- Journalism
- Jupyter Notebooks
- Learning Rate
- Math & Statistics
- Media
- Miscellaneous
- Mobile
- Models
- Nlp
- Ocr
- Online Courses
- Papers
- Playgrounds
- Podcast
- Python Libraries
- Reinforcement Learning
- Reproducible Ai
- Research
- Resnet
- Resources From Courses
- Tips
- Tools
- Videos
- RedditSota/state-of-the-art-result-for-machine-learning-problems
- EpistasisLab/penn-ml-benchmarks: A large, curated repository of benchmark datasets for evaluating supervised machine learning algorithms.
- MLPerf
- u39kun/deep-learning-benchmark: Deep Learning Benchmark for comparing the performance of DL frameworks, GPUs, and single vs half precision
- Benchmarks: Deep Learning Nvidia P100 vs V100 GPU | Xcelerit
- Zero to Singularity
- Google Research
- Microsoft ML Blog
- Apple ML Blog
- Foldl
- Jonas Degrave
- xzh
- Andrew Gibiansky
- Otoro
- No free hunch - The official Kaggle Blog
- Calculated content
- deeplearning.net
- Andrej Karpathy
- Colah
- WildML
- I am trask
- Towards Data Science
- Machine Learning, Data Science, Big Data, Analytics, AI
- Research Blog
- Distill — Latest articles about machine learning
- ML⚡️DL — AI to Hell! – Medium
- Jay Alammar – Visualizing machine learning one concept at a time
- Papers with Code : the latest in machine learning
- Tim Dettmers — Making deep learning accessible.
- Deep Learning Book - Ian Goodfellow and Yoshua Bengio and Aaron Courville (11/2016)
- Neural Networks and Deep Learning - Michael Nielsen (12/2017)
- Hands-on Machine Learning with Scikit-Learn and Tensorflow - Aurélien Géron (3/2017)
- Manning | Grokking Deep Learning
- Manning | Deep Learning with R
- Manning | Real-World Machine Learning
- Manning | Deep Reinforcement Learning in Action
- Manning | Deep Learning and the Game of Go
- Manning | GANs in Action
- Top 10 Books on NLP and Text Analysis – sciforce – Medium
- Manning | Deep Learning with Python
- Manning | Deep Learning with PyTorch
- Build a Deep Learning Rig for $800
- Building your own deep learning box
- The $1700 great Deep Learning box: Assembly, setup and benchmarks
- Build your 1st Deep Learning Rig
- Which GPU(s) to Get for Deep Learning: My Experience and Advice for Using GPUs in Deep Learning (Tim Dettmers)
- GPU Benchmark
- Choosing Components for Personal Deep Learning Machine
- Why building your own Deep Learning computer is 10x cheaper than AWS
- Artificial Intelligence & Deep Learning
- Deep Learning
- AI & Deep Learning Enthusiasts Worldwide
- Artificial Intelligence & Deep Learning - DeepNetGroup
- Deep Learning / AI
- Self-Driving car with Deep Learning
- Artificial intelligence & Deep learning
- Deeplearning.net / Datasets
- Google Street View House Numbers (SVHN)
- MNIST
- Tiny images
- One Hundred Million Creative Commons Flickr Images for Research
- Text REtrieval Conference (TREC) Data - English Test Questions (Topics) File List
- Translation Task - EMNLP 2015 Tenth Workshop on Statistical Machine Translation
- VGG-16
- Pretrained CNNs - MatConvNet
- Visual Geometry Group: Oxford-IIIT Pet Dataset
- fast.ai Datasets
- Tencent/tencent-ml-images: Largest multi-label image database; ResNet-101 model; 80.73% top-1 acc on ImageNet
- ImageNet Large Scale Visual Recognition Competition 2012 (ILSVRC2012)
- chrieke/awesome-satellite-imagery-datasets: List of satellite imagery datasets with annotations for computer vision and deep learning
- Repository configuration | nvidia-docker
- floydhub/dl-docker: An all-in-one Docker image for deep learning. Contains all the popular DL frameworks (TensorFlow, Theano, Torch, Caffe, etc.)
- Explore - Docker Hub
- Use nvidia-docker to create awesome Deep Learning Environments for R (or Python) PT I – Kai Lichtenberg
- Docker Tutorial 5: Nvidia-Docker 2.0 Installation in Ubuntu 18.04
- Tensorflow
- Keras
- Caffe
- Caffe2
- CNTK
- Theano
- PyTorch
- Apache MXNet
- Chainer
- Deeplearning4j
- Deeplearn.js
- Fast.ai
- Lore
- Brain.js
- XGBoost
- Libsvm
- SciKit Learn
- Gluon
- Knet
- TensorLayer
- Keras-Sharp
- Pyro
- GitHub - OlafenwaMoses/ImageAI
- Darknet: Open Source Neural Networks in C
- Create ML | Apple Developer Documentation
- apple/turicreate: Turi Create simplifies the development of custom machine learning models.
- xmartlabs/Bender: Easily craft fast Neural Networks on iOS! Use TensorFlow models. Metal under the hood.
- Progressive Growing of GANs for Improved Quality, Stability, and Variation | Research
- High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
- junyanz/CycleGAN: Software that can generate photos from paintings, turn horses into zebras, perform style transfer, and more.
- junyanz/pytorch-CycleGAN-and-pix2pix: Image-to-image translation in PyTorch (e.g. horse2zebra, edges2cats, and more)
- junyanz/BicycleGAN: [NIPS 2017] Toward Multimodal Image-to-Image Translation
- deepfakes/faceswap: Non official project based on original /r/Deepfakes thread. Many thanks to him!
- faceswap-GAN/notes at master · shaoanlu/faceswap-GAN
- yunjey/StarGAN: PyTorch Implementation of StarGAN - CVPR 2018
- Meow Generator – Alexia Jolicoeur-Martineau
- Meow Generator – Alexia Jolicoeur-Martineau
- Microsoft researchers build an AI that draws what you tell it to
- junyanz/iGAN: Interactive Image Generation via Generative Adversarial Networks
- [1701.07875] Wasserstein GAN
- Generative Adversarial Networks — A Theoretical Walk-Through.
- zi2zi: Master Chinese Calligraphy with Conditional Adversarial Networks
- eriklindernoren/Keras-GAN: Keras implementations of Generative Adversarial Networks.
- eriklindernoren/PyTorch-GAN: PyTorch implementations of Generative Adversarial Networks.
- Hands-on Machine Learning with Scikit-Learn & Tensorflow
- Open.ai gym
- deepmind/lab: A customisable 3D platform for agent-based AI research
- DeepMind
- fast.ai
- OpenAI
- deep-painterly-harmonization/README.md at master · luanfujun/deep-painterly-harmonization
- pytorch/examples: A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
- NervanaSystems/nlp-architect: NLP Architect by Intel AI Lab: Python library for exploring the state-of-the-art deep learning topologies and techniques for natural language processing and natural language understanding
- Nervana
- zhixuhao/unet: unet for image segmentation
- google/python-fire: Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.
- google/sentencepiece: Unsupervised text tokenizer for Neural Network-based text generation.
- autogenerating test data along with arranging it in the directories that are required for lesson 163
- salesforce/awd-lstm-lm: LSTM and QRNN Language Model Toolkit for PyTorch
- KaimingHe/deep-residual-networks: Deep Residual Learning for Image Recognition
- MichalDanielDobrzanski/DeepLearningPython35: neuralnetworksanddeeplearning.com integrated scripts for Python 3.5.2 and Theano with CUDA support
- mnielsen/neural-networks-and-deep-learning: Code samples for my book "Neural Networks and Deep Learning"
- deeppomf/DeepLearningAnimePapers: A list of papers and other resources on deep learning with anime style images.
- FavoritePapers/image_generation.md at master · SeitaroShinagawa/FavoritePapers
- PeterTor/sparse_convolution: sparse convolution Implementation
- general-deep-image-completion/README.md at master · adamstseng/general-deep-image-completion
- uber/horovod: Distributed training framework for TensorFlow, Keras, and PyTorch.
- wookayin/gpustat: 📊 A simple command-line utility for querying and monitoring GPU status
- Model Zoo · BVLC/caffe Wiki
- ysh329/deep-learning-model-convertor: The convertor/conversion of deep learning models for different deep learning frameworks/softwares.
- Microsoft/MMdnn: MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g. model conversion and visualization. Convert models between Caffe, Keras, MXNet, Tensorflow, CNTK, PyTorch Onnx and CoreML.
- ROCm-Developer-Tools/HIP: HIP : Convert CUDA to Portable C++ Code
- piiswrong/deep3d: Automatic 2D-to-3D Video Conversion with CNNs
- Tencent/tencent-ml-images: Largest multi-label image database; ResNet-101 model; 80.73% top-1 acc on ImageNet
- t-SNE – Laurens van der Maaten
- TensorLayer Community
- PacktPublishing/Deep-Learning-with-Keras: Code repository for Deep Learning with Keras published by Packt
- PacktPublishing/Getting-Started-with-TensorFlow: Getting Started with TensorFlow, published by Packt
- PacktPublishing/Advanced-NLP-Projects-with-TensorFlow-2.0
- A gallery of interesting Jupyter Notebooks · jupyter/jupyter Wiki
- facebookresearch/Detectron: FAIR's research platform for object detection research, implementing popular algorithms like Mask R-CNN and RetinaNet.
- matterport/Mask_RCNN: Mask R-CNN for object detection and instance segmentation on Keras and TensorFlow
- facebookresearch/DensePose: A real-time approach for mapping all human pixels of 2D RGB images to a 3D surface-based model of the body
- omni-us/squeezedet-keras: Keras implementation of the Squeeze Det Object Detection Deep Learning Framework
- dennybritz/reinforcement-learning: Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow. Exercises and Solutions to accompany Sutton's Book and David Silver's course.
- eriklindernoren/Keras-GAN: Keras implementations of Generative Adversarial Networks.
- eriklindernoren/PyTorch-GAN: PyTorch implementations of Generative Adversarial Networks.
- eriklindernoren/ML-From-Scratch: Machine Learning From Scratch. Bare bones Python implementations of machine learning models and algorithms with a focus on accessibility. Aims to cover everything from data mining to deep learning.
- zaidalyafeai/Notebooks: Machine learning notebooks in different subjects optimized to run in google collaboratory
- facebookresearch/DensePose: A real-time approach for mapping all human pixels of 2D RGB images to a 3D surface-based model of the body
- NVIDIA/vid2vid: Pytorch implementation of our method for high-resolution (e.g. 2048x1024) photorealistic video-to-video translation.
- floydhub/dl-setup: Instructions for setting up the software on your deep learning machine
- deep_learning_object_detection/README.md at master · hoya012/deep_learning_object_detection
- yunjey/pytorch-tutorial: PyTorch Tutorial for Deep Learning Researchers
- cvhciKIT/sloth: Sloth is a tool for labeling image and video data for computer vision research.
- awslabs/ec2-spot-labs: Collection of tools and code examples to demonstrate best practices in using Amazon EC2 Spot Instances.
- omarsar/nlp_overview: Modern Deep Learning Techniques Applied to Natural Language Processing
- CSAILVision/LabelMeAnnotationTool: Source code for the LabelMe annotation tool.
- DeepMind
- NVIDIA/FastPhotoStyle: Style transfer, deep learning, feature transform
- Paperspace
- Crestle
- Microsoft Azure
- AWS Amazon
- Google Compute Engine
- Infrastructure for Deep Learning
- Finding Good Learning Rate and The One Cycle Policy.
- [1803.09820] A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay
- Another data science student's blog – The 1cycle policy
- Hands-on Machine Learning with Scikit-Learn and Tensorflow - Aurélien Géron (3/2017)
- Probability and Statistics for Programmers
- Probabilistic Programming & Bayesian Methods for Hackers
- Understanding Machine Learning: from Theory to Algorithms
- Elements of statistical learning
- An introduction to statistical learning
- Foundations of data science
- A programmer's guide to data Mining
- Mining massive datasets
- Machine learning yearning
- Transforming Standard Video Into Slow Motion with AI - NVIDIA Developer News CenterNVIDIA Developer News Center
- NVIDIA has Open Sourced an Impressive Video to Video Translation Technique
- imxieyi/CoreML-MPS: Run compiled CoreML(v1) model using MPSNN
- Espresso | A minimal iOS neural network framework
- The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time
- NLP's ImageNet moment has arrived
- The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time
- Visualizing A Neural Machine Translation Model (Mechanics of Seq2seq Models With Attention) – Jay Alammar – Visualizing machine learning one concept at a time
- Dissecting BERT Part 1: The Encoder – Dissecting BERT – Medium
- Dissecting BERT Appendix: The Decoder – Dissecting BERT – Medium
- The fall of RNN / LSTM – Towards Data Science
- A Brief Overview of Attention Mechanism – SyncedReview – Medium
- The Unreasonable Effectiveness of Recurrent Neural Networks
- Google AI Blog: Transformer: A Novel Neural Network Architecture for Language Understanding
- The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time
- The State of Transfer Learning in NLP
- Machine Learning- Coursera - Andrew Ng
- Deep Learning Specialization - Coursera
- Advanced Machine Learning Specialization - Coursera
- Fast.ai
- Deep Learning Udacity
- MIT 6.S094: Deep Learning for Self-Driving Cars
- 6.S191: Introduction to Deep Learning
- CS231n: Convolutional Neural Networks for Visual Recognition
- Google's Machine learning crash course
- Google.ai
- Machine Learning with TensorFlow on Google Cloud Platform | Coursera
- Machine Learning Crash Course | Google Developers
- Self-Driving Car | Udacity
- MIT 6.S094: Deep Learning for Self-Driving Cars
- AI School
- Reviews for Machine Learning from Coursera | Class Central
- Reviews for 6.S191: Introduction to Deep Learning from Massachusetts Institute of Technology | Class Central
- Salesforce Einstein Discovery - Easy AI and Machine Learning | Udemy
- Artificial Intelligence (AI) | edX
- Artificial Intelligence A-Z™: Learn How To Build An AI | Udemy
- Lecture Collection | Convolutional Neural Networks for Visual Recognition (Spring 2017) - YouTube
- CS 188: Introduction to Artificial Intelligence, Fall 2018
- MIT 6.S094: Deep Learning for Self-Driving Cars
- Agoria Academy: Deep Learning Day
- Agoria Academy: Deep Learning Day
- Deep Learning | Coursera
- Stanford CS 224N | Natural Language Processing with Deep Learning
- Deep Learning Papers Reading Roadmap
- Machine Theory of Mind - DeepMind
- [1801.06146] Universal Language Model Fine-tuning for Text ... - arXiv
- A disciplined approach to neural network hyper-parameters: Part 1 ...
- Visualizing and Understanding Convolutional Networks
- Cyclical Learning Rates for Training Neural Networks
- 1704.00109.pdf
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
- Deep Video Portraits
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
- A guide to convolution arithmetic for deep learning
- Generative Reversible Networks
- Patch-Based Image Inpainting with Generative Adversarial Networks
- 1712.00080.pdf
- NVIDIA SPLATNet Research Paper Wins a Major CVPR 2018 Award - NVIDIA Developer News CenterNVIDIA Developer News Center
- Adversarial Attacks on Face Detectors using Neural Net based Constrained Optimization
- 1803.09820.pdf
- Show, Attend and Tell: Neural Image CaptionGeneration with Visual Attention
- 1512.03385.pdf
- https://arxiv.org/pdf/1712.09913.pdf
- https://arxiv.org/pdf/1603.07285.pdf
- [1505.04597] U-Net: Convolutional Networks for Biomedical Image Segmentation
- [1603.05027] Identity Mappings in Deep Residual Networks
- [1712.09913] Visualizing the Loss Landscape of Neural Nets
- [1810.04805v1] BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- [1803.09820] A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay
- [1802.06474] A Closed-form Solution to Photorealistic Image Stylization
- Not All Samples Are Created Equal: Deep Learning with Importance Sampling
- 1911.07658v1.pdf
- Numpy
- Pandas: Python Data Analysis Library
- seaborn: statistical data visualization
- Scikit-Learn
- PDL - Python Download library
- Pyro
- Reinforcement Learning from scratch – Insight Data
- Spinning Up in Deep RL
- dennybritz/reinforcement-learning: Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow. Exercises and Solutions to accompany Sutton's Book and David Silver's course.
- CS294-112 Fa18 11/14/18 - YouTube
- Open-source RL - Google Spreadsheets
- dennybritz/reinforcement-learning: Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow. Exercises and Solutions to accompany Sutton's Book and David Silver's course.
- Open-source RL
- Facebook AI | Tools | Open Source Deep Learning Tools
- Facebook AI Research – Facebook Research
- AI & Deep Learning Publications & Researchers | NVIDIA Research
- Berkeley Artificial Intelligence Research Lab
- Artificial Intelligence Archives - NVIDIA Developer News CenterNVIDIA Developer News Center
- http://arxiv.org/abs/1512.03385
- blog
- code
- http://image-net.org/challenges/LSVRC/2015/
- COCO
- https://github.com/KaimingHe/resnet-1k-layers
- VGG-16
- Training and investigating Residual Nets
- Deep Residual Learning for Image Recognition
- ResNet training in Torch
- Deep Residual learning - paper implementation
- implementation of the deep residual network used for cifar10
- Residual networks in torch (MNIST 100 layers)
- NOAA Right Whale Recognition, Winner's Interview
- Using neon for Scene Recognition: Mini-Places2
- Matlab (MatConvNet) implementation of "Deep Residual Learning for Image Recognition"
- imagenet-resnet.py
- keras-resnet
- ImageNet ILSVRC classification
- ResNet in TensorFlow
- [Introduction to Resnet models](https://github.com/KaimingHe/deep-residual-networks]
- [Cyclical learning rates for training neural networks (paper)](http://arxiv.org/abs/1506.01186]
- [Visually explained convolutions (site)](http://setosa.io/ev/image-kernels/]
- [Sigmoid explained (online book chapter](http://neuralnetworksanddeeplearning.com/chap4.html]
- [Visualizing and understanding convolutional networks (paper)](https://cs.nyu.edu/~fergus/papers/zeilerECCV2014.pdf]
- [Snapshot emsembles](https://arxiv.org/abs/1704.00109]
- [Kaggle-cli](https://github.com/floydwch/kaggle-cli]
- [Summary of lesson 2](https://medium.com/@apiltamang/case-study-a-world-class-image-classifier-for-dogs-and-cats-err-anything-9cf39ee4690e]
- [AWS Setup](https://github.com/reshamas/fastai_deeplearn_part1/blob/master/tools/aws_ami_gpu_setup.md]
- [Tmux](https://github.com/reshamas/fastai_deeplearn_part1/blob/master/tools/tmux.md]
- [Notes on fast.ai](https://github.com/reshamas/fastai_deeplearn_part1/tree/master/tools]
- [Summary of Lesson 2](https://medium.com/@apiltamang/case-study-a-world-class-image-classifier-for-dogs-and-cats-err-anything-9cf39ee4690e]
- [Learning rate finder](https://medium.com/@surmenok/estimating-optimal-learning-rate-for-a-deep-neural-network-ce32f2556ce0]
- [Convolutional Neural Networks in 5 minutes](https://medium.com/@init_27/convolutional-neural-network-in-5-minutes-8f867eb9ca39]
- [Visualizing learning rate vs batch rate](https://miguel-data-sc.github.io/2017-11-05-first/]
- [Decoding the ResNet architecture](http://teleported.in/posts/decoding-resnet-architecture/]
- [A practitioners' guide to PyTorch](https://medium.com/@radekosmulski/a-practitioners-guide-to-pytorch-1d0f6a238040]
- [Techburst: Improving the way we work with learning rate.](https://techburst.io/improving-the-way-we-work-with-learning-rate-5e99554f163b]
- [validation sets](http://www.fast.ai/2017/11/13/validation-sets/]
- [Teleported.in: The Cyclical Learning Rate technique](http://teleported.in/posts/cyclic-learning-rate/]
- [Transfer Learning Using Differential Rates](https://towardsdatascience.com/transfer-learning-using-differential-learning-rates-638455797f00]
- [Deep Learning, NLP, and Representations115](http://colah.github.io/posts/2014-07-NLP-RNNs-Representations/]
- [Structured Deep Learning](https://towardsdatascience.com/structured-deep-learning-b8ca4138b848]
- [Fun with small image data-sets](https://towardsdatascience.com/fun-with-small-image-data-sets-part-2-54d683ca8c96]
- [Optimization for Deep Learning Highlights in 2017](http://ruder.io/deep-learning-optimization-2017/]
- [Entity Embeddings of Categorical Variables](https://arxiv.org/abs/1604.06737]
- NVIDIA Container Runtime and Orchestrators | NVIDIA Developer
- Introducing Apex: PyTorch Extension with Tools to Realize the Power of Tensor Cores - NVIDIA Developer News CenterNVIDIA Developer News Center
- Download DeepStream SDK 2.0 Today to Develop Scalable Video Analytics Applications - NVIDIA Developer News CenterNVIDIA Developer News Center
- Announcing NVIDIA DALI and NVIDIA nvJPEG - NVIDIA Developer News CenterNVIDIA Developer News Center
- NVIDIA Releases TensorRT 4 - NVIDIA Developer News CenterNVIDIA Developer News Center
- lutzroeder/netron: Visualizer for deep learning and machine learning models