Neuralnettf 
Neural Networks Fundamentals using TensorFlow as Example 
28 hours 
This course will give you knowledge in neural networks and generally in machine learning algorithm, deep learning (algorithms and applications).
This training is more focus on fundamentals, but will help you choosing the right technology : TensorFlow, Caffe, Teano, DeepDrive, Keras, etc. The examples are made in TensorFlow.
TensorFlow Basics
Creation, Initializing, Saving, and Restoring TensorFlow variables
Feeding, Reading and Preloading TensorFlow Data
How to use TensorFlow infrastructure to train models at scale
Visualizing and Evaluating models with TensorBoard
TensorFlow Mechanics
Inputs and Placeholders
Build the GraphS
Inference
Loss
Training
Train the Model
The Graph
The Session
Train Loop
Evaluate the Model
Build the Eval Graph
Eval Output
The Perceptron
Activation functions
The perceptron learning algorithm
Binary classification with the perceptron
Document classification with the perceptron
Limitations of the perceptron
From the Perceptron to Support Vector Machines
Kernels and the kernel trick
Maximum margin classification and support vectors
Artificial Neural Networks
Nonlinear decision boundaries
Feedforward and feedback artificial neural networks
Multilayer perceptrons
Minimizing the cost function
Forward propagation
Back propagation
Improving the way neural networks learn
Convolutional Neural Networks
Goals
Model Architecture
Principles
Code Organization
Launching and Training the Model
Evaluating a Model

dladv 
Advanced Deep Learning 
28 hours 
Machine Learning Limitations
Machine Learning, Nonlinear mappings
Neural Networks
NonLinear Optimization, Stochastic/MiniBatch Gradient Decent
Back Propagation
Deep Sparse Coding
Sparse Autoencoders (SAE)
Convolutional Neural Networks (CNNs)
Successes: Descriptor Matching
Stereobased Obstacle
Avoidance for Robotics
Pooling and invariance
Visualization/Deconvolutional Networks
Recurrent Neural Networks (RNNs) and their optimizaiton
Applications to NLP
RNNs continued,
HessianFree Optimization
Language analysis: word/sentence vectors, parsing, sentiment analysis, etc.
Probabilistic Graphical Models
Hopfield Nets, Boltzmann machines, Restricted Boltzmann Machines
Hopfield Networks, (Restricted) Bolzmann Machines
Deep Belief Nets, Stacked RBMs
Applications to NLP , Pose and Activity Recognition in Videos
Recent Advances
LargeScale Learning
Neural Turing Machines

mldt 
Machine Learning and Deep Learning 
21 hours 
This course covers AI (emphasizing Machine Learning and Deep Learning)Machine learning
Introduction to Machine Learning
Applications of machine learning
Supervised Versus Unsupervised Learning
Machine Learning Algorithms
Regression
Classification
Clustering
Recommender System
Anomaly Detection
Reinforcement Learning
Regression
Simple & Multiple Regression
Least Square Method
Estimating the Coefficients
Assessing the Accuracy of the Coefficient Estimates
Assessing the Accuracy of the Model
Post Estimation Analysis
Other Considerations in the Regression Models
Qualitative Predictors
Extensions of the Linear Models
Potential Problems
Biasvariance trade off [underfitting/overfitting] for regression models
Resampling Methods
CrossValidation
The Validation Set Approach
LeaveOneOut CrossValidation
kFold CrossValidation
BiasVariance TradeOff for kFold
The Bootstrap
Model Selection and Regularization
Subset Selection [Best Subset Selection, Stepwise Selection, Choosing the Optimal Model]
Shrinkage Methods/ Regularization [Ridge Regression, Lasso & Elastic Net]
Selecting the Tuning Parameter
Dimension Reduction Methods
Principal Components Regression
Partial Least Squares
Classification
Logistic Regression
The Logistic Model cost function
Estimating the Coefficients
Making Predictions
Odds Ratio
Performance Evaluation Matrices
[Sensitivity/Specificity/PPV/NPV, Precision, ROC curve etc.]
Multiple Logistic Regression
Logistic Regression for >2 Response Classes
Regularized Logistic Regression
Linear Discriminant Analysis
Using Bayes’ Theorem for Classification
Linear Discriminant Analysis for p=1
Linear Discriminant Analysis for p >1
Quadratic Discriminant Analysis
KNearest Neighbors
Classification with Nonlinear Decision Boundaries
Support Vector Machines
Optimization Objective
The Maximal Margin Classifier
Kernels
OneVersusOne Classification
OneVersusAll Classification
Comparison of Classification Methods
Introduction to Deep Learning
ANN Structure
Biological neurons and artificial neurons
Nonlinear Hypothesis
Model Representation
Examples & Intuitions
Transfer Function/ Activation Functions
Typical classes of network architectures
Feed forward ANN.
Structures of Multilayer feed forward networks
Back propagation algorithm
Back propagation  training and convergence
Functional approximation with back propagation
Practical and design issues of back propagation learning
Deep Learning
Artificial Intelligence & Deep Learning
Softmax Regression
SelfTaught Learning
Deep Networks
Demos and Applications
Lab:
Getting Started with R
Introduction to R
Basic Commands & Libraries
Data Manipulation
Importing & Exporting data
Graphical and Numerical Summaries
Writing functions
Regression
Simple & Multiple Linear Regression
Interaction Terms
Nonlinear Transformations
Dummy variable regression
CrossValidation and the Bootstrap
Subset selection methods
Penalization [Ridge, Lasso, Elastic Net]
Classification
Logistic Regression, LDA, QDA, and KNN,
Resampling & Regularization
Support Vector Machine
Resampling & Regularization
Artificial Neural Network
Deep Learning
Note:
For ML algorithms, case studies will be used to discuss their application, advantages & potential issues.
Analysis of different data sets will be performed using R

matlabml1 
Introduction to Machine Learning with MATLAB 
21 hours 
MATLAB Basics
MATLAB More Advanced Features
BP Neural Network
RBF, GRNN and PNN Neural Networks
SOM Neural Networks
Support Vector Machine, SVM
Extreme Learning Machine, ELM
Decision Trees and Random Forests
Genetic Algorithm, GA
Particle Swarm Optimization, PSO
Ant Colony Algorithm, ACA
Simulated Annealing, SA
Dimenationality Reduction and Feature Selection

aiauto 
Artificial Intelligence in Automotive 
14 hours 
This course covers AI (emphasizing Machine Learning and Deep Learning) in Automotive Industry. It helps to determine which technology can be (potentially) used in multiple situation in a car: from simple automation, image recognition to autonomous decision making.
Current state of the technology
What is used
What may be potentially used
Rules based AI
Simplifying decision
Machine Learning
Classification
Clustering
Neural Networks
Types of Neural Networks
Presentation of working examples and discussion
Deep Learning
Basic vocabulary
When to use Deep Learning, when not to
Estimating computational resources and cost
Very short theoretical background to Deep Neural Networks
Deep Learning in practice (mainly using TensorFlow)
Preparing Data
Choosing loss function
Choosing appropriate type on neural network
Accuracy vs speed and resources
Training neural network
Measuring efficiency and error
Sample usage
Anomaly detection
Image recognition
ADAS

deepmclrg 
Machine Learning & Deep Learning with Python and R 
14 hours 
MACHINE LEARNING
1: Introducing Machine Learning
The origins of machine learning
Uses and abuses of machine learning
Ethical considerations
How do machines learn?
Abstraction and knowledge representation
Generalization
Assessing the success of learning
Steps to apply machine learning to your data
Choosing a machine learning algorithm
Thinking about the input data
Thinking about types of machine learning algorithms
Matching your data to an appropriate algorithm
Using R for machine learning
Installing and loading R packages
Installing an R package
Installing a package using the pointandclick interface
Loading an R package
Summary
2: Managing and Understanding Data
R data structures
Vectors
Factors
Lists
Data frames
Matrixes and arrays
Managing data with R
Saving and loading R data structures
Importing and saving data from CSV files
Importing data from SQL databases
Exploring and understanding data
Exploring the structure of data
Exploring numeric variables
Measuring the central tendency – mean and median
Measuring spread – quartiles and the fivenumber summary
Visualizing numeric variables – boxplots
Visualizing numeric variables – histograms
Understanding numeric data – uniform and normal distributions
Measuring spread – variance and standard deviation
Exploring categorical variables
Measuring the central tendency – the mode
Exploring relationships between variables
Visualizing relationships – scatterplots
Examining relationships – twoway crosstabulations
Summary
3: Lazy Learning – Classification Using Nearest Neighbors
Understanding classification using nearest neighbors
The kNN algorithm
Calculating distance
Choosing an appropriate k
Preparing data for use with kNN
Why is the kNN algorithm lazy?
Diagnosing breast cancer with the kNN algorithm
Step 1 – collecting data
Step 2 – exploring and preparing the data
Transformation – normalizing numeric data
Data preparation – creating training and test datasets
Step 3 – training a model on the data
Step 4 – evaluating model performance
Step 5 – improving model performance
Transformation – zscore standardization
Testing alternative values of k
Summary
4: Probabilistic Learning – Classification Using
Naive Bayes
Understanding naive Bayes
Basic concepts of Bayesian methods
Probability
Joint probability
Conditional probability with Bayes' theorem
The naive Bayes algorithm
The naive Bayes classification
The Laplace estimator
Using numeric features with naive Bayes
Example – filtering mobile phone spam with the naive Bayes algorithm
Step 1 – collecting data
Step 2 – exploring and preparing the data
Data preparation – processing text data for analysis
Data preparation – creating training and test datasets
Visualizing text data – word clouds
Data preparation – creating indicator features for frequent words
Step 3 – training a model on the data
Step 4 – evaluating model performance
Step 5 – improving model performance
Summary
5: Divide and Conquer – Classification Using
Decision Trees and Rules
Understanding decision trees
Divide and conquer
The C5.0 decision tree algorithm
Choosing the best split
Pruning the decision tree
Example – identifying risky bank loans using C5.0 decision trees
Step 1 – collecting data
Step 2 – exploring and preparing the data
Data preparation – creating random training and test datasets
Step 3 – training a model on the data
Step 4 – evaluating model performance
Step 5 – improving model performance
Boosting the accuracy of decision trees
Making some mistakes more costly than others
Understanding classification rules
Separate and conquer
The One Rule algorithm
The RIPPER algorithm
Rules from decision trees
Example – identifying poisonous mushrooms with rule learners
Step 1 – collecting data
Step 2 – exploring and preparing the data
Step 3 – training a model on the data
Step 4 – evaluating model performance
Step 5 – improving model performance
Summary
6: Forecasting Numeric Data – Regression Methods
Understanding regression
Simple linear regression
Ordinary least squares estimation
Correlations
Multiple linear regression
Example – predicting medical expenses using linear regression
Step 1 – collecting data
Step 2 – exploring and preparing the data
Exploring relationships among features – the correlation matrix
Visualizing relationships among features – the scatterplot matrix
Step 3 – training a model on the data
Step 4 – evaluating model performance
Step 5 – improving model performance
Model specification – adding nonlinear relationships
Transformation – converting a numeric variable to a binary indicator
Model specification – adding interaction effects
Putting it all together – an improved regression model
Understanding regression trees and model trees
Adding regression to trees
Example – estimating the quality of wines with regression trees
and model trees
Step 1 – collecting data
Step 2 – exploring and preparing the data
Step 3 – training a model on the data
Visualizing decision trees
Step 4 – evaluating model performance
Measuring performance with mean absolute error
Step 5 – improving model performance
Summary
7: Black Box Methods – Neural Networks and
Support Vector Machines
Understanding neural networks
From biological to artificial neurons
Activation functions
Network topology
The number of layers
The direction of information travel
The number of nodes in each layer
Training neural networks with backpropagation
Modeling the strength of concrete with ANNs
Step 1 – collecting data
Step 2 – exploring and preparing the data
Step 3 – training a model on the data
Step 4 – evaluating model performance
Step 5 – improving model performance
Understanding Support Vector Machines
Classification with hyperplanes
Finding the maximum margin
The case of linearly separable data
The case of nonlinearly separable data
Using kernels for nonlinear spaces
Performing OCR with SVMs
Step 1 – collecting data
Step 2 – exploring and preparing the data
Step 3 – training a model on the data
Step 4 – evaluating model performance
Step 5 – improving model performance
Summary
8: Finding Patterns – Market Basket Analysis Using
Association Rules
Understanding association rules
The Apriori algorithm for association rule learning
Measuring rule interest – support and confidence
Building a set of rules with the Apriori principle
Example – identifying frequently purchased groceries with
association rules
Step 1 – collecting data
Step 2 – exploring and preparing the data
Data preparation – creating a sparse matrix for transaction data
Visualizing item support – item frequency plots
Visualizing transaction data – plotting the sparse matrix
Step 3 – training a model on the data
Step 4 – evaluating model performance
Step 5 – improving model performance
Sorting the set of association rules
Taking subsets of association rules
Saving association rules to a file or data frame
Summary
9: Finding Groups of Data – Clustering with kmeans
Understanding clustering
Clustering as a machine learning task
The kmeans algorithm for clustering
Using distance to assign and update clusters
Choosing the appropriate number of clusters
Finding teen market segments using kmeans clustering
Step 1 – collecting data
Step 2 – exploring and preparing the data
Data preparation – dummy coding missing values
Data preparation – imputing missing values
Step 3 – training a model on the data
Step 4 – evaluating model performance
Step 5 – improving model performance
Summary
10: Evaluating Model Performance
Measuring performance for classification
Working with classification prediction data in R
A closer look at confusion matrices
Using confusion matrices to measure performance
Beyond accuracy – other measures of performance
The kappa statistic
Sensitivity and specificity
Precision and recall
The Fmeasure
Visualizing performance tradeoffs
ROC curves
Estimating future performance
The holdout method
Crossvalidation
Bootstrap sampling
Summary
11: Improving Model Performance
Tuning stock models for better performance
Using caret for automated parameter tuning
Creating a simple tuned model
Customizing the tuning process
Improving model performance with metalearning
Understanding ensembles
Bagging
Boosting
Random forests
Training random forests
Evaluating random forest performance
Summary
DEEP LEARNING with R
1: Getting Started with Deep Learning
What is deep learning?
Conceptual overview of neural networks
Deep neural networks
R packages for deep learning
Setting up reproducible results
Neural networks
The deepnet package
The darch package
The H2O package
Connecting R and H2O
Initializing H2O
Linking datasets to an H2O cluster
Summary
2: Training a Prediction Model
Neural networks in R
Building a neural network
Generating predictions from a neural network
The problem of overfitting data – the consequences explained
Use case – build and apply a neural network
Summary
3: Preventing Overfitting
L1 penalty
L1 penalty in action
L2 penalty
L2 penalty in action
Weight decay (L2 penalty in neural networks)
Ensembles and model averaging
Use case – improving outofsample model performance
using dropout
Summary
4: Identifying Anomalous Data
Getting started with unsupervised learning
How do autoencoders work?
Regularized autoencoders
Penalized autoencoders
Denoising autoencoders
Training an autoencoder in R
Use case – building and applying an autoencoder model
Finetuning autoencoder models
Summary
5: Training Deep Prediction Models
Getting started with deep feedforward neural networks
Common activation functions – rectifiers, hyperbolic tangent,
and maxout
Picking hyperparameters
Training and predicting new data from a deep neural network
Use case – training a deep neural network for automatic
classification
Working with model results
Summary
6: Tuning and Optimizing Models
Dealing with missing data
Solutions for models with low accuracy
Grid search
Random search
Summary
DEEP LEARNING WITH PYTHON
I Introduction
1 Welcome
Deep Learning The Wrong Way
Deep Learning With Python
Summary
II Background
2 Introduction to Theano
What is Theano?
How to Install Theano
Simple Theano Example
Extensions and Wrappers for Theano
More Theano Resources
Summary
3 Introduction to TensorFlow
What is TensorFlow?
How to Install TensorFlow
Your First Examples in TensorFlow
Simple TensorFlow Example
More Deep Learning Models
Summary
4 Introduction to Keras
What is Keras?
How to Install Keras
Theano and TensorFlow Backends for Keras
Build Deep Learning Models with Keras
Summary
5 Project: Develop Large Models on GPUs Cheaply In the Cloud
Project Overview
Setup Your AWS Account
Launch Your Server Instance
Login, Configure and Run
Build and Run Models on AWS
Close Your EC2 Instance
Tips and Tricks for Using Keras on AWS
More Resources For Deep Learning on AWS
Summary
III Multilayer Perceptrons
6 Crash Course In Multilayer Perceptrons
Crash Course Overview
Multilayer Perceptrons
Neurons
Networks of Neurons
Training Networks
Summary
7 Develop Your First Neural Network With Keras
Tutorial Overview
Pima Indians Onset of Diabetes Dataset
Load Data
Define Model
Compile Model
Fit Model
Evaluate Model
Tie It All Together
Summary
8 Evaluate The Performance of Deep Learning Models
Empirically Evaluate Network Configurations
Data Splitting
Manual kFold Cross Validation
Summary
9 Use Keras Models With ScikitLearn For General Machine Learning
Overview
Evaluate Models with Cross Validation
Grid Search Deep Learning Model Parameters
Summary
10 Project: Multiclass Classification Of Flower Species
Iris Flowers Classification Dataset
Import Classes and Functions
Initialize Random Number Generator
Load The Dataset
Encode The Output Variable
Define The Neural Network Model
Evaluate The Model with kFold Cross Validation
Summary
11 Project: Binary Classification Of Sonar Returns
Sonar Object Classification Dataset
Baseline Neural Network Model Performance
Improve Performance With Data Preparation
Tuning Layers and Neurons in The Model
Summary
12 Project: Regression Of Boston House Prices
Boston House Price Dataset
Develop a Baseline Neural Network Model
Lift Performance By Standardizing The Dataset
Tune The Neural Network Topology
Summary
IV Advanced Multilayer Perceptrons and Keras
13 Save Your Models For Later With Serialization
Tutorial Overview .
Save Your Neural Network Model to JSON
Save Your Neural Network Model to YAML
Summary
14 Keep The Best Models During Training With Checkpointing
Checkpointing Neural Network Models
Checkpoint Neural Network Model Improvements
Checkpoint Best Neural Network Model Only
Loading a Saved Neural Network Model
Summary
15 Understand Model Behavior During Training By Plotting History
Access Model Training History in Keras
Visualize Model Training History in Keras
Summary
16 Reduce Overfitting With Dropout Regularization
Dropout Regularization For Neural Networks
Dropout Regularization in Keras
Using Dropout on the Visible Layer
Using Dropout on Hidden Layers
Tips For Using Dropout
Summary
17 Lift Performance With Learning Rate Schedules
Learning Rate Schedule For Training Models
Ionosphere Classification Dataset
TimeBased Learning Rate Schedule
DropBased Learning Rate Schedule
Tips for Using Learning Rate Schedules
Summary
V Convolutional Neural Networks
18 Crash Course In Convolutional Neural Networks
The Case for Convolutional Neural Networks
Building Blocks of Convolutional Neural Networks
Convolutional Layers
Pooling Layers
Fully Connected Layers
Worked Example
Convolutional Neural Networks Best Practices
Summary
19 Project: Handwritten Digit Recognition
Handwritten Digit Recognition Dataset
Loading the MNIST dataset in Keras
Baseline Model with Multilayer Perceptrons
Simple Convolutional Neural Network for MNIST
Larger Convolutional Neural Network for MNIST
Summary
20 Improve Model Performance With Image Augmentation
Keras Image Augmentation API
Point of Comparison for Image Augmentation
Feature Standardization
ZCA Whitening
Random Rotations
Random Shifts
Random Flips
Saving Augmented Images to File
Tips For Augmenting Image Data with Keras
Summary
21 Project Object Recognition in Photographs
Photograph Object Recognition Dataset
Loading The CIFAR10 Dataset in Keras
Simple CNN for CIFAR10
Larger CNN for CIFAR10
Extensions To Improve Model Performance
Summary
22 Project: Predict Sentiment From Movie Reviews
Movie Review Sentiment Classification Dataset
Load the IMDB Dataset With Keras
Word Embeddings
Simple Multilayer Perceptron Model
OneDimensional Convolutional Neural Network
Summary
VI Recurrent Neural Networks
23 Crash Course In Recurrent Neural Networks
Support For Sequences in Neural Networks
Recurrent Neural Networks
Long ShortTerm Memory Networks
Summary
24 Time Series Prediction with Multilayer Perceptrons
Problem Description: Time Series Prediction
Multilayer Perceptron Regression
Multilayer Perceptron Using the Window Method
Summary
25 Time Series Prediction with LSTM Recurrent Neural Networks
LSTM Network For Regression
LSTM For Regression Using the Window Method
LSTM For Regression with Time Steps
LSTM With Memory Between Batches
Stacked LSTMs With Memory Between Batches
Summary
26 Project: Sequence Classification of Movie Reviews
Simple LSTM for Sequence Classification
LSTM For Sequence Classification With Dropout
LSTM and CNN For Sequence Classification
Summary
27 Understanding Stateful LSTM Recurrent Neural Networks
Problem Description: Learn the Alphabet
LSTM for Learning OneChar to OneChar Mapping
LSTM for a Feature Window to OneChar Mapping
LSTM for a Time Step Window to OneChar Mapping
LSTM State Maintained Between Samples Within A Batch
Stateful LSTM for a OneChar to OneChar Mapping
LSTM with Variable Length Input to OneChar Output
Summary
28 Project: Text Generation With Alice in Wonderland
Problem Description: Text Generation
Develop a Small LSTM Recurrent Neural Network
Generating Text with an LSTM Network
Larger LSTM Recurrent Neural Network
Extension Ideas to Improve the Model
Summary

aiintrozero 
From Zero to AI 
35 hours 
This course is created for people who have no previous experience in probability and statistics.
Probability (3.5h)
Definition of probability
Binomial distribution
Everyday usage exercises
Statistics (10.5h)
Descriptive Statistics
Inferential Statistics
Regression
Logistic Regression
Exercises
Intro to programming (3.5h)
Procedural Programming
Functional Programming
OOP Programming
Exercises (writing logic for a game of choice, e.g. noughts and crosses)
Machine Learning (10.5h)
Classification
Clustering
Neural Networks
Exercises (write AI for a computer game of choice)
Rules Engines and Expert Systems (7 hours)
Intro to Rule Engines
Write AI for the same game and combing solutions into hybrid approach

dmmlr 
Data Mining & Machine Learning with R 
14 hours 
Introduction to Data mining and Machine Learning
Statistical learning vs. Machine learning
Iteration and evaluation
BiasVariance tradeoff
Regression
Linear regression
Generalizations and Nonlinearity
Exercises
Classification
Bayesian refresher
Naive Bayes
Dicriminant analysis
Logistic regression
KNearest neighbors
Support Vector Machines
Neural networks
Decision trees
Exercises
Crossvalidation and Resampling
Crossvalidation approaches
Bootstrap
Exercises
Unsupervised Learning
Kmeans clustering
Examples
Challenges of unsupervised learning and beyond Kmeans
Advanced topics
Ensemble models
Mixed models
Boosting
Examples
Multidimensional reduction
Factor Analysis
Principal Component Analysis
Examples

mlfsas 
Machine Learning Fundamentals with Scala and Apache Spark 
14 hours 
The aim of this course is to provide a basic proficiency in applying Machine Learning methods in practice. Through the use of the Scala programming language and its various libraries, and based on a multitude of practical examples this course teaches how to use the most important building blocks of Machine Learning, how to make data modeling decisions, interpret the outputs of the algorithms and validate the results.
Our goal is to give you the skills to understand and use the most fundamental tools from the Machine Learning toolbox confidently and avoid the common pitfalls of Data Sciences applications.
Introduction to Applied Machine Learning
Statistical learning vs. Machine learning
Iteration and evaluation
BiasVariance tradeoff
Machine Learning with Python
Choice of libraries
Addon tools
Regression
Linear regression
Generalizations and Nonlinearity
Exercises
Classification
Bayesian refresher
Naive Bayes
Logistic regression
KNearest neighbors
Exercises
Crossvalidation and Resampling
Crossvalidation approaches
Bootstrap
Exercises
Unsupervised Learning
Kmeans clustering
Examples
Challenges of unsupervised learning and beyond Kmeans

mlrobot1 
Machine Learning for Robotics 
21 hours 
This course introduce machine learning methods in robotics applications.
It is a broad overview of existing methods, motivations and main ideas in the context of pattern recognition.
After short theoretical background, participants will perform simple exercise using open source (usually R) or any other popular software.
Regression
Probabilistic Graphical Models
Boosting
Kernel Methods
Gaussian Processes
Evaluation and Model Selection
Sampling Methods
Clustering
CRFs
Random Forests
IVMs

annmldt 
Artificial Neural Networks, Machine Learning, Deep Thinking 
21 hours 
DAY 1  ARTIFICIAL NEURAL NETWORKS
Introduction and ANN Structure.
Biological neurons and artificial neurons.
Model of an ANN.
Activation functions used in ANNs.
Typical classes of network architectures .
Mathematical Foundations and Learning mechanisms.
Revisiting vector and matrix algebra.
Statespace concepts.
Concepts of optimization.
Errorcorrection learning.
Memorybased learning.
Hebbian learning.
Competitive learning.
Single layer perceptrons.
Structure and learning of perceptrons.
Pattern classifier  introduction and Bayes' classifiers.
Perceptron as a pattern classifier.
Perceptron convergence.
Limitations of a perceptrons.
Feedforward ANN.
Structures of Multilayer feedforward networks.
Back propagation algorithm.
Back propagation  training and convergence.
Functional approximation with back propagation.
Practical and design issues of back propagation learning.
Radial Basis Function Networks.
Pattern separability and interpolation.
Regularization Theory.
Regularization and RBF networks.
RBF network design and training.
Approximation properties of RBF.
Competitive Learning and Self organizing ANN.
General clustering procedures.
Learning Vector Quantization (LVQ).
Competitive learning algorithms and architectures.
Self organizing feature maps.
Properties of feature maps.
Fuzzy Neural Networks.
Neurofuzzy systems.
Background of fuzzy sets and logic.
Design of fuzzy stems.
Design of fuzzy ANNs.
Applications
A few examples of Neural Network applications, their advantages and problems will be discussed.
DAY 2 MACHINE LEARNING
The PAC Learning Framework
Guarantees for finite hypothesis set – consistent case
Guarantees for finite hypothesis set – inconsistent case
Generalities
Deterministic cv. Stochastic scenarios
Bayes error noise
Estimation and approximation errors
Model selection
Radmeacher Complexity and VC – Dimension
Bias  Variance tradeoff
Regularisation
Overfitting
Validation
Support Vector Machines
Kriging (Gaussian Process regression)
PCA and Kernel PCA
Self Organisation Maps (SOM)
Kernel induced vector space
Mercer Kernels and Kernel  induced similarity metrics
Reinforcement Learning
DAY 3  DEEP LEARNING
This will be taught in relation to the topics covered on Day 1 and Day 2
Logistic and Softmax Regression
Sparse Autoencoders
Vectorization, PCA and Whitening
SelfTaught Learning
Deep Networks
Linear Decoders
Convolution and Pooling
Sparse Coding
Independent Component Analysis
Canonical Correlation Analysis
Demos and Applications

mlfunpython 
Machine Learning Fundamentals with Python 
14 hours 
The aim of this course is to provide a basic proficiency in applying Machine Learning methods in practice. Through the use of the Python programming language and its various libraries, and based on a multitude of practical examples this course teaches how to use the most important building blocks of Machine Learning, how to make data modeling decisions, interpret the outputs of the algorithms and validate the results.
Our goal is to give you the skills to understand and use the most fundamental tools from the Machine Learning toolbox confidently and avoid the common pitfalls of Data Sciences applications.
Introduction to Applied Machine Learning
Statistical learning vs. Machine learning
Iteration and evaluation
BiasVariance tradeoff
Machine Learning with Python
Choice of libraries
Addon tools
Regression
Linear regression
Generalizations and Nonlinearity
Exercises
Classification
Bayesian refresher
Naive Bayes
Logistic regression
KNearest neighbors
Exercises
Crossvalidation and Resampling
Crossvalidation approaches
Bootstrap
Exercises
Unsupervised Learning
Kmeans clustering
Examples
Challenges of unsupervised learning and beyond Kmeans

mlintro 
Introduction to Machine Learning 
7 hours 
This training course is for people that would like to apply basic Machine Learning techniques in practical applications.
Audience
Data scientists and statisticians that have some familiarity with machine learning and know how to program R. The emphasis of this course is on the practical aspects of data/model preparation, execution, post hoc analysis and visualization. The purpose is to give a practical introduction to machine learning to participants interested in applying the methods at work
Sector specific examples are used to make the training relevant to the audience.
Naive Bayes
Multinomial models
Bayesian categorical data analysis
Discriminant analysis
Linear regression
Logistic regression
GLM
EM Algorithm
Mixed Models
Additive Models
Classification
KNN
Ridge regression
Clustering

systemml 
Apache SystemML for Machine Learning 
14 hours 
Apache SystemML is a distributed and declarative machine learning platform.
SystemML provides declarative largescale machine learning (ML) that aims at flexible specification of ML algorithms and automatic generation of hybrid runtime plans ranging from single node, inmemory computations, to distributed computations on Apache Hadoop and Apache Spark.
Audience
This course is suitable for Machine Learning researchers, developers and engineers seeking to utilize SystemML as a framework for machine learning.
Running SystemML
Standalone
Spark MLContext
Spark Batch
Hadoop Batch
JMLC
Tools
Debugger
IDE
Troubleshooting
Languages and ML Algorithms
DML
PyDML
Algorithms

MLFWR1 
Machine Learning Fundamentals with R 
14 hours 
The aim of this course is to provide a basic proficiency in applying Machine Learning methods in practice. Through the use of the R programming platform and its various libraries, and based on a multitude of practical examples this course teaches how to use the most important building blocks of Machine Learning, how to make data modeling decisions, interpret the outputs of the algorithms and validate the results.
Our goal is to give you the skills to understand and use the most fundamental tools from the Machine Learning toolbox confidently and avoid the common pitfalls of Data Sciences applications.
Introduction to Applied Machine Learning
Statistical learning vs. Machine learning
Iteration and evaluation
BiasVariance tradeoff
Regression
Linear regression
Generalizations and Nonlinearity
Exercises
Classification
Bayesian refresher
Naive Bayes
Logistic regression
KNearest neighbors
Exercises
Crossvalidation and Resampling
Crossvalidation approaches
Bootstrap
Exercises
Unsupervised Learning
Kmeans clustering
Examples
Challenges of unsupervised learning and beyond Kmeans

appliedml 
Applied Machine Learning 
14 hours 
This training course is for people that would like to apply Machine Learning in practical applications.
Audience
This course is for data scientists and statisticians that have some familiarity with statistics and know how to program R (or Python or other chosen language). The emphasis of this course is on the practical aspects of data/model preparation, execution, post hoc analysis and visualization.
The purpose is to give practical applications to Machine Learning to participants interested in applying the methods at work.
Sector specific examples are used to make the training relevant to the audience.
Naive Bayes
Multinomial models
Bayesian categorical data analysis
Discriminant analysis
Linear regression
Logistic regression
GLM
EM Algorithm
Mixed Models
Additive Models
Classification
KNN
Bayesian Graphical Models
Factor Analysis (FA)
Principal Component Analysis (PCA)
Independent Component Analysis (ICA)
Support Vector Machines (SVM) for regression and classification
Boosting
Ensemble models
Neural networks
Hidden Markov Models (HMM)
Space State Models
Clustering

predio 
Machine Learning with PredictionIO 
21 hours 
PredictionIO is an open source Machine Learning Server built on top of stateoftheart open source stack.
Audience
This course is directed at developers and data scientists who want to create predictive engines for any machine learning task.
Getting Started
Quick Intro
Installation Guide
Downloading Template
Deploying an Engine
Customizing an Engine
App Integration Overview
Developing PredictionIO
System Architecture
Event Server Overview
Collecting Data
Learning DASE
Implementing DASE
Evaluation Overview
Intellij IDEA Guide
Scala API
Machine Learning Education and Usage Examples
Comics Recommendation
Text Classification
Community Contributed Demo
Dimensionality Reducation and usage
PredictionIO SDKs (Select One)
Java
PHP
Python
Ruby
Community Contributed
