Rolling in the Deep with
Anh T. Tra
April 22, 2019
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
1 / 19
Outlines
1
Introduction
2
On the Surface: AI/ML/DL at the glance
3
In the Deep: Deep Learning and TensorFlow
4
DL Interesting Applications
5
Demo: Dog/Cat Classification
6
QnA
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
2 / 19
Introduction
About Us
Anh T. Tra
Sr. Consultant
Global CyberSoft (HCVN)
Phong T. Le
Consultant
Global CyberSoft (HCVN)
Quan Nguyen
Software Engineer
D-Soft
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
3 / 19
On the Surface: AI/ML/DL at the glance
1
Introduction
2
On the Surface: AI/ML/DL at the glance
3
In the Deep: Deep Learning and TensorFlow
4
DL Interesting Applications
5
Demo: Dog/Cat Classification
6
QnA
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
4 / 19
On the Surface: AI/ML/DL at the glance
AI/ML/DL
Figure 1: Big picture about AI/ML/DL1 .
1
/>
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
5 / 19
On the Surface: AI/ML/DL at the glance
ML/DL Timeline
Figure 1: Timeline of the development of deep learning and commonly-used machine learning algorithms2 .
2
Cao, Chensi, et al. ”Deep learning and its applications in biomedicine.” Genomics, proteomics & bioinformatics 16.1 (2018): 17-32.
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
6 / 19
On the Surface: AI/ML/DL at the glance
ML vs. DL
Figure 1: Comparison between Machine Learning and Deep Learning3 .
3
/>
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
7 / 19
On the Surface: AI/ML/DL at the glance
Neural Network Recap
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
8 / 19
On the Surface: AI/ML/DL at the glance
Neural Network Recap
• A Neural Network is a function!
• It (generally) comprised of:
• Neurons which pass input values through functions and output the result
• Weights which carry values between neurons
• We group neurons into layers. There are 3 main types of layers:
• Input Layer
• Hidden Layer
• Output Layer
• Train a Neural Network = Find good Weights:
θ = argminθ
loss(y (x ), hθ (x ))
(1)
x
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
9 / 19
In the Deep: Deep Learning and TensorFlow
1
Introduction
2
On the Surface: AI/ML/DL at the glance
3
In the Deep: Deep Learning and TensorFlow
4
DL Interesting Applications
5
Demo: Dog/Cat Classification
6
QnA
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
10 / 19
In the Deep: Deep Learning and TensorFlow
Deep Learning in One slide
• What is it:
•
•
•
•
Extract useful patterns from data.
How:
Neural network + optimization
How (Pratical):
Python + TensorFlow & friends
Hart Part:
Good Question + Good Data
Why now:
Data, hardware, community, tools,
invesment
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
Exciting progress:
• Face recognition
• Image classification
• Speech recognition
• Text-to-speech generation
• Handwriting transcription
• Medical diagnosis
• Cars: drivable area, lane keeping
• Digital assistants
• Ads, search, social recommendations
• Game playing with deep RL
/>TensorFlow
MEETUP 2019
April 22, 2019
11 / 19
In the Deep: Deep Learning and TensorFlow
History of DL Tools
• Torch - 2002
• CUDA - 2007
• Theano - 2008
• Caffe - 2014
• TensorFlow 0.1 - 2015
• PyTorch 0.1 - 2017
• TensorFlow 1.0 - 2017
• PyTorch 1.0 - 2017
• TensorFlow 2.0 - 2019
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
12 / 19
In the Deep: Deep Learning and TensorFlow
TensorFlow in One Slide
• What is it: Deep Learning Library
• Facts: Open Source, Python, Google
• Community:
• 117,000+ GitHub stars
• TensorFlow.org: Blogs, Documentation, DevSummit, YouTube talks
• Ecosystem:
• Keras: high-level API
• TensorFLow.js: in the browser
• TensorFlow Lite: on the phone
• Colaboratory: in the cloud
• TPU: optimized hardware
• TensorBoard: visualization
• TensorFlow Hub: graph modules
• Alternatives: PyTorch, MXNet, CNTK
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
13 / 19
DL Interesting Applications
1
Introduction
2
On the Surface: AI/ML/DL at the glance
3
In the Deep: Deep Learning and TensorFlow
4
DL Interesting Applications
5
Demo: Dog/Cat Classification
6
QnA
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
14 / 19
DL Interesting Applications
Image Style Transfer
• Introduction: />• Web application: />
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
15 / 19
DL Interesting Applications
Real-time Object Detection
• Papers:
• Redmon, Joseph, et al. ”You only look once: Unified, real-time object detection.”
Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.
• Redmon, Joseph, and Ali Farhadi. ”YOLO9000: better, faster, stronger.” Proceedings of the
IEEE conference on computer vision and pattern recognition. 2017.
• Redmon, Joseph, and Ali Farhadi. ”Yolov3: An incremental improvement.” arXiv preprint
arXiv:1804.02767 (2018).
• Video demo: />
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
16 / 19
Demo: Dog/Cat Classification
1
Introduction
2
On the Surface: AI/ML/DL at the glance
3
In the Deep: Deep Learning and TensorFlow
4
DL Interesting Applications
5
Demo: Dog/Cat Classification
6
QnA
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
17 / 19
Demo: Dog/Cat Classification
Dog/Cat classification
Source code: />CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
18 / 19
QnA
Question and Answer
CuuDuongThanCong.com
Anh T. Tra
(HCVN - Global CyberSoft)
/>TensorFlow
MEETUP 2019
April 22, 2019
19 / 19