Machine Learning and Parallel Computing
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
• Introduction to Google Cloud Platform (GCP) • GCP Services
• Big Data on Google Cloud Platform
• Google Cloud Platform VS Competitors
• GCP Demo
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
• What is Cloud Computing:
Cloud computing is the use of off-site systems to help computers store, manage, process, and/or communicate information. These off-site systems are hosted on the cloud (or the internet) instead of on your computer or other local storage.
They can encompass anything from email servers to software programs, data storage, or even increasing your computer’s processing power.
You typically pay only for cloud services you use, helping you lower your operating costs, run your infrastructure more efficiently, and scale as your business needs change.
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
• Examples of Cloud Computing:
• SaaS or Software as a Service. SaaS means instead of installing software on your computer, you access the platform online. Examples would include:
◦ Square, which processes payments online
◦ Google Apps such as Google Drive or Calendar
◦ Slack, which allows collaboration and chat between other users
• IaaS or Infrastructure as a Service. IaaS provides infrastructure components such as servers, storage, networking, security, and moreover the cloud. Examples would include:
◦ ◦
◦
Dropbox, a file storage and sharing system
Microsoft Azure, which offers backup and disaster recovery services, hosting, and more
Rackspace, which offers data, security, and infrastructure services.
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
• Examples of Cloud Computing:
•
PaaS or Platform as a Service. PaaS provides computing platforms such as operating systems, programming language execution environments, databases, and web servers. Examples would include:
◦ Google App Engine and Heroku, which allow developers to develop and serve apps
Serverless Computing. Serverless computing (also called simply “Serverless”) is simply using a server on the cloud. This offers more elasticity, easier maintenance, and is often more price effective than hosting servers on-site.
•
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Function As A Service
Data As A Service
Storage As A Service
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
• Types of Cloud Computing:
Public cloud: Public clouds are owned and operated by a third-party cloud service providers, which deliver their computing resources, like servers and storage, over the Internet.
Private cloud: A private cloud refers to cloud computing resources used exclusively by a single business or organization. A private cloud can be physically located on the company’s on-site datacenter.
Hybrid cloud: Hybrid clouds combine public and private clouds, bound together by technology that allows data and applications to be shared between them.
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
• Cloud Computing Service Provider
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Google Cloud is a suite of Cloud Computing services offered by Google. The platform provides various services like compute, storage, networking, Big Data, and many more that run on the same infrastructure that Google uses
internally for its end users like Google Search and YouTube.
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Google Cloud Platform VS Competitors
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Access control
Why Google Cloud Platform?
An infrastructure tailored to individual business needs
Industry-dedicated solutions
GCP security
Per-second billing
Budget control
An own GCP network
GCP scalability
Availability
Real-time migration
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Google Cloud Platform Services
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Compute Services
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Network Services
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Cloud AI Services
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Storage Services
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
Big Data Services
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
GCP Products to Big Data
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
INGESTION
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
PROCESSING
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
STORAGE
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
EXPLORATION
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
ANALYTICS
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
EXAMPLE
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
CLOUD STORAGE
• VERSIONING
• STATIC SITES
• RESUMABLE TRANSFERS
• OBJECT CHANGE NOTIFICATIONS
• TB SCALE
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
CLOUD SQL
• FULLY MANAGED
• EASE OF USE
• HIGHLY RELIABLE
• FLEXIBLE CHARGING
• SECURITY, AVAILABILITY, OU RABILITY
• EASY MIGRATION & DATA
PORTA BI I ITY
• OPTIMIZED MYSQL VERSIONS
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
BIG QUERY
• FULLY MANAGED BIG DATA ANALYTICSSERVICE
• SUPPORT SQL
• FAST
• SCALABLE
• FLEXIBLE AND FAMILIAR
• SECURITY AND RE IABILITY
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
BIG QUERY
• INCLUDES
• APACHE HADOOP
• APACHE PIG
• APACHE HIVE
• APACHE SPARK
• FAST AND SCALABLE DATA PROCESSING
• FLEXIBLE VIRTUAL MACHINES
• RESIZABLE CLUSTER
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
DATA LAB
• POWERFUL DATA EXPLORATION
• SCALABLE
• DATA MANAGEMENT
• VISUALIZATION
• 0PEN SOURCE (JUPYTER)
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
GCP REGIONS & ZONES
Data Engineering - ITS70504
Week 6
•
Google Cloud Platform
PRACTICING
FREE ACCOUNT ON GOOGLE CLOUD
Data Engineering - ITS70504
Thank You
Email: [email protected] H/P: +60163224407
