Skip to content

Cloud computing

Slides

  • Learn how to get started with Google Cloud Platform and how to interact with the SDK.

    M20: Cloud Setup

  • Learn how to use different GCP services to support your machine learning pipeline.

    M21: Cloud Services

Running computations locally is often sufficient when only playing around with code in the initial phase of development. However, to scale your experiments you will need more computing power than what your standard laptop/desktop can offer. You probably already have experience with running on a local cluster or similar but today's topic is about utilizing cloud computing.

Image

Image credit

There exist numerous amount of cloud computing providers with some of the biggest being:

  • Azure
  • AWS
  • Google Cloud Platform (GCP)
  • Alibaba Cloud

They all have slight advantages and disadvantages over each other. In this course, we are going to focus on Google Cloud platform, because they have been kind enough to sponsor $50 of cloud credit to each student. If you happen to run out of credit, you can also get some free credit for a limited amount of time when you sign up with a new account. What's important to note is that all these different cloud providers all have the same set of services and that learning how to use the services of one cloud provider in many cases translates to also knowing how to use the same services at another cloud provider. The services are called something different and can have a bit of a different interface/interaction pattern but in the end, it does not matter.

Today's exercises are about getting to know how to work with the cloud. If you are in doubt about anything or want to deep dive into some topics, I can recommend watching this series of videos or going through the general docs.

Learning objectives

The learning objectives of this session are:

  • In general being familiar with the Google SDK working
  • Being able to start different compute instances and work with them
  • Know how to do continuous integration workflows for the building of docker images
  • Knowledge about how to store data and containers/artifacts in cloud buckets
  • Being able to train simple deep-learning models using a combination of cloud services