Giter VIP home page Giter VIP logo

jantonisito / ai-on-aws Goto Github PK

View Code? Open in Web Editor NEW

This project forked from data-science-on-aws/data-science-on-aws

0.0 0.0 0.0 486.64 MB

AI and Machine Learning with Kubeflow, Amazon EKS, and SageMaker

Home Page: https://datascienceonaws.com

Jupyter Notebook 86.91% Dockerfile 0.02% Python 9.56% Shell 0.23% TSQL 0.01% Scala 1.56% HTML 0.44% JavaScript 0.07% CSS 0.01% R 0.15% Batchfile 0.07% Java 0.96% Makefile 0.02%

ai-on-aws's Introduction

Upcoming O'Reilly Book: Data Science on AWS

Register for early access directly on our website.

Data Science on AWS

Workshop Instructions

Note: This workshop will create an ephemeral AWS acccount for each attendee. This ephemeral account is not accessible after the workshop. You can, of course, clone this GitHub repo and reproduce the entire workshop in your own AWS Account.

1. Login to the Workshop Portal (aka Event Engine).

Event Box Account.

Event Box Account.

Event Engine Dashboard.

2. Login to the AWS Console

Event Engine AWS Console

Take the defaults and click on Open AWS Console. This will open AWS Console in a new browser tab.

If you see this message, you need to logout from any previously used AWS accounts.

AWS Account Logout

Please logout of all AWS Console sessions in all browser tabs.

Double-check that your account name is something like TeamRole/MasterKey as follows:

IAM Role

If not, please logout of your AWS Console in all browser tabs and re-run the steps above!

3. Launch a SageMaker Notebook Instance

Open the AWS Management Console

Note: This workshop has been tested on the US West (Oregon) (us-west-2) region. Make sure that you see Oregon on the top right hand corner of your AWS Management Console. If you see a different region, click the dropdown menu and select US West (Oregon).

In the AWS Console search bar, type SageMaker and select Amazon SageMaker to open the service console.

SageMaker Console.

Select Create notebook instance.

SageMaker Console.

SageMaker Console

In the Notebook instance name text box, enter workshop.

Choose ml.c5.2xlarge. We'll only be using this instance to launch jobs. The training job themselves will run either on a SageMaker managed cluster or an Amazon EKS cluster.

Volume size 250 - this is needed to explore datasets, build docker containers, and more. During training data is copied directly from Amazon S3 to the training cluster when using SageMaker. When using Amazon EKS, we'll setup a distributed file system that worker nodes will use to get access to training data.

Fill notebook instance

In the IAM role box, select the default TeamRole.

Fill notebook instance

You must select the default VPC, Subnet, and Security group as shown in the screenshow. Your values will likely be different. This is OK.

Keep the default settings for the other options not highlighted in red, and click Create notebook instance. On the Notebook instances section you should see the status change from Pending -> InService

Fill notebook instance

4. Start the Jupyter Notebook

Note: Proceed when the status of the notebook instance changes from Pending to InService after a few minutes.

Start Jupyter

5. Launch a New Terminal within the Jupyter Notebook

Click File > New > [...scroll down...] Terminal to launch a terminal in your Jupyter instance.

6. Clone this GitHub Repo in the Terminal

Within the Jupyter terminal, run the following:

cd ~/SageMaker && git clone https://github.com/data-science-on-aws/workshop

7. Navigate Back to Notebook View

8. Start the Workshop!

Navigate to 01_intro/ in your Jupyter notebook and start the workshop!

You may need to refresh your browser if you don't see the new workshop/ directory.

Start Workshop

ai-on-aws's People

Contributors

antje avatar cfregly avatar jtrollin avatar stephensmithwick avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.