Learn Learn AWS Glue using pyspark by doing like a Professional !
Python Basics - Introduction - Overview IDE installation
Python Basics - Functions - Anonymous Function & Modules
Python Basics - Exception - Exception Handling & User Defined exceptions
Pyspark - Load Data Inside Data Bricks
AWS Glue - Introduction
N/A
Students, graduates, working professionals, net worker and programmer.
Basic knowledge of programming.
Section 1 - Introduction to the Course
Section 2 - Python Basics - Introduction - Overview IDE installation
Section 2 - Python Basics - Introduction - Variables, Namespaces, Datatypes, Find the type, type Conversion
Section 2 - Python Basics - Introduction - Import & Operators
Section 2 - Python Basics - Flow Control - if-else, for loop
Section 2 - Python Basics - Flow control - while loop, break, continue
Section 2 - Python Basics - Functions - Functions & Function Arguments
Section 2 - Python Basics - Functions - Anonymous Function & Modules
Section 2a - Python Basics - Datatypes - List & Tuple
Section 2b - Python Basics - Datatypes - List & Tuple
Section 2a - Python Basics - Datatypes - Set & Dictionary
Section 2b - Python Basics - Datatypes - Set & Dictionary
Section 2a - Python Basics - Exception - Exception Handling & User Defined exceptions
Section 2b - Python Basics - Exception - Exception Handling & User Defined exceptions
Section 3 - PySpark - Introduction to Spark
Section 3 - Pyspark - Spark Architecture
Section 3 - Pyspark - API's In Pyspark
Section 3- Pyspark - Databricks Set up
Section 3 -Pyspark - Load Data Inside Data Bricks
Section3 - Pyspark - DataFrame Basics Part 1
Section 3 - Pyspark - DataFrame Basics Part 2
Section3 - Pyspark- Working With Columns
Section3- Pyspark - Filter
Section3 - Pyspark - Sorting
Section3 - Pyspark - Aggregate Operations in DataFrame
Section 3- Pyspark - Join
Section 4 - AWS Glue - Introduction
Section 4 - AWS Glue - Architecture on populating Glue Catalog
Section 4- AWS Glue - Loading Data in S3
Section 4 - AWS Glue - Setting up Crawlers
Section 4 - AWS Glue - Using Athena to Query the Data Catalog
Section 4 - AWS Glue - Automate DataCatalog Refresh using Lambda
Section 5 - AWS Glue - Authoring Jobs using Python shell in AWS Glue Part 1
Section 5 -AWS Glue - Authoring Jobs using Python shell in AWS Glue Part 2
Section 5 - AWS Glue - Authoring Jobs using pyspark (Script authored by us) - Part 1
Section 5 - AWS Glue - Authoring Jobs using pyspark (Script authored by us) - Part 2
Section 5 - AWS Glue - Authoring Jobs using pyspark (Autogenerated by Glue )
Section 6 - AWS Glue Monitoring ,Triggers and debugging - Setting up Triggers for Glue Jobs
Section 6 - AWS Glue Monitoring ,Triggers and debugging - Setting up Monitoring and Calculate number of DPUs
Section 6 - AWS Glue Monitoring ,Triggers and debugging - Setting up Endpoint for debugging Glue jobs
Section 6 - AWS Glue Monitoring ,Triggers and debugging - Using Zeppelin notebook to debug Glue Jobs