Snowflake Online Training: Git & Git Hub | +91 7396553033 (India) | +1 614 558 5570 (USA)

fkp.iai.analytics@gmail.com | Git and GitHub for Data Engineers

1. Introduction
a. Types of Databases - OLTP, OLAP, No SQL
b. Need of a Cloud Data warehouse - MPP, On Premise MPP, Cloud MPP
c. Snowflake High level architecture
• Snowflake Layers
• Snowflake Editions
d. Snowflake work environment setup
e. Snowflake Ecosystem
f. Snowflake Client Connectivity
g. Working with ODBC | JDBC | Python | Spark Connectors with AWS Glue
h. SnowSQL CLI: Configuring & SnowSQL Commands hands on
i. Snowflake Web GUI
j. Working with config file
k. Working with multiple snowflake accounts
l. Preview & Active features
2. Snowflake Architecture
a. Virtual Warehouses
• Introduction to Virtual Warehouses
• Components and functions of virtual warehouse
• Types of Virtual Warehouses
• Auto/manual suspends and resume
• Multi-cluster Warehouses
• Auto resizing
• Auto scaling policies
• Warehouse Caching
• Understanding Warehouse load and maintenance the workloads
• Optimal usage of Warehouses and Guidelines
• Resource monitors
• Warehouse Billing procedure
b. Storage
• Introduction to Columnar storage
• Micro-partitions
• Micro-partitions Actions during DDL and DML commands
• Query Pruning
• Data Clustering
• Understanding Data Clustering
• Clustering Depth, Micro-partitions overlapping, Clustering ratio
• Choosing Clustering keys
• Auto and manual clustering
• Billing criteria
c. Cloud Services
• Functions and Billing criterion
• Cache
• SQLs - Metadata operations
3. Snowflake Data Dictionary
a. Information schema
b. Snowflake database
c. Limitations
4. Snowflake Table functions
a. Table function and uses
b. Creating a table function
c. Built-in table functions
d. Querying dictionary data using table functions
5. Snowflake SQL Optimization
a. General query Issues
b. Query Profiler
c. Understanding the query plan
d. Steps to improve query performance
6. Snowflake Database Objects
a. Database
b. Schema
c. Managed access Schema
d. Snowflake tables
• Temporary tables
• Transient tables
• External tables
• Directory tables
e. Types of Views
i. Regular views
ii. Secure Views
iii. Materialized views
f. Sequences
g. Auto increment/Identity columns
h. Snowflake Masking Policy
i. Snowflake Row Access Policy
j. Materialized views vs Cached Results
k. Managing storage cost
7. Snowflake Data recovery features
a. Time travel
b. Fail safe
c. Database replication
d. Billing procedure
8. AWS CLI
a. Installing and Configuring AWS CLI
b. AWS Storage Service
c. Learning AWS CLI Commands
d. Billing criteria for storage and notification services
9. Snowflake specific database objects
a. Stages
i. Internal stage - • User stage
• Table stage
• Named Internal stage
ii. External stage
b. Querying stage files
c. File format
d. Data share
e. Reader accounts
f. Warehouses and Snowflake Reader accounts
g. Streams and Tasks
h. Data pipeline concept in Data engineering
i. TAGs
j. SOS
10. Data loading
a. COPY, PUT, GET INSERT
b. File format and copying options
c. Validation mode
d. Error handing
e. Data loading considerations
f. Optimizing data loads
g. Data loading practical framework discussion
Split, Compress, Move
11. Data unloading
a. Basics of Data exporting
b. File format and export options
c. Understanding threads
12. Snow pipe
a. Snow pipe basics
b. Snow pipe consideration and guidelines
c. Creating a Snow pipe
d. AWS Storage Integration, ARN
e. AWS Notification Services and billing
f. Snow pipe billing criterion
g. Corresponding Dictionary objects and Table functions
13. Snowflake SQL
a. Snowflake Basic SQL
b. MERGE statement
c. String functions
d. Aggregate functions
e. Pivoting
f. Data and Time functions
g. Collation
h. Time Zone
i. Window functions
j. Multi table inserts
k. Cloning Objects
l. Lateral join
14. Processing Semi-structured Data
a. Snowflake Supported file formats
b. Flattening functions
c. Loading JSON data
d. JSON data processing hands on
e. Sequences and normalized tables
15. Snowflake Functions, Parameters and Variables
a. Snowflake functions and uses
b. Creating a function
c. Working with Built-in functions
d. System parameters
• Account level parameters
• Session level parameters
• Object level parameters
e. Variables and uses
• Define variables and use
• list variables
16. Snowflake User management & Access Control
a. Roles

b. Hands on with System roles and responsibilities
• Accountadmin
• Sysadmin
• Securityadmin
• Useradmin
• Public
b. Custom roles
c. Secondary role
c. Creating Users & options
d. Granting rights on future objects
e. Transfer of rights on cloned objects
f. Working with privileges
17. Snowflake Credits, Billing & Guidelines
a. Snowflake credit
b. Understanding the snowflake bill
c. Compute billing process
d. Storage billing process
e. Cloud services billing process
18. Framework
a. ETL Scripts
b. Config tables
c. Log tables
d. Role of Unix & Python
19. Data lake and Snowflake
20. Two workshops
Git, GitHub, Configuring Git, Configuring GitHub, pull requests in git, fork and clone in git
APIs

Видео Snowflake Online Training: Git & Git Hub | +91 7396553033 (India) | +1 614 558 5570 (USA) канала fkp institute of AI