Python on Snowflake: 1 Million Record Migration from SQL Server using read_sql and write_pandas

Python on Snowflake: 1 Million Record Migration from SQL Server using read_sql and write_pandas

Migrating data across data platforms can be a challenge. Luckily, Pandas, Snowflake and the Snowflake Connector for Python can make this process pretty easy. In this episode, we’re going to migrate one million records from SQL Server to Snowflake. To do this, we’ll use pyodbc, pandas, and the snowflake connector, as well as pandas_tools from the extended connector. Armed with these tools, we’ll be able to make our migration easy and repeatable.

Related Videos:
Python on Snowflake: 1 Million Record Migration from SQL Server using read_sql and write_pandas
You are watching this one now!
Python on Snowflake - How to use execute_async to kick off one/more queries - No stopping the code!
https://youtu.be/DMVmpNyhF5g
How to Use SQL Joins when Using Python on Snowflake to Get Pandas Dataframes
https://youtu.be/n3MmuEjLuzM
How to Use Python to Create Stored Procedures in Snowflake - SQL, Javascript, and Python Example
https://youtu.be/bKQgTnjbeaM
Python on Snowflake - How to Perform Transactions with Rollback
https://youtu.be/Kx_rMTz-TTQ
Python on Snowflake - How to Perform Concurrent Select Queries Using execute_async
https://youtu.be/KNdgCnJCE7Y
Python on Snowflake - How to Use Describe()
https://youtu.be/DNzc-ifhSmQ
Python on Snowflake: How to use Merge (Upsert)
https://youtu.be/aqZ8c4cc_9w
Python on Snowflake - How to Read and Write JSON Data Part 1
https://youtu.be/-8D0l3-Qu-s
Want to get access to premium content made just for you and have a chat with me? Find me on Patreon :
https://www.patreon.com/mackenziedata...

Want to work with me 1:1? Contact me today and book your free 20 min consultation!
Contact form you can find at http://www.mackenziemackenzie.com/

Follow me on social media:
https://www.facebook.com/mackenziedat...
https://twitter.com/seamacke
https://www.instagram.com/seamacke/
https://www.reddit.com/user/seamacke
https://www.linkedin.com/in/psmackenzie/

Get Microsoft Office including Access:
https://click.linksynergy.com/fs-bin/click?id=BdGJecFFM8A&offerid=1160033.10004289&type=3&subid=0

Got a YouTube Channel? I use TubeBuddy, it is awesome. Give it a try:
https://www.tubebuddy.com/seanmackenziedataengineering
For developers looking for a new role, check out:
https://www.toptal.com/qKaO2b/worlds-top-talent

Needing to hire technical resources for your project? Get the best:
https://www.toptal.com/qKaO2b/worlds-top-talent

#Snowflake #SQLServer #DataEngineering

https://youtu.be/FHQyOlcO3RQ

Видео Python on Snowflake: 1 Million Record Migration from SQL Server using read_sql and write_pandas канала Sean MacKenzie Data Engineering