PySpark Tutorial 2026 #3 | Create Your First Real DataFrame in PySpark (Event Dataset)

Welcome to the PySpark micro-course 🚀

In this video, we create our first real PySpark DataFrame using an example dataset of user events.

This is how data often looks in real applications such as mobile games, e-commerce platforms, or analytics systems.

In this video you will learn:
• How to create a dataset in PySpark
• How to build a Spark DataFrame
• How to view data using show()
• How to inspect the schema using printSchema()
• What a DataFrame actually represents in Spark

We continue working in Databricks, which is widely used in real Data Engineering teams.

📌 Homework:
- Add 3 more users to the dataset.
- Add a new event type (for example: "start_game").
- Run df.count() again.

Write in the comments:
• What new event did you add?
• How many rows are now in your dataset?

In the next lesson, we will start transforming data using select() and filter().

For more video please subscribe to the channel: https://www.youtube.com/@magic_python

Видео PySpark Tutorial 2026 #3 | Create Your First Real DataFrame in PySpark (Event Dataset) канала Magic Python