Загрузка...

End-to-End Healthcare Data Engineer Project | GCP | Real - Time

🚀 Build a Real-Time Healthcare Data Engineering Project on Google Cloud Platform (GCP)!
In this project, we design and implement a Patient Vitals Monitoring System — a complete, end-to-end data engineering pipeline that runs 100% in the cloud and is fully automated.

The pipeline streams live patient vitals (heart rate, oxygen level, and body temperature) through Pub/Sub, processes them in real time using Dataflow with Apache Beam, and stores them in BigQuery — following the Medallion Architecture (Bronze, Silver, Gold).
Finally, we visualize the real-time analytics in Power BI, creating live dashboards for patient monitoring and healthcare insights.

This project mirrors how enterprise-level healthcare systems manage IoT-style streaming data for real-time decision-making — all inside GCP’s modern data ecosystem.

⚙️ 💡 What You’ll Learn

✅ Real-time streaming data ingestion using Pub/Sub
✅ Stream processing and transformations with Apache Beam (Dataflow)
✅ Multi-layer architecture using Bronze, Silver, and Gold layers (Medallion)
✅ Scalable cloud data warehousing with BigQuery
✅ Real-time visualization in Power BI
✅ Fully automated, event-driven data pipeline — no manual triggers
✅ Deploying, monitoring, and managing streaming jobs in GCP Console
✅ Integrating Data Engineering + Cloud Analytics for healthcare use cases

🧰 💾 Tech Stack:
1. Google Cloud Platform (GCP)
2. Pub/Sub
3. Dataflow (Apache Beam)
4. BigQuery
5. Power BI (Healthcare Dashboard)
6. Python
7. Git + GitHub

📂 🔗 Project Repository:
GitHub: https://github.com/Jay61616/Patient-Vital-Monitoring-GCP

⏱ Timestamps (Suggested)
0:00 Intro
1:05 Abstract
8:26 Begin Procedure
14:28 Simulator Explanation
43:48 Stream Data
54:27 Dataflow Code Explanation
1:56:03 Create Bucket
1:57:49 Create Big query Table
2:12:20 Start Dataflow Pipeline
2:25:19 Connect Power Bi to BigQuery
2:26:53 Create Dashboard
2:54:59 Outro

🌐 💬 Stay Connected:
🔗 LinkedIn: https://www.linkedin.com/in/jayachandrakadiveti/
💻 GitHub: https://github.com/Jay61616
🌍 Website: https://jay.unaux.com

Credits:
Intro Music: https://socialbunnymarketing.com
Icons: https://www.flaticon.com/

🔥 #Hashtags
#healthcaredataengineeringproject #googlecloud #GCPProject #DataEngineering #HealthcareAnalytics #PubSub #Dataflow #ApacheBeam #BigQuery #PowerBI #StreamingData #RealTimeData #CloudDataEngineering #HealthcareData #EndToEndProject #BigData #ModernDataStack #PortfolioProject #GoogleCloudDataEngineer #gcp

Видео End-to-End Healthcare Data Engineer Project | GCP | Real - Time канала Data with Jay
Яндекс.Метрика
Все заметки Новая заметка Страницу в заметки
Страницу в закладки Мои закладки
На информационно-развлекательном портале SALDA.WS применяются cookie-файлы. Нажимая кнопку Принять, вы подтверждаете свое согласие на их использование.
О CookiesНапомнить позжеПринять