Hair Segmentation with Vision Transformers (UNETR) in TensorFlow

🚀 In this tutorial, you'll learn how to train, test, and visualize a UNETR (UNet + Transformers) model for multi-class image segmentation using Python and TensorFlow! We'll walk through the full pipeline — from preprocessing and patchifying the dataset to predicting and saving results on real test images

We’ll walk through the full pipeline:

📦 Loading and preprocessing a real-world segmentation dataset (Figaro Hair Segmentation)
🧠 Building the UNETR architecture combining Vision Transformers (ViT) with a U-Net-like decoder
🛠️ Training the model using a custom Dice Loss
🧪 Running inference and visualizing segmentation masks
🧩 Using Patchify to divide images into transformer-friendly patches
🔥 What You’ll Learn:

✅ How UNETR works (ViT + U-Net) - practical coding
✅ Patch creation for transformer models
✅ Custom loss functions for segmentation
✅ TensorFlow model training and prediction
✅ Test the model and visualize the results with OpenCV

Code for the tutorial : https://ko-fi.com/s/11e9fbdea9

You can find more computer vision tutorials in my blog page : https://eranfeit.net/blog/

You can find more Visual Language models tutorials tutorials in this playlist : https://www.youtube.com/playlist?list=PLdkryDe59y4a2PRJda-Z7M7Sod7uQKT2d

You can find more image Segmentation tutorials in this playlist : https://www.youtube.com/playlist?list=PLdkryDe59y4a0mid6wHQVeg-GDytXYv2F

~~~~~~~~~~~~~~~ recommended courses and books ~~~~~~~~~~~~~~~
A perfect course for learning modern Computer Vision with deep dive in TensorFlow , Keras and Pytorch . You can find it here : http://bit.ly/3HeDy1V
I also recommend this book, https://amzn.to/44GnlLW : "Make Your Own Neural Network - An In-depth Visual Introduction For Beginners ".
~~~~~~~~~~~~~~~ CONNECT ~~~~~~~~~~~~~~~
☕ Buy me a coffee - https://ko-fi.com/eranfeit
🖥️ Email : feitgemel@gmail.com
🌐 https://eranfeit.net
🤝 Fiverr : https://www.fiverr.com/s/mB3Pbb
🐦 Twitter - https://twitter.com/eran_feit
📸 Instagram - https://www.instagram.com/eran_feit/
▶️ Subscribe - youtube.com/@eranfeit?sub_confirmation=1
🐙 Facebook - https://www.facebook.com/groups/3080601358933585
📝 Medium - https://medium.com/@feitgemel
~~~~~~~~~~~~~~ SUPPORT ME 🙏~~~~~~~~~~~~~~
🅿 Patreon - https://www.patreon.com/EranFeit
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
#EranFeit #Visiontransformers #UnetR
~~~~~~~~~~~~~~ Chapters ~~~~~~~~~~~~~
00:00 Introduction and Demo
03:01 Installation
11:00 Build the model + Train
19:36 Test the model
~~~~~~~~~~~~~~ Credits ~~~~~~~~~~~~~
Music by Vincent Rubinetti
Download the music on Bandcamp: https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown
Stream the music on Spotify: https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u

Видео Hair Segmentation with Vision Transformers (UNETR) in TensorFlow канала Eran Feit