Unity Perception: Where's Waldo? Creating Synthetic Training Data for Machine Learning with fastai
The book series "Where's Waldo" is very popular. The task is to find a little guy in overcrowded images. But can a computer do the trick as well?
Perception package on GitHub: https://github.com/Unity-Technologies/com.unity.perception
Training a machine learning system for computer vision requires a lot of data. Especially, when it comes to segmentation tasks which require labeling individual pixels of an image, creating sufficient amounts of training data becomes a daunting task. Here comes the new perception package of Unity in handy. It allows to automatically generate synthetic training data in the game engine.
The video provides an example of how to use the new functionality to create Waldo-like images for training a neural net. The neural net is then trained using the fastai library.
Artificial Intelligence is a world on its own and resides somewhere out on the ocean, and it is called Apagayo Island. With the increasing importance of AI technology for our own world, more people should understand what they are working on on this island. But unfortunately, for many people this world is not accessible as they lack the required math and coding skills. This leads to a lot of myths and weird stories about AI technology.
This channel is an adventure to the secrets of Apagayo Island. It tries to educate in an entertaining way by storytelling in a game-like world, inspired by the classical computer game series Monkey Island. The foundation of AI is explained without the need of studying math and coding. So, join us in discovering the secrets of Apagayo Island.
.......................................................................
USED ASSETS (Affiliate links)
POLYGON - Pirates Pack https://assetstore.unity.com/packages/3d/environments/historic/polygon-pirates-pack-92579?aid=1101larZd
POLYGON - Adventure Pack https://assetstore.unity.com/packages/3d/environments/fantasy/polygon-adventure-pack-80585?aid=1101larZd
POLYGON - Fantasy Rivals https://assetstore.unity.com/packages/3d/characters/humanoids/polygon-fantasy-rivals-118399?aid=1101larZd
POLYGON - Heist Pack https://assetstore.unity.com/packages/3d/environments/urban/polygon-heist-pack-97949?aid=1101larZd
POLYGON - Town Pack https://assetstore.unity.com/packages/3d/environments/urban/polygon-town-pack-121115?aid=1101larZd
POLYGON - City Pack https://assetstore.unity.com/packages/3d/environments/urban/polygon-city-pack-95214?aid=1101larZd
POLYGON - SciFi City Pack https://assetstore.unity.com/packages/3d/environments/sci-fi/polygon-sci-fi-city-pack-115950?aid=1101larZd
POLYGON - SciFi Space Pack https://assetstore.unity.com/packages/3d/environments/sci-fi/polygon-sci-fi-space-pack-138857?aid=1101larZd
POLYGON - Office Pack https://assetstore.unity.com/packages/3d/props/interior/polygon-office-pack-159492?aid=1101larZd
POLYGON - Farm Pack https://assetstore.unity.com/packages/3d/environments/industrial/polygon-farm-pack-146192?aid=1101larZd
POLYGON - Vikings Pack https://assetstore.unity.com/packages/3d/environments/fantasy/polygon-vikings-pack-85664?aid=1101larZd
POLYGON - Particle FX https://assetstore.unity.com/packages/vfx/particles/polygon-particle-fx-168372?aid=1101larZd
Crest Ocean System URP https://assetstore.unity.com/packages/tools/particles-effects/crest-ocean-system-urp-141674?aid=1101larZd
AllSky 200+ Sky Box Set https://assetstore.unity.com/packages/2d/textures-materials/sky/allsky-200-sky-skybox-set-10109?aid=1101larZd
Ultimate Game Music Collection https://assetstore.unity.com/packages/audio/music/orchestral/ultimate-game-music-collection-37351?aid=1101larZd
RPG Character Mecanim Animation Pack https://assetstore.unity.com/packages/3d/animations/rpg-character-mecanim-animation-pack-63772?aid=1101larZd
Third Person Motion Controller https://assetstore.unity.com/packages/templates/systems/third-person-motion-controller-15672?aid=1101larZd
Bird Flock Bundle https://assetstore.unity.com/packages/3d/characters/animals/bird-flock-bundle-25576?aid=1101larZd
Bird Flock Bundle 2 https://assetstore.unity.com/packages/3d/characters/animals/bird-flock-bundle-2-71740?aid=1101larZd
Low Poly Animated Animals https://assetstore.unity.com/packages/3d/characters/animals/low-poly-animated-animals-93089?aid=1101larZd
.......................................................................
ABOUT
I am Christian, I have a Ph.D. in theoretical physics, and almost 20 years of experience in the IT industry, mostly as chief architect in a large software company. In 2018 I founded Atlantic Tech & Candy to bridge the gap between the AI and the business world.
IF YOU ARE INTERESTED in learning more about AI, check out my artificial intelligence course:
https://atnc.ai/online-workshops
This course is especially intended for non-experts.
CONTACT
Email: info@atnc.ai
SOCIAL MEDIA
Twitter @christian_wiele (https://twitter.com/christian_wiele)
PRODUCED BY
Atlantic Tech & Candy (https://atnc.ai)
Видео Unity Perception: Where's Waldo? Creating Synthetic Training Data for Machine Learning with fastai канала The Secrets of Apagayo Island
Perception package on GitHub: https://github.com/Unity-Technologies/com.unity.perception
Training a machine learning system for computer vision requires a lot of data. Especially, when it comes to segmentation tasks which require labeling individual pixels of an image, creating sufficient amounts of training data becomes a daunting task. Here comes the new perception package of Unity in handy. It allows to automatically generate synthetic training data in the game engine.
The video provides an example of how to use the new functionality to create Waldo-like images for training a neural net. The neural net is then trained using the fastai library.
Artificial Intelligence is a world on its own and resides somewhere out on the ocean, and it is called Apagayo Island. With the increasing importance of AI technology for our own world, more people should understand what they are working on on this island. But unfortunately, for many people this world is not accessible as they lack the required math and coding skills. This leads to a lot of myths and weird stories about AI technology.
This channel is an adventure to the secrets of Apagayo Island. It tries to educate in an entertaining way by storytelling in a game-like world, inspired by the classical computer game series Monkey Island. The foundation of AI is explained without the need of studying math and coding. So, join us in discovering the secrets of Apagayo Island.
.......................................................................
USED ASSETS (Affiliate links)
POLYGON - Pirates Pack https://assetstore.unity.com/packages/3d/environments/historic/polygon-pirates-pack-92579?aid=1101larZd
POLYGON - Adventure Pack https://assetstore.unity.com/packages/3d/environments/fantasy/polygon-adventure-pack-80585?aid=1101larZd
POLYGON - Fantasy Rivals https://assetstore.unity.com/packages/3d/characters/humanoids/polygon-fantasy-rivals-118399?aid=1101larZd
POLYGON - Heist Pack https://assetstore.unity.com/packages/3d/environments/urban/polygon-heist-pack-97949?aid=1101larZd
POLYGON - Town Pack https://assetstore.unity.com/packages/3d/environments/urban/polygon-town-pack-121115?aid=1101larZd
POLYGON - City Pack https://assetstore.unity.com/packages/3d/environments/urban/polygon-city-pack-95214?aid=1101larZd
POLYGON - SciFi City Pack https://assetstore.unity.com/packages/3d/environments/sci-fi/polygon-sci-fi-city-pack-115950?aid=1101larZd
POLYGON - SciFi Space Pack https://assetstore.unity.com/packages/3d/environments/sci-fi/polygon-sci-fi-space-pack-138857?aid=1101larZd
POLYGON - Office Pack https://assetstore.unity.com/packages/3d/props/interior/polygon-office-pack-159492?aid=1101larZd
POLYGON - Farm Pack https://assetstore.unity.com/packages/3d/environments/industrial/polygon-farm-pack-146192?aid=1101larZd
POLYGON - Vikings Pack https://assetstore.unity.com/packages/3d/environments/fantasy/polygon-vikings-pack-85664?aid=1101larZd
POLYGON - Particle FX https://assetstore.unity.com/packages/vfx/particles/polygon-particle-fx-168372?aid=1101larZd
Crest Ocean System URP https://assetstore.unity.com/packages/tools/particles-effects/crest-ocean-system-urp-141674?aid=1101larZd
AllSky 200+ Sky Box Set https://assetstore.unity.com/packages/2d/textures-materials/sky/allsky-200-sky-skybox-set-10109?aid=1101larZd
Ultimate Game Music Collection https://assetstore.unity.com/packages/audio/music/orchestral/ultimate-game-music-collection-37351?aid=1101larZd
RPG Character Mecanim Animation Pack https://assetstore.unity.com/packages/3d/animations/rpg-character-mecanim-animation-pack-63772?aid=1101larZd
Third Person Motion Controller https://assetstore.unity.com/packages/templates/systems/third-person-motion-controller-15672?aid=1101larZd
Bird Flock Bundle https://assetstore.unity.com/packages/3d/characters/animals/bird-flock-bundle-25576?aid=1101larZd
Bird Flock Bundle 2 https://assetstore.unity.com/packages/3d/characters/animals/bird-flock-bundle-2-71740?aid=1101larZd
Low Poly Animated Animals https://assetstore.unity.com/packages/3d/characters/animals/low-poly-animated-animals-93089?aid=1101larZd
.......................................................................
ABOUT
I am Christian, I have a Ph.D. in theoretical physics, and almost 20 years of experience in the IT industry, mostly as chief architect in a large software company. In 2018 I founded Atlantic Tech & Candy to bridge the gap between the AI and the business world.
IF YOU ARE INTERESTED in learning more about AI, check out my artificial intelligence course:
https://atnc.ai/online-workshops
This course is especially intended for non-experts.
CONTACT
Email: info@atnc.ai
SOCIAL MEDIA
Twitter @christian_wiele (https://twitter.com/christian_wiele)
PRODUCED BY
Atlantic Tech & Candy (https://atnc.ai)
Видео Unity Perception: Where's Waldo? Creating Synthetic Training Data for Machine Learning with fastai канала The Secrets of Apagayo Island
Показать
Комментарии отсутствуют
Информация о видео
8 октября 2020 г. 22:02:43
00:07:46
Другие видео канала
What you can learn from Sheldon Cooper and The Big Bang Theory (about Science, Sci Fi, and AI)Export Synty Characters from Unity to Blender and BackHow to make a boring topic like AI more exciting, and why this is importantTrain a Space Robot with Unity ML-AgentsScience Fiction or Real? What is AI?Unity Perception: Beginner Tutorial (for Synthetic Image Data)Unity Tutorial: How to Modify Synty Low-Poly Assets with ProBuilder in Unity?A Gamedev Adventure to the World of Artificial IntelligenceUnity Tutorial: Creating Randomized Synthetic Images with Unity3d Perception (for Deep Learning)How to Become a More Creative Indie Game DeveloperWhat is an algorithm?Indie DevLog #1: AI, Monkey Island, and a Wild IdeaWhat is Machine Learning? All you need to know!Beans or Bones - Official TrailerUnity Tutorial: Creating a Low-Poly Swamp (w/ Polaris, Crest, Synty, Enviro, Vegetation Studio Pro)Unity Tutorial: How to Modify Synty Low-Poly Characters with ProBuilder in UnityUnity Tutorial: Setting up Unity Perception for Creating Synthetic Images (for Deep Learning & AI)Indie DevLog: Creating Core Abilities in Unity (using Opsive Ultimate Character Controller)Unity Perception: Democratizing AI, Deep Learning through Synthetic Data (using Blender & Unity3d)How to use Shader Graph with Low Poly Assets in Unity (e.g. Synty)