Hugging Face Datasets #3 | Adding Images
How to work with the Hugging Face datasets library in Python. Here we focus on adding images, using dataset builder scripts, the download manager and iter_archive function. Everything we do is using the best-practice methods for Hugging Face (huggingface) Datasets, all in Python.
Can be used for datasets in image search, similarity search/semantic search/vector similarity search, classification, question-answering. Makes training/fine-tuning models with pytorch and tensorflow easy.
🤖 AI Dev Studio:
https://aurelio.ai/
👾 Discord:
https://discord.gg/c5QtDB9RAP
00:00 Intro
02:05 Creating Tar Files for Images
05:11 Compressing Images in Tar Files
06:26 Adding Dataset Builder Script
09:07 Iterable Download Manager with iter_archive
09:56 _generate_examples Function Definition
12:52 Adding to Hugging Face Datasets Hub
13:34 Fixing Errors
14:23 Using Your New Dataset
14:53 Dealing with Larger Image Datasets
Видео Hugging Face Datasets #3 | Adding Images канала James Briggs
Can be used for datasets in image search, similarity search/semantic search/vector similarity search, classification, question-answering. Makes training/fine-tuning models with pytorch and tensorflow easy.
🤖 AI Dev Studio:
https://aurelio.ai/
👾 Discord:
https://discord.gg/c5QtDB9RAP
00:00 Intro
02:05 Creating Tar Files for Images
05:11 Compressing Images in Tar Files
06:26 Adding Dataset Builder Script
09:07 Iterable Download Manager with iter_archive
09:56 _generate_examples Function Definition
12:52 Adding to Hugging Face Datasets Hub
13:34 Fixing Errors
14:23 Using Your New Dataset
14:53 Dealing with Larger Image Datasets
Видео Hugging Face Datasets #3 | Adding Images канала James Briggs
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Variables and Flows for Chatbots | NeMo Guardrails #2GUI-based Few Shot Classification Model Trainer | DemoAI Agent Evaluation with RAGASInput Data Pipelines - TensorFlow Essentials #4How to build a Q&A Reader Model in Python (Open-domain QA)FREE 11 Hour NLP Transformers Course (Next 3 Days Only)Streamlit for ML #1 - Installation and APIStreamlit for ML #3 - Make Apps Fast with CachingFine-tune High Performance Sentence Transformers (with Multiple Negatives Ranking)How-to Decode Outputs From NLP Models (Python)Fast Zero Shot Object Detection with OpenAI CLIPSPLADE: the first search model to beat BM25LangChain Multi-Query Retriever for RAGIntro to APIs in Python - API Series #1Stoic Philosophy Text Generation with TensorFlowIdentify Stocks on Reddit with SpaCy (NER in Python)Implementing Filters in the New Haystack Doc StoreQ&A Document Retrieval With DPRStreamlit for ML #5.3 - Publishing Components to PipFunctional API - TensorFlow Essentials #2Composite Indexes and the Faiss Index Factory