BeautifulSoup Tutorial - Zillow Web Scraping in Python
In this Web Scraping Python Tutorial, we will learn how to scrape Zillow using the BeautifulSoup library. BeautifulSoup is an awesome library for parsing HTML and getting exactly the data you need. So we will scrape real estate property data using Python and BeautifulSoup.
Other popular libraries used by web scraping developers in python are Scrapy and Selenium, but every library has its own pros and cons. Scrapy is like a spaceship. Beautifulsoup is like a skateboard. If you are a Python beginner, then it wouldn't be right to start with learning how to drive a spaceship. Start with the skateboard first! So that is the reason why we are using Beautifulsoup. We’ll pair BeautifulSoup with the Requests library to fetch Zillow's web pages via HTTP GET requests. Follow the exact steps on how to scrape real estate properties from Zillow!
I will do Live Coding while solving a freelance task from Upwork.
📄 Code Download: https://github.com/andrei-volkau/one-time-scrapers/tree/master/zillow-price_url_geo_sqft
⭐️ Timestamps ⭐️
00:00 - Upwork task description
00:48 - Import requests library + specifying HTTP GET request
02:11 - Obtaining HEADERS from Chrome Developer Tools
04:06 - PARAMS for HTTP GET request
05:29 - Creating ZillowScraper() class
05:55 - Defining fetch() class method
06:39 - Defining run() class method
08:19 - Defining code entry point
09:28 - Defining parse() class method
14:36 - Inspecting Zillow Web Page
15:50 - Find PARENT element using BeautifulSoup
17:57 - Inspecting CHILD elements (spoiler: one of them is an Ad)
21:08 - Getting CHILD elements in our code
24:30 - Extracting text from SCRIPT html tag + making json
28:00 - Extracting real estate data from json (python dict in our case)
34:20 - Extracting price
36:48 - Iterating through all Zillow pages
41:50 - Defining to_csv() class method
44:49 - Scraped Data in csv format
Let's connect on Linkedin ► https://www.linkedin.com/in/andreivolkau/
Find me on Upwork ► https://www.upwork.com/o/profiles/users/~01ce59ba5c3cd5e8d4/
⚡ Please leave a LIKE and SUBSCRIBE for more content! ⚡
⭐ Tags ⭐
web scraping
beautifulsoup
scraping
web scraping python
python beautifulsoup
Python Tutorials
Python web scraper tutorial
Web Scraper Python
octoparse
data scraping
python scrapy
web scraping using python
web crawler python
⭐ Hashtags ⭐
#webscraping #beautifulsoup #pythontutorial
Видео BeautifulSoup Tutorial - Zillow Web Scraping in Python канала Web Scraping with Andy
Other popular libraries used by web scraping developers in python are Scrapy and Selenium, but every library has its own pros and cons. Scrapy is like a spaceship. Beautifulsoup is like a skateboard. If you are a Python beginner, then it wouldn't be right to start with learning how to drive a spaceship. Start with the skateboard first! So that is the reason why we are using Beautifulsoup. We’ll pair BeautifulSoup with the Requests library to fetch Zillow's web pages via HTTP GET requests. Follow the exact steps on how to scrape real estate properties from Zillow!
I will do Live Coding while solving a freelance task from Upwork.
📄 Code Download: https://github.com/andrei-volkau/one-time-scrapers/tree/master/zillow-price_url_geo_sqft
⭐️ Timestamps ⭐️
00:00 - Upwork task description
00:48 - Import requests library + specifying HTTP GET request
02:11 - Obtaining HEADERS from Chrome Developer Tools
04:06 - PARAMS for HTTP GET request
05:29 - Creating ZillowScraper() class
05:55 - Defining fetch() class method
06:39 - Defining run() class method
08:19 - Defining code entry point
09:28 - Defining parse() class method
14:36 - Inspecting Zillow Web Page
15:50 - Find PARENT element using BeautifulSoup
17:57 - Inspecting CHILD elements (spoiler: one of them is an Ad)
21:08 - Getting CHILD elements in our code
24:30 - Extracting text from SCRIPT html tag + making json
28:00 - Extracting real estate data from json (python dict in our case)
34:20 - Extracting price
36:48 - Iterating through all Zillow pages
41:50 - Defining to_csv() class method
44:49 - Scraped Data in csv format
Let's connect on Linkedin ► https://www.linkedin.com/in/andreivolkau/
Find me on Upwork ► https://www.upwork.com/o/profiles/users/~01ce59ba5c3cd5e8d4/
⚡ Please leave a LIKE and SUBSCRIBE for more content! ⚡
⭐ Tags ⭐
web scraping
beautifulsoup
scraping
web scraping python
python beautifulsoup
Python Tutorials
Python web scraper tutorial
Web Scraper Python
octoparse
data scraping
python scrapy
web scraping using python
web crawler python
⭐ Hashtags ⭐
#webscraping #beautifulsoup #pythontutorial
Видео BeautifulSoup Tutorial - Zillow Web Scraping in Python канала Web Scraping with Andy
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Who developed the BeautifulSoup library?How do I know if BeautifulSoup is installed❓BeautifulSoup Tutorial - What is lxml❓BeautifulSoup Tutorial - How to use prettify❓BeautifulSoup Tutorial - How to find tag❓BeautifulSoup Tutorial - How to get text ❓BeautifulSoup Tutorial - How to get href❓Why is it called BeautifulSoup? 🤔BeautifulSoup Tutorial - What is tag❓BeautifulSoup Tutorial - What is soup❓BeautifulSoup Tutorial - Which parser to use❓BeautifulSoup Tutorial - Web Scraping Resumes in PythonBeautifulSoup Tutorial - Web Scraping in PythonBeautifulSoup Tutorial - Web Scraping 🐕 images in Python