Загрузка страницы

BeautifulSoup Tutorial - Zillow Web Scraping in Python

In this Web Scraping Python Tutorial, we will learn how to scrape Zillow using the BeautifulSoup library. BeautifulSoup is an awesome library for parsing HTML and getting exactly the data you need. So we will scrape real estate property data using Python and BeautifulSoup.

Other popular libraries used by web scraping developers in python are Scrapy and Selenium, but every library has its own pros and cons. Scrapy is like a spaceship. Beautifulsoup is like a skateboard. If you are a Python beginner, then it wouldn't be right to start with learning how to drive a spaceship. Start with the skateboard first! So that is the reason why we are using Beautifulsoup. We’ll pair BeautifulSoup with the Requests library to fetch Zillow's web pages via HTTP GET requests. Follow the exact steps on how to scrape real estate properties from Zillow!
I will do Live Coding while solving a freelance task from Upwork.
📄 Code Download: https://github.com/andrei-volkau/one-time-scrapers/tree/master/zillow-price_url_geo_sqft

⭐️ Timestamps ⭐️
00:00 - Upwork task description
00:48 - Import requests library + specifying HTTP GET request
02:11 - Obtaining HEADERS from Chrome Developer Tools
04:06 - PARAMS for HTTP GET request
05:29 - Creating ZillowScraper() class
05:55 - Defining fetch() class method
06:39 - Defining run() class method
08:19 - Defining code entry point
09:28 - Defining parse() class method
14:36 - Inspecting Zillow Web Page
15:50 - Find PARENT element using BeautifulSoup
17:57 - Inspecting CHILD elements (spoiler: one of them is an Ad)
21:08 - Getting CHILD elements in our code
24:30 - Extracting text from SCRIPT html tag + making json
28:00 - Extracting real estate data from json (python dict in our case)
34:20 - Extracting price
36:48 - Iterating through all Zillow pages
41:50 - Defining to_csv() class method
44:49 - Scraped Data in csv format

Let's connect on Linkedin ► https://www.linkedin.com/in/andreivolkau/
Find me on Upwork ► https://www.upwork.com/o/profiles/users/~01ce59ba5c3cd5e8d4/

⚡ Please leave a LIKE and SUBSCRIBE for more content! ⚡

⭐ Tags ⭐
web scraping
beautifulsoup
scraping
web scraping python
python beautifulsoup
Python Tutorials
Python web scraper tutorial
Web Scraper Python
octoparse
data scraping
python scrapy
web scraping using python
web crawler python

⭐ Hashtags ⭐
#webscraping #beautifulsoup #pythontutorial

Видео BeautifulSoup Tutorial - Zillow Web Scraping in Python канала Web Scraping with Andy
Показать
Комментарии отсутствуют
Введите заголовок:

Введите адрес ссылки:

Введите адрес видео с YouTube:

Зарегистрируйтесь или войдите с
Информация о видео
9 июня 2020 г. 15:13:31
00:45:07
Яндекс.Метрика