Scrapy- Get User Input. Python Web Scraping #2.

Sometimes we want to get user input in for our scrapers, This video shows how can we achieve this in Scrapy. User will give wallpaper name, the scraper will start fetching wallpaper urls and store them to a file.

The code base is present at below location-
https://github.com/harishbisht29/scraping_projects/tree/7670b2a4865e1a17d13118cbe195fce92402db56

I took the help of below resources while creating this video-
https://stackoverflow.com/questions/15611605/how-to-pass-a-user-defined-argument-in-scrapy-spider

Chapters
0:00 - Introduction
0:30 - Finding URL to hit.
1:50 - Scrapy command for pass arguments
2:50 - Using arguments inside your code.
05:45 - THE ERROR! and its Solution.
07:03 - Passing 2 words as single argument.
07:36 - Final thoughts

If this video was helpful to you please like it, and if you want to see some content like this and support me hit the subscribe button. Till then 😊Code Them All😊

Thanks.

#webscraping #scrapy #python-scraping

Видео Scrapy- Get User Input. Python Web Scraping #2. канала codethemall