Setup & context

We had a list of websites to scrape and predefined fields to scrape from every website for cars. Following were websites from where we needed to scrap data.

• Autoscout24

• Autotrader.co.uk

• Autotrader.com

• Bringtrailer.com

• goo-net-exchange.com

• pistonheads.com

• Ebay.com

The challenge & problem PROCESS

We faced challenges in scraping fields and storing clean data in the database. We successfully overcame these challenges and found solutions to the issues.

results

We successfully scraped those 7 websites in the context of car scraping and stored the cleaned data in a PostgreSQL database for future use.

Automobile Websites Scraping

My project with my client gave me the opportunity to work on scraping different websites that deal with buying and selling automobiles. The goal was to scrape specific data from all websites and store it in a PostgreSQL database for future use.