← Go Back

Built a simple Ebay Scraper build with python, scrapy and mongodb

• Github Link

Technology Used: Python3, Scrapy, MongoDB

The idea was to build a simple and efficient scraping system that accepts the URL of a specific website(Ebay) and scrapes a list of items with price. The system should also be able to scrap data if there are paginations

• Uses Scrapy as a framework for automated scraping
• Scrape websites with pagination and with parallel processing
• Uses mongodb, since the data fetched was somewhat not schematic and unstructured