This tutorial blog will let you know how to scrape product data from Wayfair with the help of Web Scrapeping Chrome Extension. This helps to collect basic product data, ratings, pricing, and more.
We scrape data from Wayfair including:
- Product’s Name
- Sellers
- Ratings
- Total Reviews
- Sales Price
- Original Prices
- Products’ Features
- Product Information
The screenshot given below shows different data fields that we can scrape at X-Byte:
Requirements
Google Chrome Browser : Just download the Google Chrome browser. This extension needs Chrome 49+.
Web Scraping Chrome Extension : You can download the Web Scraping extension from Chrome Web Store. When you complete the download of this extension, you can see the spider icon within the browser toolbar.
Importing the Wayfair Data Scraper
After doing the installation, right-click any place on the page, then go to ‘Inspect’ and a console of developer tools will pop up. Then click on a tab called Web Scraper as well as go to the button ‘Create New Sitemap’ and click on the ‘Import sitemap’ alternative. Now, just paste the given JSON in the JSON Sitemap box.
You may get JSON from the GIST link given below:
https://www.xbyte.io/contact-us/
Getting the URLs from Wayfair
Wayfair helps you search for the products, which you could filter depending on parameters including brand, prices, materials, ratings, etc. The scraper helps you extract data from Wayfair depending on the requirements. You may select the data filters required as well as copy the equivalent URL. In a Web Scraper toolbar, just click on a Sitemap button, choose the alternative “Edit metadata’ as well as paste new URLs (depending on your filters) and Start URL.
Running the Scraper
Visit the Sitemap as well as click the ‘Scrape’ option from the drop-down. One new request of Chrome would launch, allowing the extension to scroll as well as collect the data. When the scraping gets completed, the browser gets close automatically as well as sends the notification.
Data Downloading
To download scraped data in the CSV file, which you can use in Google Sheets or Microsoft Excel, just go to Sitemap drop down > Export like CSV > Download.
