We extracted 2, 00,773 of mobile devices reviews using data extraction program of ten different makes, in which the products belong to major categories of mobile brands: Samsung, iPhone, Micromax, Vivo, Redmi, Panasonic, Motorola, Lenovo, Oppo, and Nokia. Those online reviews were posted by 1, 29,061 number of users. Each review include the following information 1) product name, 2) user name, 3) ratings, 4) review title, 5) upvote, 5) downvote, 7) date, 8) review text, 9) userid, 10) productid. these reviews are unfiltered and can be used for spam detection, sentiment analysis, recommender system, etc.
Steps to reproduce
The scraper was created for automatic extraction of opinions and metadata from one of the Ecommerce website. The scraper makes use of Tag Path Clustering approach for extraction. The approach also uses selenium tool for browser automation, Beautifulsoup for parsing and navigating and Pandas for data store.