Hamrobazaar.com is one of the most popular forum based e-commerce website from Nepal. One can find various items in this site. But finding the right item that is on sale, for example say finding a Scooter, it can be quite a challenging task because of the number of entries and variations. So, here is a... » read more
This is a snippet of Python’s Scrapy code that I recently wrote to crawl and scrape job listings from a Nepal’s leading job listing site MeroJob. I am planning to use data scraped from this site to perform some data analysis on the current job market trend of Nepal. def parseJobLink(self, response): item = MerojobItem()... » read more
Introduction GoodReads is a very good resource for info about books, authors and interesting quotations. In this post, I will share a piece of code that will allow you to scrape for quotations from this site. The code is written for python’s Scrapy framework. Getting Started To get started with scraping quotes from your favorite... » read more
Web Scraping Data For Hollywood Actors/Actresses Info A friend of mine and I were discussing about the divorce rate/trends of Hollywood actors. Basically she was claiming that most of the actors have multiple wives and have gone through divorce in Hollywood. I was not so much in agreement and so came this project. I created... » read more
Here’s a web crawling script to crawl videos from Youtube: https://github.com/psovit/yt_crawler.git The script is written in Python’s Scrapy framework and can be used for finding full list of videos easily by various filters like ‘keyword’, ‘view count’, ‘channel’, ‘votes’ etc. easily. Feel free to clone/fork/modify and let me know if you need any help running... » read more