- June 24, 2015
- Posted by: Graham Onak
- Category: SEO Tips
This is the best way to scrape Google search results quickly, easily and for free.
In this video I show you how to use a free Chrome extension called Linkclump to quickly copy Google search results to a Google sheet. This is the best way I know how to copy links from Google.
Most crawlers don’t pull Google results, here’s why.
Scraping Google is against their terms of service. They go so far as to block your IP if you automate scraping of their search results. I’ve tried great scraping tools like Import.io with no luck. This is especially the case if you’re trying to pull search results from pages that Google hides as duplicates.
The best way to scrape Google is manually.
It may not be as fast as using a web crawler, but the fact is – it’s safe, easy and fast. I’ve use the above web scraping technique to pull 1,000 links in 5 minutes on the couch. Here’s the rundown on what you need to do.
- Download Linkclump for Chrome
- Adjust your Linkclump settings – set them to “Copy to Clipboard” on action.
- Open a spreadsheet
- Search for a term
- Right click and drag to copy all links in the selection
- Copy and paste to a spreadsheet
- Go to the next page of search results
- Rinse and repeat
That’s it! Super easy and fast. This makes for an excellent project to outsource to a virtual assistant for chump change.