This is the best way to scrape Google search results quickly and easily for free.
I’ve tried great scraping tools like Import.io with no luck. This is especially the case if you’re trying to pull search results from pages that Google hides as duplicates.
The best way to scrape Google is to do it manually.
It may not be as fast as using a web crawler, but it’s safe, easy and fast. I’ve used the above web scraping technique to pull 1,000 links in just 5 minutes on the couch. Here’s the rundown on what you need to do.
In this video, I show you how to use a free Chrome extension called Linkclump to quickly copy Google search results to a Google sheet.
Most crawlers don’t pull Google results. Here’s why:
Scraping Google is against their terms of service; they go so far as to block your IP if you automate scraping of their search results.
- Download Linkclump for Chrome.
- Adjust your Linkclump settings — set them to “Copy to Clipboard” on action.
- Open a spreadsheet.
- Search for a term.
- Right-click and drag to copy all links in the selection.
- Copy and paste the links into a spreadsheet.
- Go to the next page of search results.
- Rinse and repeat.
That’s it! It’s Super easy and fast, and it makes for an excellent project to outsource to a virtual assistant for chump change.