Keep scrolling until you have a single page containing all search results for your query. If you are indeed querying results of over 100 you should see gInfinity append the next page of search results to the current page:
This will limit the chances of warning messages about ‘unusual traffic from your computer network’ which you can receive if persistently query Google. At 10 results a page you would need to query Google 20 times, but at 100 results a page you’ll only query Google twice. Let’s say for example that your domain has 200 pages indexed. This will limit the number of queries against Google search results. By default Google is set to return 10 results but you can override this to a maximium of 100. If you’re working with a large website with hundreds of URLs you’ll probably benefit from increasing the number of search ‘Results Per Page’.If you are extracting URLs for your domain use the Site search operator e.g. Go to Google and perform your search query.This will un-restrict the number of search results per page by seamlessly appending the next page of search results to the current list of SERPS – in essence creating infinite scrolling of SERPs.
#ONLINE URL EXTRACTOR INSTALL#
Install the ginfinity plugin for Chrome.If you’d prefer not to use Chrome the bookmarlet itself will work with other browsers, but we’ll be using a plugin not available in other browsers (to my knowledge!).
#ONLINE URL EXTRACTOR DOWNLOAD#
If you’re not using Chrome you can download it here. We’ll be utilising a JavaScript bookmarlet to process the search results provided by Google in combination with a nifty Chrome plugin to seamlessly scroll multiple pages of search results. I’ll start by saying there is nothing magic or malicious about this approach. So what if I told you it’s possible to extract a list of URLs from SERPs with a few clicks? You wouldn’t believe me, right? Wrong! With this little bookmarklet which I originally adapted for High Position from a similar tool by Liam Delahunty you’ll be able to extract URL and anchor text information with minimal effort. That’s fine if you’re operating a relatively small number of URLs but trying to adopt this approach for any more than 10 results can become somewhat tiresome – even extracting 10 results manually can be a bore!
You can of course extract the data manually using the ‘site:’ search operator and copy/pasting the results. But neither actually provide a definitive list of the URLs which Google has indexed for your domain. They also provide insight into the proportion of URLs index from any submitted sitemaps. Google Search Console (previously Webmaster Tools) offers an ‘Index Status’ which provides insight into the number of URLs indexed, historic trends and various filters. Power users and webmasters will know that it is difficult to get a definitive list of indexed URLs directly from Google. This process itself can be useful for a number of reasons from analysing the visible Titles and Meta Descriptions to searching for indexation of rogue or redundant URLs. The most common reason for this (in my experience at least) is to obtain a list of all URLs which Google has indexed for your particular domain. Every now and then you may want to extract a list of URLs from a Google web search for a particular search query.
0 kommentar(er)
