Have you ever wanted to surf the webs as a bot? Ever wondered what the Googlebot gets to see online that you don’t? To find out, install 1000 Bots and surf the internet as Googlebot – the most influential Internet user of all.
1000 Bots is a simple web extension which changes your browser’s user agent to that of the Googlebot. Googlebot is a web crawler which surfs the web extensively to build a searchable index for the Google search engine (making it one of the most influential internet users. Only what it sees is indexed and can later be found by other users). By changing your settings to match those of Googlebot, you become one of thousands of Google web crawlers browsing the web to index its contents.
Surfing the web as Googlebot gives you access to what is referred to as the grey web, a layer of content only visible to bots. In some cases it might give you access to websites and archives that are usually hidden behind a paywall. Because while the website owner will present the regular user with a login page, they will give web crawlers access to their full archive in order for it to be represented in Google’s search results.
Extension is still pending review in Chrome Web Store ;((
Meanwhile chrome users can install the extension manually. Just download
the extension, unzip it and follow the guide on stackoverflow.
💻 Install the web extension.
📡 To start surfing as Googlebot, click on the icon in the browser toolbar.
🏄🏾♀️ Surf your favourite websites.
🌐 Check RYBN’s Double Negative Capchas to see if you pass the bot test.
(You might have to take the test twice until it works)
The source code for 1000 Bots is free software and published under the GNU GPLv3.
1000 Bots is a response to @RYBNs wonderful work Double Negative Captchas.
<3 !Mediengruppe Bitnik