Have you ever wondered how Google gets sites indexed that you have to pay for? You click the link with the perfect answer to your question, but you have to pay for it. In this article I will show you a hole many of these sites open to get their site indexed by google. Note, this is only an educational article and nothing else.
If you look at it, the only thing thats separating me from a googlebot, is my user agent string. Well as far as the website is concerned.
“When you visit a Web page, your browser sends the user-agent string to the server hosting the site that you’re visiting. This string indicates which browser you’re using, its version number, and details about your system, such as operating system and version. The Web server can use this information to provide content that is tailored for your specific browser.” Taken from msdn.
So, all you should have to do is, send them a modified user agent string right? But it can’t be that easy can it?
Well, it is that easy, and this is how to do it.
Firefox users, just install this extension, then restart your browser. Then when you restart, import this file (right click and save) that has a huge list of user agent settings including Googlebot/2.1 and many other spiders/bots. To import, just click tools in your toolbar, then user agent switcher…
Then options, and options again.
Now a options window should come up. Click Useragents.
When you click import, it will ask you for a file and just select the one you downloaded from above.
Now if you go back to tools->user agent switcher, you should see a ton of different agents. Just select one then bam, thats what you become. To check it, go here and look under useragent to see what it thinks you are.
If you are using a browser other than firefox, refer here to find out how to do this
Thats all you have to do. Isn’t that sad? These pay sites open a very big hole just because they want free advertising on google. I guess thats the price they pay for getting greedy.
If you have a pay site and you want to advertise on google, use adwords. With the money you are making on your site, you can afford it. I would hate for you to have all the good content that you are losing money on because people are getting in for free.
OctalMage
Edit: and its back
Buy Jason a cup of coffee.