How many Bots follow you?
In a given time frame?
None so far
1 every so often
1 a week
1 a day
several a week
several a day
many every hour
seen from Malaysia
seen from Germany
seen from China
seen from Belarus
seen from China
seen from China
seen from China

seen from United States
seen from United States
seen from United States
seen from Norway
seen from Sweden
seen from China

seen from Singapore

seen from Malaysia
seen from Italy

seen from Belgium

seen from Kuwait

seen from Malaysia
seen from United Kingdom
How many Bots follow you?
In a given time frame?
None so far
1 every so often
1 a week
1 a day
several a week
several a day
many every hour
...Are the bots slowing down?
well? Are they?
I haven't seen ONE in weeks
I get like one every now and then?
I get a few a couple days
I get like 2 or three on a given day
I get too damn many!
IT'S DAMN NEAR ENDLESS!!!!! I just wanted to post about BLORBOOOOOOOOOO!!!!!
Botify is an SEO crawler that helps your website optimize for Googlebot
Botify optimizes sites so that they are crawled by Google’s bots, and visible on search results.
Most businesses live or die on Google search rankings. If you can’t crack the top few results, it’s almost impossible to consistently drive organic traffic to your site.
But how does Google decide which sites appear at the top of the results list? It uses Googlebot, a proprietary automated software script to “crawl” every website on the Internet and create an index that becomes the basis for search results. The problem is that this script is vague and mysterious, making it impossible for website creators to truly optimize for Googlebot and other search engines’ crawlers.
Enter Botify, a cloud-based crawler that will examine your website and create a detailed SEO analysis with actionable feedback. The French-based company, which launched today onstage at Disrupt NY, has already raised $7.2 million and on-boarded big-name customers like eBay, BlaBlaCar and Expedia.
But a few things make Botify stand out from the hundreds of other SEO companies out there.
First, the crawler is strong. The startup jokes that it holds the “world record” for most URLs crawled from a single website — 150,000,000. Botify also will let site administrators specify the crawl speed — anywhere from 10 to over 200 pages per second. Why would a site want its content crawled slower? Because Botify can crawl so fast that it sometimes stresses a site’s servers.
Besides a strong crawler overall, Botify can also detect which pages on a site have been crawled by Google. When Google crawls a site, it leaves traces in a site’s server logs. Once the site provides these logs to Botify, they can compare it with their own crawl to see if Google had visited a certain page.
Adrien Menard, co-founder and CEO of the company, explained that when “a page is not crawled by Google, it can’t drive any traffic and therefore any revenue. Pages ignored by Google represent a huge potential of traffic and revenue.”
Read full story here.