meplace

3. 04.

Robots.txt é um ficheiro de texto que se coloca na directoria principal de uma página web.
Para que serve? Para que os web web spiders e web robots não acedam/pesquisem ficheiros/pastas que normalmente não é visto pelo público.

Aqui no meu blog, já me tinha apercebido que estas aranhas da web tentavam aceder ao robots.txt que eu não tenho! Fiquei sempre confuso. Percebi agora o que procuram..

Um exemplo de um robots.txt (aplicado ao wodpress):
User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /comments
Disallow: /category/*/*
Disallow: */trackback
Disallow: */comments
Disallow: /*?*
Disallow: /*?
Allow: /wp-content/uploads

# Google Image
User-agent: Googlebot-Image
Disallow:
Allow: /*

# Google AdSense
User-agent: Mediapartners-Google*
Disallow:
Allow: /*

# Internet Archiver Wayback Machine
User-agent: ia_archiver
Disallow: /

# digg mirror
User-agent: duggmirror
Disallow: /

# Does anyone care I love Google Apache htaccess

Sitemap: http://www.askapache.com/sitemap.xml

Ler mais: wiki.en, wiki.pt.

Este post, vem a propósito do robots.txt do Google.
O Google também tem este ficheiro. Podem ver/pesquisar algumas coisas que normalmente não vêem, como por exemplo alguns motores de busca em versões beta - não muito publicitadas.

26. 03.

Google (NSDQ: GOOG) has not released sales predictions for devices based on its mobile operating system Android. But that doesn’t stop Rich Miner, group manager for mobile platforms at the search giant, from being confident. After his presentation on Thursday at the Emerging Communications Conference at the Computer History Museum in Silicon Valley, Miner said he expects Android-based devices to outpace sales of the popular iPhone.

“Once you have devices out there from Motorola (NYSE: MOT), HTC, Samsung, and so on, there’s a much larger potential market on Android than for the iPhone,” Miner said. Despite the runaway success of the iPhone, which sold 4 million units in its first seven months of release, “there’s a single manufacturer, it’s targeted at a particular demographic, and it falls far short of the 1 billion mobile phones sold every year worldwide,” added Miner.

Introduced last November, Android is a “complete open-source [software] stack” for mobile devices, not just an operating system,” Miner said during his eComm presentation. Trying to stimulate application development for Android devices, Google is offering $10 million in prizes in its “Android Developers Challenge” for innovative and useful apps.

Opening the iPhone platform to third-party apps, Apple earlier this month released the software development kit for the popular consumer device. Apple said this week that the SDK has already been downloaded more than 100,000 times. Miner, however, pointed out that significant restrictions will still limit the creation of rich and useful applications for the iPhone.

“There are things I saw people doing with the first version of the Android SDK that it seems like you can’t do with the iPhone at least at the moment,” he says.

Google said last month at the 3GSM conference in Barcelona that the Android SDK has been downloaded 750,000 times. “That’s for a device that doesn’t even exist yet,” remarked Miner.

Motorola, Samsung, HTC, and LG all belong to the Open Handset Alliance, which was formed last year by Google to promote open platforms and open networks in the mobile and wireless industry. All four are expected to release devices based on Android in the second half of this year. Miner indicated on Thursday that he expects one of the handset makers (most likely Taiwanese manufacturer HTC, according to industry reports) to reach the market before the other three.

Android and the iPhone, Miner adds, are aimed at different markets.

“It’s not a competitive thing — it’s great that people are finally building tools so all of these third-party applications can be built and get out there,” Miner said. “[If I were a developer] I’d certainly be looking at the iPhone, and if you believe there will be lots of Android phones out there, as we do, I’d be developing for both platforms.”

source: informationweek