Google hopes to standardize robots.txt by going open source

Google wants to make the Robots Exclusion Protocol an Internet standard.