Google is working on updates to advanced robots.txt and, according to a recent tweet, "The latest additions include explicit details on the files for IDNs, IP-addresses, and port numbered hostnames.