# All robots will spider the domain User-agent: * User-Agent: MJ12bot Disallow: