# robots.txt for http://www.example.com/ User-agent: * Disallow: /Files/ Disallow: /Offer/ Disallow: /Page/ Disallow: /webapp2011x_disabled_2016-12-09 Disallow: /webapp2016x