# robots.txt file that does not allow them to look at specific directories User-agent: * Disallow: /images/ Disallow: /meta/