# robots.txt file # exclude internet archive only: User-agent: ia_archiver Disallow: / # end robots.txt file