User-agent: * Disallow: /*.pdf$ Disallow: /_old_site/ Disallow: /_old_app/ Disallow: /core/ Disallow: /vendor/