User-agent: * Disallow: /admin.php Disallow: /crp.php Disallow: /data/