User-agent: * Disallow: /log-in/ Disallow: /media/ Disallow: /static/ Disallow: /admin/