User-agent: * Disallow: /function Disallow: /?feed Disallow: /?tag Disallow: /?m Disallow: /?author Crawl-delay: 1