User-agent: *

Disallow: /api*
Disallow: /file*
Disallow: /search*