User-agent: Googlebot
Allow: /
Disallow: /api


User-agent: Yandex
Allow: /
Disallow: /api


User-agent: *
Content-signal: ai-train=yes, search=yes, ai-input=yes
Allow: /
Disallow: /api