Function extractRobots

extractRobots(input: DocumentInput): RobotsMetadata
Extract robots metadata from HTML.
Parameters
- input: DocumentInput
  Parsed HTML document or raw HTML string
Returns RobotsMetadata
Robots metadata
Remarks
Extracts robot directives from meta tags for general robots, Googlebot, Bingbot, and Google News bot.
Example
```
// With parsed document (recommended for multiple extractions)
const doc = parseHTML(htmlString);
const robots = extractRobots(doc);

// Or directly with HTML string
const robots = extractRobots(htmlString);
```
- Defined in src/metadata/robots/extract.ts:35