Magpie HTML - v0.1.3
    Preparing search index...

    Function extractRobots

    • Extract robots metadata from parsed HTML document.

      Parameters

      • doc: Document

        Parsed HTML document

      Returns RobotsMetadata

      Robots metadata

      Extracts robot directives from meta tags for general robots, Googlebot, Bingbot, and Google News bot.

      const doc = parseHTML(htmlString);
      const robots = extractRobots(doc);
      console.log(robots.robots?.index); // true/false
      console.log(robots.robots?.follow); // true/false

    Settings

    Member Visibility