Open topic with navigation

# FollowRobotProtocol

If enabled, the connector follows Robot protocol. Use the parameter `FollowRobotMeta` to determine whether the connector follows the Robot META tags.

If the robot’s protocol disallows your spider access to the Web site or to certain areas of the Web Site, disable this parameter so your spider ignores the robot’s protocol.

Type: | Boolean
Default: | True
Required: | No
Configuration Section: | TaskName or Default
Example: | `FollowRobotProtocol=False`
See Also: |

© 2016 Hewlett Packard Enterprise Development LP | Send documentation feedback to HPE Close We welcome your comments! To open the configured email client on this computer, open an email window. Otherwise, copy the information below to a web mail client, and send this email to AutonomyTPFeedback@hpe.com. Product: Topic Title: Help Topic: Feedback:

_HP_HTML5_bannerTitle.htm