Option to whitelist crawler IP addresses or User-Agent for website training data

Allow teams to whitelist the Fibi website crawler in their WAF/firewall by providing a published list of crawler IP addresses or a dedicated User-Agent string.

What AI feature?
Other

Please authenticate to join the conversation.

Upvoters
Status

In Review

Board

Fibi AI Agent

Date

About 2 hours ago

Author

Thierry Maasdam

Subscribe to post

Get notified by email when there are changes.