Detecting bots
Valid bots identify themselves as user agents of bot
type
and can be tracked through Discover.
For example, when bots are detected, you can identify the pages on
your site that have been crawled by specific search engine bots such
as googlebot, msnbot, and more.
Self-reporting bots can be identified through the user-agent
string
value in the request. Discover can
match the values reported in this field to the values in the UserAgent
field
in the public standard Browscap.csv
. This user agent
information is posted to the [ExtendedUserAgent]
area
of the request.
Optionally, you can configure the Discover Reference
Session Agent to overload the TLT_APPLICATION_NAME
with
the browser type extracted from the user agent cache.
- See "Discover Reference Session AgentOverloadingApplicationReferenceField" in the Unica Discover Configuration Manual.