WebLog Expert
recognizes most spiders (robots) by user agent string. If
the 
tracking code is installed on site pages, the
program can also report automated prefetching requests of some
browsers as requests from spiders.
Recognizing spiders
is important as their requests should be distinguished from
requests of usual visitors to provide accurate statistics on
visitor activity.
The
Access
Statistics (excluding the
Virtual
Domains report),
Visitors, Referrers, Goals and Tracked Files reports don't include statistics on any requests from
spiders by default. Other reports count hits, bandwidth and failed
requests from spiders while visitor-related metrics such as number
of visitors, page views, visit length, etc don't include activity
from spiders.
You can check
the Count spiders as visitors option to enable processing of spider requests the
same way as requests from usual visitors.
