Robot usage

Currently ZookaBot is used by Sitexploration & Zooka. ZookaBot is one of the data collecting engines controlled by the Centiverse system.

I you observe that you are hit hard and continuous by ZookaBot, it might be the Crawl-on-demand function or similar executed by Sitexploration.

Feel free to contact us about ZookaBot.

Crawl control

ZookaBot is used to crawl selected parts of the internet.
The robot will follow the basic command from robots.txt.

How to control ZookaBot from robots.txt

#keep zookabot away
User-agent: Zookabot
Disallow: /	

#keep away from file path containing /private/	
User-agent: Zookabot
Disallow: /private/ 	

#keep away from files containing /private.html
User-agent: Zookabot
Disallow: /private.html	

#keep away from .html files	
User-agent: Zookabot
Disallow: /.html