centiverse

Robot usage

Currently ZookaBot is used by Sitexploration & Zooka. ZookaBot is one of the data collecting engines controlled by the Centiverse system.

I you observe that you are hit hard and continuous by ZookaBot, it might be the Crawl-on-demand function or similar executed by Sitexploration.


Feel free to contact us about ZookaBot.


Crawl control


ZookaBot is used to crawl selected parts of the internet.
The robot will follow the basic command from robots.txt.


How to control ZookaBot from robots.txt