VidimusBot — the Vidimus crawler
Who VidimusBot is, what it reads on your site, how often it returns and how to block it in robots.txt. The Vidimus crawler respects robots.txt and always identifies itself by name.
VidimusBot is the crawler of Vidimus, a company register and due diligence platform for Czechia and Slovakia. If you found its name in your web server logs, this page explains what it does, how often it comes and how to stop it.
How to recognise it
It always identifies itself in the User-Agent header with its name and the address of this page:
VidimusBot/1.0 (+https://vidimus.sk/bot)
It does not pretend to be a browser or another crawler and does not try to get around bot protection.
Finding company websites
Companies are required to state their registration number on their website. The crawler visits a domain, reads the home page and the contact page and checks whose registration number they carry. This lets us link a company from the commercial register to its real website.
- at most 5 requests per domain in one visit (redirects are not counted)
- only the home page and common contact pages such as /kontakt or /o-nas
- it returns to the same domain after 180 days at the earliest
- we do not store page text — only the registration number found, with a short surrounding snippet as evidence
- a website is linked to a company only when the page itself carries its registration number
Passive domain scan
For domains we already know as a company website, the crawler checks the basic technical state: whether the site is alive, whether its certificate is valid and whether basic security headers are set. It sends your server only this:
- the robots.txt file — always first
- the home page
- the /.well-known/security.txt file, unless robots.txt disallows it
- one TLS handshake on port 443
- for a domain with an MTA-STS policy, its public mta-sts.txt file
Public DNS records are requested from a DNS resolver, not from your server. The scan returns to the same domain after 30 days at the earliest.
What the crawler does not do
- it does not try passwords, submit forms or log in
- it does not look for hidden paths or subdomains and does not scan ports
- it does not download images, documents or whole sites
- it does not force old protocols or test for vulnerabilities
How to block the crawler
We respect robots.txt. The crawler reads it as its first request and follows the group for VidimusBot; if there is none, the group for all crawlers. If you do not want it on your site, add this to robots.txt:
User-agent: VidimusBot
Disallow: /
After that the crawler sends nothing to your site except the robots.txt request itself — no home page and no TLS connection. You can also disallow selected paths only.
Contact
For questions, complaints or a request to exclude a domain, write to info@vidimus.sk.
Last updated: October 2026.
Create an account · Sign in