MYLBot
MYLBot is the web crawler of Mind Your Language (MYL), a translation company.
It reads the public pages of websites we translate or have been asked to quote on. We use it to count words and to pick up new content for translation.
How to recognise it
- User agent
Mozilla/5.0 (compatible; MYLBot/1.0; +https://bot.mindyourlanguage.com/)
What it does
- Reads public pages only
- It does not log in, fill in forms or collect personal data.
- Crawls slowly
- About one page every one to two seconds.
For website owners
To let MYLBot through a firewall or bot protection, allow requests whose user agent contains MYLBot.
If you would like us to stop or slow down a crawl of your site, please get in touch and we will do so.
Contact
You can reach us through mindyourlanguage.com.