About This File
The module monitors bot activity on the site.
A simple and convenient extension that has the ability to add any bots.
Maintains archival statistics with pages visited and the dates of their visits (including IP addresses).
Useful for analyzing site indexing by different search engines, link checking bots (such as Ahrefs) or analyzing site scraping by attackers.
I will listen to any opinions on improvements and wishes.
1. The last approach of the robot is interesting
2. The statistics of visits, frequency of visits, number of pages during a visit, by time are interesting..
3. It is also possible to track known parsing bots and spambots, which can be covered up, but by other means.
There is no demo, everything is on the screen.
Useful or useless - it's up to you..
What we can do...
bot - page - route - date
Those. user agent - page visited - internal representation - date of visit
For what?
You have created a product, you need to find out whether a bot visited the page and when.
Of course, you can use http log parsers, and do this almost daily.
Or use reports from various metrics
The module allows you to find out about bot traffic at any time. Build your reports with a specific skill.
You can see which bots are visiting. IP, and post the frequency and time of visit. For example, on one of the experimental sites, it was found that G-bot very rarely runs from 2 to 4 in the morning, and more often during working hours.
No need to read further - just a history of development
Editing bots
Filter by bots
Buttons for checking pages in the index
the visited page is presented with a protocol
Added report button
Multi-stores are taken into account
Support for Cyrillic domains is included
Added a report on the frequency of visits by robots by hour. Added debugging functionality - check if it is installed correctly
You can disable link checking in robots if not necessary.
Added information reports - number of bots on a page, number of pages viewed by a bot - when hovering over a column
