Spider analysis
Spider analysis
Spider Analysis page displays the access statistics and access records of search engine spiders.
Entry Path
Top menu of the background → 'Data' → 'Spider Analysis'. Actual address:/system/statistic/spiderrequires administrative privileges(canAdmin)
Function description
The page provides two entries, 'Spider Statistics' and 'Access Record', for observing the crawling frequency of various search engine spiders.
Screenshot of the interface

Index口径
| Indicator | Calculation口径 | Data source | Time range | Delay / Note |
|---|---|---|---|---|
| Spider access times/types | Search engine spider crawling times and categories | Access log | Determined by the default range of the report | It is recommended to keep the spider pass open |
Source of口径: Backend
controller/manageController/statistics.goofStatisticSpider(About the 15th line), retrieve data from the statistical aggregation table according to the site and time range.
Operation steps
- Enter 'Data → Spider Analysis' to view statistics.
- Switch to「Access Records」to view details.
- When the spider time is 0 for a long time, check the robots, cover and link push configuration.
Applicable scenarios and suggestions
- After the new content is published, observe whether the spider captures it in time.
- When the spider's access decreases, check whether the website security protection mistakenly intercepts the spider.
Points to note
- It is recommended to keep the 'whether to allow the spider' in website security protection open, otherwise it will affect statistics and inclusion.
- The visit records contain IP, and note desensitization when exporting and screenshotting.