Spider analysis

📅 November 21, 2026 👁️ 0

Spider analysis

Spider Analysis page displays the access statistics and access records of search engine spiders.

Entry Path

Top menu of the background → 'Data' → 'Spider Analysis'. Actual address:/system/statistic/spiderrequires administrative privileges(canAdmin)

Function description

The page provides two entries, 'Spider Statistics' and 'Access Record', for observing the crawling frequency of various search engine spiders.

Screenshot of the interface

Spider analysis

Index口径

Indicator Calculation口径 Data source Time range Delay / Note
Spider access times/types Search engine spider crawling times and categories Access log Determined by the default range of the report It is recommended to keep the spider pass open

Source of口径: Backendcontroller/manageController/statistics.goofStatisticSpider(About the 15th line), retrieve data from the statistical aggregation table according to the site and time range.

Operation steps

  1. Enter 'Data → Spider Analysis' to view statistics.
  2. Switch to「Access Records」to view details.
  3. When the spider time is 0 for a long time, check the robots, cover and link push configuration.

Applicable scenarios and suggestions

  • After the new content is published, observe whether the spider captures it in time.
  • When the spider's access decreases, check whether the website security protection mistakenly intercepts the spider.

Points to note

  • It is recommended to keep the 'whether to allow the spider' in website security protection open, otherwise it will affect statistics and inclusion.
  • The visit records contain IP, and note desensitization when exporting and screenshotting.

Related documents