Automatic generation of Sitemap and Baidu active push for accelerated inclusion
Using Sitemap and active push to accelerate inclusion, the key point is to let the search engine receive the address in two rhythms: the sitemap is responsible for the full list and update time, usually read according to the crawling cycle; active push is responsible for delivering the new address to Baidu, Bing at the moment of article publication, saving the waiting time for crawling discovery. Both are configured, and the inclusion time of new content will be shortened stably.
Division of labor of two roads
| mechanism | What to convey | Suitable scenario |
|---|---|---|
| Sitemap (Site Map) | Full address, update time, page type | Column structure verification, historical page rediscovery |
| Push manually | Single new address | New articles, revised pages, and activity pages notified immediately |
Only create Sitemap, the collection rhythm depends on how often the other side crawls; only push, and there is a lack of an overall view when historical pages appear structural changes.
Configure Sitemap auto-generation
AnQiCMS supports Sitemap auto-generation, daily maintenance of the list does not need to be done manually. It is recommended to do a complete check before going online:
- Confirm that the site map can be accessed normally and includes home page, column page, and content page addresses;
- Check several addresses to confirm that they are consistent with the address form generated by the pseudo-static rules;
- Check whether there are background addresses, preview addresses, or test columns mixed in;
- Write the sitemap address to robots.txt for easy discovery by the crawling end;
- Submit to the search engine site owner platform once after the sitemap is updated;
The value of automatically generated content lies in the synchronous reflection of content changes, provided that your address rules are stable. When the style of the address is frequently changed, the sitemap will amplify the chaos;
Connect to Baidu and Bing for active push
AnQiCMS link push management supports Baidu, Bing active push, used to push new content to search engines to accelerate indexing. Connection sequence:
- Obtain the site's push interface and credentials from the site owner platform and save them in the background push configuration;
- Set the trigger time for push, usually choose the time of the formal release of the article, do not push for drafts and pending release status;
- First connect, try pushing in small batches first, confirm that the return is successful rather than quota or signature error;
- After normalization, pay attention to the push success rate and failure reasons, and prioritize pushing core columns when the quota is limited.
Align the push frequency with the content production rhythm: batch push for daily updated sites, and push single articles for low-frequency sites after they are completed. When migrating old content in batches, do not fill it up all at once, submit it by date and section to be closer to the normal release rhythm.
Track the effect of inclusion.
Determine whether the configuration is effective by looking at three indicators: the time from the release of a new address to its searchability, the proportion of
Common questions
Is it certain that it will be included after pushing?No guarantee. The push only solves the problem of 'knowing in time that there is this address', whether the inclusion still depends on whether the page content and structure is worth crawling.
How large does the site map need to be split?When a single file reaches the limit, split it by type or time period and then hand it over to the summary of the index site map.
What needs to be redone after changing the CMS?Re-generate the site map, re-bind the push credentials, and check the 301 redirect of the old address; all three are indispensable.
Do I still need to wait for the crawler to capture?Yes. Push and site map acceleration for discovery, the crawler will still visit according to its own budget, maintaining server response stability is also important.