How long will it take for a new page without active push to be indexed by search engines?
How long does it take for a new page without active push to be indexed by the search engine? The waiting time is not fixed, but it depends on the speed of the search engine finding the page, not the quality of the page. The waiting time is for the crawling cycle: usually, it has to wait for the next full scan for being discovered passively by the site map; it can be discovered inadvertently through友情链接 (friendship links) or old pages within the site, and the time is more unpredictable. Active push shortens this waiting time because it directly notifies the other party that there is new content, skipping the step of waiting for others to discover it.
When not pushing, waiting from which three sections?
The first segment is discovery. The crawler does not know that a new page has appeared in the world; it is just traversing the existing path. The update frequency of the sitemap and the density of internal links will affect this segment. The second segment is scheduling. After the search engine discovers it, it still needs to decide whether to really crawl this round, and the queuing time for low-weight sites and new domains is significantly longer. The third segment is indexing and display, which is usually faster than the first two segments.
Most of the complaints about slow inclusion fall in the first paragraph. The official definition of the interface is straightforward: the website can be called to notify that the content has been updated, so that crawling, indexing, and discovery can happen immediately. Attaching the link push eliminates the waiting period in the discovery phase.
Active push solves which section
The positioning of link push is to accelerate the inclusion of new content: after the page is published or updated, the address is submitted to the search engine by the website, and the URL submission interfaces of Baidu push and Bing belong to this category. The difference it brings is the timing of the notification, not the page weight. Pay attention to three points:
- Pushing should trigger along with the publish action, accumulating and补batching at night, effectively giving the timing back to the other party;
- Repeatedly pushing to the same address within a short period of time does not bring additional benefits, but may trigger quota limits, checking for duplicate submissions is the first thing after integration;
- Pushing only covers the batch of addresses you submitted, the rediscovery of historical pages still relies on the sitemap.
The sitemap is responsible for the other half.
Sitemap provides a full list and the update time for each address. It does not solve timeliness, but solves coverage. The value of automatically generating a site map lies in not missing: new categories, batch imported content, and old articles with changed addresses will all enter the list with the generation action. The manual maintenance list often misses the latter two categories.
The division of labor can be remembered like this: link push takes care of the new, site map takes care of the whole; push takes care of this time, site map takes care of the future. Without generating a site map, historical content goes unnoticed; without doing push and only generating a site map, new pages will fall into passive waiting.
Landing order and verification
It is recommended to follow four steps. The first step is to normalize the address, determine the pseudo-static rules first, and avoid the existence of two accessible addresses for the same document, as this will only create duplicates when pushed. The second step is to link and push, placing the trigger after the document is published and updated. The third step is to enable automatic generation of the site map and confirm the time for new pages to enter the list. The fourth step is to connect to the submission interface on the search engine side, and ensure that the file configuration is properly set up with permissions according to the site.
Check three indicators: submission success rate, repeated and failed reasons returned, and the ratio of actual inclusion to submission volume. If the ratio is low for a long time, first check the address specification and content quality, and then suspect the push itself.
Common questions
If pushed, is it definitely included?No. The push only guarantees that the other party knows the existence of the address first time, whether it is included still depends on the page content and site condition.
How often should it be pushed?Follow the release. When supplementing historical addresses in batches, push in batches according to the interface quota, and don't send the whole site list at one time.
Is the update time in the site map useful?It is just a prompt, the actual crawling rhythm is not determined by it. What needs to be maintained is the completeness of the list and the accuracy of the address.
What should be done first when migrating an old site?First, clarify the 301 redirect relationships, and then push the new address. The more chaotic the address, the more duplicates and invalid records will be pushed.