Should the pagination address on the list page be included in the sitemap
Should the pagination address on the list page be included in the sitemap, the judgment standard is not the technical habit, but whether this address carries an independent query requirement: Only when the pagination page after the second page has independent value for the reader and the content is not repeated with the homepage, it is worth declaring the inclusion; on the contrary, if the pagination is just the continuation of the same batch of articles, it is enough to put all the detail pages into the sitemap. The division of the inclusion range precedes any submission action.
What is declared by the sitemap
The role of the sitemap is to inform the crawling program that 'these addresses are worth visiting', it declares a value judgment rather than a comprehensive list. The AnQiCMS Sitemap is automatically generated, the scope is determined by the content status: formal documents enter the sitemap, drafts and content to be published do not enter, and documents in the recycle bin are not involved. Therefore, to control the scope of inclusion, you should start with the content status and column structure, rather than manually deleting entries. Whether the pagination address is included in the image depends on whether the list of results it points to is stable and reviewable.
Should the pagination address be included, judged by two categories
First category, pagination carries independent needs: Filtered by category, region, or parameter pages, the Nth page corresponds to a fixed set of content that does not appear elsewhere, this type of address can be included in the sitemap. Second category, pagination is just an extension of the timeline: Blog pages are divided by publication time, the second page is just older articles, which have already been declared on the detail page level, and including the pagination address again is just to make the crawling program repeat the same content. When making a judgment, ask a question: Is there any detailed content on this pagination page that is not covered by other pages?
The static rules must ensure the stability of the address
Whether the pagination address can be permanently indexed depends on the stability of the address format. AnQiCMS supports static URL and static rule management, which can write pagination parameters in a fixed form. Two situations need to be avoided: multiple accessible writing methods for the same page (both with parameters and without parameters available at the same time), and sorting parameters causing the explosion of pagination combinations. The former disperses the indexing signal, and the latter generates a large number of nearly duplicate addresses, both of which dilute the crawling priority. Sorting and filtering parameters without independent value should not be included in the sitemap.
robots and 301 redirects do not expand the inclusion scope
The configuration of robots.txt resolves the issue of allowing and prohibiting crawling, it cannot help a page to be indexed; blocking the pagination directory is just not crawling, it does not mean that it is removed from the index.The 301 redirect acts in the opposite direction, it is convergence rather than expansion: when multiple pagination formats point to the same content, use redirect merging signals; after the column is revised, the old list address should 301 to the new address to avoid leaving broken links.As for the submission and notification of inclusion, you can actively push new content to Baidu and Bing through the link push capability, without the need to submit for pagination addresses separately. Entrust the association of on-site keywords to the anchor text management maintenance, so that the path between the list page and the detail page is clear.
What to observe after adjusting the inclusion scope
After changing the scope of the site map, the observation order should be to confirm that the crawling is accessible (the site map can be read, and the pagination addresses return normally), then look at the changes in the inclusion volume, and finally look at the amount of traffic from the list page. If there is no independent entry on the pagination page within two weeks, it means that the judgment is wrong, and the scope should be收回 to the detail page level.
Common questions
If the pagination addresses are excluded from the entire site, will there be any content leakage
There will be no leakage, as long as the detail pages are all in the site map. Missing inclusion usually comes from incorrect status settings or new pages not being pushed in time, rather than missing pagination addresses.
Is a list page with filtering parameters considered a pagination
It is not the same category. If the filtering page covers independent query requirements, it is worth a separate judgment; if it is just a different sorting of the same collection, it belongs to duplicate addresses and is not suitable for site maps
What if the pagination address format changes
Use 301 redirect to point to the new format, while ensuring that only one accessible static rule is retained, to avoid two writing methods being online at the same time.