The average click-through rate of questions with AI overview has dropped by about 20%, what other indicators can be attributed to
The average click-through rate of questions with AI overview has dropped by about 20%, what other indicators can be attributed to it? First, let's determine the nature of this number: it comes from a study covering ten million-level keywords, comparing the mean difference before and after the overview of the same batch of questions relative to the baseline. The mean means that the results are calculated by combining different intent and different industry questions together, and using it to predict the decline of a single site will be significantly biased - a site with a high proportion of brand words is facing a completely different traffic structure compared to a site with a high proportion of long-tail information words.
What does this 20% number measure?
The sample is counted by question unit and not divided by site; the baseline is the performance before the overview appears. Therefore, it describes that 'questions with an overview are more likely not to be skipped out', rather than 'your site has dropped by 20%'. Taking it as a ratio that can be applied to your own backend is the most common way this type of research is misinterpreted.
Why can't it be taken directly as the decline of a single site
Three reasons: Firstly, the intention structure is different; the click behavior of navigation and transactional questions is not on the same distribution as information questions; secondly, the position structure is different; the loss of pages originally ranked first and those pushed to the second screen after is very different; thirdly, the overview trigger is unstable; the results of the same question at different times and on different devices are not consistent, and the fluctuation within a short period of time is easily interpreted as a trend.
Three indicators that still hold steady.
A category is the amount of in-coming traffic brought by brand words and questions containing brand names, which is less affected by the overview and can reflect whether the actual demand changes; another category is the manifestation of non-informational intent, such as the behavior brought by pages such as inquiry, comparison, and download; another category is the conversion process after the entrance - form submission,留言, consulting and ordering, which occur outside the overview and are closer to business results than click-through rate. Split the keyword library into these groups according to intent and observe the trend, which is closer to the explainable attribution than focusing on the total amount.
Make the attribution reproducible.
Leave the control period first: Do not change a large number of templates and content at the same time, otherwise it will be impossible to distinguish between the impact of the overview and the impact of the revision. Next, look at the push and inclusion: If only part of the questions trigger the overview, use link push to actively hand over the new content and revision address to the search engine, so that the variable of 'whether included' can be fixed first. Finally, check the structure: Whether the anchor text and internal links hide the conversion page too deeply, when the deep link is skipped, the decline in click-through rate will appear simultaneously on the result side and the site side, and it is easy to be mixed into one thing.
Common questions
Can questions without an overview be used as a control group?Can it, and better. Comparing the performance of the same batch of keywords by triggering a preview group is more reliable than directly citing the external average.
If the click-through rate decreases, does that mean the content has worsened?Not necessarily. After the preview puts the answer in the foreground, some needs are met on the result page, and the clicks naturally decrease, which is a separate line from content quality.
How often should one look at the conclusion?It is recommended to look at trends on a monthly basis and structural changes on a quarterly basis. Short-term fluctuations after a single algorithm or layout adjustment should not be conclusive.
Where should one start?Prioritize the observability on the conversion side, and then discuss content rewriting; when one does not know what the user does after entering the station, any click-through rate conclusion cannot be verified.