The other two indicators related to the core bulk sms service goal, the first is an auxiliary index , and the second is a reverse index . With these two indicators, we can better determine the core goal, and we can better detect whether this is a successful experiment later on. If the core indicators have improved a lot, but at the same time the negative indicators have also risen a lot, it may be equivalent to making up for the poor, and it will be difficult to improve the core bulk sms service indicators in the end. Continuing from the example above, when users search for products, we find that the user's click-through rate is very low, far lower than the industry average.
Suppose the industry average is 5%, and the bulk sms service current click-through rate of your product is only 2%. Suppose the core goal is to increase the click rate of products from 2% to 5%, and at the same time, the auxiliary indicator is that the purchase conversion rate will increase to a certain extent. After all, it is necessary to ensure that the incoming traffic is not fake traffic, and eventually a certain conversion can be formed. The reverse indicator is that the bounce bulk sms service rate of the page will not be greatly affected to a certain extent. 2. Determining the sample size for testing After determining the experimental goal, we should calculate the sample size to be tested.
Although a large sample size can better reflect the bulk sms service accuracy of the experiment, it may also take more time to collect data. With a small sample size, it is difficult to describe the accuracy of the data. So we need to collect enough data to do experiments in a limited time. According to the principle of experimental accuracy, generally the sample size with statistical significance ≥ 95% is an effective sample size , which can ensure the accuracy of the experimental bulk sms service results. The result of the set test experiment. How to determine the minimum sample size required for statistical significance? Directly use the AB test sample size calculator to calculate the