What is a false positive?
A false positive (Type 1 Error, False Positive Error) in AB testing indicates whether the difference between variations was due to the alterations or to other noise. A high confidence level helps to prevent these false positives.
Industry standard is for a 95% confidence level, leaving a 5% chance that the tested change was not due to the changes in the variation.
