In this paper, we investigate an interesting question that came up when reading a problem in a school textbook: What happens to the variance of a dataset in the case of changing one single data point, and why? Some of the answers are not surprising but here we find the full answer and demonstrate the understanding of it suitable for school students.