ab testing - Sample size for google content experiment -
can give me idea kind of traffic / sample size need statistically significant result when doing google content experiement 2 variations?
google uses multi armed bandit testing. here article on googles answer
the best way in practice watch percentage in google analytics experiments tab , see how moves toward 95%.
you can't exact answer because changes take measurements , based on difference trying measure. if 1 variation performs 300% better other take lot smaller sample size if 1 variation performs 10% better other.
to see how math straight statistical significance works here explanation. statistical significance tutorial
here spot has calculator calculator
as far math multi armed bandit quote peter whittle sums up
[the bandit problem] formulated during [second world] war, , efforts solve sapped energies , minds of allied analysts suggestion made problem dropped on germany, ultimate instrument of intellectual sabotage.
Comments
Post a Comment