ab testing - Sample size for google content experiment -


can give me idea kind of traffic / sample size need statistically significant result when doing google content experiement 2 variations?

google uses multi armed bandit testing. here article on googles answer

the best way in practice watch percentage in google analytics experiments tab , see how moves toward 95%.

you can't exact answer because changes take measurements , based on difference trying measure. if 1 variation performs 300% better other take lot smaller sample size if 1 variation performs 10% better other.

to see how math straight statistical significance works here explanation. statistical significance tutorial

here spot has calculator calculator

as far math multi armed bandit quote peter whittle sums up

[the bandit problem] formulated during [second world] war, , efforts solve sapped energies , minds of allied analysts suggestion made problem dropped on germany, ultimate instrument of intellectual sabotage.


Comments

Popular posts from this blog

c# - How Configure Devart dotConnect for SQLite Code First? -

java - Copying object fields -

c++ - Clear the memory after returning a vector in a function -