• rerunning tests increases Alpha error probability
  • also known as “data snooping” or “p-hacking”
  • possible remedy: z-line
    • plot all results (even across papers) on a line, it should be normally distributed, otherwise it is biased
  • examples, further details: https://en.wikipedia.org/wiki/Data_dredging