you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 5 days ago (2 children)

P value just tells you how likely the difference between two data sets is just random chance. Having said that, there are many ways to p hack to achieve significant values.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 5 days ago

    I’m probably being too pedantic, but that’s exactly correct, though it also captures the spirit and practically most common cases.

    Just change “two datasets” to “a statistic”, because hypothesis tests can be pretty general.

    I don’t love P values, they’re not quite an intuitive probability, they bake in a lot of assumptions, they can be deceptively over or under sensitive, and they’re hard to explain. As a tool they’re useful but they always need context and planning.

  • source
  • parent