Visualizing Uncertainty

Topics covered
Popular Clips
Episode Highlights
P-Values
and engage in a lively discussion about the role of p-values in statistical research. Loni challenges the conventional use of the 0.05 p-value threshold, describing it as arbitrary and emphasizing the need for a more nuanced understanding. She argues that smaller p-values indicate a stronger ability to reject the null hypothesis, but the specific threshold should not be rigidly applied across all fields 1.
Being on 0.05 doesn't really mean anything for me. It's just a binary threshold that people put there that's completely random.
---
Kyle reflects on the broader implications of relying on p-values, questioning their role in the reproducibility crisis and the potential shift away from traditional statistical methods 2.
  Â
Transparency
The conversation shifts to the importance of transparency in statistical methodologies. Loni argues against banning p-values and confidence intervals, suggesting that the focus should be on educating researchers to use these tools correctly and ensuring data transparency 3. She highlights the risks of a replication crisis in computer science due to a lack of transparency and dichotomous interpretations in research 4.
I think transparency is the one thing that matters the most and not the tools per se.
---
Kyle agrees, emphasizing the need for openness and the potential benefits of alternative visualizations to improve data interpretation 3.
Related Episodes


Uncertainty Representations
Answers 383 questions

Visualization and Interpretability
Answers 383 questions

Defending the p-value
Answers 383 questions
Skeptical Survey Interpretation
Answers 383 questions

Bayesian A/B Testing
Answers 383 questions

[MINI] Heteroskedasticity
Answers 383 questions
[MINI] The T-Test
Answers 383 questions

Interpretability Practitioners
Answers 383 questions

Unsupervised Depth Perception
Answers 383 questions
False Discovery Rates
Answers 383 questions

4 out of 5 Data Scientists Agree
Answers 383 questions
[MINI] p-values
Answers 383 questions

The Experimental Design of Paranormal Claims
Answers 383 questions

Video Game Analytics
Answers 383 questions

Social Networks
Answers 383 questions
