Skip to content
35 - Replicability Analysis for Natural Language Processing, with Roi Reichart episode artwork

Oct 19, 2017 31 min

35 - Replicability Analysis for Natural Language Processing, with Roi Reichart

from NLP Highlights Hosted by Allen Institute for Artificial Intelligence

TACL 2017 paper by Rotem Dror, Gili Baumer, Marina Bogomolov, and Roi Reichart. Roi comes on to talk to us about how to make better statistical comparisons between two methods when there are multiple datasets in the comparison. This paper shows that there are more powerful methods available than the occasionally-used Bonferroni correction, and using the better methods can let you make stronger, statistically-valid conclusions. We talk a bit also about how the assumptions you make about your data can affect the statistical tests that you perform, and briefly mention other issues in replicability / reproducibility, like training variance. https://www.semanticscholar.org/paper/Replicability-Analysis-for-Natural-Language-Proces-Dror-Baumer/fa5129ab6fd85f8ff590f9cc8a39139e9dfa8aa2

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

35 - Replicability Analysis for Natural Language Processing, with Roi Reichart

0:00 31:07

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of NLP Highlights?

This episode is 31 minutes long.

When was this NLP Highlights episode published?

This episode was published on October 19, 2017.

Can I download this NLP Highlights episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.