Reproducibility of empirical findings : experiments in philosophy and beyond
The field of experimental philosophy has received considerable attention, essentially for producing results that seem highly counter-intuitive and at the same time question some of the fundamental methods used in philosophy. A substantial part of this attention has focused on the role of intuitions in philosophical methodology. One of the major contributions of experimental philosophy on this topic has been concrete evidence in support of intuitional diversity; the idea that intuitions vary systematically depending on variables such as ethnicity, socioeconomic background, or gender. Because of the important implications, these findings have been the subject of extensive debate. Despite the seeming significance of the findings and despite all the debates that the experimental philosophy movement has prompted, what has not been examined systematically is the reproducibility of the results. Instead, the reported findings have been simply accepted as established facts. We set out to replicate a wide range of experiments and surprisingly failed to reproduce many of the reported findings, some of which are from the most cited and attention grabbing papers of the field. We draw two conclusions from our findings.
Seyedsayamdost, Hamid
B Philosophy (General)
Reproducibility of empirical findings : experiments in philosophy and beyond. The field of experimental philosophy has received considerable attention, essentially for producing results that seem highly counter-intuitive and at the same time question some of the fundamental methods used in philosophy. A substantial part of this attention has focused on the role of intuitions in philosophical methodology. One of the major contributions of experimental philosophy on this topic has been concrete evidence in support of intuitional diversity; the idea that intuitions vary systematically depending on variables such as ethnicity, socioeconomic background, or gender. Because of the important implications, these findings have been the subject of extensive debate. Despite the seeming significance of the findings and despite all the debates that the experimental philosophy movement has prompted, what has not been examined systematically is the reproducibility of the results. Instead, the reported findings have been simply accepted as established facts. We set out to replicate a wide range of experiments and surprisingly failed to reproduce many of the reported findings, some of which are from the most cited and attention grabbing papers of the field. We draw two conclusions from our findings.
empirical_finding philosophy beyond field experimental philosophy receive_considerable_attention essentially produce seem highly counter intuitive time question fundamental method_use philosophy substantial_part attention_focus role intuition philosophical methodology one_major contribution experimental philosophy topic concrete evidence_support diversity idea intuition vary systematically depend variable ethnicity socioeconomic background gender important_implication finding subject extensive debate despite seem significance finding despite debate experimental philosophy movement prompt examine systematically result instead report finding simply accept establish fact set replicate wide_range surprisingly fail reproduce many report finding cite attention paper field draw conclusion finding