Institution for Social and Policy Studies

Advancing Research • Shaping Policy • Developing Leaders

A Framework for Testing Elaborate Theories

Author(s): 

Devin Caughey, Allan Dafoe, and Jason Seawright

ISPS ID: 
ISPS17-13
Full citation: 
Caughey, Devin, Allan Dafoe, and Jason Seawright (2017). Nonparametric Combination (NPC): A Framework for Testing Elaborate Theories, The Journal of Politics 79(2): 688-701. DOI: 10.1086/689287
Abstract: 
Social scientists are commonly advised to deduce and test all observable implications of their theories. We describe a principled framework for testing such “elaborate” theories: nonparametric combination. Nonparametric combination (NPC) assesses the joint probability of observing the theoretically predicted pattern of results under the sharp null of no effects. NPC accounts for the dependence among the component tests without relying on modeling assumptions or asymptotic approximations. Multiple-testing corrections are also easily implemented with NPC. As we demonstrate with four applications, NPC leverages theoretical knowledge into greater statistical power, which is particularly valuable for studies with strong research designs but small sample sizes. We implement these methods in a new R package, NPC.
Publication name: 
Publication type: 
Supplemental information: 

Link to article here.

Publication date: 
2017
Location: 
Discipline: 
Area of study: