Premium
Integrative Complexity Coding Raises Integratively Complex Issues
Author(s) -
Tetlock Philip E.,
Metz S. Emlen,
Scott Sydney E.,
Suedfeld Peter
Publication year - 2014
Publication title -
political psychology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.419
H-Index - 95
eISSN - 1467-9221
pISSN - 0162-895X
DOI - 10.1111/pops.12207
Subject(s) - coding (social sciences) , computer science , factoring , context (archaeology) , dialectic , psychology , cognitive science , theoretical computer science , mathematics , epistemology , statistics , philosophy , economics , biology , paleontology , finance
Conway, Conway, Gornick, and Houck (2014) report a major effort to automate integrative complexity coding. Judging this effort requires researchers to be more explicit in articulating key methodological assumptions about the coding process and theoretical assumptions about the construct. Unresolved issues include: (1) when, and on what basis, we should attribute divergences between human coders and algorithms to overestimations or underestimations by one or the other approach; and (2) to what extent second‐generation algorithms can yield Pareto improvements that reduce errors of both underestimation and overestimation. Further progress in developing natural language processing measures of this cognitive style will require sharper definitions of target constructs: in particular, different types of differentiation (dialectical and elaborative) and integration (hierarchical and flexible) and clearer guidelines for factoring context into assessments.