Archive for the ‘Triangulation’ Category

Triangulation and Disconfirmation

January 17, 2010

Triangulation and confirmation

Methodological triangulation is the use of different kinds of method in a single investigation. In the nursing literature, there was a debate over triangulation in the nineteen eighties and nineties. While less febrile than it was, the debate continues today. The crux of the debate is whether both “qualitative” and “quantitative” methods could support a single result (theory). Those who argued against confirming triangulation thought that different methods could be only complementary, each supporting a distinct and independent part of a study. In “A New Foundation for Methodological Triangulation” (Journal of Nursing Scholarship, 34: 269-275, 2002) and “Methodological Triangulation in Nursing Research” (Philosophy of the Social Sciences, 313: 40-59, 2001), Sandra Dunbar, Margret Moloney, and I argued in favor of the use of qualitative and quantitative methods to support a single study. (See my web page for links to these and other essays.)

In our discussion, we noted that results of the different methods might conflict, but we did not pursue the further questions that such conflict raises. How are investigators to handle inconsistent results from different methods? Can the results of a quantitative study show that a qualitative result is incorrect, or vice versa? Does one kind of method trump the other? Published literature normally touts successes, not failures. Hence, it is difficult to find concrete examples that help us think about how one kind of method might undermine or disconfirm results obtained by another.

Heat wave

An interesting example for reflecting on triangulation comes from the sociological literature on the 1995 Chicago heat wave. 739 people died in a week of record heat and humidity. In Heat Wave: A Social Autopsy of Disaster in Chicago (University of Chicago Press, 2002), Eric Klinenberg argued that differences in death rates among neighborhoods were explained by their differing “social ecologies.” Death rates were higher in North Lawndale, a poor and predominantly African-American neighborhood, than in South Lawndale, a Latino neighborhood. Analysis by the CDC showed that throughout Chicago, being elderly and living alone were risk factors for heat-related deaths. Klinenberg appeals to factors like crime rates and population density as contributing to social isolation of the elderly, which would make them vulnerable.

The data for Klinenberg’s research were primarily demographic, and would count as “quantitative,” if we apply the category as used in the nursing literature. An interesting challenge to Klinenberg’s work comes from Mitchell Duneier, who conducted a series of interviews with residents of North Lawndale and nearby neighborhoods (“Ethnography, the Ecological Fallacy, and the 1995 Chicago Heat Wave” American Sociological Review, 2006). 16 people died in North Lawndale. Interviewing neighbors and family members, Duneier found that of the 16, “at least 12 were living with families and had domestic relationships” (p. 682). 14 of the 16 were said to have gone out of the house regularly. Duneier’s interviews thus directly undermine Klinenberg’s explanation for the heat wave deaths in North Lawndale.

Text and numbers in conflict

Duneier’s work shows one of the ways in which interview results can disconfirm survey results. Duneier roughly conforms to a Popperian logic: he identifies a consequence of Klinenberg’s explanation (that many or most of the deceased in North Lawndale were socially isolated), and shows it to be false. Characterizing the logic of Duneier’s argument in this way, however, effaces much of its texture.

Duneier describes his method as “ethnographic,” but the word is used differently her than in the nursing literature (or the anthropological literature, for that matter). What he means is that his method involved “shoe leather.” He and a photographer walked the neighborhood, knocked on doors, and struck up conversations with passers-by. Had he not done this, e.g. had he made a random selection from the telephone book, it would have been very unlikely that he would have gathered the kind of information he did. Moreover, Duneier did not obtain his result by simple counting. His open, unstructured interviews were a crucial part of unfolding the stories that surrounded each unique individual. Sifting through these, he identified the themes that were key to understanding the ways in which the deceased may or may not have been made vulnerable by the social ecology of their neighborhoods.

Qualitative and quantitative methods in conflict

One of the reasons why the triangulation issue continues to be discussed is that qualitative researchers often feel threatened by quantitative work. Statistical methods have the status associated with big science, and the politics of qualitative and quantitative research continues to plague the discipline of nursing. Duneier’s work shows how there is less distance among methods than is commonly assumed. Methods associated with the qualitative research do not require a methodology that is opposed to quantitative research. Because the methods are consistent, a careful and imaginative researcher like Duneier can bring them into productive conflict, providing a richer and more empirically adequate picture.