Let me begin by saying that I consider myself more of a qualitative researcher; I have limited knowledge of statistical analysis and my experience in this area is limited to data cleaning and visualisation in Python.
What I can’t wrap my head around is how particular types of ethnographic studies, often involving small minority cohorts, are academically valid. Either you accept that their results are not even theoretically generalisable, rendering them almost useless; or that their theoretical generalisations encourage prejudicial views. This is because their design hinges on the lived experiences, values and social interactions of the objects of study, who are implicitly assumed to have their own exclusive and even solipsistic ways of thinking.
Other types of qualitative research are primarily interested in processes, and the why and how questions of the human world. Hopefully the context has already been established through previous quantitative studies, i.e. there is an empirical basis to the phenomenon. There are primary sources available: cultural artefacts, policy texts, learning technologies at school, grand tombs, etc. At worst the researcher only needs to conduct a first order interpretation of the facts. In an ethnography, you have to interpret someone else’s interpretation, or engage in a ‘double hermeneutic’. Maybe this is done also in the humanities, but the implications are graver for the social sciences.
To illustrate, let’s look at a silly hypothetical case. Suppose prior studies have found that blue-skinned people are more likely to engage in conspicuous consumption than green-skinned people. You conduct a longitudinal study of a group of blue-skinned people of all walks of life. You find that those who become financially successful have lots of branded handbags and vice-versa. You interview, do what you need to do to find out why. You arrive at a conclusion, one of many possible, that the blue culture places great emphasis on looking good. The lived experiences of those people tell you that they get better overall treatment with a Gucci on their shoulder. At least, that’s your understanding.
Now, you say you want to make analytic or theoretical generalisations. How can you do this based on your tiny sample? Well, you pull up 5 similar studies that reflect the same theme of looking good. You think they all cohere. Congratulations, you now have found a line of reasoning that represents 0.001% of the blue population. Suppose peer reviewers want to check your data to see if the participants did actually receive better treatment. Whoops, not possible. They have to rely on your field notes.
The danger, of course, is that readers may be tempted to conclude that most blue people find value in dandyism and prioritise showy displays over substance. You point to your ‘results are not generalisable’ disclaimer and cry foul. Fair enough. But is your theory even transferable? What about the blue peeps who don’t subscribe to those values and have no clue what you’re talking about? If it doesn’t apply to them, then what really is the significance of your ethnographic research?
My 2 pence. Open to opposing viewpoints.