Microanalysis of Nonverbal Aspects of Communication (from the Intellectual History of Multimodal Analysis)
https://doi.org/10.22394/2074-0492-2023-2-86-118
Abstract
The paper considers some intellectual roots of the contemporary multimodal analysis. The prehistory of microanalysis of social interaction includes semiotics of nonverbal communication and the anthropological study of patterns of expressive and communicative behavior as it was performed by Gregory Bateson and Margaret Mead in the pioneering research on Balinese character. The Batesonian approach to interaction was influenced by cybernetic ideas—particularly the notion of feedback— which led to theoretical advances on communication in general and, particularly, in the study of family interaction in a psychiatric perspective. The interdisciplinary research project that became known as “The Natural History of an Interview” was the first example of a broad interdisciplinary collaboration involving anthropologists, linguists and psychiatrists. It has brought about a detailed analysis of a filmed interaction that correlated data about talk, paralanguage, and body language (kinesics). The results of this project, as well as of the other attempts at kinesic microanalysis, allowed one to question the goals of research and the adequacy of research methods employed. However, the input from kinesics and, broader, semiotics of non-verbal communication was instrumental for including data about participants’ attention traced as gaze-direction into analysis of talk-in-interaction, as it was put in practice by Charles Goodwin.
About the Author
I. Utekhin
European university at St.Petersburg; Indiana University
Russian Federation
Russian Federation
St.Petersburg; Bloomington
References
1. Argyle M. (1967) The Psychology of Interpersonal Behaviour. Harmondsworth: Penguin.
2. Bateson G. (1972) Steps to an Ecology of Mind: Collected Essays in Anthropology, Psychiatry, Evolution, and Epistemology, University of Chicago Press1 .
3. Bateson G. & Mead M. (1942) Balinese character; a photographic analysis, New York Academy of Sciences.
4. Bateson G., Ruesch J. (1951) Communication: The Social Matrix of Psychiatry, W.W. Norton & Co.
5. Bateson G., Jackson D., Haley J. & Weakland J. (1956) Toward a theory of schizophrenia. Behavioral Science, 1(4): 251-2642 .
6. Bateson, G. Naven. a survey of the problems suggested by a composite picture of the culture of a New Guinea tribe drawn from three points of view. 2d ed. Stanford (CA): Stanford University Press, 1958 (1st ed. — 1936)
7. Bates E.A. The emergence of symbols: cognition and communication in infancy, NY: Academic Press, 19793 .
8. Birdwhistell R.L. (1952) Introduction to Kinesics: An Annotation System for Analysis of Body Motion and Gesture, Washington, DC: Department of State, Foreign Service Institute.
9. Birdwhistell R. L. (1970) Kinesics and Context: Essays on Body Motion Communication, Philadelphia: University of Pennsylvania Press.
10. Brennan S. E. & Clark H. H. (1996) Conceptual pacts and lexical choice in conversation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22(6): 1482–1493.
11. Clark H.H. & Brennan S. E. (1991) Grounding in communication. In L.B. Resnick, J.M. Levine & S.D. Teasley (Eds.) Perspectives on socially shared cognition (p. 127–-49). American Psychological Association.
12. Collett P., Marsh P. (1974) Patterns of Public Behaviour: Collision Avoidance on a Pedestrian Crossing. Semiotica. 12(4): 281-300.
13. Henning E. (2021) Perception, awareness, and film practice: A natural history of the “Doris Film”. J. McElvenny & A. Ploder (Eds.) Holisms of communication: The early history of audio-visual sequence analysis. Berlin: Language Science Press: 105–138.
14. Davis M. (2001) “Film Projectors as Microscopes: Ray L. Birdwhistell & Microanalysis of Interaction [1955‒1975],” Visual Anthropology Review, 17 (2): 39-49.
15. Efron D. (1972) Gesture, Race and Culture: A Tentative Study of the Spatio-temporal and “linguistic” Aspects of the Gestural Behavior of Eastern Jews and Southern Italians in New York City, Living Under Similar as Well as Different Environmental Conditions. The Hague: Mouton (Approaches to Semiotics 9) [Efron D. (1941). Gesture and Environment, New York: King’s Crown Press. 1941].
16. Ekman P. (1985) Telling Lies. Clues to Deceit in the Marketplace, Politics, and Marriage, NY: W.W. Norton.
17. Ekman P. (1999) Emotional and Conversational Nonverbal Signals. In Messing L.S. & Campbell R. (Eds.) Gesture, Speech, and Sign (p. 45-55), New York, NY: Oxford University Press.
18. Farnell B. (2003) Birdwhistell, Hall, Lomax and the Origins of Visual Anthropology, Visual Anthropology, 16 (1): 43-55.
19. Fromm-Reichmann F. (1948) Notes on the development of treatment of schizophrenics by psychoanalytic psychotherapy. Psychiatry, 11(3): 263-273.
20. Gumperz J. J. & Hymes D.H. (Eds.) (1964) The ethnography of communication, Washington, DC: Blackwell Publishing on behalf of the American Anthropological Association (American Anthropologist 66(6), Part 2).
21. Goodwin C. (1979) The Interactive Construction of a Sentence in Natural Conversation. In G. Psathas (Ed.) Everyday Language: Studies in Ethnomethodology, New York: Irvington Publishers: 97-121
22. Goodwin C. (1981) Conversational organization: Interaction between speakers and hearers, New York: Academic.
23. Hall E.T. (1959) The Silent Language, Doubleday & Company, Inc., Garden City, New York.
24. Hall E.T. (1966) The Hidden Dimension, Doubleday, Garden City, N.Y. Hall E.T. (1976) Beyond Culture, Anchor Books, Garden City, N.Y.
25. Hall E.T. (1983) The Dance of Life: the other dimension of time, Anchor Books, New York.
26. Hall E.T. & Trager G.L. (1953) The Analysis of Culture, Washington, DC: Foreign Service Institute/American Council of Learned Societies.
27. Harris M. (1976) “History and Significance of the Emic/Etic Distinction”. Annual Review of Anthropology, 5: 329-350.
28. Huxley J. (Ed.) (1966) A Discussion on Ritualization of Behaviour in Animals and Man. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences. 251(772).
29. Ikegami Y. (1971) “A Stratificational Analysis of the Hand Gestures in Indian Classical Dancing”. Semiotica, 4(4): 365-391.
30. Jefferson G. (2004) Glossary of transcript symbols with an introduction. G.H. Lerner (Ed.) Conversation analysis: Studies from the first generation, Philadelphia: John Benjamins: 13-31
31. Kendon A. (ed.) (1981) Nonverbal communication, interaction, and gesture: selections from Semiotica, Approaches to Semiotics, 41. The Hague [etc.]: Mouton.
32. Kendon A., Sigman S. J., Birdwhistell R.L. (1996) (1918‒1994). Conmemorative essay. Semiotica, 112 (3/4): 231-261.
33. Leeds-Hurwitz W. (1987) The social history of “The natural history of an interview”: A multidisciplinary investigation of social communication. Research on Language and Social Interaction 20: 1-51.
34. Leeds-Hurwitz W. (1990) Notes in the history of intercultural communication: The foreign service institute and the mandate for intercultral training. Quarterly Journal of Speech, 76: 268-281.
35. Leeds-Hurwitz W. (2010) The social history of language and social interaction research: people, places, ideas, Hampton Press, Cresskill, NJ.
36. Leeds-Hurwitz W. & Kendon A. (2021) The Natural History of an Interview and the microanalysis of behavior in social interaction: A critical moment in research practice. In: James McElvenny & Andrea Ploder (eds.) Holisms of communication: The early history of audio-visual sequence analysis. Berlin: Language Science Press: 145-200
37. MacCannell D. (1973) “A Note on Hat Tipping”. Semiotica, 7(4): 300-312.
38. McQuown N.A. (Ed.) (1971) The Natural History of an Interview. With contributions by Gregory Bateson, Ray L. Birdwhistell, Henry W. Brosin, Charles F. Hockett, Norman A. McQuown, Henry L. Smith, Jr. George L. Trager. Microfilm Collection of Manuscripts on Cultural Anthropology Series: XV No: 99 University of Chicago Library, Chicago, Illinois (June 30).
39. McQuown N.A. (1957) Linguistic Transcription and Specification of Psychiatric Interview Materials. Psychiatry, 20(1): 79-86.
40. Mead M. (1995) Visual Anthropology in a Discipline of Words. Paul Hockings (ed.), Principles of Visual Anthropology, De Gruyter: 3-10.
41. Mondada L. (2021) The NHI and the emergence of video-based multimodal studies of social interaction. Response to Wendy Leeds-Hurwitz and Adam Kendon. In: James McElvenny & Andrea Ploder (eds.) Holisms of communication: The early history of audiovisual sequence analysis, Berlin: Language Science Press: 205-228.
42. Sacks H. & Schegloff E. (2002) Home position. Gesture 2(2): 133-146. Schegloff E. (2000) On Granularity. Annual Review of Sociology, 26: 715–20.
43. Schegloff E., Harvey S. (1972) “Opening up Closings”. Semiotica VIII, 4: 289-327.
44. Schiffrin D. (1974) “Handwork as Ceremony: The Case of the Handshake”. Semiotica. 12(3): 189-202.
45. Sebeok T.A., Hayes A. S., Bateson M. C. (Eds.) (1964) Approaches to Semiotics: Cultural Anthropology, Psychology, Psychiatry, Linguistics, Education. Transactions of the Indiana University Conference on Paralinguistics and Kinesics. Janua Linguarum: Series Maior, Vol. 15. The Hague: Mouton — De Gruyter.
46. Smith W. J., Chase J., Katz L.A. (1974) “Tongue Showing: A Facial Display of Humans and Other Primate Species”. Semiotica, 11(3): 201-246.
47. Sperber D., Wilson D. (1995) Relevance: Communication and cognition, Oxford: Blackwell. 2nd edition. Trager G.L. (1958) Paralanguage: A first approximation. Studies in Linguistics, 13: 1-12.
48. Trager G.L. (1961) The typology of paralanguage. Anthropological Linguistics, 3 (1): 17–21.
49. Trager G. L. (1966) Approaches to Semiotics: Cultural Anthropology, Psychology, Psychiatry, Linguistics, Education. Transactions of the Indiana University Conference on Paralinguistics and Kinesics. Book review. American Antropologist, 68(1): 296-297.
50. Watter S.B. (2017) Scrutinizing: Film and the Microanalysis of Behavior. Grey Room 66, Winter: 32-69.
51. Watzlawick P., Beavin J., Jackson D. (1967) Pragmatics of human communication: A study of interactional patterns, pathologies, and paradoxes, New York: W.W. Norton1 .
52. Wilder C. (1979) The Palo Alto Group: Difficulties and Directions of the Interactional View for Human Communication Research. Human Communication Research, 5(2): 171- 186.
53. Winkin Y. (1988) Erving Goffman: Les moments et leurs hommes, Textes recuellis et presents par Yves Winkin. Paris: Seuil/Minuit.
Review
For citations:
Utekhin I. Microanalysis of Nonverbal Aspects of Communication (from the Intellectual History of Multimodal Analysis). Sociology of Power. 2023;35(2):86-118. (In Russ.) https://doi.org/10.22394/2074-0492-2023-2-86-118
Views:
97
Email this article 