Toward a Greater Understanding of the Use of Nonverbal Cues To Deception in Computer-Mediated Communication

Joey F. George Iowa State University ; Annette M. Mills ; Gabriel Giordano Ohio University ; Manjul Gupta Florida International University ; Vanesa M. Tennant ; Carmen C. Lewis

Abstract

<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Background:</b> Computer-mediated communication (CMC) is an important part of work life. However, this communication can be dishonest, and when people attempt to judge dishonesty, irrespective of the cues available, they tend to rely on a few nonverbal cues that are not the most reliable. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Literature review:</b> According to leakage theory, CMC modes differ from each other in the number of cues to deception they can transmit, potentially affecting one's ability to detect deception in a given medium. There is considerable research on peoples’ use of nonverbal cues across CMC modes to evaluate deception, but limited understanding of the choices they make and the extent to which their deception judgments are impaired or helped by cues they have access to for different CMC modes. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Research questions:</b> 1. To what extent are the nonverbal cues that people say they rely on to detect deception shaped by the medium that they use for communication? 2. What are the effects of nonverbal cue availability on deception detection success? <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Methodology:</b> We conducted an experiment with 132 veracity judges from New Zealand and Jamaica, who observed interview segments in Spanish and Hindi (languages that they did not understand) to isolate the effects of nonverbal cues. They determined the veracity of each segment and listed the things that guided their judgment. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Results/discussion:</b> The results suggest that when certain nonverbal cues are available, such as gaze aversion, these suppress attention to more reliable cues (e.g., voice pitch) when judging deception. Redirecting attention to more reliable cues is therefore important. Unexpectedly, cue choice also varied across language by medium. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Conclusions:</b> The findings extend the understanding of people's use of nonverbal cues and the extent to which certain cues distract in the deception judgment. Although people rely on vocalic cues in audio-only media and kinesic cues in video-only media, they tend to rely mostly on, and are distracted by, a few kinesic cues for full audiovisual media, even though vocalic cues are available. We also found that people can successfully detect cues to deception, even when their communication mode is relatively bereft of useful information. However, the availability (or lack) of nonverbal cues was not a factor in deception detection success. To improve detection, deception training that targets reliable cues for different media is needed.

Journal
IEEE Transactions on Professional Communication
Published
2023-06-01
DOI
10.1109/tpc.2023.3263378
CompPile
Open Access
Closed
Topics
Export

Citation context

Cited by in this index (0)

No articles in this index cite this work.

References (49) · 2 in this index

  1. 10.25300/MISQ/2018/13215
     ↗
  2. 10.1007/s10919-014-0179-z
     ↗
  3. 10.1002/jip.1543
     ↗
  4. 10.1080/00332747.1969.11023575
     ↗
  5. 10.1109/HICSS.2003.1173792
     ↗
Show all 49 →
  1. 10.1080/01463373.2017.1298637
     ↗
  2. 10.1177/0022022105282295
     ↗
  3. 10.1371/journal.pone.0156615
     ↗
  4. 10.1080/10683160308138
     ↗
  5. 10.1037/0021-9010.89.1.137
     ↗
  6. 10.1016/j.copsyc.2022.101380
     ↗
  7. 10.18290/rh21696s-9
     ↗
  8. 10.1016/j.eswa.2020.114341
     ↗
  9. 10.1371/journal.pone.0254960
     ↗
  10. 10.1002/acp.2990
     ↗
  11. 10.1177/0146167200265010
     ↗
  12. 10.1146/annurev-psych-010418-103135
     ↗
  13. 10.1093/jcmc/zmz018
     ↗
  14. 10.4088/PCC.09r00780
     ↗
  15. 10.1207/s15327957pspr1003_2
     ↗
  16. 10.1111/j.1468-2885.1996.tb00127.x
     ↗
  17. 10.1177/0093650213485785
     ↗
  18. 10.1145/985692.985709
     ↗
  19. 10.1037/0022-3514.70.5.979
     ↗
  20. Is your company hiring Charlatans? A study of ethical standards in the hiring process
  21. IEEE Transactions on Professional Communication
  22. 10.1007/BF00996226
     ↗
  23. 10.1007/s10726-009-9169-7
     ↗
  24. 10.1016/j.chb.2014.02.027
     ↗
  25. 10.1007/BF02173410
     ↗
  26. 10.1016/j.obhdp.2008.02.002
     ↗
  27. 10.1111/j.1468-2958.2008.00333.x
     ↗
  28. The impact of presentation modality on perceptions of truthful and deceptive confessions
    Criminologie
  29. IEEE Transactions on Professional Communication
  30. Detecting deception in face to face and computer mediated conversations
  31. Microsoft teams: Number of daily active users 2019&#x2013;2022
  32. Zoom user statistics: How many people use zoom in 2023?
  33. To catch a liar: A cross-cultural comparison of computer-mediated deceptive communication
  34. 10.3389/fpsyg.2016.01771
     ↗
  35. 10.4324/9781003095552
     ↗
  36. 10.1080/1068316X.2010.535820
     ↗
  37. Seeing isn't required to gesture like a native speaker
  38. 10.1146/annurev-psych-113011-143802
     ↗
  39. 10.1037/0033-2909.129.1.74
     ↗
  40. Duped Truth-Default Theory and the Social Science of Lying and Deception
  41. 10.1177/0261927X14535916
     ↗
  42. 10.2307/25148857
     ↗
  43. Nonverbal bilingualism: Deaf schemas of deception
  44. 10.1016/j.jarmac.2021.06.002
     ↗