Intelligent Virtual Agents and Culture

Intelligent Virtual Agents (IVAs) are interactive digital characters that exhibit human-like qualities and can communicate with humans and each other using natural human modalities such as facial expressions, speech and gesture. They are capable of real-time perception, cognition, emotion and action that allow them to participate in dynamic social environments.
Culture as a social phenomenon is researched with IVAs for about two decades. In our earlier research, we have focussed on modelling cultural background for IVAs based on national cultures or cultural dimensions. With IVAs that behave in a culture-specific manner (e.g. differences in verbal behaviour, communication management, gesture use, or body posture) differences between prototypical cultural behavioural features can be pointed out, cultural awareness can be raised, or specific user preferences can be met to increase the acceptance of IVAs.
In our recent research, we investigate IVAs in mixed-cultural settings, particularly when native speakers and non-native speakers meet. A crucial question is how an IVA can be recognized as foreign/outgroup. For example, non-native speech needs to be adequately generated to investigate behavioural phenomena occurring in such mixed-cultural settings.
Related publications
-
Exploratory Study on the Perception of Intelligent Virtual Agents With Non-Native Accents Using Synthetic and Natural Speech in German. . In INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION. ACM, 2022.
-
The Handbook on Socially Interactive Agents: 20 years of Research on Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics Volume 2: Interactivity, Platforms, Application. . ACM, 2022.
-
Preface. . In The Handbook on Socially Interactive Agents: 20 years of Research on Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics Volume 2: Interactivity, Platforms, Application, p. xxv-xl. ACM, 2022.
-
Challenge Discussion on Socially Interactive Agents: Considerations on Social Interaction, Computational Architectures, Evaluation, and Ethics. . In The Handbook on Socially Interactive Agents: 20 years of Research on Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics Volume 2: Interactivity, Platforms, Application, pp. 561–626. ACM, 2022.
-
The impact of mixed-cultural speech on the stereotypical perception of a virtual robot. . In Frontiers in Robotics and AI, 9. Frontiers Media SA, 2022.
-
Non-native speaker perception of Intelligent Virtual Agents in two languages: the impact of amount and type of grammatical mistakes. . In Journal on Multimodal User Interfaces. 2021.
-
What if it speaks like it was from the village? Effects of a Robot speaking in Regional Language Variations on Users’ Evaluations. . In 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2020), pp. 1315–1320. 2020.
-
Non-Native Speaker Generation and Perception for Mixed-Cultural Settings. . In ACM International Conference on Intelligent Virtual Agents 2019. ACM, 2019.
-
A Pilot Study on Adaptive Gesture Use in Interaction with Non-native Listeners. . In 4th International Workshop on Multimodal Analyses Enabling Artificial Agents in Human-Machine Interaction, pp. 26–32. ACM, 2018.
-
Adapted Foreigner-directed Communication towards Virtual Agents. . In 18th International Conference on Intelligent Virtual Agents (IVA 2018), pp. 59–64. ACM, 2018.
-
Combining a Data-driven and a Theory-based Approach to Generate Culture-dependent Behaviours for Virtual Characters. . In Advances in Culturally-Aware Intelligent Systems and in Cross-Cultural Psychological Studies, C. Faucher (ed.). Springer, 2017.
-
Modeling and Evaluating a Bayesian Network of Culture-dependent Behaviors. . In International Conference on Culture and Computing. IEEE, 2015.
-
Learning to Overcome Cultural Conflict through Engaging with Intelligent Agents in Synthetic Cultures. . In International Journal of Artificial Intelligence in Education, 25(2), pp. 291–317. 2015.
-
Effects of Language Variety on Personality Perception in Embodied Conversational Agents. . In 16th International Conference on Human-Computer Interaction. Advanced Interaction Modalities and Techniques, Vol. 8511 of LNCS, M. Kurosu (ed.), pp. 429–439. Springer, 2014.
-
Werewolves, Cheats, and Cultural Sensitivity. . In International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2014), A. L. C. Bazzan, M. N. Huhns, A. Lomuscio, P. Scerri (eds.), pp. 1085–1092. IFAAMAS, 2014.
-
A Pictorial Interaction Language for Children to Communicate with Cultural Virtual Characters. . In 16th International Conference on Human-Computer Interaction. Advanced Interaction Modalities and Techniques, Vol. 8511 of LNCS, M. Kurosu (ed.), pp. 532–543. Springer, 2014.
-
{MIXER: why the difference?}. . In International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2014), A. L. C. Bazzan, M. N. Huhns, A. Lomuscio, P. Scerri (eds.), pp. 1687–1688. IFAAMAS, 2014.
-
{W}hat {I} {S}ee is {N}ot {W}hat {Y}ou {G}et: {W}hy {C}ulture-{S}pecific {B}ehaviours for {V}irtual {C}haracters {S}hould {B}e {U}ser-{T}ested {A}cross {C}ultures. . In {AI} and {S}ociety. 2014.
-
A hybrid Approach to model a Bayesian Network of Culture-specific Behavior. . In International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2014), A. L. C. Bazzan, M. N. Huhns, A. Lomuscio, P. Scerri (eds.), pp. 1395–1396. IFAAMAS, 2014.
-
{Integration of Cultural Factors into the Behavioural Models of Virtual Characters}. . In Natural Language Generation in Interactive Systems, A. Stent, S. Bangalore (eds.), pp. 227–251. Cambridge University Press, 2014.
-
Engaging with Virtual Characters using a Pictorial Interaction Language. . In Extended Abstracts on Human Factors in Computing Systems (CHI EA 2014), M. Jones, P. A. Palanque, A. Schmidt, T. Grossman (eds.), pp. 531–534. ACM, 2014.
-
Cultural Diversity for Virtual Characters (Extended Abstract). . In International Joint Conference on Artificial Intelligence (IJCAI 2013), F. Rossi (ed.). IJCAI/AAAI, 2013.
-
Investigating the Influence of Culture on Proxemic Behaviors for Humanoid Robots. . In International Symposium on Robot and Human Interactive Communication (RO-MAN 2013), pp. 430–435. IEEE, 2013.
-
Investigating Culture-related Aspects of Behavior for Virtual Characters. . In Autonomous Agents and Multi-Agent Systems, 27(2), pp. 277–304. 2013.
-
Cultural Diversity for Virtual Characters - Investigating Behavioral Aspects across Cultures.. Technical Report (PhD dissertation), . . PhD dissertation, pp. I–IV, 1. Universität Augsburg, 2012.
-
ECUTE: Difference is good!. . In International Conference on E-Learning, (IADIS), pp. 425–429. 2012.
-
Natural Interaction with Culturally Adaptive Virtual Characters. . In Multimodal User Interfaces, 6(1-2), pp. 39–47. 2012.
-
{Cultural Behaviors of Virtual Agents in an Augmented Reality Environment}. . In 12th International Conference on Intelligent Virtual Agents (IVA 2012), Vol. 7502 of LNCS, Y. I. Nakano, M. Neff, A. Paiva, M. A. Walker (eds.), pp. 412–418. Springer, 2012.
-
{Culture-related Differences in Aspects of Behavior for Virtual Characters across Germany and Japan}. . In 10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2011), L. Sonenberg, P. Stone, K. Tumer, P. Yolum (eds.), pp. 441–448. IFAAMAS, 2011.
-
Culture-Related Topic Selection in Small Talk Conversations across Germany and Japan. . In 11th International Conference on Intelligent Virtual Agents (IVA 2011), Vol. 6895 of LNCS, H. H. Vilhjálmsson, S. Kopp, S. Marsella, K. R. Thórisson (eds.), pp. 1–13. Springer, 2011.
-
Planning Small Talk Behavior with Cultural Influences for Multiagent Systems. . In Computer Speech \& Language, 25(2), pp. 158–174. 2011.
-
Integration and Evaluation of Prototypical Culture-related Differences. . In Workshop on Culturally Motivated Virtual Characters (CMVC 2011), in conjunction with IVA 2011. 2011.
-
Towards Culturally-Aware Virtual Agent Systems. . In Handbook of Research on Culturally-Aware Information Technology: Perspectives and Models: Perspectives and Models, E. G. Blanchard, D. Allard (eds.), pp. 412–430. IGI Global, 2010.
-
A data-driven approach to model culture-specific communication management styles for virtual agents. . In 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2010), Vol. 1, W. van der Hoek, G. A. Kaminka, Y. Lespérance, M. Luck, S. Sen (eds.), pp. 99–108. IFAAMAS, 2010.
-
Generating Culture-Specific Gestures for Virtual Agent Dialogs. . In 10th International Conference on Intelligent Virtual Agents (IVA 2010), Vol. 6356 of LNCS, J. M. Allbeck, N. I. Badler, T. W. Bickmore, C. Pelachaud, A. Safonova (eds.), pp. 329–335. Springer, 2010.
-
{Creating Standardized Video Recordings of Multimodal Interactions across Cultures}. . In Multimodal Corpora, Vol. 5509, M. Kipp, J.-C. Martin, P. Paggio, D. Heylen (eds.), pp. 138–159. Springer, 2009.
-
From observation to simulation: generating culture-specific behavior for interactive systems. . In {AI \& Society}, 24(3), pp. 267–280. 2009.
-
{Culture-specific Communication Management for Virtual Agents}. . In 8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2009), Vol. 1 of AAMAS \u002709, C. Sierra, C. Castelfranchi, K. S. Decker, J. S. Sichman (eds.), pp. 281–287. IFAAMAS, 2009.
-
Talk is silver, silence is golden: A cross-cultural study on the use of pauses in speech. . In 4th International Workshop on Human-Computer Conversation. 2008.
-
{The CUBE-G approach - Coaching culture-specific nonverbal behavior by virtual agents}. . In Organizing and Learning through Gaming and Simulation (ISAGA 2007), I. Mayer, H. Mastik (eds.). 2007.