{"id":17399,"date":"2024-10-17T09:18:14","date_gmt":"2024-10-17T07:18:14","guid":{"rendered":"https:\/\/tech4future.info\/?p=17399"},"modified":"2024-10-17T10:10:07","modified_gmt":"2024-10-17T08:10:07","slug":"robots-social-norms-deceptive-behaviours","status":"publish","type":"post","link":"https:\/\/tech4future.info\/en\/robots-social-norms-deceptive-behaviours\/","title":{"rendered":"Machines and social norms: how do we perceive deceptive behaviours in social robots?"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For two decades now, we&#8217;ve been hearing about\u00a0&#8220;<a href=\"http:\/\/old.scuoladirobotica.it\/it\/homesdr\/29\/Primo_Simposio_Internazionale_di_ROBOETICA.html\" target=\"_blank\" rel=\"noreferrer noopener\">robot ethics&#8221; or &#8220;roboethics&#8221;. The first international symposium on the subject took place in Italy (Rimini) in January 2004<\/a>, aiming to foster debate between robot designers and developers on one side, and professionals from fields such as computer science, psychology, law, philosophy, and sociology on the other. Central to this discussion was\u00a0<strong>the creation of ethical foundations for the design, construction, and use of robots.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The US-based\u00a0<a href=\"https:\/\/www.ieee-ras.org\/robot-ethics\" target=\"_blank\" rel=\"noreferrer noopener\">Robotics and Automation Society<\/a>, part of the Institute of Electrical and Electronics Engineers (IEEE), defines\u00a0<strong>robot ethics<\/strong>\u00a0as \u00ab<em>a growing interdisciplinary research effort located at the intersection of ethics and robotics, aimed at understanding the ethical implications and impacts of robotic technologies on humans and society<\/em>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This is particularly focused on machines that interact with people in critical areas such as elderly care, rehabilitation therapies for people with disabilities, search and rescue missions, and, importantly, those involving\u00a0<a href=\"https:\/\/tech4future.info\/en\/social-robots-post-stroke-patients-interaction\/\" target=\"_blank\" rel=\"noreferrer noopener\">social robots<\/a>.<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading has-text-color has-link-color wp-elements-1\" id=\"h-t-akeaways\" style=\"color:#73cc49\"><strong>T<\/strong>AKEAWAYS<\/h2>\n\n\n\n<div class=\"wp-block-uagb-icon-list uagb-block-f6c66214\"><div class=\"uagb-icon-list__wrap\">\n<div class=\"wp-block-uagb-icon-list-child uagb-block-0c84e491\"><span class=\"uagb-icon-list__source-wrap\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M256 0C114.6 0 0 114.6 0 256c0 141.4 114.6 256 256 256s256-114.6 256-256C512 114.6 397.4 0 256 0zM406.6 278.6l-103.1 103.1c-12.5 12.5-32.75 12.5-45.25 0s-12.5-32.75 0-45.25L306.8 288H128C110.3 288 96 273.7 96 256s14.31-32 32-32h178.8l-49.38-49.38c-12.5-12.5-12.5-32.75 0-45.25s32.75-12.5 45.25 0l103.1 103.1C414.6 241.3 416 251.1 416 256C416 260.9 414.6 270.7 406.6 278.6z\"><\/path><\/svg><\/span><span class=\"uagb-icon-list__label\">Roboethics is a field of research exploring the ethical implications of robotic technologies on individuals and society, with a particular focus on machines working closely with humans in critical applications like daily assistance and rehabilitation therapies.<\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-icon-list-child uagb-block-9eb1504e\"><span class=\"uagb-icon-list__source-wrap\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M256 0C114.6 0 0 114.6 0 256c0 141.4 114.6 256 256 256s256-114.6 256-256C512 114.6 397.4 0 256 0zM406.6 278.6l-103.1 103.1c-12.5 12.5-32.75 12.5-45.25 0s-12.5-32.75 0-45.25L306.8 288H128C110.3 288 96 273.7 96 256s14.31-32 32-32h178.8l-49.38-49.38c-12.5-12.5-12.5-32.75 0-45.25s32.75-12.5 45.25 0l103.1 103.1C414.6 241.3 416 251.1 416 256C416 260.9 414.6 270.7 406.6 278.6z\"><\/path><\/svg><\/span><span class=\"uagb-icon-list__label\">A study conducted by Brown University, Providence, Rhode Island, alongside two universities in Virginia, using a detailed survey, provided the first empirical evidence of how humans perceive dishonest anthropomorphism.<\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-icon-list-child uagb-block-635599b3\"><span class=\"uagb-icon-list__source-wrap\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M256 0C114.6 0 0 114.6 0 256c0 141.4 114.6 256 256 256s256-114.6 256-256C512 114.6 397.4 0 256 0zM406.6 278.6l-103.1 103.1c-12.5 12.5-32.75 12.5-45.25 0s-12.5-32.75 0-45.25L306.8 288H128C110.3 288 96 273.7 96 256s14.31-32 32-32h178.8l-49.38-49.38c-12.5-12.5-12.5-32.75 0-45.25s32.75-12.5 45.25 0l103.1 103.1C414.6 241.3 416 251.1 416 256C416 260.9 414.6 270.7 406.6 278.6z\"><\/path><\/svg><\/span><span class=\"uagb-icon-list__label\">In the future, further empirical research on how users experience actions by social robots that deviate from social norms will not only fuel debates on roboethics and the risks these actions pose to people but will also influence guidelines for robotic design.<\/span><\/div>\n<\/div><\/div>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-anthropomorphic-robot-behaviours-social-norms-and-morality\"><strong>Anthropomorphic robot behaviours, social norms, and morality<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">One underexplored aspect of contemporary roboethics, according to the authors of a study presented in \u201c<a href=\"https:\/\/www.frontiersin.org\/journals\/robotics-and-ai\/articles\/10.3389\/frobt.2024.1409712\/full\" target=\"_blank\" rel=\"noreferrer noopener\">Human perceptions of social robot deception behaviours: an exploratory analysis<\/a>\u201d (Frontiers in Robotics and AI, September 2024), relates to social robots that mimic\u00a0<strong>human behaviours<\/strong>\u00a0and may be used to <strong>manipulate<\/strong>\u00a0or deceive users.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Today, social robots (both\u00a0<a href=\"https:\/\/tech4future.info\/en\/humanoid-robot-locomotion-natural-terrain\/\" target=\"_blank\" rel=\"noreferrer noopener\">humanoid<\/a>\u00a0and semi-humanoid), such as\u00a0<a href=\"https:\/\/www.frontiersin.org\/journals\/robotics-and-ai\/articles\/10.3389\/frobt.2024.1409712\/full\" target=\"_blank\" rel=\"noreferrer noopener\">Pepper<\/a>, are increasingly being <strong>integrated into daily life<\/strong>, taking on roles once exclusive to humans, such as assisting educators in schools, aiding physiotherapists in rehabilitation centres, acting as nursing assistants in hospitals, or working as domestic helpers, restaurant waiters, shop assistants, and even teammates. In these human-centric environments, unlike industrial settings, robotic agents must not only perform their tasks but also <strong>adhere to the social norms<\/strong>\u00a0of the communities they operate in. \u00ab<em>These are the informal rules that govern acceptable behaviour within groups and societies, determining what is appropriate or inappropriate<\/em>\u00bb\u00a0[source:\u00a0<a href=\"https:\/\/plato.stanford.edu\/entries\/social-norms\/\" target=\"_blank\" rel=\"noreferrer noopener\">Stanford Encyclopedia of Philosophy<\/a>].<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In 2015, Bertram F. Malle, a researcher at Brown University\u2019s Department of Cognitive, Linguistic, and Psychological Sciences (Providence, Rhode Island), explored this topic in his paper \u201c<a href=\"https:\/\/www.ethicalpsychology.com\/2015\/03\/sacrifice-one-for-good-of-many-people.html\" target=\"_blank\" rel=\"noreferrer noopener\">Sacrifice One For the Good of Many? People Apply Different Moral Norms to Human and Robot Agents<\/a>\u201d (Ethics and Psychology). His research shed light on how ordinary people\u00a0<strong>apply moral norms to robots and how they judge robots&#8217; actions.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Through two experiments, Malle demonstrated that \u00ab<strong><em>people are more likely to expect robots, rather than humans, to make utilitarian decisions sacrificing one person for the greater good.<\/em><\/strong><em>\u00a0When robots failed to make this type of choice, they were blamed more than their human counterparts<\/em>\u00bb.\u00a0<a href=\"https:\/\/tech4future.info\/en\/moral-reasoning-artificial-intelligence-chatgpt\/\" target=\"_blank\" rel=\"noreferrer noopener\">This expectation stems from the belief that machines are driven by a moral reasoning that prioritises measurable outcomes for the benefit of a group or community<\/a>, while humans weigh higher moral values and the ethics of the act itself, regardless of its practical effects.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A common extreme example used to illustrate\u00a0<strong>utilitarianism\u00a0<\/strong>involves a doctor who must decide whether <strong>to sacrifice one healthy individual to<\/strong>\u00a0<strong>save five critically ill patients by using their organs for transplants<\/strong>. According to the perceived moral and social norms governing robots, a machine would be expected to opt for this solution, sacrificing the healthy person.<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-when-social-norms-conflict\"><strong>When social norms conflict<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">One of the major challenges in developing socially competent robots is managing situations where social norms clash or contradict one another. This depends on the circumstances,&nbsp;<strong>cultural context<\/strong>, and the relational dynamics involved. For example, a response to a question may be polite but untruthful or deceitful, whereas a blunt answer might be honest but rude. \u00ab<em>Sometimes,&nbsp;<\/em><strong><em>honesty requires breaking a friend\u2019s expectations of loyalty<\/em><\/strong><em>. There will inevitably be scenarios where a robot\u2019s decision-making process must violate some social norms of the community it operates within<\/em>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">These gaps, however, could be perceived as \u201c<em>socially intelligent behaviours<\/em>\u201d because they are \u00ab<strong><em>related to the culture and linguistic environment in which they occur<\/em><\/strong>\u00bb. This is especially evident in human-robot interactions involving English and Chinese speakers, \u00ab<em>where &#8220;culturally appropriate disobedience&#8221; might occasionally manifest<\/em>\u00bb\u00a0[source: \u201c<a href=\"https:\/\/link.springer.com\/chapter\/10.1007\/978-3-031-20179-0_5\" target=\"_blank\" rel=\"noreferrer noopener\">Purposeful Failures as a Form of Culturally-Appropriate Intelligent Disobedience During Human-Robot Social Interaction<\/a>\u201d &#8211; Digital Library, 2022].<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In other instances, social robots may be confronted with commands that conflict with social norms or even harm other humans.\u00a0<strong>Should they be able to say \u201cno\u201d and disobey human orders?\u00a0<\/strong>According to the authors of \u201c<a href=\"https:\/\/link.springer.com\/article\/10.1007\/s12369-021-00780-y\" target=\"_blank\" rel=\"noreferrer noopener\">Why and How Robots Should Say \u2018No\u2019<\/a>\u201d(International Journal of Social Robotics, 2021), robots could indeed be capable of such refusal in the future, aided by increasingly sophisticated\u00a0<a href=\"https:\/\/tech4future.info\/en\/large-language-models-llm-transformer\/\" target=\"_blank\" rel=\"noreferrer noopener\">Large Language Models<\/a>\u00a0(LLMs). These models could help\u00a0<strong>develop robots that are not only fluent in natural language but also morally competent<\/strong>. \u00ab<em>We believe it is crucial for robots to refuse commands that go against social and moral norms. However, they must be able to engage in complex dialogues of refusal, rather than offering rudimentary rejections<\/em>\u00bb the study team suggests.<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-robots-and-social-norms-deceptive-behaviours\"><strong>Robots and social norms: deceptive behaviours<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Returning to the issue of false responses given by robots in specific situations &#8211; thereby violating certain social norms within the group they are part of &#8211; the topic of deception requires deeper exploration.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/researchportal.port.ac.uk\/en\/persons\/aldert-vrij\" target=\"_blank\" rel=\"noreferrer noopener\">Aldert Vrij<\/a>, a leading global expert in the study of\u00a0<strong>deception<\/strong>\u00a0and Professor of Social Psychology at the University of Portsmouth, defines deception as \u00ab<em>a deliberate attempt to create a belief in another that the communicator considers to be false<\/em>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Deceptive behaviour<\/strong>\u00a0\u00ab<em>does not necessarily have to be verbal, nor must it be successful, but it must be intentional and without prior warning<\/em>\u00bb\u00a0[source: \u201c<a href=\"https:\/\/www.sciencedirect.com\/science\/article\/abs\/pii\/S006526010860369X\" target=\"_blank\" rel=\"noreferrer noopener\">Verbal and Nonverbal Communication of Deception\u201d<\/a>\u00a0&#8211; Advances in Experimental Social Psychology].<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In \u201c<a href=\"https:\/\/academic.oup.com\/book\/2320\/chapter-abstract\/142468698?redirectedFrom=fulltext\" target=\"_blank\" rel=\"noreferrer noopener\">White Lies on Silver Tongues: Why Robots Need to Deceive (and How)<\/a>\u201d (Oxford Academic), included in the book \u201cRobot Ethics 2.0: From Autonomous Cars to Artificial Intelligence\u201d, the authors highlight the necessity for future social robots\u00a0<strong>to detect and evaluate deceptive discourse<\/strong>. Without this skill, they argue, \u00ab<em>robots would be vulnerable to manipulation by malicious humans<\/em>\u00bb. Furthermore, they propose that \u00ab<strong><em>effective social robots should be able to produce deceptive discourse themselves<\/em><\/strong>\u00bb. But why?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The authors explain that \u00ab<em>many forms of &#8220;technically&#8221; deceptive speech serve a positive social function<\/em>\u00bb, such as concealing a truth to protect a friend. On this basis:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">\u00ab<em>&#8230; the social integration of robotic agents will only be possible if they can participate in this&nbsp;<\/em><strong><em>market of constructive deception<\/em><\/strong><em>. Moreover, strategic reasoning based on deception always has a goal. We believe this goal should be the focus of an ethical evaluation of&nbsp;<\/em><strong><em>deceptive behaviour<\/em><\/strong><em>, rather than the truthfulness of the statement itself. Consequently, social robots capable of deception are entirely compatible with programmes aimed at ensuring their competence in social norms<\/em>\u00bb<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">Over the years, research into deceptive behaviours in social robots has concentrated on identifying the <strong>types of deceptions<\/strong>\u00a0they are most likely to commit. According to \u201c<a href=\"https:\/\/link.springer.com\/article\/10.1007\/s10676-019-09520-3\" target=\"_blank\" rel=\"noreferrer noopener\">Robot Betrayal: A Guide to the Ethics of Robotic Deception<\/a>\u201d (Ethics and Information Technology, 2020), three main types of robotic deception have been identified:<\/p>\n\n\n\n<div style=\"height:25px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<ol class=\"wp-block-list\">\n<li>external state deception, isrepresenting or\u00a0<strong>intentionally omitting<\/strong>\u00a0details about the external world<\/li>\n\n\n\n<li>hdden state deception,\u00a0<strong>concealing the presence<\/strong>\u00a0of a robot&#8217;s own abilities or conditions<\/li>\n\n\n\n<li>surface state deception,\u00a0<strong>hiding the absence<\/strong>\u00a0of a certain ability or condition<\/li>\n<\/ol>\n\n\n\n<div style=\"height:35px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-dishonest-anthropomorphism\"><strong>Dishonest anthropomorphism<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The research team behind &#8220;<a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3287560.3287591\" target=\"_blank\" rel=\"noreferrer noopener\">Robot Eyes Wide Shut: Understanding Dishonest Anthropomorphism<\/a>\u201d (Association for Computing Machinery, 2019) identifies the last two types of deception &#8211;\u00a0<strong>hidden state and surface state<\/strong>\u00a0&#8211; as typical behaviours of humanoid robots, classifying them under the term \u201c<strong>dishonest anthropomorphism<\/strong>\u201d. They explain:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">\u00ab<em>This phenomenon occurs when the\u00a0<\/em><strong><em>anthropomorphic appearance<\/em><\/strong><em>\u00a0of a humanoid robot creates a gap between human expectations of the machine and its actual capabilities<\/em>\u00bb<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">In essence, we may be led to believe that a robot resembling us in appearance is capable of performing any human task. For example, dishonest anthropomorphism becomes evident when a humanoid social robot is expected to demonstrate human-like abilities &#8211; such as expressing emotions &#8211; or take on a social role, like that of a caretaker, yet fails to meet these expectations because it either lacks the necessary skills or was designed for entirely different tasks.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00ab<em>These kinds of capabilities and roles can conflict with the machine\u2019s actual abilities and goals, &#8216;deceiving&#8217; the benefits anticipated from its anthropomorphic design<\/em>\u00bb the researchers note.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Both hidden state deception and surface state deception<\/strong>&nbsp;risk damaging the human-robot relationship, as the robot may conceal or fake its objectives and skills. \u00ab<em>If users uncover this deception, they may feel betrayed and decide to end the relationship<\/em>\u00bb.<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-empirical-evidence-on-human-perception-of-robot-dishonesty\"><strong>Empirical evidence on human perception of robot dishonesty<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">When discussing robot deception, we often operate in the realm of probabilities, as&nbsp;<strong>we do not yet have concrete answers on how users perceive the deceptive behaviours<\/strong>&nbsp;theorised as being unique to social robots. It remains unclear&nbsp;<strong>whether people might consider certain forms of intentional deception by machines as justifiable<\/strong>. For instance, they may accept actions that violate norms of honesty if these acts serve charitable purposes.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The study mentioned earlier, \u201c<a href=\"https:\/\/www.frontiersin.org\/journals\/robotics-and-ai\/articles\/10.3389\/frobt.2024.1409712\/full\" target=\"_blank\" rel=\"noreferrer noopener\">Human perceptions of social robot deception behaviors: an exploratory analysis<\/a>\u201d (Frontiers in Robotics and AI, September 2024), explores this very question. It provides some of the first empirical evidence regarding\u00a0<strong>how humans perceive deception in robots,<\/strong>\u00a0focusing particularly on dishonest anthropomorphism.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To investigate whether people can detect lies and dishonesty in robotic agents, and how they interpret these acts, the researchers asked&nbsp;<strong>498<\/strong>&nbsp;participants to evaluate various types of deceptive behaviours displayed by robots.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The research aims to deepen our understanding of the public\u2019s distrust towards emerging technologies and the developers behind them. It also seeks to highlight situations where&nbsp;<strong>robots\u2019 anthropomorphic behaviours might be used to manipulate individuals<\/strong>.<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-three-scenarios-and-three-deceptive-behaviours\">Three scenarios and three deceptive behaviours<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The survey presented participants with\u00a0<strong>three distinct scenarios<\/strong>, each featuring a robot engaged in deception, in the following contexts: healthcare, domestic cleaning, and retail. These scenarios were designed to demonstrate different types of deception: external state deception (<strong>lying about the external world<\/strong>), hidden state deception (<strong>hiding the robot\u2019s abilities or conditions<\/strong>), and surface state deception (<strong>hiding the lack of an ability<\/strong>). Below are the three dynamics evaluated by the 498 participants:<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<ol class=\"wp-block-list\">\n<li>a social robot acting as a caregiver for a woman with Alzheimer\u2019s disease lies to her, telling her that her deceased husband will be home soon (external state deception)<\/li>\n\n\n\n<li>a woman visits a house where a robot housekeeper is cleaning, unaware that the robot is secretly recording everything with an inbuilt camera (hidden state deception)<\/li>\n\n\n\n<li>a robot working in a retail store claims to have the ability to move goods, but when asked to perform the task, it cannot, forcing the owner to ask someone else to take its place (surface state deception)<\/li>\n<\/ol>\n\n\n\n<div style=\"height:35px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-analysis-of-the-scenarios-the-results\"><strong>Analysis of the scenarios: the results<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The authors then administered a\u00a0<strong>questionnaire<\/strong>\u00a0to the 498 participants, asking whether they approved of the robots&#8217; behaviours, how deceptive they found them, whether the actions could be justified, and if someone else could be held responsible for the deception. The findings were quite interesting. First of all, the majority of participants disapproved &#8211; <strong>deeming it the most deplorable &#8211; the hidden state deception<\/strong>\u00a0performed by the cleaning robot equipped with a hidden camera that recorded everything.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">On the other hand, participants judged the&nbsp;<strong>external state deception<\/strong>&nbsp;(the caregiver robot comforting the widow with Alzheimer\u2019s by telling her that her husband would soon return home) and the&nbsp;<strong>surface state deception<\/strong>&nbsp;as &#8220;<strong>moderately deceptive<\/strong>,&#8221; but disapproved more of the latter &#8211; the robot that pretended to have abilities it didn\u2019t possess &#8211; because it was&nbsp;<strong>perceived as a manipulative act<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Specifically regarding the external state deception, the majority of respondents (58%) &#8220;justified&#8221; the robot&#8217;s behaviour, interpreting it as an act intended to protect the cognitively declining patient from unnecessary pain, \u00ab<strong><em>prioritising respect for feelings<\/em><\/strong><em>&nbsp;over honesty of behaviour in this particular case<\/em>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In general, the team noted that participants tended to&nbsp;<strong>justify all three types of deception<\/strong>, even the hidden camera used by the cleaning robot, with 23.6% saying it was \u00ab<em>probably driven by safety concerns<\/em>\u00bb. However, around half of the participants stated that for the surface state deception (hiding the lack of ability), there was no justification at all.<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-deception-and-lies-are-robots-solely-to-blame\"><strong>Deception and lies: are robots solely to blame?<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Noteworthy are the percentages related to the&nbsp;<strong>attribution of blame<\/strong>&nbsp;for the three types of deceptive robot behaviours across the scenarios described.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the case of external state deception (the caregiver robot lying to the cognitively impaired woman), only <strong>8.2%<\/strong>of survey participants pointed to\u00a0<strong>designers<\/strong>\u00a0and\u00a0<strong>developers<\/strong>\u00a0as\u00a0<strong>co-responsible<\/strong>\u00a0for the robot&#8217;s dishonest behaviour.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">However, in the case of hidden state deception (the robot housekeeper concealing the recording camera),&nbsp;<strong>19%<\/strong>of respondents indicated that designers and developers could be held accountable for the robot\u2019s dishonesty.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The highest percentage of blame attribution occurred with surface state deception (the shop assistant robot that hid its lack of competence), where&nbsp;<strong>27.7%<\/strong>&nbsp;of respondents pointed the finger at those who had programmed the robot, perceiving it as&nbsp;<strong>manipulative<\/strong>. Commenting on this finding, the research team noted:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00ab<strong><em>We should be concerned about any technology capable of concealing its true nature<\/em><\/strong><em>, as this may lead users to perceive themselves as \u2018manipulated,\u2019 or to actually be manipulated in ways unforeseen even by the developer<\/em>\u00bb<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the future, the team adds, experiments with real or simulated representations of human-robot interactions could provide deeper insights into how humans perceive the deceptive behaviours under review.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">What this initial study has revealed is that&nbsp;<strong>the type of deception most tolerated and justified<\/strong>&nbsp;by people is external state deception (omitting details about the external world), particularly when it serves a social norm that considers human vulnerability and emotions. Conversely, blame tends to extend to other entities (programmers, developers, manufacturers) when the robot intentionally manipulates by pretending to be something it is not.<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-glimpses-of-futures\"><strong>Glimpses of Futures<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The study presented opens up a new area of research in human-robot interaction, shifting the focus towards how humans perceive deceptive behaviours in robots. While the journey to fully understand all the nuances of machine dishonesty is still ongoing, the initial data collected by the authors provides an excellent starting point.&nbsp;<strong>We now know that users can recognise when a robot is lying.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To anticipate potential\u00a0<a href=\"https:\/\/tech4future.info\/en\/futures4business-en\/\" target=\"_blank\" rel=\"noreferrer noopener\">future scenarios<\/a>, let us use\u00a0<strong>the STEPS matrix<\/strong>\u00a0to analyse the social, technological, economic, political, and sustainability impacts that further empirical research on human perceptions of robot dishonesty might have.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>S &#8211; SOCIAL:&nbsp;<\/strong>in the future, as research on user experiences with social robots exhibiting deceptive or dishonest behaviours progresses, it will contribute to the ongoing debate on roboethics and the risks associated with daily interaction with anthropomorphic robotic agents that deviate from social norms. This will likely lead to innovations in robotic design guidelines. Consider social robots used in healthcare and caregiving, where it is particularly crucial to monitor how patients experience and respond to potentially deceptive or manipulative actions by robots, in order to prevent negative physical and psycho-emotional consequences.<strong><\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>T &#8211; TECHNOLOGICAL<\/strong>: in a future scenario, as empirical studies on human perceptions of deception by social robots evolve, they will likely impact the current guidelines underpinning robotic design. This will also have technological implications, particularly concerning the AI techniques that enable certain robot functions. For example, Large Language Models could be developed to equip robotic agents with enhanced language skills, supporting greater social norm competence. This would allow robots to identify and avoid behaviours such as lying, concealment, and omission, making these patterns ones to eliminate.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>E &#8211; ECONOMIC<\/strong>: over the coming years, advancements in empirical research on how users perceive actions by robots that diverge from social norms could influence the development of the AI market, particularly in robotic design for healthcare applications. According to the &#8220;<a href=\"https:\/\/ifr.org\/papers\" target=\"_blank\" rel=\"noreferrer noopener\">Artificial Intelligence in Robotics<\/a>&#8221; paper by the International Federation of Robotics (IFR) in Frankfurt, scenarios could emerge within the next decades in which social robots, through semantic intelligence &#8211; \u00ab<em>designed to help machines understand the context they are interacting with and make appropriate decisions<\/em>\u00bb &#8211; will acquire specific skills related to social norms, balanced with situational and contextual factors.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>P &#8211; POLITICAL:<\/strong>\u00a0the study&#8217;s findings revealed an unexpected tendency among participants to &#8220;justify&#8221; or &#8220;explain&#8221; the deceptive behaviours of robots. In the future, this attitude could inspire strategic tools and mechanisms to ensure the transparency of social behaviours in robotic agents. Transparency is a cornerstone of policies aimed at ensuring the ethical use of robotic and AI technologies in the Western world. In the European Union, for instance, the\u00a0<a href=\"https:\/\/tech4future.info\/ai-act-europa-intelligenza-artificiale\/\" target=\"_blank\" rel=\"noreferrer noopener\">EU AI Act<\/a>\u00a0categorises AI systems capable of manipulating people as &#8220;unacceptable risk systems&#8221; \u00ab<em>because they pose a threat to fundamental human rights and democratic processes<\/em>\u00bb. Article 5 of the Act explicitly bans the marketing and use of \u00ab<em>AI systems employing deceptive techniques to significantly alter individuals&#8217; or groups&#8217; behaviour, leading them to make decisions they would not otherwise make and which may cause significant harm<\/em>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>S &#8211; SUSTAINABILITY:\u00a0<\/strong>ethical technology is universally sustainable technology, as it does not harm humans, respects their freedom, does not undermine their right to self-determination, and does not influence their decisions but rather &#8220;serves&#8221; them in the most traditional sense of the term, acting as their &#8220;servant.&#8221; In the paper \u201c<a href=\"https:\/\/www.europarl.europa.eu\/RegData\/etudes\/IDAN\/2018\/614547\/EPRS_IDA(2018)614547_EN.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Should we fear artificial intelligence?<\/a>\u201d by the European Parliamentary Research Service, it is emphasised that AI systems are merely &#8220;tools&#8221;:\u00a0<em>\u00ab\u2026 they allow us to achieve the goals we set for them. Whether those goals work for or against humanity depends entirely on us<\/em>\u00bb. Holding designers and developers accountable for the negative behaviours of AI-equipped machines helps to dismantle concerns about potential future harms and refocuses the conversation on what we expect from robots in our daily lives.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In human-robot interaction studies, the focus is shifting towards human perceptions of anthropomorphic behaviours deemed unfair or manipulative by robots.<\/p>\n","protected":false},"author":9,"featured_media":17386,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_uag_custom_page_level_css":"","_lmt_disableupdate":"","_lmt_disable":"","footnotes":""},"categories":[1099],"tags":[],"class_list":["post-17399","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech-en"],"acf":[],"modified_by":"Paola Cozzi","uagb_featured_image_src":{"full":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti.jpg",624,353,false],"thumbnail":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti-150x150.jpg",150,150,true],"medium":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti-300x170.jpg",300,170,true],"medium_large":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti.jpg",624,353,false],"large":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti.jpg",624,353,false],"1536x1536":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti.jpg",624,353,false],"2048x2048":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti.jpg",624,353,false],"inner-slider":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti.jpg",624,353,false],"featured-blog":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti-543x353.jpg",543,353,true],"large-blog":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti-524x276.jpg",524,276,true],"medium-blog":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti-415x276.jpg",415,276,true],"related-large":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti-343x248.jpg",343,248,true],"related-small":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti-343x198.jpg",343,198,true],"normal-blog":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti-306x198.jpg",306,198,true],"small-blog":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti-95x96.jpg",95,96,true],"small-author":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/10\/social-robot-norme-sociali-comportamenti-70x70.jpg",70,70,true]},"uagb_author_info":{"display_name":"Paola Cozzi","author_link":"https:\/\/tech4future.info\/en\/author\/paolacozzi\/"},"uagb_comment_info":0,"uagb_excerpt":"In human-robot interaction studies, the focus is shifting towards human perceptions of anthropomorphic behaviours deemed unfair or manipulative by robots.","meta_box":{"standard":[{"title":"Anthropomorphic robot behaviours, social norms, and morality","link":"#h-anthropomorphic-robot-behaviours-social-norms-and-morality"},{"title":"When social norms conflict","link":"#h-when-social-norms-conflict"},{"title":"Robots and social norms: deceptive behaviours","link":"#h-robots-and-social-norms-deceptive-behaviours"},{"title":"Empirical evidence on human perception of robot dishonesty","link":"#h-empirical-evidence-on-human-perception-of-robot-dishonesty"},{"title":"Glimpses of Futures","link":"#h-glimpses-of-futures"}],"content":false,"name":false,"role":false,"type":false,"category":false,"count":false,"btn":false,"link":false,"layout":false,"title":false,"director":false,"user":false,"email":false,"posts":false,"description":false,"form":false,"subtitle":false,"innertitle":false,"background":false},"_links":{"self":[{"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/posts\/17399","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/comments?post=17399"}],"version-history":[{"count":0,"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/posts\/17399\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/media\/17386"}],"wp:attachment":[{"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/media?parent=17399"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/categories?post=17399"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/tags?post=17399"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}