Research Ideas and Outcomes : Research Idea
|
Corresponding author: Johanna Seibt (filseibt@cas.au.dk)
Received: 21 Nov 2018 | Published: 27 Nov 2018
© 2018 Johanna Seibt, Christina Vestergaard
This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Citation: Seibt J, Vestergaard C (2018) Fair Proxy Communication: Using Social Robots to Modify the Mechanisms of Implicit Social Cognition. Research Ideas and Outcomes 4: e31827. https://doi.org/10.3897/rio.4.e31827
|
This article introduces a new communicational format called Fair Proxy Communication. Fair Proxy Communication is a specific communicational setting in which a teleoperated robot is used to remove perceptual cues of implicit biases in order to increase the perceived fairness of decision-related communications. The envisaged practical applications of Fair Proxy Communication range from assessment communication (e.g. job interviews at Affirmative Action Employers) to conflict mediation, negotiation and other communication scenarios that require direct dialogue but where decision-making maybe negatively affected by implicit social biases. The theoretical significance of Fair Proxy Communication pertains primarily to the investigation of 'mechanisms' of implicit social cognition in neuropsychology, but this new communicational format also raises many research questions for the fields of organisational psychology, negotiation and conflict research and business ethics. Fair Proxy Communication is currently investigated by an interdisciplinary research team at Aarhus University, Denmark.
communication, perceptual bias, discrimination, integrative social robotics, telepresence, job interview, conflict facilitation, fairness, mediator neutrality, social cognition
The aim of this paper is to introduce the communicational format called "Fair Proxy Communication". The basic idea of Fair Proxy Communication was conceived by the first author in 2014, empirically explored by the second author in a pilot study at a Danish professional school in early 2015 and further developed by both authors. Fair Proxy Communication has been described in greater detail in 2016 in the context of a grant application for Integrative Social Robotics, a new approach to research, design and development of applications of robots in social interaction contexts. Even though the basic idea of Fair Proxy Communication is independent of this approach, it also can serve as a prime illustration of its potential benefits. In fact, the requirements for Fair Proxy Communication, as defined below, will become clearer if we introduce it from within its larger motivational context and begin with a brief sketch of background of Integrative Social Robotics.
"Social robotics" and "Human-Robot-Interaction Studies" are fairly young interdisciplinary research areas exploring the phenomena of human interactions with so-called 'social robots.' So far, both areas have been conducted with limited interdisciplinary scope, involving mainly robotics, psychology (developmental psychology but also autism research), geronotology and education science, but the Humanities and social sciences are not yet fully involved. This means in effect that, so far, deeply disruptive technologies have been developed and investigated without involving all relevant expertise. Given that so-called 'social' robots are to engage humans in new socio-cultural interactions, it seems irresponsible and ultimately counterproductive to disregard the expertise of the Humanities. Integrative Social Robotics (
Integrative Social Robotics is a targeted response to growing concerns, expressed both within the robotics community as well as in the professional and public debate on socio-cultural and ethical values, that an unregulated social robotics industry may create profound and possibly negative cultural changes (see e.g.
This serial arrangement — first development, then professional evaluation of socio-cultural and ethical significance and finally policy and legal regulation — has two crucial drawbacks. On the one hand, due to the mentioned sequentialisation, research on the cultural-ethical implications and commercial potential of social robotics applications currently is lagging far behind the rapid developments in robot technology and the advice that policy- and law-makers can receive from national ethical councils is not always fully informed about the technology. On the other hand, as long as the methods and categories of value and social interaction research in the Humanities are not included in the interdisciplinary scope of HRI — currently mainly consisting of quantitative studies in psychology and sociology — the research, design and development process in social robotics misses out on important resources for innovation and anticipatory adjustments to expected ethical and legal regulation.
In contrast, according to the approach of Integrative Social Robotics, Humanities research on ethical, conceptual and socio-cultural norms and values is both informed by and provides information on on all stages of the research, design and development process of social robotics. Since so-called ‘social’ robots are no longer tools but interfere with the sphere of human social interactions at the (preconscious and conscious) semiotic level of social agency, Integrative Social Robotics proposes that research, design and development of social robotics applications should be joined, from the very beginning, with professional research in disciplines whose concepts and methods have been designed to explore, empirically and hermeneutically, the profound complexity of human social interactions and the cultural values constituted by these practices.
More concretely, Integrative Social Robotics operates with five methodological principles (
Of primary interest in the present context is the fifth principle, the "values first principle" which demands that social robotics applications should be developed with the goal of preserving or enhancing a value that has top rank in a given axiological system (ethical or sociocultural values are typically top rank values). This demand for a strictly value-driven approach is a reinforcement of cognate design principles calling for "value-sensitive" technology development (
The development of Fair Proxy Communication, the application of which we will describe in the following, is a prime illustration of the "values first principle". The non-replacement maxim demands that we identify suitable targets for social robotics applications by considering which of our top values could be supported by agents and can do what human agents cannot do. In the case of Fair Proxy Communication, the top values pursued are perceived fairness (in communication), as well as the values of social equality and/or peace as these depend on perceived fairness. Guided by the question: 'how can we enhance perceived fairness in communication – and thereby enhance social equality and/or peace–making good use of features that are unique to robots?', the first author, a philosopher, conceived of the idea of Fair Proxy Communication by combining:
The second author, a specialist in conflict research and anthropology, refined the initial idea and conducted first qualitative research using the Telenoid R1 robot (created by Hiroshi Ishiguro, ATR, Japan). Based on these pilot studies, we could establish Fair Proxy Communication as a viable research target for an interdisciplinary team committed to Integrative Social Robotics (26 researchers from 14 disciplines), for it appeared that certain teleoperated communication robots can "do what humans should but cannot do," namely,
In the following sections, we will define the idea of Fair Proxy Communication more precisely, describe its practical and theoretical objectives and explain the current implementation of several research lines exploring Fair Proxy Implementation.
The field of Human-Robot Interaction Studies, a relatively new multidisciplinary research area, is still in need of more precise descriptive terminology. For this reason, we wish to offer here a fairly detailed definition of the term "Fair Proxy Communication", which is short-hand for "fairness-enhancing communication with robotic proxies" and hereafter abbreviated as 'FPC'. This is a tentative definition that we may need to adjust in the course of our empirical research, but for such adjustments, it is important to have an initial reference point with a precise definition.
Roughly speaking, FPC labels a specific communicational format that involves the ‘telepresence’ of one communication partner who remotely operates a robot with a special set of affordances and a communicational setting (such as job interviews) where perceptual biases may lead to unfair decisions. Before we present a more precise definition, let us offer an illustration; consider Figs
A job interview using FPC, from the perspective of the job candidate. A female candidate (in the definition D1-1: H1) operates her robotic proxy, a Telenoid R4 robot, while she communicates with the male interviewer. Her head movements, lip movements and speech are translated directly to the robot, either via a kinetic sensor on a headset or by a facial reading programme; her voice may or may not be morphed to mask gender (see section "Practical Significance" below). The camera that projects the interviewer on to her computer screen is in the eyes of the robot –thus, in contrast to a skype session, she looks into the interviewer's eyes when facing the interviewer.
The illustrated scenario is an instantiation of the general definition of FPC, which we state as follows:
Definition (Def1): FPC refers to a specific form of communication, which consists of a communication scenario suited for FPC (D1-1), a condition describing the physical set-up of FPC (D1-2), a condition describing the practical-ethical goal that is to be achieved via FPC (D1-3) and means by which the goal is achieved (D1-4).
(Def 1-3) S has been modified as described in (Def 1-1) for the sake of the practical-ethical goal of increasing the perceived fairness of S relative to D, i.e.of ensuring that H2 (or any of the Hi) is not provided with perceptual cues (pertaining to gender, age, ethnicity, race etc.) that both H1 and H2 (and any of the Hi) know to be associated with negative or positive biases relevant for D.
(Def 1-4) The robotic proxy has a (physical and kinematic) design PKD that fulfils the practical-ethical goal as specified in (Def 1-2).
We supplement definition (D1) with the following points of explanatory commentary.
Comment 1: Condition (Def 1-1) requires that, for any concrete application of FPC, it needs to be clarified explicitly which decision is the target of the application. In the given illustration of the job interview, the decision mentioned in condition (Def 1-1) may be the decision to commit to a definite evaluation of whether the candidate is suited for the position or it may be the decision that is based on the assessment, namely, to hire the candidate or admit her to the next step in the selection process etc. This is crucially important for further research on FPC since it is one thing to investigate whether the removal of perceptual cues for bias achieved by FPC can alter the evaluations of job candidates and another to investigate whether it also can change actual hiring rates. Besides job interviews, there are many other suitable communication scenarios involving short-term or long-term decision-making that can be negatively affected by perceptual biases, such as oral examinations, personal meetings for application for credit, rental property or other asymmetric business transactions. Note also that the fact that H2's decision about H1 may merely be the decision that H1 is trustworthy and provides good counsel – in the following section, we describe an application of FPC where conflict facilitators use robotic proxies in order to circumvent so-called "perceived mediator bias".
Comment 2: According to (Def1-1) and (Def1-2), the decisional power in S should be asymmetric and only the person that is decided upon, H1, is telepresent in S via robotic proxy. Thus, asymmetric decisional power in S is tied to asymmetric telepresence. One might argue, however, that perceived fairness of S might be even further increased if the decision-maker H2 also is telepresent in S via robotic proxy, since this will preventH1 being affected by the perceptual cues of H2, which may hamper H1's communicational performance relative to assessment questions (e.g. a female student may answer exam questions more freely if she cannot detect the gender of her examiner). Symmetric telepresence in our view will not produce what we call below the "Fair Proxy Effect", a specific phenomeno that arises in a human interlocutor when she or he is in the direct physical presence of the robotic proxy.
Comment 3: According to (Def1-2), the remote operation capabilities of the robotic proxy should preserve the communicative capacities of H1 as these are relevant for D. For our illustration of the job interview, this means that the robotic proxy should be able to produce H1's verbal and non-verbal input to the conversations in ways that do not diminish the semantic content of what is said; for example, H1's voice should be transmitted in real-time without delays, sufficiently loud and clearly, in natural prosody, her head movements should be sufficiently expressive and accompany her speech in real-time without delay etc. In a different scenario, other communicative capacities of H1 may be relevant – for example, if FPC is used to remove potential ethnic or racial biases in an audition for a choir, the focus will be on the precise rendition of all qualitative aspects of spontaneous vocal productions while head movements will be irrelevant. Or again, if FPC were used in an exam for choreographers where candidates are asked toimprovise a display of their choreographic creativity, the functionalities of the robotic proxy would be focused on the accurate rendition of the bodily movements of H1 dancing his or her improvisation in the remote location. The fact that (Def1-2) requires that the functionalities of the robotic proxy transmits all communicational elements that are relevant for D and only these, may create considerable technical difficulties (e.g. the servo motors of the robotic proxy must not be audible etc.).
Comment 4: As the formulation of (Def1-3) conveys, FPC may be used to remove different sorts of perceptual biases, i.e. the positive or negative valuations that members of a society connect with different perceptual stereotypes and that may be guided by in their decision-making. FPC may be used to remove any or all of the perceptual cues that provide information about H1's gender, ethnicity, race, age or social class. Since the practical-ethical purpose of FPC is to increase perceived fairness in a communicational scenario of type S, i.e. to increase the fairness of D relative to the knowledge of H1 and H2 about implicit bias. We assume here that H1 and H2's knowledge is representative of the state-of-the-art of research on implicit biases in a society at a given time. The goal in (Def1-3) is called 'practical-ethical' since it is a practical goal (removal of perceptual cues for bias) pursued for the sake of an ethical value (fairness). Obviously, it is an underlying assumption in (Def1-3) that H2 is not informed beforehand about H1's gender, age, race etc. that is, the feature of H1's social identity that is to be masked by way of using FPC.
Comment 5: It is constitutive for FPC that the reduction of perceptual bias is primarily due to the use of the robotic proxy. We consider a robot as a bundle for affordances (in the Gibsonian sense) – they afford perceptual and practical interactions by humans and many of their physical and kinematic features afford perceptual interactions relative to social categories. These affordances seem to vary across cultures and across individuals, but extensive research in Human-Robot Interaction studies is necessary to clarify the extent of this variation. By the ‘design’ of a robot, we mean its affordances constituted by its three-dimensional visual appearance, its kinematic, acoustic, phonetic, tactile and even olfactory features. To construct a robotic proxy is a difficult task since not only must the proxy fail to have affordances that are the cues for certain perceptual biases (e.g. neither its appearance, voice or movement must give the gender away), it must also retain the affordances of 'smooth' direct dialogue with a fellow human being.
With (Def1) and these five supplementary comments, we hope to have delineated the concept of FPC sufficiently precisely, yet also sufficiently generally, in order to convey that FPC is special communicational format that has a wide scope for practical applications while raising a host of research questions, as the following two sections will elaborate. To faciliate the exposition in these sections, we close this section by introducing two further concepts. The second definition is a mere abbreviatory stipulation:
Definition (Def-2) A fair proxy scenario is a communicative situation for which all conditions of (D1) are fulfilled, i.e. a scenario where FPC is de facto taking place or can take place.
The third definition, however, is an attempt to capture a distinctive phenomenology (i.e., distinctive experience that subjects are or can make themselves aware of by introspection) that participants reported in qualitative interviews accompanying past and ongoing pilot and experimental studies. The communicative scenarios of these studies are counselling scenarios (conflict mediation and ethical counselling) and we used Telenoid™ (model R1 and R4) robots as robotic proxies, as shown in Fig.
The creator of the Telenoid, Hiroship Ishiguro, describes the design idea of the Telenoid robots as follows. The Telenoid "was designed to appear and to behave as a minimalistic human; at the very first glance, one can easily recognise the Telenoid™ as a human while the Telenoid™ appears as both male and female, as both old and young. By this minimal design, the Telenoid™ allows people to feel as if an acquaintance in the distance is next to you. [The Telenoid is] like an empty screen on to which specific features of the remote conversation partner can be projected” (
Participants attributed the experienced cognitive relief to the fact that the missing social cues made it impossible to second-guess and anticipate appraisal by the interlocutor–"it was a robot so one would not need to think about one’s own behavior"; "I could allow myself more [to be me]”; talking to the counsellor via the Telenoid "made it easier to concentrate on what was being said", to "control [their] emotions better" and to "think better".
These reports suggest that the initially implicitly perceived absence of perceptual cues about social identities (gender, age, race, ethnicity etc.) was something that subjects eventually (after 1-2 minutes of getting used to the unfamiliar situation) were in some fashion aware of or could make themselves be aware of upon subsequent questioning and experienced as in the emotional context of relief, which seems to them connected to the absence of the normal procedures of social epistemic alignment with a dialogue partner or self-censoring.
A careful and extensive investigation of this phenomenology is currently being undertaken, but in order to facilitate the formulation of research hypotheses, we wish to present the following tentative definition:
Definition (Def-3): In a Fair Proxy scenario, human subjects in the role of H2 (i.e. who interact with the robotic proxy in bodily proximity) experience a distinctive phenomenology or subjective impression that consists of three elements:
This distinctive subjective impression does not arise when FPC is not used in the given type of communicative scenario. We call this distinctive phenomenology or subjective impression the Fair Proxy effect.
The degree of variation in the Fair Proxy effect across different Fair Proxy scenarios is still an open question. In particular, it is still an open question whether element 3 of the Fair Proxy effect, which we so far have identified in scenarios of (conflict and ethical) counselling, can also be observed in assessment communication. Moreover, it is an open question whether the Fair Proxy effect is unique in interacting with the Telenoid or will also arise when robotic proxies are implemented with robots of different design.
The two top values that drive the research, design and development process for the robotics application we call Fair Proxy Communication are social justice and peace. These two values demarcate the main areas of concrete practical use of FPC as we currently envisage it.
Social justice is violated when certain members of society are discriminated against, i.e. deselected or devalued in an assessment procedure based on features that are irrelevant for the assessment in question. Discrimination often occurs at the level of implicit social cognition, when pre-conscious stereotyping or perceptual biases guide the conscious assessment or decision in the context of job interviews, hiring or promotion. A large body of research suggests that, despite anti-discrimination laws, candidates with overt characteristics that are associated with negative interviewer evaluations (such as gender, ethnicity, being pregnant, overweight or LGBTQ) are frequently discriminated against (
Robots, on the other hand, here can do "what humans should but cannot" – they can help people to be bodily present without also presenting perceptual cues of their social identities.
The use of FPC for the sake of reducing (perceived) discrimination and increasing (perceived) social justice thus is in full compliance with the non-replacement maxim (see section "Background" above) and at least prima facie an area where social robotics can be responsibly employed. We envisage that FPC will be of practical interest for:
Perceptual biases in business and educational communication (job interviews, wage negotiation, exams) create high losses. Gender and race discrimination not only offend principles of social equality endorsed by many countries, it also lowers an economy’s total output — according to recent studies, a 50% increase in the gender wage-gap lowers the country’s GDP up to 15-25% and the global net loss is calculated to amount to several trillion US dollars (
Before FPC can be taken into use, however, further extensive research is necessary to better understand precisely how it should be used. A core question here is whether and how any increase in perceived social justice or reduction of perceived discrimination translates into actual decisionmaking and persistent cultural change (see next section).
The second main application area which should benefit from the use of FPC is the mediation or facilitation of conflicts – here an increase in perceived justice of the communicative situation can increase opportunities for interpersonal peace (with possible extensions to intergroup peace). If the mediator / facilitator is represented by the robotic proxy, this will prove beneficial in conflict where gender, ethnicity, race or age play a central role, for example, especially in divorce conflicts, where the gender of the mediator / facilitator often has negative effects on the mediation (see e.g.
Besides assessment communication and conflict resolution, there is surely a wide variety of other possible uses for FPC. In general, one could consider applying FPC in communicative contexts where direct communication of one party should be combined with anonymity of the other party; this can be useful for communication contexts where there is an asymmetry of power, such as complaint hearings between staff and management or between students and teachers etc.
Fair Proxy Communication and the possibility of communicating via robotic proxy via telepresence in general, raise a host of new and highly interdisciplinary research questions involving robotics, neuropsychology (cognitive science), psychology, gender research, business and management studies, conflict research, communication science, linguistics, anthroplogy, education science and philosophy (ethics). Here we shall only set out some of these research tasks with focus on one discipline, but it will be quickly apparent that the relevant research questions reach beyond the discipline and required interdisciplinary collaborations. (To abbreviate or clarify the exposition, we shall use the five variables we introduced in (Def1), S standing for the communicational scenario; D standing for the decision to be taken on the basis of S; H1 standing for the person represented by the robotic proxy; H2 standing for the person interacting directly with the robotic proxy; and PKD standing for the physical and kinematic design of the robotic proxy.)
As neuroscientists and neuropsychologists have begun to notice, social robots can be used as a new sort of research instrument to study social cognition (see e.g.
The phenomena of FPC offer a particularly well-focused entry point into this new research field of neuropsychological social cognition research with robots.
A research team of 26 researchers from 14 disciplines currently investigated the phenomena of FPC, its foundations and applications, in the context of a larger research project supported by the Carlsberg Foundation (2016-2021). Following the method of Integrative Social Robotics, we investigated FPC in wide-scope interdisciplinary interactions. For an introduction to the overall idea of the project, see (
The research announced in this project is supported by a Semper Ardens grant of the Carlsberg Foundation. We thank our colleagues in the project group for productive interactions that benefited the exposition of the concept of FPC as formulated here. The presentation in the section "Research Tasks" includes ideas from (in alphabetical order) Lin Adrian, David Amadio, Malene Flensborg Damholdt, Dan Druckman, Charles Ess, Michael Filzmoser, Cathrine Hasse, Sabine Köszegi, Marco Nørskov, Sladjana Nørskov, Josh Skewes and John Parm Ulhøi.
Carlsberg Semper Ardens Grant Program.
What Social Robotcs Can and Should Do–Towards Integrative Social Robotics.
Aarhus University, Denmark