【机器人系列】doweneedrobotmorality课件

1,Do we need robot morality?,WHAT IS INTELLIGENCE?,Pragmatic definition of intelligence: “an intelligent system is a system with the ability to act appropriately (or make an appropriate choice or decision) in an uncertain environment.” An appropriate action (or choice) is that which maximizes the probability of successfully achieving the mission goals (or the purpose of the system) Intelligence need not be at the human level,Human-Robot Interaction,interaction,intelligence,morality,Consciousness?,Robot Morality is a relatively new research area which is becoming very popular because of military and assistive robotics.,WHY ROBOT MORALITY ?,Robots are becoming technically extremely sophisticated. The emerging robot is a machine with sensors, processors, and effectors able to perceive the environment, have situational awareness, make appropriate decisions, and act upon the environment Various sensors: active and passive optical and ladar vision, acoustic, ultrasonic, RF, microwave, touch, etc. Various effectors: propellers, wheels, tracks, legs, hybrids,These robots live in human environment and can harm humans physically.,Military unmanned vehicles are robots Space, air, ground, water,6,Ethical concerns: Robot behavior,How do we want our intelligent systems to behave? How can we ensure they do so? Asimovs Three Laws of Robotics: A robot may not injure a human being or, through inaction, allow a human being to come to harm. A robot must obey orders given it by human beings except where such orders would conflict with the First Law. A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.,7,Ethical concerns: Human behavior,Is it morally justified to create intelligent systems with these constraints? As a secondary question, would it be possible to do so? Should intelligent systems have free will? Can we prevent them from having free will? Will intelligent systems have consciousness? (Strong AI) If they do, will it drive them insane to be constrained by artificial ethics placed on them by humans? If intelligent systems develop their own ethics and morality, will we like what they come up with?,Department of Defense (DOD) PATH TOWARD AUTONOMY,A POTPOURRI OF MILITARY ROBOTS,Many taxonomies have been used for robotic air, ground, and water vehicles: based on size, endurance, mission, user, C3 link, propulsion, mobility, altitude, level of autonomy, etc., etc.,All autonomous future military robots will need morality, household and assistive robots as well,WHICH TECHNOLOGIES ARE RELATED TO ROBOT MORALITY?,Various control system architectures: deliberative, reactive, hybrid Various command, control, and communications systems: cable, fiber optic, RF, laser, acoustic Various human/machine interfaces: displays, telepresence, virtual reality Various theories of intelligence and autonomy; Evolutionary Probabilistic Learning Developmental Cognitive,Can we build morality without intelligence?,The Tokyo University of Science: Saya,Morality for non-military robots that deal directly with humans.,13,Robots that look human,“Robots that look human tend to be a big hit with young children and the elderly,“ Hiroshi Kobayashi, Tokyo University of Science professor and Sayas developer, said yesterday. “Children even start crying when they are scolded.“,14,Human-Robot Interaction with human-like humanoid robots,“Simply turning our grandparents over to teams of robots abrogates our societys responsibility to each other, and encourages a loss of touch with reality for this already mentally and physically challenged population, Kobayashi said.,15,Can robots replace humans?,Noel Sharkey, robotics expert and professor at the University of Sheffield, believes robots can serve as an educational aid in inspiring interest in science, but they cant replace humans.,16,Robot to help people? /english/2009-03/12/content_10995694.htm,Kobayashi says Saya is just meant to help people and warns against getting hopes up too high for its possibilities. “The robot has no intelligence. It has no ability to learn. It has no identity,“ he said. “It is just a tool.,Receptionist robots,18,Receptionist,19,MechaDroyd Typ C3 Business Design, Japan,What kind of morality we expect from: Robot for disabled? Receptionist robot? Robot housemaide? Robot guide ?,20,Human Robot Interaction: Robots for elderly in Japan,21,Jobs for robots /article/idUKT27506220080408,TOKYO (Reuters) - Robots could fill the jobs of 3.5 million people in graying Japan by 2025, a thinktank says, helping to avert worker shortages as the countrys population shrinks.,22,Robots to fill jobs in Japan,Japan faces a 16 percent slide in the size of its workforce by 2030 while the number of elderly will mushroom, the government estimates, raising worries about who will do the work in a country unused to, and unwilling to contemplate, large-scale immigration.,23,HR-Interaction in Japan,The thinktank, the Machine Industry Memorial Foundation, says robots could help fill the gaps, ranging from microsized capsules that detect lesions to high-tech vacuum cleaners.,Robots to fill jobs in Japan,24,HR-Interaction in Japan,Rather than each robot replacing one person, the foundation said in a report that robots could make time for people to focus on more important things.“,Robots to fill jobs in Japan,25,What is more important than work?,What kind of more important things“? This is an ethical question.,26,using robots that monitor the health of older people in Japan,Japan could save 2.1 trillion yen ($21 billion) of elderly insurance payments in 2025 by using robots that monitor the health of older people, so they dont have to rely on human nursing care, the foundation said in its report.,Plans for robot nursing in Japan,What are the consequences for relying on robot nursing? This is an ethical question.,Assistive Robots,Caregivers would save more than an hour a day if robots: helped look after children, helped older people, did some housework reading books out loud helping bathe the elderly,How children and elderly will respond?,How will children and elderly react to robots taking care“ of them? This is an ethical question.,Seniors in Japan,“Seniors are pushing back their retirement until they are 65 years old, day care centers are being built so that more women can work during the day, and there is a move to increase the quota of foreign laborers. But none of these can beat the shrinking workforce,“ said Takao Kobayashi, who worked on the study.,HR-Interaction in Japan,“Robots are important because they could help in some ways to alleviate such shortage of the labor force.“,Seniors in Japan,HR-Interaction in Japan,How far will they alleviate such shortage of the labor force? And with what consequences? This is an ethical question.,Seniors in Japan,HR-Interaction in Japan,Kobayashi said changes was still needed for robots to make a big impact on the workforce. “Theres the expensive price tag, the functions of the robots still need to improve, and then there are the mindsets of people,“ he said. “People need to have the will to use the robots.“,Seniors in Japan,HR-Interaction in Japan,The mindsets of people“: This is THE ethical question!,Seniors in Japan,Entertainment robots,First robots in Entertainment,Neologism derived from Czech noun “robota“ meaning “labor“ Contrary to the popular opinion, not originated by (but first popularized by) Karel Capek, the author of RUR Originated by Josef Capek, Karels older brother (a painter and writer) “Robot” first appeared in Karel Capeks play RUR, published in 1920 Some claim that “robot“ was first used in Josef Capeks short story Opilec (the Drunkard) published in the collection Lelio in 1917, but the word used in Opilec is “automat“ Robots revolt against their human masters a cautionary lesson now as then,WHAT IS A ROBOT?,Many taxonomies Control taxonomy Pre-programmed (automatons) Remotely-controlled (telerobots) Supervised autonomous Autonomous Operational medium taxonomy Space Air Ground Sea Hybrid Functional taxonomy Military Industrial Household Commercial Etc.,Entertainment http:/www.thepartypups.co/,Sony: Aibo,Football,RoboCup,Love robots“ in Japan /2007/08/12/lovecom-18/,EMA (Eternal Maiden Actualization) in Japan /technology_robot_girlfriend.php,What kind of intelligence and morality you would expect from an ideal robot for entertainment?,Why Ethics of Robots?,Why Ethics of Robots?,Robots behave according to rules we program We are responsible for their behavior But as they are autonomous“ they can decide“ what to do or not in a specific situation This is the human/robot moral dilemma,Ethics of Robots: West and East,Rougly speaking: Europe: Deontology (Autonomy, Human Dignity, Privacy, Anthropocentrism): Scepticism with regard to robots USA (and anglo-saxon tradition): Utilitarian Ethics: will robots make us“ more happy? Eastern Tradition (Buddhism): Robots as one more partner in the global interaction of things,Ethics & Robots: West and East,Morality and Ethics: Ethics as critical reflection (or problematization) of morality Ethics is the science of morals as robotics is the science of robots,Concrete moral traditions,Different ontic or concrete historical moral traditions, for instance in Japan: Seken (trad. Japanese morality), Shakai (imported Western morality) Ikai (old animistic tradition) In the Far West“: Ethics of the Good (Plato, Aristotle), Christian Ethics, Utilitarian Ethics, Deontological Ethics (Kant),Ethics & Robots: Ontological Dimensions,Ontological dimension: Being or (Buddhist) Nothingness as the space of open possibilities that allow us to critizise ontic moralities Always related to basic moods (like sadness, happiness, astonishment, ) through which the uniqueness of the world and human existence is experienced (differently in different cultures),Asimos evolution http:/www.rob.cs.tu-bs.de/teaching/courses/seminar/Laufen_Mensch_vs_Roboter/,Asimos evolution http:/www.rob.cs.tu-bs.de/teaching/courses/seminar/Laufen_Mensch_vs_Roboter/,If the robot looks like a human, do we have different expectations?,Would you “kill” a robot car?,Would you “kill” a robot insect that would react by squeaky noises and escape in panic?,Would you “kill” a robot biped that would react by begging you to save his life?,Why Ethics of Robots?,Why Ethics of Robots?,Ethics is thinking about human rules of good/bad behavior: Towards each other Towards non-human living beings Towards the environment Towards artificial products Towards other societies or nations Towards the God or gods, culture-depending,AA versus AC versus AE versus AI?,Artificial Agency (AA) Artificial Consciousness (AC) Artificial Ethics (AE) Artificial Intelligence our interaction with them; and our ethical relation to them.,ARTIFICIAL CONSCIOUSNESS,Artificial X,One kind of definition-schema: Creating machines which perform in ways which require X when humans perform in those ways (or which justify the attribution of X?) Outward performance, versus psychological reality within?,X= Intelligence, = Life, = Morality, etc.,Artificial Consciousness,Artificial Consciousness (AC): creating machines which perform in ways which require consciousness when humans perform in those ways (?) Where is the psychological reality of consciousness in this? functional versus phenomenal consciousness?,Shallow and deep AC research,Shallow AC developing functional replications of consciousness in artificial agents Without any claim to inherent psychological reality Deep AC developing psychologically real (phenomenal) consciousness,Continuum or divide?,Continuum or divide? (discrete or analog?) Is deep AC realizable using current computationally-based technologies (or does it require biological replications)? Will it require Quantum Computing or biology-like computing? Thin versus thick phenomenality (See S.Torrance Two Concepts of Machine Phenomenality, (to be submitted, JCS),Real versus simulated AC - an ethically significant boundary?,Psychologically real versus just simulated artificial consciousness - This appears to mark an ethically significant boundary (perhaps unlike the comparable boundary in AI?) Not to deny that debates like the Chinese Room have aroused strong passions over many years Working in the area of AC (unlike working in AI?) puts special ethical responsibilities on shoulders of researchers,Techno-ethics,This takes us into the area of techno-ethics Reflection on the ethical responsibilities of those who are involved in technological R & D (including the technologies of artificial agents (AI, robotics, MC, etc.) Broadly, techno-ethics can be defined as: Reflection on how we, as developers and users of technologies, ought to use such technologies to best meet our existing ethical ends, within existing ethical frameworks Much of the ethics of artificial agent research comes under the general techno-ethics umbrella,From techno-ethics to artificial ethics,Whats special about the artificial agent research is that the artificial agents so produced may count (in various senses) as ethical agents in their own right This may involve a revision of our existing ethical conceptions in various ways Particularly when we are engaged in research in (progressively deeper) artificial consciousness Bearing this in mind, we need to distinguish between techno-ethics and artificial ethics (The latter may overlap with the former),Techno-ethics our responsibility for our creations,Artificial ethics what ethics we will put to future robots,ARTIFICIAL ETHICS,Towards artificial ethics (AE),A key puzzle in AE Perhaps ethical reality (or real ethical status) goes together with psychological reality?,Can a robot be ethical if he is not psychologically similar to you?,Shallow and deep AE,Shallow AE Developing ways in which the artificial agents we produce can conform to, simulate, the ethical constraints we believe desirable (Perhaps a sub-field of techno-ethics?) Deep AE Creating beings with inherent ethical status? Rights of robots, rights of human “owners” of robots? Responsibilities of robots, responsibilities of humans towards robots? The boundaries between shallow and deep AE may be perceived as fuzzy And may be intrinsically fuzzy,You do not want your robot to hurt humans (or other robots?),Proliferation of new technologies in the world,A reason for taking this issue seriously: AA, AC, etc. as potential mass-technologies Tendency for successful technologies to proliferate across the globe What if AC becomes a widely adopted technology? This should raise questions both: of a techno-ethical kind; and of a kind specific to AE,Every body would like to have a robot slave. Every educated/rich roman had a slave Every professor in 19 century had a maid.,Instrumentality,Instrumental versus intrinsic stance Normally we take our technologies as our tools or instruments Instrumental/intrinsic division in relation to psychological reality of consciousness? As we progress towards deep AC there could be a blurring of the boundaries between the two (already seen in a small way with emerging caring attitudes of humans towards people-friendly robots) This is one illustration of the move from conventional techno-ethics and artificial ethics,Instrumental robot is just a device,Intrinsic if an old lady has a robot that she loves, her children cannot just throw the old robot to the garbage can.,Artificial Ethics (AE),AE could be defined as The activity of creating systems which perform in ways which imply (or confer) the possession of ethical status when humans perform in those ways. (?) The emphasis on performance could be questioned What is the relation between AE and Artificial Consciousness (AC)? What is ethical (moral) status?,Two key elements of moral status of a robot,( Totality of moral agents ),Can robot harm community? Can community harm the robot?,( Totality of moral agents ),( one moral agent ),X is a member of community,Two key elements of Xs moral status (in the eyes of Y),(a) Xs being the recipient or target of moral concern by Y (moral consumption) Y X (b) Xs being the source of moral concern towards Y (moral production) X Y,Ethical status in the absence of consciousness,Trying to refine our conception on the relation between AC and AE What difference does consciousness make to artificial agency? In order to shed light on this question we need to investigate the putative ethical status of artificial agents (AAs) when (psychologically real) consciousness is acknowledged to be ABSENT.,Retired general has a superintelligent robot that does not look like a human and is not psychologically humanoid. Can he dismantle the robot to pieces for fun? Can he shoot at him as he paid for it?,Our ethical interaction with non- conscious artificial agents,? Could non-conscious artificial agents have genuine moral status (a) As moral consumers? (having moral claims on us) (b) As moral producers? (having moral responsibilities towards us (and themselves),The dog or horse that kills a human is ordered by the law to be killed,The robot that kills a human is killed?,?,A Strong View of AE,Psychologically real consciousness is necessary for AAs to be considered BOTH (a)as genuine moral consumers AND (b) as genuine moral producers AND there are strong constraints on what counts as psychologically real consciousness. So, on the strong view, non-conscious AAs will have no real ethical status,The MIT “strong AI researchers” will be now in trouble, explain why?,One way to weaken the strong view: by accepting weaker criteria for what counts as psychologically real consciousness e.g. by saying Of course you need consciousness for ethical status, but soon robots, etc. will be conscious in a psychologically real