Regulating Highly Automated Robot Ecologies: Insights from Three User Studies

Similar documents
AUTONOMY AND SMART URBAN MOBILITY

Global Perspectives of ITS

Simulation-based Transportation Optimization Carolina Osorio

Prototyping Collision Avoidance for suas

How innovations could shape our urban transportation projects?

Technical and Legal Challenges for Urban Autonomous Driving

DESIGN OF SIMULATION TECHNIQUES FOR DATA PREDICTION IN PUBLIC TRANSPORTATION GREGORIUS VIKO & FRISKA NATALIA FERDINAND

AGENT-BASED MODELING, SIMULATION, AND CONTROL SOME APPLICATIONS IN TRANSPORTATION

GOVERNMENT STATUS REPORT OF JAPAN

Consequences of vehicle automatization. Aspects from a transportation science perspective. Benjamin Kickhöfer. DLR Institute of Transport Research

ENGINEERING FOR HUMANS STPA ANALYSIS OF AN AUTOMATED PARKING SYSTEM

Modelling Shared Mobility in City Planning How Transport Planning Software Needs to Change ptvgroup.com

Intelligent Mobility for Smart Cities

Financial Planning Association of Michigan 2018 Fall Symposium Autonomous Vehicles Presentation

Rule-based Integration of Multiple Neural Networks Evolved Based on Cellular Automata

An Innovative Approach

Multi-agent systems and smart grid modeling. Valentin Robu Heriot-Watt University, Edinburgh, Scotland, UK

PEAK DEMAND MANAGEMENT IN NEW ENGLAND A DYNAMIC SOLUTION TO MANAGING PEAK DEMAND CHARGES

National Grid New Energy Solutions (NES)

New Mobility Services: Advanced Journey Planners

AUTOMATED TRANSIT NETWORKS

Autonomous inverted helicopter flight via reinforcement learning

MEMS Sensors for automotive safety. Marc OSAJDA, NXP Semiconductors

Autonomous cars navigation on roads opened to public traffic: How can infrastructure-based systems help?

Electric Vehicle Strategy MPSC Technical Conference February 20, 2018

Intelligent Vehicle Systems

PEVs, Charging Corridors, and DOE Analysis. Jacob Ward, Program Manager, Analysis U.S. Department of Energy

ebook 5 Ways to Optimize Your Fleet

Bridging the Automated Vehicle Gap: Consumer Trust, Technology and Liability

Automated Driving - Object Perception at 120 KPH Chris Mansley

Ensuring the safety of automated vehicles

Supervised Learning to Predict Human Driver Merging Behavior

Modelling disruptions in mobility a BP perspective BP p.l.c.

Smart Grids from the perspective of consumers IEA DSM Workshop

FIVE WAYS TO OPTIMIZE YOUR FLEET WITH GPS TRACKING

Grid Impacts of Variable Generation at High Penetration Levels

IMPACT OF AUTOMATED HIGHWAY SYSTEMS ON INTELLIGENT TRANSPORTATION SYSTEMS RESEARCH.

Disruptive Technology and Mobility Change

Optimal Vehicle to Grid Regulation Service Scheduling

Autonomous Vehicles. Conceição Magalhães 3 rd AUTOCITS workshop, October 10 th, Infrastructure Overview

Smart Control of Low Voltage Grids

Smart Cities Industry, Technology and Citizens. December 2017 Dr. Fritz Rettberg

Naturalistic Experiment to Simulate Travel Behavior Implications of Self-Driving Vehicles: The Chauffeur Experiment

Transportation Highway Engineering Conference February 24, 2015

The deployment of public transport innovation in European cities and regions. Nicolas Hauw, Polis

July 24, Rhode Island Transportation Innovation Partnership AUTONOMOUS VEHICLE MOBILITY CHALLENGE

POWER, PARALLEL AUTONOMY, AND PEOPLE Gill Pratt CEO at Toyota Research Institute GTC 2016

Investigating two-wheeler balance using experimental bicycles and simulators

Online Learning and Optimization for Smart Power Grid

The Future Sustainable Energy System Synergy between industry, researchers and students as a key to an efficient energy system transformation

Large Sample Ecodriving Experiment Preliminary Results

EVOLUTION OF MOBILITY: AUTONOMOUS VEHICLES

JUNIPER DAY. 16 октября 2018 Москва

Distributed Generation and the Importance of the Electric Power Grid

Security for the Autonomous Vehicle Identifying the Challenges

No Longer Science Fiction: The Risks and Rewards of Autonomous Vehicles FOR010

PUBLIC TRANSPORTATION AS THE

REEML. Flicking the Switch: Retail Demand-Side Response under Alternative Electricity Pricing Contracts. IRLE May 21, Tim Capon Taylor Smart 13

Political Forum. ClassNK s perspective on regulatory developments Low sulphur fuels & Ship digitalization

Laird Thermal Systems Application Note. Cooling Solutions for Automotive Technologies

Modeling, Design, and Control of Hybrid Energy Systems and Wireless Power Transfer systems

HPC and the Automotive Industry

Why mobility, why now?

The pathway to self-driving vehicles: Disconnects between human capabilities and advanced vehicle systems?

CSE 352: Self-Driving Cars. Team 14: Abderrahman Dandoune Billy Kiong Paul Chan Xiqian Chen Samuel Clark

Enabling Technologies for Autonomous Vehicles

FRAUNHOFER INSTITUTE FOR SOLAR ENERGY SYSTEMS ISE

ABB Innovation & Technology Day

PS 0500: Economic Sanctions. William Spaniel

AGENT-BASED MICRO-STORAGE MANAGEMENT FOR THE SMART GRID. POWER AGENT: Salman Kahrobaee, Rasheed Rajabzadeh, Jordan Wiebe

The Way Forward for Self Driving Cars

Efficiency Matters for Mobility. Presented at A3PS ECO MOBILITY 2018 Vienna, Austria November 12 th and 13 th, 2018

The Bergen region is at the forefront of developing smart transport solutions

WESTERN INTERCONNECTION TRANSMISSION TECHNOLGOY FORUM

Power distribution: contributing to the European energy transition

The digitalization of the energy system will computers take over? Michael Weinhold CTO Siemens Energy Management

The deployment of public transport innovation in European cities and regions. Nicolas Hauw, Polis

Connected Vehicles and Emergency Responder Technologies

REALIZING INCREASED GRID CAPACITY FOR HIGH PENETRATION OF RENEWABLE GENERATION. TechAdvantage 2015 Orange Country Convention Center Orlando, FL

AUDI URBAN PARTNERSHIP

Predicted response of Prague residents to regulation measures

Problem Definition Review

Fostering Peer Interaction to Save Energy

March 18, Samira Monshi Seungwon Noh Wilfredo Rodezno Brian Skelly

Share with the GHSEA. Smart Energy Initiatives. Collaboration and a partner eco-system to achieve results

BROCHURE. End-to-end microgrid solutions From consulting and advisory services to design and implementation

Traffic Data Services: reporting and data analytics using cellular data

AUTONOMOUS CARS: TECHNIQUES AND CHALLENGES

March 2, 2017 Integrating Transportation Planning, Project Development, and Project Programming

Planning for AUTONOMOUS VEHICLES. Presentation on the planning implications of self-driving vehicles. by Ryan Snyder Transportation Planning Expert

Elektromobilität im Spannungsfeld von Smart Grids

Cooperative Autonomous Driving and Interaction with Vulnerable Road Users

Online Learning and Optimization for Smart Power Grid

ERDF an actor in RTE "IPES" PROJECT for insertion of MV wind generation in the French Electrical System Operation.

Discovery of Design Methodologies. Integration. Multi-disciplinary Design Problems

INCREASING ENERGY EFFICIENCY BY MODEL BASED DESIGN

PORTUGUESE NETWORK FOR C-ITS

Autonomous vehicles: potential impacts on travel behaviour and our industry

Andrey Berdichevskiy, World Economic Forum. Future of Urban and Autonomous Mobility: Bringing Autonomy On and Beyond the Streets of Boston

Smart Grid Research in a Danish Perspective

Transcription:

Regulating Highly Automated Robot Ecologies: Insights from Three User Studies Wen Shen (UC, Irvine) Alanoud Al Khemeiri (Masdar Institute) Abdulla Almehrzi (Masdar Institute) Wael Al Enezi (Masdar Institute) Iyad Rahwan (MIT) Jacob W. Crandall (BYU)

Human Societies How do we achieve good human societies?

Human Societies How do we achieve good human societies? Strong central authority vs. strong individual rights

Societies of Robots? Self-driving cars Robotic buildings connected via a smart grid Financial Markets

Societies of Robots? Self-driving cars Robotic buildings connected via a smart grid Financial Markets Strong central authority vs. strong individual rights

Highly Automated Robot Ecologies Society of robots or systems Robots are independent owned by different stakeholders Robots are autonomous (from the perspective of the regulator)

Highly Automated Robot Ecologies Society of robots or systems Robots are independent owned by different stakeholders Robots are autonomous (from the perspective of the regulator) How can such systems be designed to produce good societal outcomes?

HARE are like what?

HARE are like what? Supervisory control systems

HARE are like what? Supervisory control systems

HARE are like what? Supervisory control systems Human Society

HARE are like what? Supervisory control systems Human Society

HARE are like what? Supervisory control systems Human Society Mechanism design problem

HARE are like what? Supervisory control systems Human Society Mechanism design problem

Challenge: Design efficient HARE 2 design parameters Regulatory power Robot autonomy (adaptability)

Example: Routing Game 60 B 75 A 40 40 D 60 75 C 300

Example: Routing Game 60 B 75 A 40 40 D 60 75 C 300 Vij = f (Nij, Cij)

Example: Routing Game 60 B 75 A 40 40 D 60 75 C 300 Vij = f (Nij, Cij) # of vehicles on link i-j

Example: Routing Game 60 B 75 A 40 40 D 60 75 C 300 Vij = f (Nij, Cij) # of vehicles on link i-j capacity of link i-j

Example: Routing Game 60 B 75 A 40 40 D 60 75 C 300 V ij / 1 1+e 0.25(N ij C ij ) +0.1

Example: Routing Game A 60 40 C B 40 60 75 75 D Regulator s Goal: Maximize throughput through node D 300 V ij / 1 1+e 0.25(N ij C ij ) +0.1

Example: Routing Game A 60 40 C B 40 60 75 75 D Regulator s Goal: Maximize throughput through node D 300 V ij / 1 1+e 0.25(N ij C ij ) +0.1 Needs to remove traffic congestion

Robot Behaviors

Robot Behaviors u(i,g)=v(g) c t (i,g) c $ (i,g) was the utility for arriving at dest

Robot Behaviors u(i,g)=v(g) c t (i,g) c $ (i,g) was the utility for arriving at dest Value of getting to node g

Robot Behaviors u(i,g)=v(g) c t (i,g) c $ (i,g) Value of getting to node g was the utility for arriving at dest Travel Cost

Robot Behaviors u(i,g)=v(g) c t (i,g) c $ (i,g) Value of getting to node g was the utility for arriving at dest Travel Cost Toll Cost

Robot Behaviors u(i,g)=v(g) c t (i,g) c $ (i,g) Value of getting to node g was the utility for arriving at dest Travel Cost Toll Cost Robot Autonomy (2 levels)

Robot Behaviors u(i,g)=v(g) c t (i,g) c $ (i,g) Value of getting to node g was the utility for arriving at dest Travel Cost Toll Cost Robot Autonomy (2 levels) Simple Estimate ct(i,g) assuming no congestion

Robot Behaviors u(i,g)=v(g) c t (i,g) c $ (i,g) Value of getting to node g was the utility for arriving at dest Travel Cost Toll Cost Robot Autonomy (2 levels) Simple Estimate ct(i,g) assuming no congestion Adaptive Estimate ct(i,g) using reinforcement learning

Regulatory Power Regulator s ability to change tolls

Regulatory Power Regulator s ability to change tolls 3 levels

Regulatory Power Regulator s ability to change tolls 3 levels None Regulator can do nothing

Regulatory Power Regulator s ability to change tolls 3 levels None Regulator can do nothing Limited Regulator can make limited toll changes

Regulatory Power Regulator s ability to change tolls 3 levels None Regulator can do nothing Limited Regulator can make limited toll changes Unlimited Regulator can make unlimited toll changes

Experimental Setup Regulatory Power Algorithmic Sophistication Simple Adaptive None Limited Unlimited Which one will be best?

Outcome Simple automation Adaptive automation 100 90 % Optimal Throughput 80 70 60 50 40 30 20 10 0 None Limited Unlimited Regulatory Power

Outcome Simple automation Adaptive automation 100 90 % Optimal Throughput 80 70 60 50 40 30 20 Algorithmic Sophistication Adaptive Regulatory Power None Limited Unlimited Simple 6 1 T2 T4 T4 T2 10 0 None Limited Unlimited Regulatory Power

Why Simple-Unlimited? Toll Adjustments ( per second) 2.5 2.0 1.5 1.0 0.5 Simple automation Adaptive automation Algorithm Vehicle Type Node Preference 12 8 4 0 12 8 4 Simple automation Adaptive automation 0.0 Limited Unlimited 0 Limited Unlimited Regulatory Power Regulatory Power (a) (b)

Why Simple-Unlimited? Toll Adjustments ( per second) 2.5 2.0 1.5 1.0 0.5 Simple automation Adaptive automation Algorithm Vehicle Type Node Preference 12 8 4 0 12 8 4 Simple automation Adaptive automation 0.0 Limited Unlimited 0 Limited Unlimited Regulatory Power Regulatory Power (a) (b) Given Unlimited Power, Regulators used power they didn t need

Why Simple-Unlimited? Toll Adjustments ( per second) 2.5 2.0 1.5 1.0 0.5 Simple automation Adaptive automation Algorithm Vehicle Type Node Preference 12 8 4 0 12 8 4 Simple automation Adaptive automation 0.0 Limited Unlimited 0 Limited Unlimited Regulatory Power Regulatory Power (a) (b) Given Unlimited Power, Regulators used power they didn t need

Why Simple-Unlimited? Toll Adjustments ( per second) 2.5 2.0 1.5 1.0 0.5 Simple automation Adaptive automation Algorithm Vehicle Type Node Preference 12 8 4 0 12 8 4 Simple automation Adaptive automation 0.0 Limited Unlimited 0 Limited Unlimited Regulatory Power Regulatory Power (a) (b) Given Unlimited Power, Regulators used power they didn t need Regulators had poorer models of robot behavior

Why Simple-Unlimited? Toll Adjustments ( per second) 2.5 2.0 1.5 1.0 0.5 Simple automation Adaptive automation Algorithm Vehicle Type Node Preference 12 8 4 0 12 8 4 Simple automation Adaptive automation 0.0 Limited Unlimited 0 Limited Unlimited Regulatory Power Regulatory Power (a) (b) Simple automation was easier to model

Automated Help B A D C

Automated Help Predict when the congestion will occur B A D C

Automated Help Predict when the congestion will occur Alert the regulator of predicted congestion B A D C

Automated Help Predict when the congestion will occur Alert the regulator of predicted congestion B A D C

Outcome Forecasting Yes No % Optimal Throughput 100 90 80 70 60 50 40 30 20 10 0 Simple automation Adaptive automation Limited Unlimited Limited Unlimited Regulation

Outcome Forecasting Yes No % Optimal Throughput 100 90 80 70 60 50 40 30 20 10 0 Simple automation Adaptive automation Limited Unlimited Limited Unlimited Regulation

Outcome Forecasting Yes No % Optimal Throughput 100 90 80 70 60 50 40 30 20 10 0 Simple automation Adaptive automation Limited Unlimited Limited Unlimited Regulation Decision support made Simple-Limited worse!

Outcome Forecasting Yes No % Optimal Throughput 100 90 80 70 60 50 40 30 20 10 0 Simple automation Adaptive automation Limited Unlimited Limited Unlimited Regulation Decision support made Simple-Limited worse! Why? Regulators had a poorer model of the cars.

Toward a General Theory 3 Forces : Adaptive robots -> Regulator must spend more time modeling Adaptive robots -> Regulators need more regulatory power More regulator power -> Decreased time modeling robots

Conclusions and Future Work

Conclusions and Future Work Data points that suggest less is more

Conclusions and Future Work Data points that suggest less is more Limited regulator power with simple robots produced the best results

Conclusions and Future Work Data points that suggest less is more Limited regulator power with simple robots produced the best results Just outliers? Or part of a general trend?

Conclusions and Future Work Data points that suggest less is more Limited regulator power with simple robots produced the best results Just outliers? Or part of a general trend? Can we find a way to do more with more?

Extras

Time Elapsed! Game length = 25 min Traffic Indicator Toll Adjustment Displayed after the! game was completed