Enabling Technologies for Autonomous Vehicles Sanjiv Nanda, VP Technology Qualcomm Research August 2017 Qualcomm Research Teams in Seoul, Amsterdam, Bedminster NJ, Philadelphia and San Diego
2
Delivering significant economic and societal impact Total potential economic impact of over $1 Trillion USD per year 1 Fewer driving fatalities/injuries More predictable, productive travel Less greenhouse gas emissions >1.2M 3.1B 14% Save Lives Save Time Save Energy people die each year on the roads worldwide 2 gallons of fuels wasted due traffic congestion in the US 3 of all global warming emissions from transportation 4 Vision Zero: End traffic deaths and serious injuries by 2030 1 Rocky Mountain Institute 2016; 2 Global Status Report on Road Safety, World Health Organization 2015; 3 Texas Transportation Institute Urban Mobility Report, 2015; 4 U.S, Environmental Protection Agency (EPA) 2014 3
Autonomous Vehicles and Mobility as a Service Pace of Innovation, Multiple forces of Disruption Automakers & Tier 1 s Vehicle Fleet Providers Technology Innovation (Autonomous Vehicle) Business Model Innovation (Mobility as a Service) Autonomy Technology Providers Vehicle Ownership 4
Perception Diverse Sensing Modalities 5
360 Perception On-board Sensors Camera, Radar and Lidar Cocoon V2N V2P V2V Radar Computer Vision V2I 6
Perception Beyond the Sensory Horizon HD Maps and V2X Provide Side Information V2N V2P V2V Radar Computer Vision V2I Improved active safety Provides 360 non-line-of-sight awareness, e.g. intersections/on-ramps, environmental conditions Better traffic efficiency Allows vehicles to safely drive closer to each other and enables optimization of overall traffic flow Increased situational awareness Provides ability to gather data from further ahead to deliver a more predictable driving experience 7
Perception Beyond the Sensory Horizon 8
HD Maps Access to rich, accurate up-to-date HD Maps will be key to Autonomous Driving HD Map Semantic Information Examples Lane attributes Lane direction of travel Lane speed limit Lane transition status Lane type Lane boundary attributes Lane boundary traversal Lane marking color Lane marking style Lane marking material Conditions Access restriction condition Direction of travel condition Semantic Information Lane attributes, direction /access restrictions, merges etc Localization information 6 DOF pose and precise coordinates of signs and other landmarks Qualcomm Technologies, Inc. Crowdsourced creation and update of HD maps Triangulation & Bundle adjustment GPSS/GNSS + VIO + Map Fusion Sub-meter accuracy at 95 th percentile 9
Precise Positioning: Lane Level Accuracy 10
Prediction and Planning Road World Model: Static and Dynamic Objects, Drivable Space, Road Semantics 11
Data Management Terabytes of data per day; Peta-scale data management Discard Lidar Cameras Radars Validation Annotation Yes Drive Route Spec Data Capture Capture (Online Triggers) Storage Training/ Validation External Dataset Offline Pre- Processing Data Processing Reduction Data Extraction Testing/ Visualization Simulated Dataset 12
Product Platform The Autonomy Brain Next Generation Compute Platform 100x performance compared to smartphones high throughput sensor processing; sensor fusion; computer vision; machine learning / deep learning; path planning Within a tight power/thermal budget Meeting security & functional safety requirements Road World Model and Path Prediction Perception Positioning Planning SW Architecture Toolchains, libraries, SDK RTOS Camera Front-Facing Mono/Stereo /Trifocal Surround Algorithms: CV, ML, Fusion L I D A R HMI and Control Fusion HW Architecture High Performance Data Handling & Compute within Thermal Envelope HW Accelerators RADAR Short-range Long-range Phased Array Ultrasound V2X (V2V, V2I, V2P, V2N) Sensors GNSS IMU Driver Monitoring Infrastructure Functional Safety Fault Tolerance Timing Synchronization Camera HD MAP 13
Functional Safety Addressed at a System Level Sensing and Algorithms Motion Control Hardware Massive Sensing Diversity, Fusion Fail Operational Redundancy, Reliability, Diagnostics, Self Test Software & Security Testing Process and Audits, Certificates Safety Standards, Test Specs, Emulation and Drive Tests 14
WARNING Challenges, Innovation and Disruption Ahead Leading to and Era of Safe, Efficient and Green Transportation Thank you for your kind attention! 15