Will robots drive our cars soon?

Transcription

1 Will robots drive our cars soon? Driver assistant systems with FPGA und DSP Felix Eberli, Department Head, SCS Vision trifft Realität. Supercomputing Systems AG Phone Technopark 1 Fax Zürich

2 Futuristic ideas already Zürich by Supercomputing Systems AG PUBLIC

3 Driverless car in the 1980 s 3 Zürich by Supercomputing Systems AG PUBLIC

4 DARPA Challenge 11.9km after start (5%) 4 Zürich by Supercomputing Systems AG PUBLIC

5 DARPA Urban Challenge Zürich by Supercomputing Systems AG PUBLIC

6 Mercedes Benz Versuchsfahrzeug 2013 S-500 Bertha 6 Zürich by Supercomputing Systems AG PUBLIC

7 Google car with laserscanner (2014) 7 Zürich by Supercomputing Systems AG PUBLIC

8 Tesla Auto Pilot (2015) 8 Zürich by Supercomputing Systems AG PUBLIC

9 Will robots drive our cars soon? 9 Zürich by Supercomputing Systems AG PUBLIC

10 But already in series as many driver assistant systems ADC (Distronic) Blind spot detection Break assist Pedestrian detection Park pilot Stop & Go Pilot Highway Pilot. Lets see 10 Zürich by Supercomputing Systems AG PUBLIC

11 Sensor View Radar and Stereo 13 Zürich by Supercomputing Systems AG PUBLIC

12 SCS company profile Founded 1993 and privately owned by Prof. Dr. Anton Gunzinger 90+ employees: Electrical engineers Software engineers Physicists Mathematicians Company offices at Technopark Zurich, Switzerland 16 Zürich by Supercomputing Systems AG PUBLIC

13 SCS Services Departments Embedded & Automotive Life Science / Medical High Performance Safety Embedded High Performance Computing SW / Public Transport SW / Broadcast Measure & Decide Embedded & Automotive Feasibility studies Hardware (Specification, Design, Schematics, Layout, Production) Firmware/IP (FPGA, DSP) Software (Drivers, Host SW Windows/Linux) Optimizations (ARM, DSP, EVE, Neon) 17 Zürich by Supercomputing Systems AG PUBLIC

14 SCS Embedded & Automotive Department 18 Zürich by Supercomputing Systems AG PUBLIC

15 Why autonomous driving? - Traffic Must Become Safer Injured/ Year Fatalities / Year % of all accidents with injured occur in urban environments. CH: 269 fatalities in Zürich by Supercomputing Systems AG PUBLIC

16 The Principle of Stereo Vision Disparity Image Left Image Right Image Challenge: on-line calibration to guarantee perfect results for the whole lifetime of the car. Color encoded distance: close.. far H.Hirschmüller: "Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information", DAGM 2005, CVPR Zürich by Supercomputing Systems AG PUBLIC

17 The Principle of Stereo Vision 2008 world-wide first real-time implementation of Semi-Global Matching on an automotive compliant FPGA S.Gehrig, F.Eberli, T.Meyer, A Real-time Low-Power Stereo Vision Engine Using Semi-Global Matching, ICVS 2009 (Best Paper Award) 32 Zürich by Supercomputing Systems AG PUBLIC

18 Local Stereo vs. Daimler Global Stereo Advantages of Daimler-Stereo Semi-Global Matching (SGM) Significantly more 3D measurents Significantly fewer Measurement errors in low-contrast regions robust against periodic structures Color encoded distance: close.. far Correlation SGM 33 Zürich by Supercomputing Systems AG PUBLIC

19 Stereo Results in Real-Time Baseline 25cm, 45 horizontal field of view Color encoded distance: close.. far 34 Zürich by Supercomputing Systems AG PUBLIC

20 Sensors in Modern Cars 44 Zürich by Supercomputing Systems AG PUBLIC

21 Comparison Tesla Daimler Sensors (2014) 45 Zürich by Supercomputing Systems AG PUBLIC

22 Is Stereo-Based Driver Assistance a Solved Problem? If we want Vision to become an all-day all-night sensor for safety critical systems, we should be able to work under those adverse conditions! 66 Zürich by Supercomputing Systems AG PUBLIC

23 Current research focuses on a deeper understanding of the scene 90 Zürich by Supercomputing Systems AG PUBLIC

24 Outlook Self Driving Cars Additional Links BMW kündigt selbstlenkende Fahrzeuge für 2021 an Sieben Firmen testen zurzeit selbstlenkende Autos auf Kaliforniens Straßen Mercedes Future Truck 2025 Chris Urmson Google Director Self-Driving-Cars 91 Zürich by Supercomputing Systems AG PUBLIC

25 Aktuele Ankündigungen 92 Zürich by Supercomputing Systems AG PUBLIC

26 Baby you can drive my car Source: 93 Zürich by Supercomputing Systems AG PUBLIC

27 SCS Stereo Vision Evaluation Plattform 96 Zürich by Supercomputing Systems AG PUBLIC

28 Output of the SCS Stereo Vision Evaluation Plattform More info: 97 Zürich by Supercomputing Systems AG PUBLIC

29 Example measurement accuracy 3: Distance measured = m +/ m (Baselength = 25cm) 98 Zürich by Supercomputing Systems AG PUBLIC

30 Supercomputing Systems AG Vision meets reality. Supercomputing Systems AG Phone Technopark 1 Fax Zürich