Vehicle Integration of multiple ADAS HMI Concept and Architecture Dr. J. Happe, M. Lütz 2. Tagung "Aktive Sicherheit durch Fahrerassistenz" 4. April 2006 Multiple Advanced Driver Assistance Systems Main Topics Architecture/HMI Multiple ADAS in one vehicle Synergy Multiple ADAS with one component Fusion Multiple components for one ADAS 1 vehicle n ADAS 1 component n ADAS 1 ADAS n components System 1 vehicle n components n ADAS Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 2 1
Multiple Advanced Driver Assistance Systems Main Topics 1 Driver HMI Vehicle 2 Synergy Architecture Fusion n Integration HMI Algorithm Component 1 Component 2 System Sensor... ECU Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 3 Questions to be answered for multiple Advanced Driver Assistance Systems () HMI: How many information does the driver need and where do we put it? Architecture: What are the requirements on a network of multiple Advanced Driver Assistance Systems ()? Synergy: How can sensors be used for multiple functions? Fusion: What kind of fusion of different sensors can be made? Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 4 2
Advanced Driver Assistance Systems Profile @ SV Comfort / Rela Driving Pleasure & Fun Driving without stress e.g. LDW, ACC Driving with less fuel consumption, less cost e.g. ACC Stop&Go Driver Enjoy driving, but never leave the limit Driving like on the home course e.g. Sensitive Guidance, Night Vision, Object Detection Economic Driving Orientation & Overview Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 5 Advanced Driver Assistance Systems System Approach Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 6 3
Concept Car System Level System Level 0 multiple System Levels Concept Car System Level 1 complete functionalities including HMI, controlling,... System Level 2 closed sub-functionalities (e.g. Camera & ECU with defined interface) Component Systems which support eclusively functions (e.g. sensors, actuators, displays, lighting,...) Enabler Systems with impact (e.g. brake, steering, display,...) Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 7 Concept Car Serial equipment: Head-up Display Parking Aid Navi-Professional ACC BMW E61 Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 8 4
Concept Car Realized Applications Traffic Jam Assist Traffic Sign Recognition Park Mate Night Vision (FIR) Adaptive Cruise Control SystemConcept HMI Sensitive Guidance Night Vision (NIR) Lane Departure Warning Safe Eit Assist Blind Spot Detection / Lane Change Assist Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 9 Concept Car Selected Sensor Technology Camera Radar Lidar US Others functions HDR Camera (Front) HDR NIR Camera (Front) FIR Camera (Front) Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 10 Short Range Radar 24 GHz UWB (Side) Blind Spot Detection Lane Change Assist Lane Departure Warning Traffic Sign Recognition Park Mate Night Vision (FIR) Night Vision (NIR) Traffic Jam Assist ACC (Lidar based) Sensitive Guidance Safe Eit Assist Short Range Radar 24 GHz NB (Side) Long Range Lidar (Front) Ultrasonic (Side) Digital Map 5
Concept Car Location of Sensor Technology Traffic Jam Assist Traffic Sign Recognition Lane Departure Warning Night Vision (NIR) Adaptive Cruise Control Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 11 System HMI-Concept Reduction of Information information quantity Information flow and quantity Environment Camera Radar/Lidar Information Reduction Vehicle Ultrasonic Sensors Function (ECU) Display CID&HUD Driver information flow Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 12 6
System HMI-Concept Possible Locations for Information Steering wheel and lever: Operation of longitudinal control assistance systems (ACC, JAM) Often used safety and comfort functions TFT Middle console: On/off-buttons for lateral control assistance systems (LDW, LCA, PM) On/off-button for NiVi HUD, instrument cluster and A-pillar: Information related to the primary driving task, e.g. active speed, speed limits, routing information Status of advanced assistance systems, e.g. ACC Information that is often required, e.g. NiVi CID: Information that supports the driving task (e.g. map) Comfort & communication functions Settings Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 13 System HMI-Concept Selected locations for functions Acoustic HMI Visual Haptical functions Acoustic Warning Visual Warning (Icons, LEDs, etc.) Blind Spot Detection Lane Change Assist Lane Departure Warning Traffic Sign Recognition () Park Mate Night Vision (FIR) Night Vision (NIR) Traffic Jam Assist () ACC (Lidar based) () Sensitive Guidance Safe Eit Assist () if HUD is not available Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 14 Display Instrument Cluster HUD CID On/Off Button Vibration Steering Wheel Steering Intervention (Torque) 7
System HMI-Concept Realisation SystemConcept HMI Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 15 Advanced Driver Assistance Systems Summary 8
Summary HMI: Multiple ADAS in one vehicle Problem: Compleity by number of components/adas and their interaction Solution: System HMI-Concept Architecture: Multiple ADAS in one vehicle Problem: Compleity by number of components/adas and their interaction Solution: Framework Fusion: Multiple sensors for one ADAS Problem: Unreliable Information by one sensor Solution: Use of many sensors for one application Synergy: Multiple ADAS with one sensor Problem: Too many sensors => Package, Costs Solution: Use of one sensor for many applications Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 17 Definition and Vision of SV (Advanced Driver Assistance Systems) uses environmental sensing in order to assist the driver in his driving task to increase safety and comfort Assist but not patronize the driver! Siemens VDO Automotive AG 2005 Happe/Lütz SV C RS DA1 2006-04-04 18 9