How to build an autonomous anything

Transcription

1 How to build an autonomous anything Michelle Hirsch Head of MATLAB Product Management MathWorks 2015 The MathWorks, Inc. 1

2 2

3 3

4 4

5 5

6 6

7 7

8 Autonomous Technology 8

9 Autonomous Having the power for self-governance 9

10 Autonomous Technology Provides the ability of a system to act independently of direct human control under unrehearsed conditions 10

11 11

12 Capabilities of an Autonomous System Sense 12

13 Capabilities of an Autonomous System Sense Perceive 13

14 Capabilities of an Autonomous System Sense Perceive Decide & Plan Learning Algorithms Optimization 14

15 Capabilities of an Autonomous System Sense Perceive Decide & Plan Act Control Algorithms 15

16 Autonomous Technology Transfers Responsibility to Computers Responsibility Human Computer Degree of Autonomy 16

17 Cost of rig: >$1M Repair cost: $100,000 Cost of valve: $200 17

18 18

19 19

20 20

21 Autonomous Service for Predictive Maintenance Sense Which sensor values should they use? Vibration Timing Perceive Pressure Temperature Decide & Plan Act Other variables 21

22 Autonomous Service for Predictive Maintenance Sense Perceive Decide & Plan Act Normal Operation Monitor Closely Maintenance Needed 22

23 Machine Learning or Deep Learning? Machine Learning Approach Sensor 1 Sensor 2 Sensor 25 Sensor a Sensor b Sensor c 1. Normal 2. Monitor 3. Maintain Correlation Analysis Feature Extraction Classification Output Deep Learning Approach Sensor 1 Sensor 2 Sensor Normal 2. Monitor 3. Maintain Feature Extraction & Classification Output 23

24 What are the best predictors? Data-driven Model-driven Jet Engine Monitoring 24

25 Bazille s Studio Frederic Bazille (Paris, 1870) Shuffleton s Barbershop Norman Rockwell (Vermont, 1950) 25

26 Bazille s Studio Frederic Bazille (Paris, 1870) Shuffleton s Barbershop Norman Rockwell (Vermont, 1950) 26

27 Autonomous Artistic Style Classification Rutgers University Sense Machine Learning Classification Style Classifier (SVM) Style: Regionalism Perceive Decide & Plan Image Feature Extraction Visual Features Genre Classifier (SVM) Genre: Interior Act Artist Classifier (SVM) Artist: Rockwell 27

28 Where to add autonomy with perception? Analyze more data Reduce bias Reduce variability Save time Improve performance Determine Loudspeaker Quality Virtual Semiconductor Manufacturing Calibration 28

29 Autonomous Glucose Level Management 29

30 Autonomous Glucose Level Management Bigfoot Biomedical Sense + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person Act Continuous Glucose Monitor 30

31 Autonomous Glucose Level Management Bigfoot Biomedical Sense + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 31

32 Autonomous Glucose Level Management Bigfoot Biomedical Sense Simulink, Stateflow, Polyspace + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 32

33 Autonomous Glucose Level Management Bigfoot Biomedical Sense + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 33

34 Autonomous Glucose Level Management Bigfoot Biomedical 2017 Sense Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 34

35 Virtual Clinic Generating data through simulation 35

36 Virtual Clinic Scaling computations to simulate 50 million patients a day 36

37 Where will you get your data? Simulation Public repositories In the lab In the field Internet of Things (IoT) 37

38 CNH Develops Intelligent Filling System for Forage Harvesters 38

39 Autonomous Trailer Filling Sense Perceive Decide & Plan Act Control Algorithms 39

40 Autonomous Trailer Filling Sense Perceive Decide & Plan Act Control Algorithms 40

41 41

42 Autonomous Trailer Filling Sense 3D Cameras Perceive Actuators Decide & Plan CAN Act ECU Computer vision and controls algorithms 42

43 Autonomous Trailer Filling Sense 3D Cameras Vehicle Display Controller Driver Input Visualization Perceive Decide & Plan CAN Actuators Act Computer vision and controls algorithms ECU 43

44 Autonomous Trailer Filling Sense Perceive Decide & Plan 3D Cameras Embedded Coder Vehicle Display Controller CAN Driver Input Visualization Computer Vision Controls Actuators Act Computer vision and controls algorithms ECU 44

45 Autonomous Trailer Filling Sense Perceive Decide & Plan 3D Cameras Vehicle Display Controller CAN Driver Input Visualization Computer Vision Controls Actuators Act Monitoring ECU 45

46 How will you put it into production? Embedded systems Enterprise systems HMIs 46

47 47

48 How to build an autonomous anything Focus on Perception Use the Best Predictors Get the Right Data Go to Production Look for autonomy in creative places Do more than manually possible Data-driven Model-driven Reduce to actionable data Take advantage of Big Data Use simulation to supplement available data Address the architecture Leverage Model-Based Design for embedded Automate integration with enterprise IT systems 48

49 What is your autonomous anything? 49