3-D DeepObject for precision 3-D mapping

Transcription

1 1 3-D DeepObject precision 3-D mapping Bingcai Zhang Tech Fellow ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems BAE BAE Systems. All All Rights Reserved. ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. a general general as the the product(s) product(s) or or service(s) service(s) fered fered by by BAE BAE Systems. Systems. From From time time to to time, time, changes changes may may be be made made in in the the products products or or conditions conditions supply. supply. as as XX/XX/XXXX; consists consists general inmation general inmation that is not that defined is not as defined controlled as controlled technical technical data under data ITAR under Part ITAR Part or EAR Part or EAR 772. Part 772.

2 2 DeepObject architecture ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

3 3 Advantages DeepObject architecture Take full advantage rapid advancements from the deep learning research community Combine with our two decades photogrammetry and 3D computer vision expertise Achieve near human level accuracy in the geospatial intelligence domain Support all types geospatial imagery and sensor modalities Support LiDAR 3-D point clouds ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

4 4 Rapid advancements deep learning quora.com ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

5 5 The curse dimensionality Many machine learning problems become exceedingly difficult when the number dimensions in the data is high. The phenomenon is known as the curse dimensionality. Of particular concern is that the number possible distinct configurations a set variables increases exponentially as the number variables increases (Goodfellow). Simplifying the learning problem by: Making objects stand out Suppressing background pixels Reducing variations 3-D objects in 3-D point clouds have an invariant property: Heights or Z coordinates ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

6 6 Simplicity learning by data normalization Scale normalization Using photogrammetric technology to determine pixel size Up-sample or down-sample during detection phase Local color normalization Reduce object variations in color space 3-D point cloud to 2-D image transmation Make objects stand out Rotation normalization Specific geospatial imagery Deep learning is sensitive to rotations Eliminate/reduce object variations in rotation space ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

7 7 Rotation variant object detection 1.2 probability probability (Zhang) ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

8 8 Detecting houses from sparse LiDAR point clouds Data source: OpenTopography ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

9 9 Houses in transmed 2-D images ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

10 10 Detecting cars from dense LiDAR point clouds Covering 15km 2 urban area 6,384 vehicles detected Positional accuracy: 15cm Orientation accuracy: 6 o Detection accuracy: 99% ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

11 11 Detecting cars from dense LiDAR point clouds 2 ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772. Data source: Ordnance Survey Great Britain (OSGB)

12 12 From 3-D point clouds to 2-D images ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

13 13 3-D model fitting Car fitting Rectangle Trucks harder Overhanging trees House fitting No one size fits all Building fitting Combine with hand-crafted AFE ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

14 14 Deep learning and GPU (ILSVRC2016, 100% GPU) nvidia.com ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

15 15 Future intelligent geospatial intelligence system An intelligent system that could become smarter and smarter by learning from its mistakes An intelligent system that could detect and monitor defense relevant objects at near human level accuracy With near human level accuracy, this may be the game changer in geospatial intelligence domain Significantly reduce stware engineering and enhancement costs ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

16 16 Bibliography Goodfellow, I., Y. Bengio and A. Courville, Deep Learning, The MIT Press, Cambridge, MA and London, UK, 775 pp. Zhang, B., Big geospatial data + deep learning + high permance computing = geospatial intelligence, presentation S6260, 2016 GPU Technology Conference, San Jose, CA, 4-7 April. [ last viewed 31 January 2017.] ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.

17 17 Questions? Dr. Bingcai Zhang ClearFlite, DataThruWay, GXP, GXP WebView, GXP Xplorer, Multiport, SOCET GXP, and SOCET SET are registered trademarks BAE Systems. as the product(s) or service(s) fered by BAE Systems. From time to time, changes may be made in the products or conditions supply. as XX/XX/XXXX; consists general inmation that is not defined as controlled technical data under ITAR Part or EAR Part 772.