Systems and methods are disclosed herein for monitoring a location of a client device associated with a transportation service and generating augmented reality images for display on the client device. The systems and methods use sensor data from the client device and a device localization process to monitor the location of the client device by comparing renderings of images captured by the client device to renderings of the vicinity of the pickup location. The systems and methods determine navigation instructions from the user's current location to the pickup location and select one or more augmented reality elements associated with the navigation instructions and/or landmarks along the route to the pickup location. The systems and methods instruct the client device to overlay the selected augmented reality elements on a video feed of the client device.
Generating Composite Images For Display On A Mobile Device Based On Ground Truth Image Rendering
Systems and methods are disclosed herein for monitoring a location of a vehicle approaching a pickup location associated with a transportation service and generating composite images for display on a driver client device in response to determining that the vehicle is within a threshold distance of a pickup location. The systems and methods use sensor data from the driver client device and a device localization process to monitor the location of the driver client device located in the vehicle. In response to determining that the driver client device (and thus, the vehicle) is within a threshold distance of the pickup location the service generates one or more composite images by overlaying a stored image of the pickup location with one or more persistent augmented reality elements associated with the pickup location and/or the transportation service.
Generating Augmented Reality Images For Display On A Mobile Device Based On Ground Truth Image Rendering
Systems and methods are disclosed herein for monitoring a location of a client device associated with a transportation service and generating augmented reality images for display on the client device. The systems and methods use sensor data from the client device and a device localization process to monitor the location of the client device by comparing renderings of images captured by the client device to renderings of the vicinity of the pickup location. The systems and methods determine navigation instructions from the user's current location to the pickup location and select one or more augmented reality elements associated with the navigation instructions and/or landmarks along the route to the pickup location. The systems and methods instruct the client device to overlay the selected augmented reality elements on a video feed of the client device.
- Redmond WA, US JEROME FRANCOIS BERCLAZ - Sunnyvale CA, US MICHAEL L. HARVILLE - Palo Alto CA, US YASUYUKI MATSUSHITA - Osaka, JP TAKAAKI SHIRATORI - Beijing, CN TAOYU LI - Beijing, CN TAEHUN YOON - Superior CO, US STEPHEN EDWARD SHILLER - Littleton CO, US
International Classification:
G06T 7/00
Abstract:
Systems, methods, and computer-readable storage media are provided for aligning three-dimensional point clouds that each includes data representing at least a portion of an area-of-interest. The area-of-interest is divided into multiple regions, each region having a closed-loop structure defined by a plurality of border segments, each border segment including a plurality of fragments. Point clouds representing the fragments that make up each closed-loop region are aligned with one another in a parallelized manner, for instance, utilizing a Simultaneous Generalized Iterative Closest Point (SGICP) technique, to create aligned point cloud regions. Aligned point cloud regions sharing a common border segment portion are aligned with one another to create a single, consistent, aligned point cloud having data that accurately represents the area-of-interest.