公开(公告)号：US10558037B2

公开(公告)日：2020-02-11

申请号：US15710397

申请日：2017-09-20

Applicant: Apple Inc.

Inventor： Patrick S. Piemonte ,  Wolf Kienzle ,  Douglas Bowman ,  Shaun D. Budhram ,  Madhurani R. Sapre ,  Vyacheslav Leizerovich ,  Daniel De Rocha Rosario

IPC: G02B27/01 ,  G06F3/01 ,  G06F3/0481 ,  H04W4/02 ,  G06F16/58 ,  G06F16/00 ,  G10L15/00

Abstract: Implementations described and claimed herein provide systems and methods for interaction between a user and a machine. In one implementation, a system is provided that receives an input from a user of a mobile machine which indicates or describes an object in the world. In one example, the user may gesture to the object which is detected by a visual sensor. In another example, the user may verbally describe the object which is detected by an audio sensor. The system receiving the input may then determine which object near the location of the user that the user is indicating. Such a determination may include utilizing known objects near the geographic location of the user or the autonomous or mobile machine.

公开(公告)号：US09529440B2

公开(公告)日：2016-12-27

申请号：US13942369

申请日：2013-07-15

Applicant: Apple Inc.

Inventor： Patrick S. Piemonte ,  Bradford A. Moore ,  Billy P. Chen

IPC: G06F3/0481 ,  G06F3/01 ,  G06F3/0484 ,  G06F3/0488

CPC classification number: G06F3/04883 ,  G06F3/017 ,  G06F3/04815 ,  G06F3/04845 ,  G06F3/0485 ,  G06F2203/04806 ,  G06F2203/04808

Abstract: A multitouch device can interpret and disambiguate different gestures related to manipulating a displayed image of a 3D object, scene, or region. Examples of manipulations include pan, zoom, rotation, and tilt. The device can define a number of manipulation modes, including one or more single-control modes such as a pan mode, a zoom mode, a rotate mode, and/or a tilt mode. The manipulation modes can also include one or more multi-control modes, such as a pan/zoom/rotate mode that allows multiple parameters to be modified simultaneously.

Abstract translation: 多点触摸设备可以解释和消除与操纵3D对象，场景或区域的显示图像相关的不同手势。 操作的示例包括平移，缩放，旋转和倾斜。 该装置可以定义多种操作模式，包括一个或多个单一控制模式，例如平移模式，缩放模式，旋转模式和/或倾斜模式。 操作模式还可以包括一个或多个多重控制模式，例如允许同时修改多个参数的平移/缩放/旋转模式。

公开(公告)号：US20160055669A1

公开(公告)日：2016-02-25

申请号：US14834360

申请日：2015-08-24

Applicant: Apple Inc.

Inventor： Patrick S. Piemonte ,  Erik Anders Mikael Adlers ,  Christopher Blumenberg

IPC: G06T17/05 ,  G06T11/00 ,  G06T15/80

CPC classification number: G06T17/05 ,  G01C21/3638 ,  G06T11/001 ,  G06T13/00 ,  G06T15/80 ,  Y02D70/10

Abstract: Some embodiments provide a mapping application for generating views of a three-dimensional (3D) map. The mapping application includes a geographic data module for identifying a set of geographic data that represents a portion of the 3D map. The set of geographic data includes a set of camera captured images that correspond to the portion of the 3D map. The mapping application includes an image processing module for rendering the view of the 3D map based on the geographic data by animating a type of map element in the view of the 3D map.

公开(公告)号：US20140222335A1

公开(公告)日：2014-08-07

申请号：US13757907

申请日：2013-02-04

Applicant: Apple, Inc.

Inventor： Patrick S. Piemonte ,  Marcel Van Os ,  Christopher Blumenberg

IPC: G01C21/36

CPC classification number: G01C21/3614 ,  G01C21/3664 ,  G06F3/04883 ,  G06F2203/04808

Abstract: A mobile device including a touchscreen display can detect multiple points of fingertip contact being made against the touchscreen concurrently. The device can distinguish this multi-touch gesture from other gestures based on the duration, immobility, and concurrency of the contacts. In response to detecting such a multi-touch gesture, the device can send a multi-touch event to an application executing on the device. The application can respond to the multi-touch event in a variety of ways. For example, the application can determine a distance of a path in between points on a map that a user has concurrently touched with his fingertips. The application can display this distance to the user.

Abstract translation: 包括触摸屏显示器的移动设备可以同时检测针对触摸屏进行的多个指尖接触点。 该设备可以基于联系人的持续时间，不动性和并发性来区分这种多点触摸手势与其他手势。 响应于检测到这样的多点触摸手势，设备可以向在设备上执行的应用发送多点触摸事件。 应用程序可以以多种方式响应多点触控事件。 例如，应用程序可以确定用户同时用他的指尖触摸的地图上的点之间的路径的距离。 应用程序可以向用户显示该距离。

公开(公告)号：US20130326425A1

公开(公告)日：2013-12-05

申请号：US13632124

申请日：2012-09-30

Applicant: APPLE INC.

Inventor： Scott Forstall ,  Bradford A. Moore ,  Marcel van Os ,  Christopher Blumenberg ,  Emanuele Vulcano ,  Brady A. Law ,  Patrick S. Piemonte ,  Matthew B. Ball

IPC: G06F3/0484

CPC classification number: G01C21/00 ,  G01C21/32 ,  G01C21/3626 ,  G01C21/3638 ,  G01C21/3664 ,  G01C21/367 ,  G01C21/3673 ,  G01C21/3682 ,  G06F3/041 ,  G06F3/04815 ,  G06F3/0482 ,  G06F3/0484 ,  G06F3/04845 ,  G06F3/04883 ,  G06F17/30991 ,  G06F2203/04808 ,  G06Q30/0259 ,  G06T17/05 ,  G06T19/00 ,  G06T19/003 ,  G09B29/007 ,  G09B29/10 ,  G09B29/106 ,  Y02D70/10

Abstract: A device that includes at least one processing unit and stores a multi-mode mapping program for execution by the at least one processing unit is described. The program includes a user interface (UI). The UI includes a display area for displaying a two-dimensional (2D) presentation of a map or a three-dimensional (3D) presentation of the map. The UI includes a selectable 3D control for directing the program to transition between the 2D and 3D presentations.

Abstract translation: 描述了包括至少一个处理单元并且存储用于由至少一个处理单元执行的多模式映射程序的设备。 该程序包括用户界面（UI）。 UI包括用于显示地图的二维（2D）呈现或地图的三维（3D）呈现）的显示区域。 UI包括用于指导程序在2D和3D呈现之间转换的可选3D控件。

公开(公告)号：US20130321401A1

公开(公告)日：2013-12-05

申请号：US13632040

申请日：2012-09-30

Applicant: APPLE INC.

Inventor： Patrick S. Piemonte ,  Aroon Pahwa ,  Christopher D. Moore

IPC: G06T15/00

CPC classification number: G06T15/005 ,  G01C21/3635 ,  G01C21/3638 ,  G06F17/30241 ,  G06F17/30342 ,  G06K9/46 ,  G06T19/20 ,  G06T2219/2016 ,  G06T2219/2024 ,  G09B29/005 ,  G09B29/006 ,  G09B29/106 ,  Y02D70/10

Abstract: Some embodiments provide a non-transitory machine-readable medium that stores a mapping application which when executed on a device by at least one processing unit provides automated animation of a three-dimensional (3D) map along a navigation route. The mapping application identifies a first set of attributes for determining a first position of a virtual camera in the 3D map at a first instance in time. Based on the identified first set of attributes, the mapping application determines the position of the virtual camera in the 3D map at the first instance in time. The mapping application identifies a second set of attributes for determining a second position of the virtual camera in the 3D map at a second instance in time. Based on the identified second set of attributes, the mapping application determines the position of the virtual camera in the 3D map at the second instance in time. The mapping application renders an animated 3D map view of the 3D map from the first instance in time to the second instance in time based on the first and second positions of the virtual camera in the 3D map.

Abstract translation: 一些实施例提供了一种非暂时机器可读介质，其存储映射应用程序，当由至少一个处理单元在设备上执行时，映射应用程序沿着导航路线提供三维（3D）地图的自动化动画。 映射应用程序在第一时间点识别用于确定3D映射中的虚拟摄像机的第一位置的第一组属性。 基于所识别的第一组属性，映射应用程序在第一时间确定3D映射中虚拟摄像机的位置。 映射应用程序在第二时间点识别用于在3D映射中确定虚拟摄像机的第二位置的第二组属性。 基于所识别的第二组属性，映射应用程序在第二个实例中确定虚拟相机在3D地图中的位置。 映射应用程序基于3D映射中的虚拟摄像机的第一和第二位置，在时间上呈现3D映射的从第一个实例到第二个实例的动画3D地图视图。

公开(公告)号：US11935197B2

公开(公告)日：2024-03-19

申请号：US17175456

申请日：2021-02-12

Applicant: Apple Inc.

Inventor： Patrick S. Piemonte ,  Daniel De Rocha Rosario ,  Jason D Gosnell ,  Peter Meier

IPC: G06T19/00 ,  G01C21/26 ,  G01C21/36 ,  G02B27/01 ,  G06T15/20 ,  G06T17/00 ,  G06T19/20

CPC classification number: G06T19/006 ,  G01C21/26 ,  G01C21/365 ,  G02B27/017 ,  G06T15/205 ,  G06T17/00 ,  G06T19/20 ,  G02B2027/0141 ,  G05D2201/0213 ,  G06T2210/56

Abstract: An AR system that leverages a pre-generated 3D model of the world to improve rendering of 3D graphics content for AR views of a scene, for example an AR view of the world in front of a moving vehicle. By leveraging the pre-generated 3D model, the AR system may use a variety of techniques to enhance the rendering capabilities of the system. The AR system may obtain pre-generated 3D data (e.g., 3D tiles) from a remote source (e.g., cloud-based storage), and may use this pre-generated 3D data (e.g., a combination of 3D mesh, textures, and other geometry information) to augment local data (e.g., a point cloud of data collected by vehicle sensors) to determine much more information about a scene, including information about occluded or distant regions of the scene, than is available from the local data.

公开(公告)号：US20200233212A1

公开(公告)日：2020-07-23

申请号：US16786754

申请日：2020-02-10

Applicant: Apple Inc.

Inventor： Patrick S. Piemonte ,  Wolf Kienzle ,  Douglas Bowman ,  Shaun D. Budhram ,  Madhurani R. Sapre ,  Vyacheslav Leizerovich ,  Daniel De Rocha Rosario

IPC: G02B27/01 ,  G06F16/58 ,  G06F3/01 ,  G06F3/0481 ,  H04W4/02

Abstract: Implementations described and claimed herein provide systems and methods for interaction between a user and a machine. In one implementation, a system is provided that receives an input from a user of a mobile machine which indicates or describes an object in the world. In one example, the user may gesture to the object which is detected by a visual sensor. In another example, the user may verbally describe the object which is detected by an audio sensor. The system receiving the input may then determine which object near the location of the user that the user is indicating. Such a determination may include utilizing known objects near the geographic location of the user or the autonomous or mobile machine.

公开(公告)号：US20180089899A1

公开(公告)日：2018-03-29

申请号：US15713274

申请日：2017-09-22

Applicant: Apple Inc.

Inventor： Patrick S. Piemonte ,  Daniel De Rocha Rosario ,  Jason D. Gosnell ,  Peter Meier

IPC: G06T19/00 ,  G06T15/20 ,  G01C21/36 ,  G02B27/01 ,  G01C21/26

CPC classification number: G06T19/006 ,  G01C21/26 ,  G01C21/365 ,  G02B27/017 ,  G02B2027/0141 ,  G05D2201/0213 ,  G06T15/205 ,  G06T15/506 ,  G06T17/00 ,  G06T19/20 ,  G06T2210/56

Abstract: An AR system that leverages a pre-generated 3D model of the world to improve rendering of 3D graphics content for AR views of a scene, for example an AR view of the world in front of a moving vehicle. By leveraging the pre-generated 3D model, the AR system may use a variety of techniques to enhance the rendering capabilities of the system. The AR system may obtain pre-generated 3D data (e.g., 3D tiles) from a remote source (e.g., cloud-based storage), and may use this pre-generated 3D data (e.g., a combination of 3D mesh, textures, and other geometry information) to augment local data (e.g., a point cloud of data collected by vehicle sensors) to determine much more information about a scene, including information about occluded or distant regions of the scene, than is available from the local data.

公开(公告)号：US09536325B2

公开(公告)日：2017-01-03

申请号：US14056924

申请日：2013-10-17

Applicant: Apple Inc.

Inventor： Cédric Bray ,  Christopher D. Moore ,  Patrick S. Piemonte ,  Emanuele Vulcano ,  Marcel van Os ,  Billy P. Chen ,  Seejo K. Pylappan ,  Justin O'Beirne

IPC: G06F3/0482 ,  G06T11/00 ,  G01C21/36

CPC classification number: G06T11/001 ,  G01C21/3632 ,  G01C21/367 ,  G06F3/0482

Abstract: A device that provides a map and/or navigation application that displays items on the map and/or navigation instructions differently in different modes. The applications of some embodiments provide a day mode and a night mode. In some embodiments the application uses the day mode as a default and activates the night mode when the time is after sunset at the location of the device. Some embodiments activate night mode when multiple conditions are satisfied (for example, when (1) the time is after sunset at the location of the device and (2) the ambient light level is below a threshold brightness).

Abstract translation: 提供在不同模式下不同地显示地图和/或导航指令上的项目的地图和/或导航应用的设备。 一些实施例的应用提供日模式和夜间模式。 在一些实施例中，应用程序使用日模式作为默认值，并且在设备的位置处的日落之后激活夜间模式。 一些实施例在满足多个条件时激活夜间模式（例如，当（1）在设备的位置处的日落之后的时间和（2）环境光水平低于阈值亮度时）。