-
公开(公告)号:US20210311608A1
公开(公告)日:2021-10-07
申请号:US17351050
申请日:2021-06-17
Applicant: Apple Inc.
Inventor: Bruno M. Sommer , Tucker Bull Morgan , Shih Sang Chiu , Connor Alexander Smith
IPC: G06F3/0481 , G06F3/01 , G06K9/00 , G06F3/16
Abstract: A method includes displaying a home ER environment characterized by home ER world coordinates, including one or more diorama-view representation of one or more respective ER environments. Each diorama-view representation includes ER objects arranged in a spatial relationship according to corresponding ER world coordinates. In some implementations, in response to detecting an input directed to a first diorama-view representation, the method includes transforming the home ER environment. Transforming the home ER environment includes transforming the spatial relationship between a subset of the ER objects as a function of the home ER world coordinates and corresponding ER world coordinates. In some implementations, in response to detecting an input associated with a first one of a plurality of diorama-view representations, the method includes changing display of the first one of the plurality of diorama-view representations from a first viewing vector to a second viewing vector while maintaining an arrangement of ER objects.
-
公开(公告)号:US20200097770A1
公开(公告)日:2020-03-26
申请号:US16575712
申请日:2019-09-19
Applicant: Apple Inc.
Inventor: Bruno M. Sommer , Alexandre da Veiga
Abstract: Systems and methods for localization for mobile devices are described. Some implementations may include accessing motion data captured using one or more motion sensors; determining, based on the motion data, a coarse localization, wherein the coarse localization includes a first estimate of position; obtaining one or more feature point maps, wherein the feature point maps are associated with a position of the coarse localization; accessing images captured using one or more image sensors; determining, based on the images, a fine localization pose by localizing into a feature point map of the one or more feature point maps, wherein the fine localization pose includes a second estimate of position and an estimate of orientation; generating, based on the fine localization pose, a virtual object image including a view of a virtual object; and displaying the virtual object image.
-
公开(公告)号:US20160358485A1
公开(公告)日:2016-12-08
申请号:US14732746
申请日:2015-06-07
Applicant: Apple Inc.
CPC classification number: G08G9/02 , B60W30/09 , G01C21/00 , G05D1/0212
Abstract: Systems, methods, and computer readable media to improve the operation of graphics systems are described. In general, collision avoidance techniques are disclosed that operate even when the agent lacks a priori knowledge of its environment and is, further, agnostic as to whether the environment is two-dimensional (2D) or three-dimensional (3D), whether the obstacles are convex or concave, or whether the obstacles are moving or stationary. More particularly, techniques disclosed herein use simple geometry to identify which edges of which obstacles an agent is most likely to collide. With this known, the direction of an avoidance force is also known. The magnitude of the force may be fixed, based on the agent's maximum acceleration, and modulated by weighting agents
Abstract translation: 描述了用于改进图形系统的操作的系统,方法和计算机可读介质。 通常,公开了避免碰撞的技术,即使在代理人缺乏对其环境的先验知识的情况下也可以进行操作,而且还不知道环境是二维的还是三维的(3D) 是凸的还是凹的,还是障碍物是移动还是静止。 更具体地,本文公开的技术使用简单的几何来识别代理最可能发生碰撞的障碍物的哪些边缘。 就此而言,避免力的方向也是已知的。 力的大小可以基于代理的最大加速度而被固定,并由加权代理进行调制
-
公开(公告)号:US20160358378A1
公开(公告)日:2016-12-08
申请号:US14732744
申请日:2015-06-07
Applicant: Apple Inc.
Inventor: Norman N. Wang , Jacques P. Gasselin de Richebourg , Bruno M. Sommer , Ross R. Dexter
CPC classification number: A63F13/00 , G01C21/20 , G06Q10/047 , G09B29/00 , G09B29/106
Abstract: Techniques to automatically generate a navigation graph for a given environment and agent are disclosed. The environment may include an arbitrary number of polygonal obstacles arbitrarily arranged, concave or convex, static or dynamic. The disclosed operation extrudes (in a specified manner) the vertex of each obstacle. The extruded vertices comprise the navigation graph's nodes. Each object's extruded vertices may be joined to form a corresponding extruded object. Paths may then be identified by attempting to connect every extruded vertex with every other extruded vertex. Those paths intersecting any of the extruded objects are rejected as possible paths. In some embodiments, paths that are oriented in approximately the same direction having approximately the same length may be removed as being redundant.
Abstract translation: 公开了为给定环境和代理自动生成导航图的技术。 环境可以包括任意数量的多边形障碍物任意布置,凹形或凸形,静态或动态。 所公开的操作(以指定的方式)挤出每个障碍物的顶点。 挤出的顶点包括导航图的节点。 每个物体的挤出顶点可以被连接以形成相应的挤出物体。 然后可以通过尝试将每个挤出顶点与每个其他挤出顶点连接来识别路径。 与任何挤出物体相交的那些路径被拒绝作为可能的路径。 在一些实施例中,可以将具有大致相同长度的大致相同方向定向的路径作为多余的去除。
-
公开(公告)号:US12188777B2
公开(公告)日:2025-01-07
申请号:US18338193
申请日:2023-06-20
Applicant: Apple Inc.
Inventor: Bruno M. Sommer , Avi Bar-Zeev , Frank Angermann , Stephen E. Pinto , Lilli Ing-Marie Jonsson , Rahul Nair
Abstract: Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.
-
公开(公告)号:US20240339027A1
公开(公告)日:2024-10-10
申请号:US18744965
申请日:2024-06-17
Applicant: APPLE INC.
Inventor: Jeffrey S. Norris , Bruno M. Sommer , Alexandre Da Veiga
Abstract: A method includes receiving a signal that indicates a location of a control device that is configured to change an operating state of a controlled device. The method also includes identifying a first visible device and a second visible device in one or more images, matching the first visible device with the control device based on a location of the first visible device matching the location of the control device, matching the second visible device with the controlled device, pairing the control device with a host device, and controlling the control device using the host device to change the operating state of the controlled device.
-
公开(公告)号:US12039859B2
公开(公告)日:2024-07-16
申请号:US17980057
申请日:2022-11-03
Applicant: APPLE INC.
Inventor: Jeffrey S. Norris , Bruno M. Sommer , Alexandre Da Veiga
Abstract: A method includes receiving one or more signals that each indicate a device type for a respective remote device, identifying one or more visible devices in one or more images, matching a first device from the one or more visible devices with a first signal from the one or more signals based on a device type of the first device matching a device type for the first signal and based on a visible output of the first device, pairing the first device with a second device, and controlling a function of the first device using the second device.
-
公开(公告)号:US20240062413A1
公开(公告)日:2024-02-22
申请号:US18384352
申请日:2023-10-26
Applicant: Apple Inc.
Inventor: Jeffrey S. Norris , Alexandre Da Veiga , Bruno M. Sommer , Ye Cong , Tobias Eble , Moinul Khan , Nicolas Bonnier , Hao Pan
CPC classification number: G06T7/73 , G02B27/017 , G06V20/20 , G06V10/462 , G06V10/245 , G06T2207/30204
Abstract: A method includes obtaining first pass-through image data characterized by a first pose. The method includes obtaining respective pixel characterization vectors for pixels in the first pass-through image data. The method includes identifying a feature of an object within the first pass-through image data in accordance with a determination that pixel characterization vectors for the feature satisfy a feature confidence threshold. The method includes displaying the first pass-through image data and an AR display marker that corresponds to the feature. The method includes obtaining second pass-through image data characterized by a second pose. The method includes transforming the AR display marker to a position associated with the second pose in order to track the feature. The method includes displaying the second pass-through image data and maintaining display of the AR display marker that corresponds to the feature of the object based on the transformation.
-
公开(公告)号:US20230400956A1
公开(公告)日:2023-12-14
申请号:US18238297
申请日:2023-08-25
Applicant: Apple Inc.
Inventor: Bruno M. Sommer , Tucker Bull Morgan , Shih Sang Chiu , Connor Alexander Smith
IPC: G06F3/04815 , G06F3/01 , G06F3/16 , G06V20/10
CPC classification number: G06F3/04815 , G06F3/013 , G06F3/017 , G06F3/16 , G06V20/10 , G06F3/0482
Abstract: A method includes displaying a home ER environment characterized by home ER world coordinates, including one or more diorama-view representation of one or more respective ER environments. Each diorama-view representation includes ER objects arranged in a spatial relationship according to corresponding ER world coordinates. In some implementations, in response to detecting an input directed to a first diorama-view representation, the method includes transforming the home ER environment. Transforming the home ER environment includes transforming the spatial relationship between a subset of the ER objects as a function of the home ER world coordinates and corresponding ER world coordinates. In some implementations, in response to detecting an input associated with a first one of a plurality of diorama-view representations, the method includes changing display of the first one of the plurality of diorama-view representations from a first viewing vector to a second viewing vector while maintaining an arrangement of ER objects.
-
公开(公告)号:US20230316680A1
公开(公告)日:2023-10-05
申请号:US18189429
申请日:2023-03-24
Applicant: Apple Inc.
Inventor: Jeremy S. Jones , Bruno M. Sommer , Leanid Vouk , Luis R. Deliz Centeno , Peter F. Handel , Timofey Grechkin
CPC classification number: G06T19/006 , G06V20/20 , G06F3/017
Abstract: The disclosure pertains to techniques for collaborating in a multi-user communications environment. One such technique includes receiving, at a first communication device, data associated with a multi-user communication session between a first user of the first communication device and a second user of a second communication device, presenting, at the first communication device, a non-extended reality graphical user interface (GUI), the non-extended reality GUI including a non-extended reality representation of a virtual object included in the multi-user communication session and a representation of the second user based on the data associated with the multi-user communication session, and updating, at the first communication device, the non-extended reality GUI to illustrate an interaction between the representation of the second user and the virtual object in response to the data indicating the interaction.
-
-
-
-
-
-
-
-
-