公开(公告)号：US20230298267A1

公开(公告)日：2023-09-21

申请号：US18083474

申请日：2022-12-17

Applicant: APPLE INC.

Inventor： Charilaos PAPADOPOULOS ,  Aaron M. BURNS ,  Alexis H. PALANGIE ,  Andrew P. RICHARDSON ,  Bruno M. SOMMER ,  Charles MAGAHERN ,  Joseph P. CERRA ,  Justin T. VOSS ,  Luis R. DELIZ CENTENO ,  Mark A. EBBOLE ,  Martin GARSTENAUER ,  Peter L. HAJAS ,  Samuel L. IGLESIAS

IPC: G06T17/00 ,  G06F3/01

CPC classification number: G06T17/00 ,  G06F3/013 ,  G06F3/017

Abstract: Various implementations disclosed herein more accurately or efficiently determine to which of multiple potential virtual objects user input should be directed in a 3D graphical environment. In some implementations, this involves using a rule that accounts for the types of the virtual objects to which a particular event may correspond. For example, a direction of intent may be identified and a rule used to determine to which of multiple potential virtual objects to associate an event.

公开(公告)号：US20240202944A1

公开(公告)日：2024-06-20

申请号：US18592586

申请日：2024-03-01

Applicant: APPLE INC.

Inventor： Bruno M. SOMMER ,  Alexandre DA VEIGA ,  Long H. NGO ,  Sebastian P. HERSCHER

IPC: G06T7/33 ,  G06T7/73 ,  G06T19/20

CPC classification number: G06T7/337 ,  G06T7/74 ,  G06T19/20 ,  G06T2207/10028 ,  G06T2219/024 ,  G06T2219/2004

Abstract: Various implementations provide a method for determining position data of a first device relative to a three-dimensional (3D) representation during a communication session. For example, a 3D representation is determined by a first device to correspond to a current physical environment of the first device. Then a spatial relationship is determined between the 3D representation and the current physical environment. Then position data is determined to correspond to a position of the first device relative to the 3D representation and based on a location of the first device in the current physical environment and the spatial relationship between the 3D representation and the current physical environment. The position data is then provided during a communication session between the first device and a second device with a view of the 3D representation including a representation of a user of the first device presented to a user of the second device.

公开(公告)号：US20240220031A1

公开(公告)日：2024-07-04

申请号：US18606377

申请日：2024-03-15

Applicant: Apple Inc.

Inventor： Clément Pierre Nicolas BOISSIÈRE ,  Shaun BUDHRAM ,  Tucker Bull MORGAN ,  Bruno M. SOMMER ,  Connor A. SMITH

IPC: G06F3/03 ,  G06T13/20 ,  G06T19/00

CPC classification number: G06F3/03 ,  G06T13/20 ,  G06T19/006

Abstract: Techniques for displaying a virtual object in an enhanced reality setting in accordance with a physical muting mode being active are described. In some examples, while the physical muting mode is active, a system obtains a first set of context data for one or more physical elements in a physical setting and causes display of a virtual object representing the one or more physical elements in a first position using at least a portion of the first set of context data. After the virtual object representing the one or more physical elements is displayed in the first position, the physical muting mode is deactivated. In response to detecting the deactivation of the physical muting mode, the system causes display of a transitional motion of the virtual object representing the one or more physical elements from the first position to a second position.

公开(公告)号：US20230388358A1

公开(公告)日：2023-11-30

申请号：US18232822

申请日：2023-08-11

Applicant: Apple Inc.

Inventor： Bruno M. SOMMER ,  Leanid VOUK ,  Blerim CICI ,  Berkat S. TUNG

IPC: H04L65/403

CPC classification number: H04L65/403

Abstract: A group communications platform facilitates that sharing of an application environment with other users. The platform may receive a request to initiate a group session for a local user and a remote user. An out-of-process network connection with a system communication channel between a local computing device associated with the local user and a remote computing device associated with the remote user may be established for the group session. A system call may be received from a local instance of a first application on the local computing device to transfer local data to a remote instance of the first application on the remote computing device via the out-of-process network connection. The local data may be transferred to the remote instance of the first application on the remote computing device via the out-of-process network connection and the system communication channel. The local data may include state data of the local instance of the first application for updating a state of the remote instance of the first application.

公开(公告)号：US20230288701A1

公开(公告)日：2023-09-14

申请号：US18124787

申请日：2023-03-22

Applicant: APPLE INC.

Inventor： Jeffrey S. NORRIS ,  Bruno M. SOMMER ,  Olivier GUTKNECHT

IPC: G02B27/01 ,  H04N23/13 ,  H04N23/57 ,  H04N23/63

CPC classification number: G02B27/017 ,  H04N23/13 ,  H04N23/57 ,  H04N23/632 ,  G02B2027/0141 ,  G02B2027/0187 ,  G02B2027/0192

Abstract: Various implementations disclosed herein include devices, systems, and methods that are capable of executing an application on a head-mounted device (HMD) having a first image sensor in a first image sensor configuration. In some implementations, the application is configured for execution on a device including a second image sensor in a second image sensor configuration different than the first image sensor configuration. In some implementations, a request is received from the executing application for image data from the second image sensor. Responsive to the request at the HMD, a pose of a virtual image sensor is determined, image data is generated based on the pose of the virtual image sensor, and the generated image data is provided to the executing application.

公开(公告)号：US20190251728A1

公开(公告)日：2019-08-15

申请号：US16276535

申请日：2019-02-14

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Alexandre R. MOHA ,  Nicolas V. SCAPEL ,  Guillaume P. BARLIER ,  Aurelio GUZMAN ,  Bruno M. SOMMER ,  Nina DAMASKY ,  Thibaut WEISE ,  Thomas GOOSSENS ,  Hoan PHAM ,  Brian AMBERG

IPC: G06T13/40 ,  G06K9/00 ,  H04N7/14 ,  G11B27/036 ,  G06T17/20 ,  G06T13/20 ,  G11B27/10

CPC classification number: G06T13/40 ,  G06K9/00228 ,  G06K9/00302 ,  G06T13/205 ,  G06T17/205 ,  G11B27/036 ,  G11B27/10 ,  H04N7/147 ,  H04N2007/145

Abstract: Systems and methods for generating a video of an emoji that has been puppeted using inputs from image, depth, and audio. The inputs can capture facial expressions of a user, eye, eyebrow, mouth, and head movements. A pose, held by the user, can be detected that can be used to generate supplemental animation. The emoji can further be animated using physical properties associated with the emoji and captured movements. An emoji of a dog can have its ears move in response to an up-and-down movement, or a shaking of the head. The video can be sent in a message to one or more recipients. A sending device can render the puppeted video in accordance with hardware and software capabilities of a recipient's computer device.

公开(公告)号：US20230274504A1

公开(公告)日：2023-08-31

申请号：US18174337

申请日：2023-02-24

Applicant: Apple Inc.

Inventor： Miao REN ,  Connor A. SMITH ,  Hayden J. LEE ,  Bruno M. SOMMER

IPC: G06T19/00 ,  G06T13/40 ,  G06T7/20 ,  H04N13/351 ,  G06F3/16

CPC classification number: G06T19/003 ,  G06T13/40 ,  G06T7/20 ,  H04N13/351 ,  G06F3/16

Abstract: Some examples of the disclosure are directed to selective display of avatars corresponding to users of electronic devices in a multi-user communication session. In some examples, when immersive content is shared in the communication session, the avatars remain displayed when presenting the content in the three-dimensional environment. In some examples, when perspective-limited immersive content is shared in the communication session, the avatars cease being displayed when presenting the content in the three-dimensional environment. In some examples, when content presented in a full-screen mode is shared in the communication session, the avatars remain displayed when presenting the content in the full-screen mode in the three-dimensional environment. In some examples, when object-bounded content is shared in the communication session, the avatars remain displayed when presenting the object-bounded content in the three-dimensional environment.

公开(公告)号：US20210325974A1

公开(公告)日：2021-10-21

申请号：US17362457

申请日：2021-06-29

Applicant: Apple Inc.

Inventor： Clément Pierre Nicolas BOISSIÈRE ,  Shaun BUDHRAM ,  Tucker Bull MORGAN ,  Bruno M. SOMMER ,  Connor A. SMITH

IPC: G06F3/03 ,  G06T19/00 ,  G06T13/20

Abstract: Techniques for displaying a virtual object in an enhanced reality setting in accordance with a physical muting mode being active are described. In some examples, a system obtains context data for one or more physical elements in a physical setting, wherein the context data includes first context data and second context data that is different from the first context data. In some examples, in response to obtaining the context data for the one or more physical elements in the physical setting, a system causes display of a virtual object that represents the one or more physical elements using the first context data without using the second context data, in accordance with a determination that a physical muting mode is active.