公开(公告)号：US20240397032A1

公开(公告)日：2024-11-28

申请号：US18662826

申请日：2024-05-13

Applicant: Apple Inc.

Inventor： Michael J. Rockwell ,  Oriel Y. Bergig ,  Geoffrey Stahl ,  Thibaut Weise ,  Peter Kaufmann ,  Branko Petljanski ,  Jason L. Slupeiks ,  Tom Sengelaub ,  Kathrin Berkner Cieslicki ,  Yanghai Tsin ,  Hesam Najafi ,  Arthur Y. Zhang ,  Cheng Chen ,  Graham B. Myhre ,  Fletcher R. Rothkopf ,  Marinus Meursing ,  Phil M. Hobson ,  Jason C. Sauers ,  Jan K. Quijalvo ,  Jia Tao ,  Ivan S. Maric ,  Jeremy C. Franklin ,  Wey-Jiun Lin ,  Muhammad F. Hossain

IPC: H04N13/361 ,  G06F3/01 ,  H04N13/204 ,  H04N13/344 ,  H04N13/383

Abstract: A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.

公开(公告)号：US12010155B2

公开(公告)日：2024-06-11

申请号：US17224077

申请日：2021-04-06

Applicant: Apple Inc.

Inventor： Geoffrey Stahl ,  Jeffrey S. Norris ,  Timothy R. Oriol ,  Joel N. Kerr ,  Srinivas Vedula ,  Bruno Sommer

IPC: G06F15/16 ,  H04L65/401 ,  H04L65/403

CPC classification number: H04L65/401 ,  H04L65/403

Abstract: A device for providing operating system managed group communication sessions may include a memory and at least one processor. The at least one processor may be configured to receive, by an operating system level process executing on a device and from an application process executing on a device, a request to initiate a group session between a user associated with the device and another user. The at least one processor may be further configured to identify, by the operating system level process, another device associated with the other user. The at least one processor may be further configured to initiate, by the operating system level process, the group session with the user via the other device. The at least one processor may be further configured to manage, by the operating system level process, the group session.

公开(公告)号：US11914646B1

公开(公告)日：2024-02-27

申请号：US17850093

申请日：2022-06-27

Applicant: Apple Inc.

Inventor： Geoffrey Stahl

IPC: G06F16/783 ,  H04N13/183 ,  G06F40/10 ,  G06F3/04815 ,  G02F1/13

CPC classification number: G06F16/783 ,  G02F1/1323 ,  G06F3/04815 ,  G06F40/10 ,  H04N13/183

Abstract: In accordance with some implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, a positional sensor, a rendering system, and a display. The method includes while displaying, on the display, first textual content according to an initial viewing angle, determining an expected viewing angle based on the initial viewing angle and positional data from the positional sensor. The positional data indicates a positional change of the electronic device. The initial viewing angle is different from the expected viewing angle. The method includes, in accordance with a determination that the expected viewing angle satisfies a render criterion, generating, via the rendering system, second textual content based on the expected viewing angle. The method includes displaying, on the display, the second textual content according to the expected viewing angle.

公开(公告)号：US11243402B2

公开(公告)日：2022-02-08

申请号：US17169231

申请日：2021-02-05

Applicant: Apple Inc.

Inventor： Geoffrey Stahl ,  Avi Bar-Zeev

IPC: G06F3/01 ,  G02B27/01 ,  G06F3/0481 ,  G06T7/70 ,  H04N19/139 ,  G06T19/00

Abstract: A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.

公开(公告)号：US20210312694A1

公开(公告)日：2021-10-07

申请号：US17352080

申请日：2021-06-18

Applicant: Apple Inc.

Inventor： Arthur Y Zhang ,  Ray L. Chang ,  Timothy R. Oriol ,  Ling Su ,  Gurjeet S. Saund ,  Guy Cote ,  Jim C. Chou ,  Hao Pan ,  Tobias Eble ,  Avi Bar-Zeev ,  Sheng Zhang ,  Justin A. Hensley ,  Geoffrey Stahl

IPC: G06T15/00 ,  H04W76/10 ,  G06F3/01 ,  G06T3/00 ,  G06T9/00

Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.

公开(公告)号：US12086919B2

公开(公告)日：2024-09-10

申请号：US18344294

申请日：2023-06-29

Applicant: Apple Inc.

Inventor： Arthur Y Zhang ,  Ray L. Chang ,  Timothy R. Oriol ,  Ling Su ,  Gurjeet S. Saund ,  Guy Cote ,  Jim C. Chou ,  Hao Pan ,  Tobias Eble ,  Avi Bar-Zeev ,  Sheng Zhang ,  Justin A. Hensley ,  Geoffrey Stahl

IPC: G06T15/00 ,  G06F3/01 ,  G06T3/18 ,  G06T9/00 ,  H04W76/10 ,  H04W88/08

CPC classification number: G06T15/005 ,  G06F3/012 ,  G06T3/18 ,  G06T9/00 ,  H04W76/10 ,  H04W88/08

Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.

公开(公告)号：US20230293998A1

公开(公告)日：2023-09-21

申请号：US18122819

申请日：2023-03-17

Applicant: Apple Inc.

Inventor： Geoffrey Stahl ,  Michael J. Rockwell

IPC: A63F13/65 ,  G06T11/00 ,  H04L67/131 ,  A63F13/52

CPC classification number: A63F13/65 ,  G06T11/00 ,  H04L67/131 ,  A63F13/52

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide shared extended reality (XR) experiences in which two or more users interact with their own sets of physical objects (e.g., cards, game pieces, dice, chips, etc.) during the shared experiences. Each user may have multiple physical objects, each of those physical objects having the same generic shape, size, etc., but having a unique fiducial marker. The unique fiducial marker of each physical object can be assigned to represent one of multiple virtual content items.

公开(公告)号：US20220155603A1

公开(公告)日：2022-05-19

申请号：US17665324

申请日：2022-02-04

Applicant: Apple Inc.

Inventor： Geoffrey Stahl ,  Avi Bar-Zeev

IPC: G02B27/01 ,  G06F3/01 ,  G06F3/04815 ,  G06T7/70 ,  H04N19/139

Abstract: A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.

公开(公告)号：US20210165229A1

公开(公告)日：2021-06-03

申请号：US17169231

申请日：2021-02-05

Applicant: Apple Inc.

Inventor： Geoffrey Stahl ,  Avi Bar-Zeev

IPC: G02B27/01 ,  G06F3/01 ,  G06F3/0481 ,  G06T7/70 ,  H04N19/139

Abstract: A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.

公开(公告)号：US10914957B1

公开(公告)日：2021-02-09

申请号：US16844869

申请日：2020-04-09

Applicant: Apple Inc.

Inventor： Geoffrey Stahl ,  Avi Bar-Zeev

IPC: G06T7/70 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0481 ,  H04N19/139 ,  G06T19/00

Abstract: A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.