公开(公告)号：US20240403994A1

公开(公告)日：2024-12-05

申请号：US18510413

申请日：2023-11-15

Applicant: Apple Inc.

Inventor： Sorin C Cismas ,  Alhad A Palkar ,  Kaushik Raghunath ,  Arun Kannan ,  Manjunath M Venkatesh

IPC: G06T1/20 ,  G06T5/00

Abstract: First integrated circuitry including image data rendering circuitry configured to generate image data and memory configured to store a dashboard including dashboard entries indicating a state of the image data to the image data rendering circuitry, wherein the image data rendering circuitry is configured to operate based at least in part on feedback from the dashboard.

公开(公告)号：US20240098234A1

公开(公告)日：2024-03-21

申请号：US18462161

申请日：2023-09-06

Applicant: Apple Inc.

Inventor： Michael C Friedman ,  Russell L Jones ,  Kaushik Raghunath ,  Venu M Duggineni ,  Ranjit Desai ,  Manjunath M Venkatesh ,  Michael J Rockwell ,  Arun Kannan ,  Saul H Weiss

IPC: H04N13/133 ,  H04N13/344 ,  H04N13/383

CPC classification number: H04N13/133 ,  H04N13/344 ,  H04N13/383

Abstract: A head-mounted device is provided that includes one or more cameras configured to acquire a raw video feed and one or more displays configured to present a passthrough video feed to a user. Generation of the passthrough video feed can involve processing the raw video feed using an image signal processor and auxiliary compute blocks. One or more of the auxiliary compute blocks can be bypassed in response to detecting one or more failures associated with the auxiliary compute blocks. Configured and operated in this way, the head-mounted device can fall back to a more reliable passthrough video feed without having to power cycle the head-mounted device when a failure occurs.

公开(公告)号：US20230319296A1

公开(公告)日：2023-10-05

申请号：US17889277

申请日：2022-08-16

Applicant: Apple Inc.

Inventor： Ranjit Desai ,  Adrian P. Lindberg ,  Kaushik Raghunath ,  Vinay Palakkode

IPC: H04N19/33 ,  G06V20/40 ,  G06V10/25 ,  G06V10/70

CPC classification number: H04N19/33 ,  G06V20/46 ,  G06V10/25 ,  G06V10/70

Abstract: A method is provided that includes receiving content data captured by a sensor and receiving a context signal representing a user context. The received content data is scaled using a trained model, wherein the context signal is an input to the trained model, and the scaled content data is provided for presentation to a user.

公开(公告)号：US20240323342A1

公开(公告)日：2024-09-26

申请号：US18530642

申请日：2023-12-06

Applicant: Apple Inc.

Inventor： Mohamed Al Sharnouby ,  Arun Kannan ,  Venu M Duggineni ,  Kaushik Raghunath ,  Saul H Weiss ,  Luke Yoder ,  James C McIlree ,  Sankaravadivoo Subramanian ,  Mukta S Gore ,  Russell L Jones

IPC: H04N13/383 ,  G06F3/01 ,  H04N13/106

CPC classification number: H04N13/383 ,  G06F3/013 ,  H04N13/158

Abstract: An electronic device is provided that includes at least one image sensor for acquiring a video feed and one or more displays for presenting a passthrough video feed to a user. The electronic device can include a hierarchical failure detection scheme for detecting critical failures on the device. The hierarchical failure detection scheme may include monitoring a condition of a first subsystem with a second subsystem, monitoring a condition of the second subsystem with a third subsystem, monitoring a condition of the third subsystem with a fourth subsystem, and so on. The displays can operate in a first video passthrough mode or a second video passthrough mode based on the condition of the first subsystem as monitored by the second subsystem, the condition of the second subsystem as monitored by the third subsystem, and/or the condition of the third subsystem as monitored by the fourth subsystem.

公开(公告)号：US12052430B2

公开(公告)日：2024-07-30

申请号：US17889277

申请日：2022-08-16

Applicant: Apple Inc.

Inventor： Ranjit Desai ,  Adrian P. Lindberg ,  Kaushik Raghunath ,  Vinay Palakkode

IPC: H04N19/33 ,  G06V10/25 ,  G06V10/70 ,  G06V20/40

CPC classification number: H04N19/33 ,  G06V10/25 ,  G06V10/70 ,  G06V20/46

Abstract: A method is provided that includes receiving content data captured by a sensor and receiving a context signal representing a user context. The received content data is scaled using a trained model, wherein the context signal is an input to the trained model, and the scaled content data is provided for presentation to a user.

公开(公告)号：US20240201776A1

公开(公告)日：2024-06-20

申请号：US18535797

申请日：2023-12-11

Applicant: Apple Inc.

Inventor： David M Jun ,  Arun Kannan ,  Kaushik Raghunath ,  Nikhil Sharma ,  Venu M Duggineni

IPC: G06F1/3287 ,  G06F1/16 ,  G06F1/20

CPC classification number: G06F1/3287 ,  G06F1/163 ,  G06F1/206

Abstract: An electronic device may include software and hardware subsystems that are centrally controlled by a user experience manager. The user experience manager can identify a current user context and enforce a corresponding power and performance policy for the various subsystems that is optimized for the current user context. The user experience manager can provide a set of restrictions at the launch of a user experience, can allow the various subsystems to vary their dynamic behavior based on current operating conditions as long as the dynamic adjustments do not violate the restrictions, and can perform a series of thermal mitigation operations as the internal temperature of the electronic device varies. The centralized user experience manager can also be configured to predict a user context based on monitored states of the subsystems and monitored application usage on the electronic device.

公开(公告)号：US20240406454A1

公开(公告)日：2024-12-05

申请号：US18510409

申请日：2023-11-15

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Alhad A. Palkar ,  Kaushik Raghunath ,  Arun Kannan ,  Manjunath M. Venkatesh

IPC: H04N19/65 ,  H04L65/80 ,  H04N19/895

Abstract: A system including a first integrated circuit configured to render image data and transport the image data. Further, the system includes a second integrated circuit configured to receive the image data, determine whether the image data is missing data that was expected to have been received, and generate placeholder data in response to determining that the image data is missing data that was expected to have been received.

公开(公告)号：US20240107183A1

公开(公告)日：2024-03-28

申请号：US18369399

申请日：2023-09-18

Applicant: Apple Inc.

Inventor： Joseph Cheung ,  Kaushik Raghunath ,  Michael Bekerman ,  Moinul H. Khan ,  Vivaan Bahl ,  Yung-Chin Chen ,  Yuqing Su

IPC: H04N23/86 ,  H04N23/60 ,  H04N23/83

CPC classification number: H04N23/86 ,  H04N23/665 ,  H04N23/83

Abstract: In some implementations, a method of synchronizing a content generation and delivery architecture to reduce the latency associated with image passthrough. The method includes: determining a temporal offset associated with the content generation and delivery architecture to reduce a photon-to-photon latency across the content generation and delivery architecture; obtaining a first reference rate associated with a portion of the content generation and delivery architecture; generating, via synchronization circuitry, a synchronization signal for the content generation and delivery architecture based at least in part on the first reference rate; and operating the content generation and delivery architecture according to the synchronization signal and the temporal offset.

公开(公告)号：US20240104693A1

公开(公告)日：2024-03-28

申请号：US18472710

申请日：2023-09-22

Applicant: Apple Inc.

Inventor： Vinay Palakkode ,  Kaushik Raghunath ,  Venu M. Duggineni ,  Vivaan Bahl

IPC: G06T3/40 ,  G06T7/60 ,  G06T7/70 ,  G06T15/00

CPC classification number: G06T3/4046 ,  G06T7/60 ,  G06T7/70 ,  G06T15/005 ,  G06T2207/20084 ,  G06T2207/30196

Abstract: Generating synthesized data includes capturing one or more frames of a scene at a first frame rate by one or more cameras of a wearable device, determining body position parameters for the frames, and obtaining geometry data for the scene in accordance with the one or more frames. The frames, body position parameters, and geometry data are applied to a trained network which predicts one or more additional frames. With respect to virtual data, generating a synthesized frame includes determining current body position parameters in accordance with the one or more frames, predicting a future gaze position based on the current body position parameters, and rendering, at a first resolution, a gaze region of a frame in accordance with the future gaze position. A peripheral region is predicted for the frame at a second resolution, and the combined regions form a frame that is used to drive a display.