公开(公告)号：US20240272435A1

公开(公告)日：2024-08-15

申请号：US18472138

申请日：2023-09-21

Applicant: Apple Inc.

Inventor： Simon Fortin-Deschenes ,  Amanda K Abramson ,  Luke A Pillans ,  Nicholas C Soldner

IPC: G02B27/01

CPC classification number: G02B27/0172 ,  G02B27/0176 ,  G02B2027/0118 ,  G02B2027/0138

Abstract: A head-mounted device may include a component such as a sidewall structure that is switchable between an opaque mode and a transparent mode. In the opaque mode, the component may block ambient light from passing into the interior of the head-mounted device (such that the user cannot see the surrounding environment). In the transparent mode, the component may allow ambient light to pass into the interior of the head-mounted device (such that the user can see portions of the surrounding environment). The opaque mode may provide a more immersive experience for the user of the head-mounted device, whereas the transparent mode may allow the user to see objects in their surrounding physical environment. Instead or in addition, the head-mounted device may include one or more sidewall displays.

公开(公告)号：US20250111589A1

公开(公告)日：2025-04-03

申请号：US18826434

申请日：2024-09-06

Applicant: Apple Inc.

Inventor： Simon Fortin-Deschenes ,  Luke A Pillans ,  Anselm Grundhoefer ,  Christian I Moore ,  Seyedkoosha Mirhosseini

IPC: G06T15/06 ,  G06F3/01 ,  G06T5/70 ,  G06T5/73 ,  G06V10/56 ,  G06V10/60 ,  G06V10/764

Abstract: Various implementations provide passthrough video based on adjusting camera parameters based on environment modeling. An environment characteristic may be determined based on modeling the physical environment based on sensor data captured via one or more sensors. For example, this may involve determining environment light source optical characteristics, environment surfaces optical characteristics, a 3D mapping of the environment, user behavior, a prediction of optical characteristics of light coming in the camera, and the like. The method may involve, based on the environment characteristic, determining a camera parameter for an image captured via the image sensor. For example, the method may determine exposure, gain, tone mapping, color balance, noise reduction, sharpness enhancement. The method may determine the camera parameter based on user information, e.g., user preferences, user activity, etc. The method may involve providing passthrough video of the physical environment based on the determined camera parameter.

公开(公告)号：US20240089605A1

公开(公告)日：2024-03-14

申请号：US18455476

申请日：2023-08-24

Applicant: Apple Inc.

Inventor： Luke A Pillans ,  Simon Fortin-Deschenes

IPC: H04N23/72 ,  G06F3/01 ,  H04N23/13 ,  H04N23/73 ,  H04N23/745 ,  H04N23/76 ,  H04N23/88

CPC classification number: H04N23/72 ,  G06F3/012 ,  H04N23/13 ,  H04N23/73 ,  H04N23/745 ,  H04N23/76 ,  H04N23/88

Abstract: A head-mounted device may include one or more sensors for capturing images of a real-world environment and for determining where the head-mounted device is facing in the real-world environment. The sensors can be used to capture images for creating a lighting map that indicates where one or more light sources are located within the environment and for creating a physical map representing a geometry of the environment. The sensors can be used to predict a direction in which the head-mounted device will be facing in the real-world environment. One of the sensors can include an image sensor for capturing images that are displayed to a user of the head-mounted device. One or more settings of the image sensor can be adjusted based on the lighting map and based on the predicted direction of where the head-mounted device will be facing when capturing a future frame.