公开(公告)号：US20240112303A1

公开(公告)日：2024-04-04

申请号：US18371872

申请日：2023-09-22

Applicant: Apple Inc.

Inventor： Vincent Chapdelaine-Couture ,  Emmanuel Piuze-Phaneuf ,  Julien Monat Rodier ,  Hermannus J. Damveld ,  Xiaojin Shi ,  Sebastian Gaweda

IPC: G06T5/00 ,  G06T5/50 ,  G06T7/246

CPC classification number: G06T5/001 ,  G06T5/50 ,  G06T7/248

Abstract: In some implementations, a method includes: obtaining image data associated with a physical environment; obtaining first contextual information including at least one of first user information associated with a current state of a user of the computing system, first application information associated with a first application being executed by the computing system, and first environment information associated with a current state of the physical environment; selecting a first set of perspective correction operations based at least in part on the first contextual information; generating first corrected image data by performing the first set of perspective correction operations on the image data; and causing presentation of the first corrected image data.

公开(公告)号：US20240233205A1

公开(公告)日：2024-07-11

申请号：US18612967

申请日：2024-03-21

Applicant: Apple Inc.

Inventor： Maxime Meilland ,  Duncan A. McRoberts ,  Julien Monat Rodier ,  Seyedkoosha Mirhosseini

IPC: G06T11/00 ,  G06T3/00 ,  G06T7/50

CPC classification number: G06T11/00 ,  G06T3/00 ,  G06T7/50

Abstract: In one implementation, a method of performing perspective correction of an image is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes capturing, using the image sensor, an image of a physical environment. The method includes obtaining a plurality of depths respectively associated with a plurality of pixels of the image of the physical environment. The method includes generating a clamped depth map of the image of the physical environment based on the plurality of depths, wherein each element of the clamped depth map has a depth value above or equal to a depth threshold. The method includes generating a display image by transforming, using the one or more processors, the image of the physical environment based on the clamped depth map and a difference between a perspective of the image sensor and a perspective of a user. The method includes displaying, on the display, the display image.

公开(公告)号：US20240098243A1

公开(公告)日：2024-03-21

申请号：US18369607

申请日：2023-09-18

Applicant: Apple Inc.

Inventor： Hermannus J. Damveld ,  Julien Monat Rodier ,  Marc-Andre Chenier

IPC: H04N13/344 ,  G06T3/00 ,  G06T7/70

CPC classification number: H04N13/344 ,  G06T3/0093 ,  G06T7/70 ,  G06T2207/30244

Abstract: In one implementation, a method of warping an image is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes predicting a capture pose of the device in a physical environment at a capture time and a display pose of the device in the physical environment at a display time. The method includes capturing, using the image sensor, an image of the physical environment during a capture time period including the capture time. The method includes generating a warp definition based on the predicted capture pose and the predicted display pose. The method includes warping, using the one or more processors, the image of the physical environment based on the warp definition. The method includes displaying, on the display, the warped image of the physical environment during a display time period including the display time.

公开(公告)号：US11270409B1

公开(公告)日：2022-03-08

申请号：US17029396

申请日：2020-09-23

Applicant: Apple Inc.

Inventor： Raffi A. Bedikian ,  Mohamed Selim Ben Himane ,  Pedro Manuel Da Silva Quelhas ,  Moinul Khan ,  Katharina Buckl ,  Jim C. Chou ,  Julien Monat Rodier

IPC: G06T3/00 ,  G02B27/01 ,  G02B27/00 ,  H04N13/117

Abstract: A method includes obtaining an image via an image sensor. The method includes determining a first perceptual quality value that is associated with a first portion of the image. The method includes determining a first image perceptual quality warping function that is based on the first perceptual quality value and an image warping map. The first image perceptual quality warping function is characterized by a first warping granularity level that is a function of the first perceptual quality value. The method includes warping the first portion of the image according to the first image perceptual quality warping function.