-
公开(公告)号：US20240211035A1
公开(公告)日：2024-06-27
申请号：US18390084
申请日：2023-12-20
申请人： Apple Inc.
发明人： Arthur Y. Zhang , Ray L. Chang , Yanli Zhang , Luke A. Pillans , Ryan J. Dunn , Jeffrey N. Gleason , Christian Moore , Simon Fortin-Deschenes , Emmanuel Piuze-Phaneuf
摘要： Various implementations disclosed herein include devices, systems, and methods that adjust a focus of a camera based on a distance associated with a determined user attention. For example, an example process may include obtaining sensor data from one or more sensors in a physical environment. The process may include determining at least one gaze direction of at least one eye based on the sensor data. The process may further include determining a distance associated with user attention based on a convergence determined based on an intersection of gaze directions of the at least one gaze direction, or a distance of an object in a 3D representation of the physical environment based on the at least one gaze direction. The process may further include adjusting a focus of a camera of the one or more sensors based on the distance associated with the user attention.
-
公开(公告)号：US20240112303A1
公开(公告)日：2024-04-04
申请号：US18371872
申请日：2023-09-22
申请人： Apple Inc.
发明人： Vincent Chapdelaine-Couture , Emmanuel Piuze-Phaneuf , Julien Monat Rodier , Hermannus J. Damveld , Xiaojin Shi , Sebastian Gaweda
摘要： In some implementations, a method includes: obtaining image data associated with a physical environment; obtaining first contextual information including at least one of first user information associated with a current state of a user of the computing system, first application information associated with a first application being executed by the computing system, and first environment information associated with a current state of the physical environment; selecting a first set of perspective correction operations based at least in part on the first contextual information; generating first corrected image data by performing the first set of perspective correction operations on the image data; and causing presentation of the first corrected image data.
-
公开(公告)号：US20240078692A1
公开(公告)日：2024-03-07
申请号：US18242339
申请日：2023-09-05
申请人： Apple Inc.
摘要： In one implementation, a method of performing perspective correction is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes capturing, using the image sensor, an image of a physical environment. The method includes obtaining a depth map including a plurality of depths respectively associated with a plurality of pixels of the image of the physical environment, wherein the depth map includes, for a particular pixel at a particular pixel location representing a dynamic object in the physical environment, a particular depth corresponding to a distance between the image sensor and a static object in the physical environment behind the dynamic object. The method includes transforming, using the one or more processors, the image of the physical environment based on the depth map. The method includes displaying, on the display, the transformed image.
-
公开(公告)号：US20240078640A1
公开(公告)日：2024-03-07
申请号：US18241629
申请日：2023-09-01
申请人： Apple Inc.
摘要： In one implementation, a method of performing perspective correction is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes capturing, using the image sensor, an image of a physical environment. The method includes obtaining a depth map including a plurality of depths respectively associated with a plurality of pixels of the image of the physical environment. The method includes smoothing the depth map based on a world-fixed vector. The method includes transforming, using the one or more processors, the image of the physical environment based on the smoothed depth map. The method includes displaying, on the display, the transformed image.
-
公开(公告)号：US20230377249A1
公开(公告)日：2023-11-23
申请号：US18089664
申请日：2022-12-28
申请人： Apple Inc.
CPC分类号： G06T15/205 , G06T3/0093 , G06T7/70 , G06T7/50 , G06T5/002 , G06T2207/10024 , G06T2207/10028
摘要： The method includes: obtaining a first image of an environment from a first image sensor associated with first intrinsic parameters; performing a warping operation on the first image according to perspective offset values to generate a warped first image in order to account for perspective differences between the first image sensor and a user of the electronic device; determining an occlusion mask based on the warped first image that includes a plurality of holes; obtaining a second image of the environment from a second image sensor associated with second intrinsic parameters; normalizing the second image based on a difference between the first and second intrinsic parameters to produce a normalized second image; and filling a first set of one or more holes of the occlusion mask based on the normalized second image to produce a modified first image.
-
公开(公告)号：US20240202866A1
公开(公告)日：2024-06-20
申请号：US18286522
申请日：2022-03-29
申请人： Apple Inc.
发明人： Samer Barakat , Bertrand Nepveu , Christian W. Gosch , Emmanuel Piuze-Phaneuf , Vincent Chapdelaine-Couture
CPC分类号： G06T3/18 , G02B27/017 , G06T7/55
摘要： In one implementation, a method of performing perspective correction of an image is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes capturing, using the image sensor, an image of a physical environment. The method includes obtaining a plurality of initial depths respectively associated with a plurality of pixels of the image of the physical environment. The method includes generating a depth map for the image of the physical environment based on the plurality of initial depths and a respective plurality of confidences of the plurality of initial depths. The method includes transforming, using the one or more processors, the image of the physical environment based on the depth map and a difference between a perspective of the image sensor and a perspective of a user. The method includes displaying, on the display, the transformed image.
-
公开(公告)号：US20240098232A1
公开(公告)日：2024-03-21
申请号：US18369621
申请日：2023-09-18
申请人： Apple Inc.
发明人： Emmanuel Piuze-Phaneuf , Hermannus J. Damveld , Jean-Nicola F. Blanchet , Mohamed Selim Ben Himane , Vincent Chapdelaine-Couture , Xiaojin Shi
IPC分类号： H04N13/117 , H04N13/383
CPC分类号： H04N13/117 , H04N13/383
摘要： In one implementation, a method of performing perspective correction is performed by a device having a three-dimensional device coordinate system and including a first image sensor, a first display, one or more processors, and non-transitory memory. The method includes capturing, using the first image sensor, a first image of a physical environment. The method includes transforming the first image from a first perspective of the first image sensor to a second perspective based on a difference between the first perspective and the second perspective, wherein the second perspective is a first distance away from a location corresponding to a first eye of a user less than a second distance between the first perspective and the location corresponding to the first eye of the user. The method includes displaying, on the first display, the transformed first image of the physical environment.
-
公开(公告)号：US20240005536A1
公开(公告)日：2024-01-04
申请号：US18212480
申请日：2023-06-21
申请人： Apple Inc.
IPC分类号： G06T7/50 , G06F3/04815 , H04N13/279 , G06V40/10
CPC分类号： G06T7/50 , G06F3/04815 , H04N13/279 , G06V40/107 , G06T2207/30196 , G06V2201/07
摘要： In one implementation, a method of determining a display location is performed by a device including one or more processors and non-transitory memory. The method includes obtaining a camera set of two-dimensional coordinates of a user input object in a physical environment. The method includes obtaining depth information of the physical environment excluding the user input object. The method includes transforming the camera set of two-dimensional coordinates into a display set of two-dimensional coordinates based on the depth information of the physical environment excluding the user input object.
-
-
-
-
-
-
-
搜索结果
8 条记录 (耗时 0.013 秒)
