-
公开(公告)号:US11921286B2
公开(公告)日:2024-03-05
申请号:US17450128
申请日:2021-10-06
Applicant: Apple Inc.
Inventor: Noah D. Bedard , Branko Petljanski , Kathrin Berkner Cieslicki , Ricardo J. Motta
CPC classification number: G02B27/0081 , G02B27/017 , G02B27/0172 , G06F3/013 , G06T19/006 , G06V20/20 , G02B2027/0138
Abstract: This disclosure describes a novel lens system having an entrance pupil at a location matching, or nearly matching, the eye's optical system entrance pupil. The described lens system is significantly thinner than a single-aperture lens with matched entrance pupil and is achieved by using an array of camera elements. Each camera element contains camera optics called “lenslets” and a sensor (e.g., an image or depth sensor), where a lenslet can include one or more lens elements (e.g., a compound lens). Individual camera elements can be arranged such that THEIR optical axes intersect at, or near, the eye's entrance pupil location. In addition, each camera element's field-of-view (FOV) corresponds to a small sector of a large FOV. The FOVs of adjacent camera elements can be non- or slightly-overlapping so that a wide-angle image can be formed by concatenation of the individual camera element images.
-
公开(公告)号:US20230185093A1
公开(公告)日:2023-06-15
申请号:US17933060
申请日:2022-09-16
Applicant: Apple Inc.
Inventor: Noah D. Bedard , Ricardo J. Motta , Emanuele Mandelli , Daniel R. Hennigan , Kathrin Berkner Cieslicki , Branko Petljanski , Brett D. Miller , Kenichi Saito
CPC classification number: G02B27/0172 , G03B30/00 , G02B2027/014 , G02B2027/0123 , G02B2027/0129 , G02B2027/0138 , G02B2027/0198
Abstract: A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user’s eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.
-
公开(公告)号:US20230168711A1
公开(公告)日:2023-06-01
申请号:US18101884
申请日:2023-01-26
Applicant: Apple Inc.
Inventor: Manohar B. Srikanth , Marduke Yousefpor , Ting Sun , Kathrin Berkner-Cieslicki , Mohammad Yeke Yazdandoost , Ricardo J. Motta
CPC classification number: G06F1/1605 , G06F1/1626 , G06F1/1637 , H04N23/63
Abstract: In one implementation, an apparatus includes a display having a front surface and a back surface. The display includes a plurality of pixel regions that emit light from the front surface to display a displayed image and a plurality of apertures that transmit light from the front surface to the back surface. The apparatus includes a camera disposed on a side of the back surface of the display. The camera is configured to capture a captured image. The apparatus includes a processor coupled to the display and the camera. The processor is configured to receive the captured image and apply a first digital filter to a first portion of the captured image and a second digital filter, different than the first digital filter, to a second portion of the captured image to reduce image distortion caused by the display.
-
公开(公告)号:US11448886B2
公开(公告)日:2022-09-20
申请号:US17276476
申请日:2019-09-27
Applicant: Apple Inc.
Inventor: Noah D. Bedard , Ricardo J. Motta , Emanuele Mandelli , Daniel R. Hennigan , Kathrin Berkner Cieslicki , Branko Petljanski , Brett D. Miller , Kenichi Saito
Abstract: A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user's eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.
-
公开(公告)号:US20220035160A1
公开(公告)日:2022-02-03
申请号:US17276476
申请日:2019-09-27
Applicant: Apple Inc.
Inventor: Noah D. Bedard , Ricardo J. Motta , Emanuele Mandelli , Daniel R. Hennigan , Kathrin Berkner Cieslicki , Branko Petljanski , Brett D. Miller , Kenichi Saito
Abstract: A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user's eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.
-
公开(公告)号:US20180113508A1
公开(公告)日:2018-04-26
申请号:US15788725
申请日:2017-10-19
Applicant: Apple Inc.
Inventor: Kathrin Berkner-Cieslicki , Ricardo J. Motta , Se Hoon Lim , Minwoong Kim , Kenichi Saito , Branko Petljanski , Jason C. Sauers , Yoshikazu Shinohara
CPC classification number: G06F3/013 , G02B27/0172 , G02B2027/0187 , G06T7/292 , G06T19/006 , H04N5/33
Abstract: An eye tracking system for detecting position and movements of a user's eyes in a head-mounted display (HMD). The eye tracking system may include at least one near-IR (NIR) eye tracking camera positioned at each side of the user's face and pointed towards eye-facing surfaces of eyepieces of the HMD, an illumination source that emits NIR light towards the user's eyes, and hot mirrors located between the eye-facing surfaces of the eyepieces and the user's eyes. The hot mirrors reflect at least a portion of NIR light, while allowing visible light to pass. The cameras capture images of the user's eyes reflected by the hot mirrors. Positioning the hot mirrors at or near the eye-facing surfaces of the eyepieces allows the cameras to be placed at the sides of the user's face without having to image through the eyepieces.
-
公开(公告)号:US09681096B1
公开(公告)日:2017-06-13
申请号:US15275074
申请日:2016-09-23
Applicant: Apple Inc.
Inventor: Ricardo J. Motta , Gary L. Vondran, Jr. , Manohar B. Srikanth , Brett D. Miller
CPC classification number: H04N13/156 , G06F3/011 , G06F3/012 , G06F3/013 , H04N5/23219 , H04N5/247 , H04N7/142 , H04N7/144 , H04N7/147 , H04N7/18 , H04N13/117 , H04N13/122 , H04N13/243
Abstract: This disclosure pertains to operations, systems, and computer readable media to capture images of a scene using a camera array and process the captured images based on a viewer's point of view (POV) for immersive augmented reality, live display wall, head mounted display, video conferencing, and similar applications. In one implementation, the disclosed subject matter provides a complete view to a viewer by combining images captured by a camera array. In another implementation, the disclosed subject matter tracks the viewer's POV as he moves from one location to another and displays images in accordance with his varying POV. The change of the viewer's POV is inclusive of movements in the X, Y, and Z dimensions.
-
公开(公告)号:US20250104183A1
公开(公告)日:2025-03-27
申请号:US18907344
申请日:2024-10-04
Applicant: Apple Inc.
Inventor: Brett D. Miller , Minwoong Kim , Ricardo J. Motta
IPC: G06T3/18 , G06T7/50 , G06T7/521 , G06T7/593 , G06T7/70 , G06V20/10 , H04N5/262 , H04N9/73 , H04N23/63 , H04N23/67 , H04N23/90
Abstract: Presenting an image of a scene may include capturing an image of a scene by a camera of an electronic device, wherein the electronic device comprises the camera and a display, and wherein the camera and the display have a first spatial relationship, determining a second spatial relationship between a viewpoint and the display of the electronic device, warping the image to obtain an image of a first portion of the scene based on the first spatial relationship and the second spatial relationship, and presenting the warped image on the display, wherein, from the viewpoint, the image of the first portion of the scene is substantially contiguous with a second portion of the scene visible outside an edge of the electronic device.
-
公开(公告)号:US11860368B2
公开(公告)日:2024-01-02
申请号:US17933060
申请日:2022-09-16
Applicant: Apple Inc.
Inventor: Noah D. Bedard , Ricardo J. Motta , Emanuele Mandelli , Daniel R. Hennigan , Kathrin Berkner Cieslicki , Branko Petljanski , Brett D. Miller , Kenichi Saito
CPC classification number: G02B27/0172 , G03B30/00 , G02B2027/014 , G02B2027/0123 , G02B2027/0129 , G02B2027/0138 , G02B2027/0198
Abstract: A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user's eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.
-
公开(公告)号:US11720996B2
公开(公告)日:2023-08-08
申请号:US17651001
申请日:2022-02-14
Applicant: Apple Inc.
Inventor: Brett D. Miller , Minwoong Kim , Ricardo J. Motta
IPC: G06T3/00 , G06V20/10 , H04N23/63 , H04N23/90 , G06T7/50 , G06T7/70 , H04N5/262 , H04N9/73 , H04N23/67 , G06T7/521 , G06T7/593
CPC classification number: G06T3/0093 , G06T7/50 , G06T7/70 , G06V20/10 , H04N5/2621 , H04N9/73 , H04N23/63 , H04N23/90 , G06T7/521 , G06T7/593 , G06T2207/20164 , G06T2207/30201 , H04N23/67
Abstract: Presenting an image of a scene may include capturing an image of a scene by a camera of an electronic device, wherein the electronic device comprises the camera and a display, and wherein the camera and the display have a first spatial relationship, determining a second spatial relationship between a viewpoint and the display of the electronic device, warping the image to obtain an image of a first portion of the scene based on the first spatial relationship and the second spatial relationship, and presenting the warped image on the display, wherein, from the viewpoint, the image of the first portion of the scene is substantially contiguous with a second portion of the scene visible outside an edge of the electronic device.
-
-
-
-
-
-
-
-
-