-
公开(公告)号:US10659757B2
公开(公告)日:2020-05-19
申请号:US16241294
申请日:2019-01-07
Applicant: Apple Inc.
Inventor: Ricardo J. Motta , Gary L. Vondran, Jr. , Manohar B. Srikanth , Brett D. Miller
IPC: H04N13/156 , H04N7/14 , G06F3/01 , H04N5/247 , H04N5/232 , H04N7/18 , H04N13/122 , H04N13/117 , H04N13/243
Abstract: This disclosure pertains to operations, systems, and computer readable media to capture images of a scene using a camera array and process the captured images based on a viewer's point of view (POV) for immersive augmented reality, live display wall, head mounted display, video conferencing, and similar applications. In one implementation, the disclosed subject matter provides a complete view to a viewer by combining images captured by a camera array. In another implementation, the disclosed subject matter tracks the viewer's POV as he moves from one location to another and displays images in accordance with his varying POV. The change of the viewer's POV is inclusive of movements in the X, Y, and Z dimensions.
-
公开(公告)号:US10178371B2
公开(公告)日:2019-01-08
申请号:US15588228
申请日:2017-05-05
Applicant: Apple Inc.
Inventor: Ricardo J. Motta , Gary L. Vondran, Jr. , Manohar B. Srikanth , Brett D. Miller
IPC: H04N7/15 , H04N13/156 , H04N7/14 , G06F3/01 , H04N5/247 , H04N5/232 , H04N13/117 , H04N13/243 , H04N7/18 , H04N13/122
Abstract: This disclosure pertains to operations, systems, and computer readable media to capture images of a scene using a camera array and process the captured images based on a viewer's point of view (POV) for immersive augmented reality, live display wall, head mounted display, video conferencing, and similar applications. In one implementation, the disclosed subject matter provides a complete view to a viewer by combining images captured by a camera array. In another implementation, the disclosed subject matter tracks the viewer's POV as he moves from one location to another and displays images in accordance with his varying POV. The change of the viewer's POV is inclusive of movements in the X, Y, and Z dimensions.
-
公开(公告)号:US20180082482A1
公开(公告)日:2018-03-22
申请号:US15711992
申请日:2017-09-21
Applicant: Apple Inc.
Inventor: Ricardo J. Motta , Brett D. Miller , Tobias Rick , Manohar B. Srikanth
CPC classification number: G06T19/006 , G02B27/0093 , G02B27/0172 , G02B2027/0136 , G02B2027/0138 , G02B2027/014 , G02B2027/0187 , G06F1/163 , G06F3/011 , G06F3/012 , G06F3/013 , G06F3/015 , G06F3/017 , H04N13/344 , H04N13/383
Abstract: A mixed reality system that includes a head-mounted display (HMD) that provides 3D virtual views of a user's environment augmented with virtual content. The HMD may include sensors that collect information about the user's environment (e.g., video, depth information, lighting information, etc.), and sensors that collect information about the user (e.g., the user's expressions, eye movement, hand gestures, etc.). The sensors provide the information as inputs to a controller that renders frames including virtual content based at least in part on the inputs from the sensors. The HMD may display the frames generated by the controller to provide a 3D virtual view including the virtual content and a view of the user's environment for viewing by the user.
-
公开(公告)号:US11592864B2
公开(公告)日:2023-02-28
申请号:US17682173
申请日:2022-02-28
Applicant: Apple Inc.
Inventor: Manohar B. Srikanth , Marduke Yousefpor , Ting Sun , Kathrin Berkner-Cieslicki , Mohammad Yeke Yazdandoost , Ricardo J. Motta
Abstract: In one implementation, an apparatus includes a display having a front surface and a back surface. The display includes a plurality of pixel regions that emit light from the front surface to display a displayed image and a plurality of apertures that transmit light from the front surface to the back surface. The apparatus includes a camera disposed on a side of the back surface of the display. The camera is configured to capture a captured image. The apparatus includes a processor coupled to the display and the camera. The processor is configured to receive the captured image and apply a first digital filter to a first portion of the captured image and a second digital filter, different than the first digital filter, to a second portion of the captured image to reduce image distortion caused by the display.
-
公开(公告)号:US11294422B1
公开(公告)日:2022-04-05
申请号:US16580477
申请日:2019-09-24
Applicant: Apple Inc.
Inventor: Manohar B. Srikanth , Marduke Yousefpor , Ting Sun , Kathrin Berkner-Cieslicki , Mohammad Yeke Yazdandoost , Ricardo J. Motta
Abstract: In one implementation, an apparatus includes a display having a front surface and a back surface. The display includes a plurality of pixel regions that emit light from the front surface to display a displayed image and a plurality of apertures that transmit light from the front surface to the back surface. The apparatus includes a camera disposed on a side of the back surface of the display. The camera is configured to capture a captured image. The apparatus includes a processor coupled to the display and the camera. The processor is configured to receive the captured image and apply a first digital filter to a first portion of the captured image and a second digital filter, different than the first digital filter, to a second portion of the captured image to reduce image distortion caused by the display.
-
公开(公告)号:US11217021B2
公开(公告)日:2022-01-04
申请号:US16361110
申请日:2019-03-21
Applicant: Apple Inc.
Inventor: Ricardo J. Motta , Brett D. Miller , Tobias Rick , Manohar B. Srikanth
IPC: G06T19/00 , H04N13/383 , G06F1/16 , G06F3/01 , G02B27/00 , H04N13/344 , G02B27/01
Abstract: A mixed reality system that includes a head-mounted display (HMD) that provides 3D virtual views of a user's environment augmented with virtual content. The HMD may include sensors that collect information about the user's environment (e.g., video, depth information, lighting information, etc.), and sensors that collect information about the user (e.g., the user's expressions, eye movement, hand gestures, etc.). The sensors provide the information as inputs to a controller that renders frames including virtual content based at least in part on the inputs from the sensors. The HMD may display the frames generated by the controller to provide a 3D virtual view including the virtual content and a view of the user's environment for viewing by the user.
-
公开(公告)号:US11187914B2
公开(公告)日:2021-11-30
申请号:US16583193
申请日:2019-09-25
Applicant: Apple Inc.
Inventor: Daniel R. Hennigan , Noah D. Bedard , Branko Petljanski , Jason C. Sauers , Edward S. Huo , Ricardo J. Motta , Brett D. Miller , Yury Petrov
Abstract: A scene camera system that includes two or more mirrors that reflect light from a respective portion of a field of view (FOV) in front of the system and two or more cameras that each capture the light reflected by a respective one of the two or more mirrors. By using the mirrors to reflect the light, the cameras' entrance pupils are imaged to a location closer to a user's eyes to thus achieve a more accurate representation of the perspective of the user.
-
公开(公告)号:US11044398B2
公开(公告)日:2021-06-22
申请号:US16583176
申请日:2019-09-25
Applicant: Apple Inc.
Inventor: Gabriel D. Molina , Ricardo J. Motta , Gary L. Vondran, Jr. , Dan Lelescu , Tobias Rick , Brett Miller
IPC: H04N5/232 , H04N13/106 , G06T7/557 , H04N13/282 , H04N13/117 , G06T5/50 , G06T7/00 , G06T1/00
Abstract: A light field panorama system in which a user holding a mobile device performs a gesture to capture images of a scene from different positions. Additional information, for example position and orientation information, may also be captured. The images and information may be processed to determine metadata including the relative positions of the images and depth information for the images. The images and metadata may be stored as a light field panorama. The light field panorama may be processed by a rendering engine to render different 3D views of the scene to allow a viewer to explore the scene from different positions and angles with six degrees of freedom. Using a rendering and viewing system such as a mobile device or head-mounted display, the viewer may see behind or over objects in the scene, zoom in or out on the scene, or view different parts of the scene.
-
公开(公告)号:US20190260979A1
公开(公告)日:2019-08-22
申请号:US16241294
申请日:2019-01-07
Applicant: Apple Inc.
Inventor: Ricardo J. Motta , Gary L. Vondran, JR. , Manohar B. Srikanth , Brett D. Miller
IPC: H04N13/156 , H04N7/14 , H04N5/232 , G06F3/01 , H04N13/122 , H04N7/18 , H04N13/243 , H04N13/117 , H04N5/247
Abstract: This disclosure pertains to operations, systems, and computer readable media to capture images of a scene using a camera array and process the captured images based on a viewer's point of view (POV) for immersive augmented reality, live display wall, head mounted display, video conferencing, and similar applications. In one implementation, the disclosed subject matter provides a complete view to a viewer by combining images captured by a camera array. In another implementation, the disclosed subject matter tracks the viewer's POV as he moves from one location to another and displays images in accordance with his varying POV. The change of the viewer's POV is inclusive of movements in the X, Y, and Z dimensions.
-
公开(公告)号:US20190221044A1
公开(公告)日:2019-07-18
申请号:US16361110
申请日:2019-03-21
Applicant: Apple Inc.
Inventor: Ricardo J. Motta , Brett D. Miller , Tobias Rick , Manohar B. Srikanth
IPC: G06T19/00 , H04N13/344 , G02B27/00 , G06F3/01 , G02B27/01 , G06F1/16 , H04N13/383
CPC classification number: G06T19/006 , G02B27/0093 , G02B27/0172 , G02B2027/0136 , G02B2027/0138 , G02B2027/014 , G02B2027/0187 , G06F1/163 , G06F3/011 , G06F3/012 , G06F3/013 , G06F3/015 , G06F3/017 , H04N13/344 , H04N13/383
Abstract: A mixed reality system that includes a head-mounted display (HMD) that provides 3D virtual views of a user's environment augmented with virtual content. The HMD may include sensors that collect information about the user's environment (e.g., video, depth information, lighting information, etc.), and sensors that collect information about the user (e.g., the user's expressions, eye movement, hand gestures, etc.). The sensors provide the information as inputs to a controller that renders frames including virtual content based at least in part on the inputs from the sensors. The HMD may display the frames generated by the controller to provide a 3D virtual view including the virtual content and a view of the user's environment for viewing by the user.
-
-
-
-
-
-
-
-
-