公开(公告)号：US12126943B1

公开(公告)日：2024-10-22

申请号：US17665331

申请日：2022-02-04

申请人： Apple Inc.

发明人： Felipe Bacim de Araujo e Silva ,  Stuart J. Wood ,  Noah D. Bedard ,  Bosheng Zhang ,  Dana F. Segler, Jr. ,  Blake M. Coughenour ,  Rong Liu ,  Yung-Yu Hsu

IPC分类号： H04N9/31 ,  G01B11/25 ,  G03B21/20

CPC分类号： H04N9/3138 ,  G01B11/25 ,  G03B21/2013 ,  G03B21/2033 ,  G03B21/208 ,  H04N9/3147 ,  H04N9/3164 ,  H04N9/3194

摘要： A spatial light system that may, for example, be used to project image content onto surfaces of a room. The system may include two or more projection units for emitting light onto surfaces within a room. The system may include a controller and two or more projection units, each module including an LED array, an array of light pipes, and a condenser lens. Two or more projection units may be connected to a flexible strip that provides power and data (e.g., serial data) to the projection units. Two or more flex strips may be connected together. The flex strips provide a serially-connected, flexible modular architecture for spatial light systems that allow the projection units to be conformed to a variety of configurations and shapes.

公开(公告)号：US20240053823A1

公开(公告)日：2024-02-15

申请号：US18493482

申请日：2023-10-24

申请人： Apple Inc.

发明人： Kathrin Berkner-Cieslicki ,  Se Baek Oh ,  Scott M. DeLapp ,  Christopher F. Griffo ,  Bradley C. Steele ,  Ting Sun ,  Kenichi Saito ,  Noah D. Bedard

IPC分类号： G06F3/01 ,  G02B27/00 ,  G02B27/01

CPC分类号： G06F3/013 ,  G02B27/0093 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0174 ,  G02B2027/0187

摘要： An eye tracking system for detecting position and movements of a user's eyes in a head-mounted display (HMD). The eye tracking system includes at least one eye tracking camera, an illumination source that emits infrared light towards the user's eyes, and diffraction gratings located at the eyepieces. The diffraction gratings redirect or reflect at least a portion of infrared light reflected off the user's eyes, while allowing visible light to pass. The cameras capture images of the user's eyes from the infrared light that is redirected or reflected by the diffraction gratings.

公开(公告)号：US11550408B1

公开(公告)日：2023-01-10

申请号：US17361144

申请日：2021-06-28

申请人： Apple Inc.

发明人： Jean Hsiang-Chun Lu ,  Bosheng Zhang ,  Kathrin Berkner Cieslicki ,  Manohar B. Srikanth ,  Noah D. Bedard ,  Ting Sun

IPC分类号： G06F3/041 ,  G06F3/0354 ,  G06F3/042

摘要： A device such as a stylus may have a color sensor. The color sensor may have a color sensing light detector having a plurality of photodetectors each of which measures light for a different respective color channel. The color sensor may also have a light emitter. The light emitter may have an adjustable light spectrum. The light spectrum may be adjusted during color sensing measurements using information such as ambient light color measurements made with a color ambient light sensor that has a plurality of photodetectors each of which measures light for a different respective color channel. An inertial measurement unit may be used to measure the angular orientation between the stylus and an external object during color measurements. Arrangements in which the light emitter is modulated during color sensing may also be used. Measurements from the stylus may be transmitted wirelessly to external equipment.

公开(公告)号：US11187914B2

公开(公告)日：2021-11-30

申请号：US16583193

申请日：2019-09-25

申请人： Apple Inc.

发明人： Daniel R. Hennigan ,  Noah D. Bedard ,  Branko Petljanski ,  Jason C. Sauers ,  Edward S. Huo ,  Ricardo J. Motta ,  Brett D. Miller ,  Yury Petrov

IPC分类号： G02B27/14 ,  G02B27/01 ,  G02B5/08 ,  G02B30/35

摘要： A scene camera system that includes two or more mirrors that reflect light from a respective portion of a field of view (FOV) in front of the system and two or more cameras that each capture the light reflected by a respective one of the two or more mirrors. By using the mirrors to reflect the light, the cameras' entrance pupils are imaged to a location closer to a user's eyes to thus achieve a more accurate representation of the perspective of the user.

公开(公告)号：US20240201512A1

公开(公告)日：2024-06-20

申请号：US18067604

申请日：2022-12-16

申请人： Apple Inc.

发明人： Felipe Bacim De Araujo E Silva ,  Noah D. Bedard ,  Bosheng Zhang ,  Brett D. Miller ,  Seung Wook Kim

IPC分类号： G02B30/27 ,  G02B27/01 ,  G06F3/01 ,  G06T15/00 ,  H04N13/275

CPC分类号： G02B30/27 ,  G02B27/017 ,  G06F3/011 ,  G06T15/005 ,  H04N13/275

摘要： Methods and apparatus for generating images to be displayed on lenticular displays. In these methods, a fixed mesh is generated offline, and in real-time texture information is mapped to the fixed mesh. In an offline process, texture and 3D mesh information for an object is used to render UV map views for multiple viewpoints of the object, view maps are generated from display calibration data, and a lenticular to UV map is generated from the UV map views and view maps. In real-time, texture information is captured, and a composite process is performed that generates a lenticular image for multiple viewpoints by sampling pixels from the texture based on the lenticular to UV map. The lenticular image is then displayed on the lenticular display. Detected positions of persons in the environment may be used to limit the number of viewpoints that are generated during the real-time composite process.

公开(公告)号：US11860368B2

公开(公告)日：2024-01-02

申请号：US17933060

申请日：2022-09-16

申请人： Apple Inc.

发明人： Noah D. Bedard ,  Ricardo J. Motta ,  Emanuele Mandelli ,  Daniel R. Hennigan ,  Kathrin Berkner Cieslicki ,  Branko Petljanski ,  Brett D. Miller ,  Kenichi Saito

IPC分类号： G02B27/01 ,  G03B30/00

CPC分类号： G02B27/0172 ,  G03B30/00 ,  G02B2027/014 ,  G02B2027/0123 ,  G02B2027/0129 ,  G02B2027/0138 ,  G02B2027/0198

摘要： A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user's eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.

公开(公告)号：US11360557B2

公开(公告)日：2022-06-14

申请号：US16984040

申请日：2020-08-03

申请人： Apple Inc.

发明人： Kathrin Berkner-Cieslicki ,  Se Baek Oh ,  Scott M. DeLapp ,  Christopher F. Griffo ,  Bradley C. Steele ,  Ting Sun ,  Kenichi Saito ,  Noah D. Bedard

IPC分类号： G06F3/01 ,  G02B27/01 ,  G02B27/00

摘要： An eye tracking system for detecting position and movements of a user's eyes in a head-mounted display (HMD). The eye tracking system includes at least one eye tracking camera, an illumination source that emits infrared light towards the user's eyes, and diffraction gratings located at the eyepieces. The diffraction gratings redirect or reflect at least a portion of infrared light reflected off the user's eyes, while allowing visible light to pass. The cameras capture images of the user's eyes from the infrared light that is redirected or reflected by the diffraction gratings.

公开(公告)号：US20210041948A1

公开(公告)日：2021-02-11

申请号：US16984040

申请日：2020-08-03

申请人： Apple Inc.

发明人： Kathrin Berkner-Cieslicki ,  Se Baek Oh ,  Scott M. DeLapp ,  Christopher F. Griffo ,  Bradley C. Steele ,  Ting Sun ,  Kenichi Saito ,  Noah D. Bedard

IPC分类号： G06F3/01 ,  G02B27/01 ,  G02B27/00

摘要： An eye tracking system for detecting position and movements of a user's eyes in a head-mounted display (HMD). The eye tracking system includes at least one eye tracking camera, an illumination source that emits infrared light towards the user's eyes, and diffraction gratings located at the eyepieces. The diffraction gratings redirect or reflect at least a portion of infrared light reflected off the user's eyes, while allowing visible light to pass. The cameras capture images of the user's eyes from the infrared light that is redirected or reflected by the diffraction gratings.

公开(公告)号：US20240089569A1

公开(公告)日：2024-03-14

申请号：US18302822

申请日：2023-04-19

申请人： Apple Inc.

发明人： Roei Remez ,  Brian McCall ,  Milan Maksimovic ,  Maoz Ovadia ,  Arnaud Laflaquière ,  Gershon Rosenblum ,  Noah D. Bedard ,  Omer Korech ,  Emanuel Mordechai ,  Keith Lyon ,  Refael Della Pergola ,  Niv Gilboa

IPC分类号： H04N23/13 ,  G02B1/00 ,  G02B1/04 ,  G02B26/08 ,  G02B27/00 ,  G02B27/40

CPC分类号： H04N23/13 ,  G02B1/002 ,  G02B1/041 ,  G02B26/0808 ,  G02B27/0012 ,  G02B27/40

摘要： An image sensing device includes a detector assembly, which includes a matrix of optical sensing elements having a predefined pitch. Each optical sensing element includes an active area having a width that is less than 90% of the pitch. An array of optical apertures are respectively aligned with the optical sensing elements such that each optical aperture is positioned at a distance from a respective optical sensing element that is no less than twice the width of the active area. Objective optics are configured to focus light from a scene onto the detector assembly.

公开(公告)号：US11921286B2

公开(公告)日：2024-03-05

申请号：US17450128

申请日：2021-10-06

申请人： Apple Inc.

发明人： Noah D. Bedard ,  Branko Petljanski ,  Kathrin Berkner Cieslicki ,  Ricardo J. Motta

IPC分类号： G02B27/00 ,  G02B27/01 ,  G06F3/01 ,  G06T19/00 ,  G06V20/20

CPC分类号： G02B27/0081 ,  G02B27/017 ,  G02B27/0172 ,  G06F3/013 ,  G06T19/006 ,  G06V20/20 ,  G02B2027/0138

摘要： This disclosure describes a novel lens system having an entrance pupil at a location matching, or nearly matching, the eye's optical system entrance pupil. The described lens system is significantly thinner than a single-aperture lens with matched entrance pupil and is achieved by using an array of camera elements. Each camera element contains camera optics called “lenslets” and a sensor (e.g., an image or depth sensor), where a lenslet can include one or more lens elements (e.g., a compound lens). Individual camera elements can be arranged such that THEIR optical axes intersect at, or near, the eye's entrance pupil location. In addition, each camera element's field-of-view (FOV) corresponds to a small sector of a large FOV. The FOVs of adjacent camera elements can be non- or slightly-overlapping so that a wide-angle image can be formed by concatenation of the individual camera element images.