公开(公告)号：US11488352B1

公开(公告)日：2022-11-01

申请号：US16747063

申请日：2020-01-20

Applicant: Apple Inc.

Inventor： Daniel Kurz

IPC: G06T17/05 ,  G06K9/62 ,  G06T7/55

Abstract: Various implementations disclosed herein include devices, systems, and methods for modeling a geographical space for a computer-generated reality (CGR) experience. In some implementations, a method is performed by a device including a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, the method includes obtaining a set of images. In some implementations, the method includes providing the set of images to an image classifier that determines whether the set of images correspond to a geographical space. In some implementations, the method includes establishing correspondences between at least a subset of the set of images in response to the image classifier determining that the subset of images correspond to the geographical space. In some implementations, the method includes synthesizing a model of the geographical space based on the correspondences between the subset of images.

公开(公告)号：US11334156B2

公开(公告)日：2022-05-17

申请号：US17328703

申请日：2021-05-24

Applicant: Apple Inc.

Inventor： Sebastian Knorr ,  Daniel Kurz

IPC: G06F3/048 ,  G06F3/01 ,  G02B27/00 ,  G06F3/0481 ,  G02B27/01

Abstract: Triggering a state change includes displaying a first version of a series of frames based on a first setup configuration, obtaining a second setup configuration for the series of frames, in response to obtaining a second setup configuration, monitoring for a change in an eye status, and in response to detecting a change in the eye status, displaying a second version of the series of frames based on the second setup configuration.

公开(公告)号：US11321923B2

公开(公告)日：2022-05-03

申请号：US16862430

申请日：2020-04-29

Applicant: Apple Inc.

Inventor： Mark B. Rober ,  Sawyer I. Cohen ,  Daniel Kurz ,  Tobias Holl ,  Benjamin B. Lyon ,  Peter Georg Meier ,  Jeffrey M. Riepling ,  Holly Gerhard

IPC: G06T19/00 ,  G06F3/01 ,  B60R1/00 ,  B60Q9/00 ,  B60W50/08 ,  B60W10/04 ,  B60W10/18 ,  B60W10/20 ,  B60W10/22 ,  B60K35/00 ,  B60K37/06 ,  G06V20/20 ,  G06V20/56 ,  G06V20/59 ,  G06T13/40 ,  G05D1/00 ,  G06V40/20 ,  G06F3/0481

Abstract: A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may provide immersive VR experiences by replacing the view of the real world with virtual environments. Active vehicle systems and/or vehicle control systems may be integrated with the VR system to provide physical effects with the virtual experiences. The virtual environments may be altered to accommodate a passenger upon determining that the passenger is prone to or is exhibiting signs of motion sickness.

公开(公告)号：US20210311550A1

公开(公告)日：2021-10-07

申请号：US17328703

申请日：2021-05-24

Applicant: Apple Inc.

Inventor： Sebastian Knorr ,  Daniel Kurz

IPC: G06F3/01 ,  G02B27/00 ,  G06F3/048 ,  G06F3/0481

Abstract: Triggering a state change includes displaying a first version of a series of frames based on a first setup configuration, obtaining a second setup configuration for the series of frames, in response to obtaining a second setup configuration, monitoring for a change in an eye status, and in response to detecting a change in the eye status, displaying a second version of the series of frames based on the second setup configuration.

公开(公告)号：US11016565B2

公开(公告)日：2021-05-25

申请号：US16888985

申请日：2020-06-01

Applicant: Apple Inc.

Inventor： Sebastian Knorr ,  Daniel Kurz

IPC: G06F3/048 ,  G06F3/01 ,  G02B27/00 ,  G06F3/0481 ,  G02B27/01

Abstract: Triggering a state change includes displaying a first version of a series of frames based on a first setup configuration, obtaining a second setup configuration for the series of frames, in response to obtaining a second setup configuration, monitoring for a change in an eye status, and in response to detecting a change in the eye status, displaying a second version of the series of frames based on the second setup configuration.

公开(公告)号：US20210110560A1

公开(公告)日：2021-04-15

申请号：US17076507

申请日：2020-10-21

Applicant: Apple Inc.

Inventor： Sebastian Knorr ,  Daniel Kurz

IPC: G06T7/579 ,  G06T7/246 ,  G06T7/277

Abstract: Determining spatial coordinates of a 3D reconstruction includes obtaining, from a first camera system, a first image comprising a first real object, obtaining, from a second camera system, a second image comprising a second real object associated with known geometric properties, wherein the first camera system and the second camera system have a known spatial relationship, and determining a scale of the face based on the second image and the known geometric properties of the at least part of the second real object. Determining the spatial coordinates of the 3D reconstruction also includes determining a pose of the first and second camera systems, and determining the spatial coordinates based on the pose of the first camera system and the scale of the at least part of the second real object.

公开(公告)号：US20210076014A1

公开(公告)日：2021-03-11

申请号：US17028360

申请日：2020-09-22

Applicant: Apple Inc.

Inventor： Peter Meier ,  Mohamed Selim Ben Himane ,  Daniel Kurz

IPC: H04N9/31 ,  H04N5/225 ,  H04N5/33 ,  H04N13/128 ,  H04N13/15 ,  H04N13/257 ,  G01B11/24 ,  G01B11/25

Abstract: A method of projecting digital information on a real object in a real environment includes the steps of projecting digital information on a real object or part of a real object with a visible light projector, capturing at least one image of the real object with the projected digital information using a camera, providing a depth sensor registered with the camera, the depth sensor capturing depth data of the real object or part of the real object, and calculating a spatial transformation between the visible light projector and the real object based on the at least one image and the depth data. The invention is also concerned with a corresponding system.

公开(公告)号：US20200051267A1

公开(公告)日：2020-02-13

申请号：US16546833

申请日：2019-08-21

Applicant: Apple Inc.

Inventor： Sebastian Knorr ,  Daniel Kurz

IPC: G06T7/579 ,  G06T7/277 ,  G06T7/246

Abstract: Determining spatial coordinates of a 3D reconstruction includes obtaining, from a first camera system, a first image comprising a first real object, obtaining, from a second camera system, a second image comprising a second real object associated with known geometric properties, wherein the first camera system and the second camera system have a known spatial relationship, and determining a scale of the face based on the second image and the known geometric properties of the at least part of the second real object. Determining the spatial coordinates of the 3D reconstruction also includes determining a pose of the first and second camera systems, and determining the spatial coordinates based on the pose of the first camera system and the scale of the at least part of the second real object.

公开(公告)号：US20190362179A1

公开(公告)日：2019-11-28

申请号：US16531678

申请日：2019-08-05

Applicant: Apple Inc.

Inventor： Mohamed Selim Ben Himane ,  Daniel Kurz ,  Thomas Olszamowski

IPC: G06K9/62 ,  G06K9/46

Abstract: A method of providing a set of feature descriptors configured to be used in matching an object in an image of a camera is provided. The method includes: a) providing at least two images of a first object; b) extracting in at least two of the images at least one feature from the respective image, c) providing at least one descriptor for an extracted feature, and storing the descriptors; d) matching descriptors in the first set of descriptors; e) computing a score parameter based on the result of the matching process; f) selecting at least one descriptor based on its score parameter; g) adding the selected descriptor(s) to a second set of descriptors; and h) updating the score parameter of descriptors in the first set based on a selection process and to the result of the matching process.

公开(公告)号：US10482669B2

公开(公告)日：2019-11-19

申请号：US15713421

申请日：2017-09-22

Applicant: Apple Inc.

Inventor： Mark B. Rober ,  Sawyer I. Cohen ,  Daniel Kurz ,  Tobias Holl ,  Benjamin B. Lyon ,  Peter Georg Meier ,  Jeffrey M. Riepling ,  Holly Gerhard

IPC: G06T19/00 ,  B60R1/00 ,  B60Q9/00 ,  B60W50/08 ,  B60W10/04 ,  B60W10/18 ,  B60W10/20 ,  B60W10/22 ,  G06F3/01 ,  G06K9/00 ,  G06T13/40 ,  B60K35/00 ,  B60K37/06 ,  G05D1/00 ,  G06F3/0481

Abstract: A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide augmented or virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may project virtual content so that the content appears as a distant object stabilized or fixed in the external environment. The VR system may aid in productivity, as passengers may perform work while riding in the vehicle without experiencing motion sickness. In addition, the VR system may provide enhanced virtual experiences to passengers in moving vehicles by matching accelerations and motions of the vehicle to accelerations and motions in the virtual experiences.