公开(公告)号：US10650546B2

公开(公告)日：2020-05-12

申请号：US16046715

申请日：2018-07-26

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Selim Benhimane

IPC: G06T7/73 ,  G06K9/32 ,  G06T7/33 ,  G06T7/246 ,  G06K9/00 ,  G06K9/72 ,  G06K9/46 ,  G06K9/62 ,  G06T7/30 ,  G06T7/70

Abstract: A method of providing a descriptor for at least one feature of an image comprises the steps of providing an image captured by a capturing device and extracting at least one feature from the image, and assigning a descriptor to the at least one feature, the descriptor depending on at least one parameter which is indicative of an orientation, wherein the at least one parameter is determined from the orientation of the capturing device measured by a tracking system. The invention also relates to a method of matching features of two or more images.

公开(公告)号：US10607350B2

公开(公告)日：2020-03-31

申请号：US15618604

申请日：2017-06-09

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Peter Meier

IPC: G06K9/42 ,  G06K9/46 ,  G06T7/514 ,  G06T7/593 ,  G06T7/73

Abstract: The invention provides methods of detecting and describing features from an intensity image. In one of several aspects, the method comprises the steps of providing an intensity image captured by a capturing device, providing a method for determining a depth of at least one element in the intensity image, in a feature detection process detecting at least one feature in the intensity image, wherein the feature detection is performed by processing image intensity information of the intensity image at a scale which depends on the depth of at least one element in the intensity image, and providing a feature descriptor of the at least one detected feature. For example, the feature descriptor contains at least one first parameter based on information provided by the intensity image and at least one second parameter which is indicative of the scale.

公开(公告)号：US10528847B2

公开(公告)日：2020-01-07

申请号：US16531678

申请日：2019-08-05

Applicant: Apple Inc.

Inventor： Mohamed Selim Ben Himane ,  Daniel Kurz ,  Thomas Olszamowski

IPC: G06K9/62 ,  G06K9/46

Abstract: A method of providing a set of feature descriptors configured to be used in matching an object in an image of a camera is provided. The method includes: a) providing at least two images of a first object; b) extracting in at least two of the images at least one feature from the respective image, c) providing at least one descriptor for an extracted feature, and storing the descriptors; d) matching descriptors in the first set of descriptors; e) computing a score parameter based on the result of the matching process; f) selecting at least one descriptor based on its score parameter; g) adding the selected descriptor(s) to a second set of descriptors; and h) updating the score parameter of descriptors in the first set based on a selection process and to the result of the matching process.

公开(公告)号：US10297083B2

公开(公告)日：2019-05-21

申请号：US15022184

申请日：2013-09-16

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Lejing Wang

IPC: G06T19/00 ,  G06F17/30 ,  G06F17/50 ,  G06T7/33 ,  G06T7/73

Abstract: The invention is related to a method of determining a model which describes at least part of a real object, which comprises the steps of: providing a first image of at least part of the real object to a first processing device, wherein the first image is captured by a camera, sending at least part of the first image to a second processing device which is physically separate from the first processing device, determining on the second processing device a registration between the first image and a first model provided on the second processing device according to the at least part of the first image received at the second processing device, determining geometric information for at least one pixel in the first image according to the registration, sending the geometric information from the second processing device to the first processing device, and using at least part of the geometric information received at the first processing device together with at least part of the first image to determine on the first processing device a second model comprising geometric and material information which describes at least part of the real object.

公开(公告)号：US20180357786A1

公开(公告)日：2018-12-13

申请号：US16046715

申请日：2018-07-26

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Selim Benhimane

IPC: G06T7/73 ,  G06K9/00 ,  G06K9/32 ,  G06K9/62 ,  G06T7/70 ,  G06T7/33 ,  G06T7/30 ,  G06K9/46 ,  G06T7/246

CPC classification number: G06T7/73 ,  G06K9/00624 ,  G06K9/3216 ,  G06K9/46 ,  G06K9/6202 ,  G06T7/246 ,  G06T7/30 ,  G06T7/33 ,  G06T7/70 ,  G06T2207/10012 ,  G06T2207/30232 ,  G06T2207/30244

Abstract: A method of providing a descriptor for at least one feature of an image comprises the steps of providing an image captured by a capturing device and extracting at least one feature from the image, and assigning a descriptor to the at least one feature, the descriptor depending on at least one parameter which is indicative of an orientation, wherein the at least one parameter is determined from the orientation of the capturing device measured by a tracking system. The invention also relates to a method of matching features of two or more images.

公开(公告)号：US20180089901A1

公开(公告)日：2018-03-29

申请号：US15713428

申请日：2017-09-22

Applicant: Apple Inc.

Inventor： Mark B. Rober ,  Sawyer I. Cohen ,  Daniel Kurz ,  Tobias Holl ,  Benjamin B. Lyon ,  Peter Georg Meier ,  Jeffrey M. Riepling ,  Holly Gerhard

IPC: G06T19/00 ,  G06F3/01 ,  G06T13/40 ,  B60R1/00 ,  B60Q9/00

CPC classification number: G06T19/006 ,  B60K35/00 ,  B60K37/06 ,  B60K2370/177 ,  B60Q9/00 ,  B60R1/00 ,  B60R2300/207 ,  B60R2300/60 ,  B60W10/04 ,  B60W10/18 ,  B60W10/20 ,  B60W10/22 ,  B60W50/08 ,  B60W2540/22 ,  G05D1/0088 ,  G06F3/011 ,  G06F3/012 ,  G06F3/016 ,  G06F3/0481 ,  G06K9/00335 ,  G06K9/00671 ,  G06K9/00791 ,  G06K9/00832 ,  G06T13/40

Abstract: A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may provide immersive VR experiences by replacing the view of the real world with virtual environments. Active vehicle systems and/or vehicle control systems may be integrated with the VR system to provide physical effects with the virtual experiences. The virtual environments may be altered to accommodate a passenger upon determining that the passenger is prone to or is exhibiting signs of motion sickness.

公开(公告)号：US20170236033A1

公开(公告)日：2017-08-17

申请号：US15444404

申请日：2017-02-28

Applicant: Apple Inc.

Inventor： Selim Benhimane ,  Daniel Kurz ,  Thomas Olszamowski

IPC: G06K9/62

CPC classification number: G06K9/623 ,  G06K9/46 ,  G06K9/4671 ,  G06K9/6255 ,  G06K9/6262

Abstract: A method of providing a set of feature descriptors configured to be used in matching an object in an image of a camera is provided. The method includes: a) providing at least two images of a first object; b) extracting in at least two of the images at least one feature from the respective image, c) providing at least one descriptor for an extracted feature, and storing the descriptors; d) matching descriptors in the first set of descriptors; e) computing a score parameter based on the result of the matching process; f) selecting at least one descriptor based on its score parameter; g) adding the selected descriptor(s) to a second set of descriptors; and h) updating the score parameter of descriptors in the first set based on a selection process and to the result of the matching process.

公开(公告)号：US12039644B2

公开(公告)日：2024-07-16

申请号：US17323542

申请日：2021-05-18

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Anton Fedosov

IPC: G06T11/60 ,  G06F3/16 ,  G06T19/00 ,  H04N7/18

CPC classification number: G06T11/60 ,  G06F3/16 ,  G06T19/006 ,  H04N7/183

Abstract: The invention is related to a method of presenting a digital information related to a real object, comprising determining a real object, providing a plurality of presentation modes, wherein the plurality of presentation modes comprises an augmented reality mode, and at least one of a virtual reality mode and an audio mode, providing at least one representation of a digital information related to the real object, determining a spatial relationship between a camera and a reference coordinate system under consideration of an image captured by the camera, selecting a presentation mode from the plurality of presentation modes according to the spatial relationship, and presenting the at least one representation of the digital information using the selected presentation mode.

公开(公告)号：US11900569B2

公开(公告)日：2024-02-13

申请号：US17957416

申请日：2022-09-30

Applicant: APPLE INC.

Inventor： Peter Meier ,  Daniel Kurz ,  Brian Chris Clark ,  Mohamed Selim Ben Himane

IPC: G06T5/00 ,  G06T7/73 ,  G06V10/60 ,  G06V40/16 ,  G06V20/10

CPC classification number: G06T5/005 ,  G06T7/75 ,  G06V10/60 ,  G06V20/10 ,  G06V40/171

Abstract: Various implementations disclosed herein include devices, systems, and methods that detect surfaces and reflections in such surfaces. Some implementations involve providing a CGR environment that includes virtual content that replaces the appearance of a user or the user's device in a mirror or other surface providing a reflection. For example, a CGR environment may be modified to include a reflection of the user that does not include the device that the user is holding or wearing. In another example, the CGR environment is modified so that virtual content, such as a newer version of the electronic device or a virtual wand, replaces the electronic device in the reflection. In another example, the CGR environment is modified so that virtual content, such as a user avatar, replaces the user in the reflection.

公开(公告)号：US11727661B2

公开(公告)日：2023-08-15

申请号：US16878296

申请日：2020-05-19

Applicant: Apple Inc.

Inventor： Darko Stanimirovic ,  Daniel Kurz

IPC: G06T7/11 ,  G06V10/143 ,  G06T7/73 ,  G06T7/246 ,  G06V40/16

CPC classification number: G06V10/143 ,  G06T7/11 ,  G06T7/248 ,  G06T7/74 ,  G06T2207/10048 ,  G06T2207/20076 ,  G06T2207/20212 ,  G06V40/161

Abstract: A method for determining at least one property related to at least part of a real environment comprises receiving a first image of a first part of a real environment captured by a first camera, wherein the first camera is a thermal camera and the first image is a thermal image and the first part of the real environment is a first environment part, providing at least one description related to at least one class of real objects, wherein the at least one description includes at least one thermal property related to the at least one class of real objects, receiving a second image of the first environment part and of a second part of the real environment captured by a second camera, wherein the second part of the real environment is a second environment part, providing an image alignment between the first image and the second image, determining, for at least one second image region contained in the second image, at least one second probability according to the image alignment, pixel information of the first image, and the at least one description, wherein the at least one second probability relates to the at least one class of real objects, and wherein the at least one second image region comprises at least part of the first environment part, determining at least one image feature derived from pixel information of at least one third image region contained in the second image according to the at least one second probability, wherein the at least one third image region comprises at least part of the second environment part, and performing at least one computer vision method to determine at least one property related to at least part of the second environment part according to the determined at least one image feature.