公开(公告)号：US10445895B2

公开(公告)日：2019-10-15

申请号：US15525310

申请日：2014-11-21

Applicant: Apple Inc.

Inventor： Sebastian Knorr ,  Daniel Kurz

IPC: G06T7/579 ,  G06T7/246 ,  G06T7/277

Abstract: The invention, in one aspect, is related to a method of determining spatial coordinates of a 3D reconstruction of at least part of a first real object at absolute spatial scale comprising the steps of: receiving image information of a first image including at least part of the first real object captured with a first camera, of a third image including the at least part of the first real object captured with a third camera, of a second image including at least a first part of a second real object captured with a second camera, and of a fourth image including at least a second part of the second real object captured with a fourth camera, wherein the frustum of the first camera and the frustum of the second camera do not overlap and wherein the frustum of the third camera and the frustum of the fourth camera do not overlap, and providing a first spatial transformation between the first camera and the second camera and providing a second spatial transformation between the third camera and the fourth camera, providing a first scale information indicative of an absolute spatial scale of the at least first part of the second real object, and a second scale information indicative of an absolute spatial scale of the at least second part of the second real object, determining at least part of a pose (P2F) of the second camera and at least part of a pose (P4F) of the fourth camera according to the second image, the first scale information, the fourth image and the second scale information, wherein the at least part of the pose (P2F) of the second camera and the at least part of the pose (P4F) of the fourth camera are defined in a second common coordinate system, determining at least part of a pose (P1F) of the first camera according to the at least part of the pose (P2F) of the second camera and the first spatial transformation, and determining at least part of a pose (P3F) of the third camera according to the at least part of the pose (P4F) of the fourth camera and the second spatial transformation, and determining spatial coordinates of a 3D reconstruction of the at least part of the first real object at absolute spatial scale according to the first image, the third image and the at least part of the pose (P1F) of the first camera and the at least part of the pose (P3F) of the third camera.

公开(公告)号：US20190230297A1

公开(公告)日：2019-07-25

申请号：US16371568

申请日：2019-04-01

Applicant: Apple Inc.

Inventor： Sebastian Knorr ,  Daniel Kurz

IPC: H04N5/272 ,  H04N5/232 ,  H04N5/222 ,  G06T7/70 ,  G06T19/00

Abstract: A method of generating at least one image of a real environment comprises providing at least one environment property related to at least part of the real environment, providing at least one virtual object property related to a virtual object, determining at least one imaging parameter according to the at least one provided virtual object property and the at least one provided environment property, and generating at least one image of the real environment representing information about light leaving the real environment according to the determined at least one imaging parameter, wherein the light leaving the real environment is measured by at least one camera.