-
公开(公告)号:US10438373B2
公开(公告)日:2019-10-08
申请号:US15807263
申请日:2017-11-08
Applicant: Apple Inc.
Inventor: Lejing Wang , Peter Meier
Abstract: The invention is related to a method and system for determining a pose of a first camera, comprising providing or receiving a spatial relationship (Rvc 1) between a visual content displayed on a display device and the first camera, receiving image information associated with an image (B1) of at least part of the displayed visual content captured by a second camera, and determining a pose of the first camera according to the image information associated with the image (B1) and the spatial relationship (Rvc1).
-
公开(公告)号:US20190188915A1
公开(公告)日:2019-06-20
申请号:US16055907
申请日:2018-08-06
Applicant: Apple Inc.
Inventor: Peter Meier , Stefan Holzer
CPC classification number: G06T19/006 , G06T7/10 , G06T7/70 , G06T15/20 , G06T15/205 , G06T19/20 , G06T2207/20021 , G06T2207/30244 , G06T2210/04
Abstract: The invention relates to a method for representing a virtual object in a real environment, having the following steps: generating a two-dimensional representation of a real environment by means of a recording device, ascertaining a position of the recording device relative to at least one component of the real environment, segmenting at least one area of the real environment in the two-dimensional image on the basis of non-manually generated 3D information for identifying at least one segment of the real environment in distinction to a remaining part of the real environment while supplying corresponding segmentation data, and merging the two-dimensional image of the real environment with the virtual object or, by means of an optical, semitransparent element directly with reality with consideration of the segmentation data. The invention permits any collisions of virtual objects with real objects that occur upon merging with a real environment to be represented in a way largely close to reality.
-
公开(公告)号:US20190005734A1
公开(公告)日:2019-01-03
申请号:US16126785
申请日:2018-09-10
Applicant: Apple Inc.
Inventor: Peter Meier , Michael Kuhn , Frank Angermann
IPC: G06T19/00
CPC classification number: G06T19/006 , G06T19/00 , G06T2219/024
Abstract: A method for representing virtual information in a view of a real environment comprises providing a virtual object having a global position and orientation with respect to a geographic global coordinate system, with first pose data on the global position and orientation of the virtual object, in a database of a server, taking an image of a real environment by a mobile device and providing second pose data as to at which position and with which orientation with respect to the geographic global coordinate system the image was taken. The method further includes displaying the image on a display of the mobile device, accessing the virtual object in the database and positioning the virtual object in the image on the basis of the first and second pose data, manipulating the virtual object or adding a further virtual object, and providing the manipulated virtual object with modified first pose data or the further virtual object with third pose data in the database.
-
公开(公告)号:US09922446B2
公开(公告)日:2018-03-20
申请号:US14654395
申请日:2012-12-21
Applicant: Apple Inc.
Inventor: Lejing Wang , Peter Meier , Stefan Misslinger
CPC classification number: G06T15/20 , G06T15/06 , G06T19/006
Abstract: A method for representing virtual information in a view of a real environment is provided that includes: providing a system setup including at least one display device, wherein the system setup is adapted for blending in virtual information on the display device in at least part of the view, determining a position and orientation of a viewing point relative to at least one component of the real environment, providing a geometry model of the real environment, providing at least one item of virtual information and a position of the at least one item of virtual information, determining whether the position of the item of virtual information is inside a 2D or 3D geometrical shape, determining a criterion which is indicative of whether the built-in real object is at least partially visible or non-visible in the view of the real environment, and blending in the at least one item of virtual information on the display device in at least part of the view of the real environment.
-
公开(公告)号:US09646422B2
公开(公告)日:2017-05-09
申请号:US15024800
申请日:2013-09-24
Applicant: Apple Inc.
Inventor: Anton Fedosov , Stefan Misslinger , Peter Meier
CPC classification number: G06T19/006 , G01C21/3611 , G01C21/3638 , G01C21/3679 , G06F3/011 , G06T15/20 , H04L29/06034
Abstract: There is disclosed a method and mobile device for displaying points of interest in a view of a real environment displayed on a screen of the mobile device with a functionality for interaction with a user, which comprises the steps of: capturing an image of the real environment or a part of the real environment using a camera, determining at least one point of interest related to the real environment, determining an image position of the at least one point of interest in the image, displaying at least part of the image on at least part of the screen, overlaying a computer-generated indicator with the at least part of the image on the screen at a screen position according to the image position of the at least one point of interest, displaying a computer-generated virtual object related to the at least one point of interest on the screen at a screen position determined according to the screen position of the computer-generated indicator and which is adjacent to a bottom edge of the screen, displaying a visually perceivable relation indication indicative of a relation between the computer-generated virtual object and the computer-generated indicator. The mobile device may perform an action related to the at least one point of interest if at least part of the computer-generated virtual object displayed on the screen is touched.
-
公开(公告)号:US11935197B2
公开(公告)日:2024-03-19
申请号:US17175456
申请日:2021-02-12
Applicant: Apple Inc.
Inventor: Patrick S. Piemonte , Daniel De Rocha Rosario , Jason D Gosnell , Peter Meier
CPC classification number: G06T19/006 , G01C21/26 , G01C21/365 , G02B27/017 , G06T15/205 , G06T17/00 , G06T19/20 , G02B2027/0141 , G05D2201/0213 , G06T2210/56
Abstract: An AR system that leverages a pre-generated 3D model of the world to improve rendering of 3D graphics content for AR views of a scene, for example an AR view of the world in front of a moving vehicle. By leveraging the pre-generated 3D model, the AR system may use a variety of techniques to enhance the rendering capabilities of the system. The AR system may obtain pre-generated 3D data (e.g., 3D tiles) from a remote source (e.g., cloud-based storage), and may use this pre-generated 3D data (e.g., a combination of 3D mesh, textures, and other geometry information) to augment local data (e.g., a point cloud of data collected by vehicle sensors) to determine much more information about a scene, including information about occluded or distant regions of the scene, than is available from the local data.
-
公开(公告)号:US20240085189A1
公开(公告)日:2024-03-14
申请号:US18513898
申请日:2023-11-20
Applicant: Apple Inc.
Inventor: Peter Meier , Christian Lipski
CPC classification number: G01C21/206 , G01C21/20 , G05D1/0231 , G06V20/10 , G06V20/36 , H04W4/33
Abstract: An apparatus, method, and computer readable medium related to determining the position of a device, for example determining the pose of a camera. Varying embodiments discuss the use of sensors and captured images to construct an environment property map, which provides reference information in the form of environment properties that are associated with positions, such as camera poses. Embodiments of the disclosure discuss using the environment property map online (e.g. in real time) in order to determine the position of a device. In some embodiments, the environment property map provides a coarse position that is used to refine or limit the necessary work for determining a more precise position.
-
58.
公开(公告)号:US20240013487A1
公开(公告)日:2024-01-11
申请号:US17862301
申请日:2022-07-11
Applicant: Apple Inc.
Inventor: Ian M. Richter , Daniel Ulbricht , Jean-Daniel E. Nahmias , Omar Elafifi , Peter Meier
Abstract: In one implementation, a method includes: identifying a plurality of plot-effectuators and a plurality of environmental elements within a scene associated with a portion of video content; determining one or more spatial relationships between the plurality of plot-effectuators and the plurality of environmental elements within the scene; synthesizing a representation of the scene based at least in part on the one or more spatial relationships; extracting a plurality of action sequences corresponding to the plurality of plot-effectuators based at least in part on the portion of the video content; and generating a corresponding synthesized reality (SR) reconstruction of the scene by driving a plurality of digital assets, associated with the plurality of plot-effectuators, within the representation of the scene according to the plurality of action sequences.
-
公开(公告)号:US20230351644A1
公开(公告)日:2023-11-02
申请号:US18215311
申请日:2023-06-28
Applicant: Apple Inc.
Inventor: Ian M. Richter , Daniel Ulbricht , Jean-Daniel E. Nahmias , Omar Elafifi , Peter Meier
IPC: G06T11/00
CPC classification number: G06T11/00 , G06F3/04883
Abstract: In one implementation, a method includes: obtaining a user input to view SR content associated with video content; if the video content includes a first scene when the user input was detected: obtaining first SR content for a first time period of the video content associated with the first scene; obtaining a task associated with the first scene; and causing presentation of the first SR content and a first indication of the task associated with the first scene; and if the video content includes a second scene when the user input was detected: obtaining second SR content for a second time period of the video content associated with the second scene; obtaining a task associated with the second scene; and causing presentation of the second SR content and a second indication of the task associated with the second scene.
-
公开(公告)号:US11756294B2
公开(公告)日:2023-09-12
申请号:US17397747
申请日:2021-08-09
Applicant: Apple Inc.
Inventor: Peter Meier , Michael J. Rockwell
Abstract: An exemplary process for identifying a type of a physical environment amongst a plurality of types of physical environments is provided. The process includes obtaining, using the one or more cameras, image data corresponding to a physical environment. The process further includes identifying at least one portion of an entity in the physical environment based on the image data; determining, based on the identified at least one portion of the entity, whether the entity is an entity of a first type; determining a type of the physical environment if the entity is an entity of the first type; and presenting one or more virtual objects and a representation of the entity.
-
-
-
-
-
-
-
-
-