Method and system for determining a pose of camera

    公开(公告)号:US10438373B2

    公开(公告)日:2019-10-08

    申请号:US15807263

    申请日:2017-11-08

    Applicant: Apple Inc.

    Abstract: The invention is related to a method and system for determining a pose of a first camera, comprising providing or receiving a spatial relationship (Rvc 1) between a visual content displayed on a display device and the first camera, receiving image information associated with an image (B1) of at least part of the displayed visual content captured by a second camera, and determining a pose of the first camera according to the image information associated with the image (B1) and the spatial relationship (Rvc1).

    Method and apparatus for representing a virtual object in a real environment

    公开(公告)号:US20190188915A1

    公开(公告)日:2019-06-20

    申请号:US16055907

    申请日:2018-08-06

    Applicant: Apple Inc.

    Abstract: The invention relates to a method for representing a virtual object in a real environment, having the following steps: generating a two-dimensional representation of a real environment by means of a recording device, ascertaining a position of the recording device relative to at least one component of the real environment, segmenting at least one area of the real environment in the two-dimensional image on the basis of non-manually generated 3D information for identifying at least one segment of the real environment in distinction to a remaining part of the real environment while supplying corresponding segmentation data, and merging the two-dimensional image of the real environment with the virtual object or, by means of an optical, semitransparent element directly with reality with consideration of the segmentation data. The invention permits any collisions of virtual objects with real objects that occur upon merging with a real environment to be represented in a way largely close to reality.

    Method for Representing Virtual Information in a View of a Real Environment

    公开(公告)号:US20190005734A1

    公开(公告)日:2019-01-03

    申请号:US16126785

    申请日:2018-09-10

    Applicant: Apple Inc.

    CPC classification number: G06T19/006 G06T19/00 G06T2219/024

    Abstract: A method for representing virtual information in a view of a real environment comprises providing a virtual object having a global position and orientation with respect to a geographic global coordinate system, with first pose data on the global position and orientation of the virtual object, in a database of a server, taking an image of a real environment by a mobile device and providing second pose data as to at which position and with which orientation with respect to the geographic global coordinate system the image was taken. The method further includes displaying the image on a display of the mobile device, accessing the virtual object in the database and positioning the virtual object in the image on the basis of the first and second pose data, manipulating the virtual object or adding a further virtual object, and providing the manipulated virtual object with modified first pose data or the further virtual object with third pose data in the database.

    Method for representing virtual information in a real environment

    公开(公告)号:US09922446B2

    公开(公告)日:2018-03-20

    申请号:US14654395

    申请日:2012-12-21

    Applicant: Apple Inc.

    CPC classification number: G06T15/20 G06T15/06 G06T19/006

    Abstract: A method for representing virtual information in a view of a real environment is provided that includes: providing a system setup including at least one display device, wherein the system setup is adapted for blending in virtual information on the display device in at least part of the view, determining a position and orientation of a viewing point relative to at least one component of the real environment, providing a geometry model of the real environment, providing at least one item of virtual information and a position of the at least one item of virtual information, determining whether the position of the item of virtual information is inside a 2D or 3D geometrical shape, determining a criterion which is indicative of whether the built-in real object is at least partially visible or non-visible in the view of the real environment, and blending in the at least one item of virtual information on the display device in at least part of the view of the real environment.

    Method for representing points of interest in a view of a real environment on a mobile device and mobile device therefor

    公开(公告)号:US09646422B2

    公开(公告)日:2017-05-09

    申请号:US15024800

    申请日:2013-09-24

    Applicant: Apple Inc.

    Abstract: There is disclosed a method and mobile device for displaying points of interest in a view of a real environment displayed on a screen of the mobile device with a functionality for interaction with a user, which comprises the steps of: capturing an image of the real environment or a part of the real environment using a camera, determining at least one point of interest related to the real environment, determining an image position of the at least one point of interest in the image, displaying at least part of the image on at least part of the screen, overlaying a computer-generated indicator with the at least part of the image on the screen at a screen position according to the image position of the at least one point of interest, displaying a computer-generated virtual object related to the at least one point of interest on the screen at a screen position determined according to the screen position of the computer-generated indicator and which is adjacent to a bottom edge of the screen, displaying a visually perceivable relation indication indicative of a relation between the computer-generated virtual object and the computer-generated indicator. The mobile device may perform an action related to the at least one point of interest if at least part of the computer-generated virtual object displayed on the screen is touched.

    System For Determining Position Both Indoor and Outdoor

    公开(公告)号:US20240085189A1

    公开(公告)日:2024-03-14

    申请号:US18513898

    申请日:2023-11-20

    Applicant: Apple Inc.

    Abstract: An apparatus, method, and computer readable medium related to determining the position of a device, for example determining the pose of a camera. Varying embodiments discuss the use of sensors and captured images to construct an environment property map, which provides reference information in the form of environment properties that are associated with positions, such as camera poses. Embodiments of the disclosure discuss using the environment property map online (e.g. in real time) in order to determine the position of a device. In some embodiments, the environment property map provides a coarse position that is used to refine or limit the necessary work for determining a more precise position.

    METHOD AND DEVICE FOR GENERATING A SYNTHESIZED REALITY RECONSTRUCTION OF FLAT VIDEO CONTENT

    公开(公告)号:US20240013487A1

    公开(公告)日:2024-01-11

    申请号:US17862301

    申请日:2022-07-11

    Applicant: Apple Inc.

    CPC classification number: G06T19/00 G06V20/41

    Abstract: In one implementation, a method includes: identifying a plurality of plot-effectuators and a plurality of environmental elements within a scene associated with a portion of video content; determining one or more spatial relationships between the plurality of plot-effectuators and the plurality of environmental elements within the scene; synthesizing a representation of the scene based at least in part on the one or more spatial relationships; extracting a plurality of action sequences corresponding to the plurality of plot-effectuators based at least in part on the portion of the video content; and generating a corresponding synthesized reality (SR) reconstruction of the scene by driving a plurality of digital assets, associated with the plurality of plot-effectuators, within the representation of the scene according to the plurality of action sequences.

    METHOD AND DEVICE FOR PRESENTING SYNTHESIZED REALITY COMPANION CONTENT

    公开(公告)号:US20230351644A1

    公开(公告)日:2023-11-02

    申请号:US18215311

    申请日:2023-06-28

    Applicant: Apple Inc.

    CPC classification number: G06T11/00 G06F3/04883

    Abstract: In one implementation, a method includes: obtaining a user input to view SR content associated with video content; if the video content includes a first scene when the user input was detected: obtaining first SR content for a first time period of the video content associated with the first scene; obtaining a task associated with the first scene; and causing presentation of the first SR content and a first indication of the task associated with the first scene; and if the video content includes a second scene when the user input was detected: obtaining second SR content for a second time period of the video content associated with the second scene; obtaining a task associated with the second scene; and causing presentation of the second SR content and a second indication of the task associated with the second scene.

    Scene classification
    60.
    发明授权

    公开(公告)号:US11756294B2

    公开(公告)日:2023-09-12

    申请号:US17397747

    申请日:2021-08-09

    Applicant: Apple Inc.

    CPC classification number: G06V20/35 G06V20/20

    Abstract: An exemplary process for identifying a type of a physical environment amongst a plurality of types of physical environments is provided. The process includes obtaining, using the one or more cameras, image data corresponding to a physical environment. The process further includes identifying at least one portion of an entity in the physical environment based on the image data; determining, based on the identified at least one portion of the entity, whether the entity is an entity of a first type; determining a type of the physical environment if the entity is an entity of the first type; and presenting one or more virtual objects and a representation of the entity.

Patent Agency Ranking