COMMUNICATION SESSIONS USING OBJECT INFORMATION

    公开(公告)号:US20230290078A1

    公开(公告)日:2023-09-14

    申请号:US17991853

    申请日:2022-11-22

    Applicant: APPLE INC.

    CPC classification number: G06T19/006 G06F3/1454 G06T2219/024

    Abstract: Various implementations use object information to facilitate a communication session. Some implementations create a dense reconstruction (e.g., a point cloud or triangular mesh) of a physical environment, for example, using light intensity images and depth sensor data. A less data-intensive object information is also created to represent the physical environment for more efficient storage, editing, sharing, and use. In some implementations, the object information includes object attribute and location information. In some implementations, a 2D floorplan or other 2D representation provides object locations and metadata (e.g., object type, texture, heights, dimensions, etc.) provide object attributes. The object location and attribute information may be used, during a communication session, to generate a 3D graphical environment that is representative of the physical environment.

    ENVIRONMENT CAPTURE AND RENDERING
    3.
    发明公开

    公开(公告)号:US20240233097A1

    公开(公告)日:2024-07-11

    申请号:US18582835

    申请日:2024-02-21

    Applicant: APPLE INC.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that generate 2D views of a 3D environment using a 3D point cloud where the cloud points selected for each view are based on a low-resolution 3D mesh. In some implementations, a 3D point cloud of a physical environment is obtained, the 3D point cloud including points each having a 3D location and representing an appearance of a portion of the physical environment. Then, a 3D mesh is obtained corresponding to the 3D point cloud, and a 2D view of the 3D point cloud from a viewpoint is generated using a subset of the points of the 3D point cloud, where the subset of points is selected based on the 3D mesh.

    PORTAL VIEW FOR CONTENT ITEMS
    4.
    发明公开

    公开(公告)号:US20240257478A1

    公开(公告)日:2024-08-01

    申请号:US18609826

    申请日:2024-03-19

    Applicant: APPLE INC.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that provide an XR environment that depicts an environment with a viewing portal for viewing an added content item that is positioned behind the viewing portal. Some implementations determine a first position for a viewing portal within a 3D coordinate system corresponding to an environment, determine a second position for a content item within the 3D coordinate system, where the second position is opposite a front surface of the viewing portal, and determine a viewpoint of an electronic device within the 3D coordinate system. In some implementations, a portion of the content item visible through the viewing portal from the viewpoint is identified, where the portion is identified based on the first position, the second position, and the viewpoint. Then, a view of the identified portion of the content item is provided in the environment.

    REPRESENTING FLAT SURFACES IN POINT-BASED REPRESENTATIONS OF PHYSICAL ENVIRONMENTS

    公开(公告)号:US20240203055A1

    公开(公告)日:2024-06-20

    申请号:US18582757

    申请日:2024-02-21

    Applicant: APPLE INC.

    CPC classification number: G06T17/20

    Abstract: Various implementations disclosed herein include devices, systems, and methods that generate a 3D representation of a physical environment by generating a point cloud and selectively replacing some of the points. For example, points representing flat surfaces (e.g., walls and ceilings) may be replaced with planar elements that are “painted” using image data. In contrast, points representing non-flat portions (e.g. furniture, curtains, wall hangings, etc.) are left as points in the model or altered in a different way. Selectively altering the 3D representation may provide (a) a cleaner feeling and/or (b) a more compact 3D representation for more efficient and faster communication and/or rendering.

    ALIGNING SCANNED ENVIRONMENTS FOR MULTI-USER COMMUNICATION SESSIONS

    公开(公告)号:US20240202944A1

    公开(公告)日:2024-06-20

    申请号:US18592586

    申请日:2024-03-01

    Applicant: APPLE INC.

    Abstract: Various implementations provide a method for determining position data of a first device relative to a three-dimensional (3D) representation during a communication session. For example, a 3D representation is determined by a first device to correspond to a current physical environment of the first device. Then a spatial relationship is determined between the 3D representation and the current physical environment. Then position data is determined to correspond to a position of the first device relative to the 3D representation and based on a location of the first device in the current physical environment and the spatial relationship between the 3D representation and the current physical environment. The position data is then provided during a communication session between the first device and a second device with a view of the 3D representation including a representation of a user of the first device presented to a user of the second device.

    3D PHOTOS
    9.
    发明公开
    3D PHOTOS 审中-公开

    公开(公告)号:US20230298278A1

    公开(公告)日:2023-09-21

    申请号:US17980584

    申请日:2022-11-04

    Applicant: APPLE INC.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that determine how to present a three-dimensional (3D) photo in an extended reality (XR) environment (e.g., in 3D, 2D, blurry, or not at all) based on viewing position of a user active in the XR environment relative to a placement of the 3D photo in the XR environment. In some implementations, at an electronic device having a processor, a 3D photo that is an incomplete 3D representation created based on one or more images captured by an image capture device is obtained. In some implementations, a viewing position of the electronic device relative to a placement position of the 3D photo is determined, and a presentation mode for the 3D photo is determined based on the viewing position. In some implementations, the 3D photo is provided at the placement position based on the presentation mode in the XR environment.

Patent Agency Ranking