-
公开(公告)号:US20230298281A1
公开(公告)日:2023-09-21
申请号:US18068711
申请日:2022-12-20
Applicant: Apple Inc.
Inventor: Timothy R. PEASE , Alexandre DA VEIGA , David H. Y. HUANG , Peng LIU , Robert K. MOLHOLM
CPC classification number: G06T19/006 , G06V40/20 , G06F3/14 , G06F3/165 , G06F3/013
Abstract: In an exemplary process, a set of parameters corresponding to characteristics of a physical setting of a user is obtained. Based on the parameters, at least one display placement value and a fixed boundary location corresponding to the physical setting are obtained. In accordance with a determination that the at least one display placement value satisfies a display placement criterion, a virtual display is displayed at the fixed boundary location corresponding to the physical setting.
-
公开(公告)号:US20230290078A1
公开(公告)日:2023-09-14
申请号:US17991853
申请日:2022-11-22
Applicant: APPLE INC.
Inventor: Bradley W. PEEBLER , Alexandre DA VEIGA
CPC classification number: G06T19/006 , G06F3/1454 , G06T2219/024
Abstract: Various implementations use object information to facilitate a communication session. Some implementations create a dense reconstruction (e.g., a point cloud or triangular mesh) of a physical environment, for example, using light intensity images and depth sensor data. A less data-intensive object information is also created to represent the physical environment for more efficient storage, editing, sharing, and use. In some implementations, the object information includes object attribute and location information. In some implementations, a 2D floorplan or other 2D representation provides object locations and metadata (e.g., object type, texture, heights, dimensions, etc.) provide object attributes. The object location and attribute information may be used, during a communication session, to generate a 3D graphical environment that is representative of the physical environment.
-
公开(公告)号:US20240233097A1
公开(公告)日:2024-07-11
申请号:US18582835
申请日:2024-02-21
Applicant: APPLE INC.
Inventor: Long H. NGO , Alexandre DA VEIGA
CPC classification number: G06T5/77 , G06T11/40 , G06T17/20 , G06T19/00 , G06T2207/10028 , G06T2219/024
Abstract: Various implementations disclosed herein include devices, systems, and methods that generate 2D views of a 3D environment using a 3D point cloud where the cloud points selected for each view are based on a low-resolution 3D mesh. In some implementations, a 3D point cloud of a physical environment is obtained, the 3D point cloud including points each having a 3D location and representing an appearance of a portion of the physical environment. Then, a 3D mesh is obtained corresponding to the 3D point cloud, and a 2D view of the 3D point cloud from a viewpoint is generated using a subset of the points of the 3D point cloud, where the subset of points is selected based on the 3D mesh.
-
公开(公告)号:US20240257478A1
公开(公告)日:2024-08-01
申请号:US18609826
申请日:2024-03-19
Applicant: APPLE INC.
Inventor: Alexandre DA VEIGA , Timothy T. CHONG , Timothy R. PEASE
CPC classification number: G06T19/006 , G06T13/20 , G06T19/20 , G06V10/245 , G06V10/25 , G06T2219/2004 , G06T2219/2016
Abstract: Various implementations disclosed herein include devices, systems, and methods that provide an XR environment that depicts an environment with a viewing portal for viewing an added content item that is positioned behind the viewing portal. Some implementations determine a first position for a viewing portal within a 3D coordinate system corresponding to an environment, determine a second position for a content item within the 3D coordinate system, where the second position is opposite a front surface of the viewing portal, and determine a viewpoint of an electronic device within the 3D coordinate system. In some implementations, a portion of the content item visible through the viewing portal from the viewpoint is identified, where the portion is identified based on the first position, the second position, and the viewpoint. Then, a view of the identified portion of the content item is provided in the environment.
-
公开(公告)号:US20240221337A1
公开(公告)日:2024-07-04
申请号:US18603533
申请日:2024-03-13
Applicant: APPLE INC.
Inventor: Alexandre DA VEIGA , Alexander MENZIES , Michael I. WEINSTEIN , Vedant SARAN
CPC classification number: G06T19/20 , G06F3/011 , G06T17/20 , G06V10/22 , G06V10/462 , G06V20/64 , H04S7/303 , G06T2200/04 , G06T2210/56 , G06T2219/2004 , H04S2400/11
Abstract: Various implementations disclosed herein include devices, systems, and methods that provide 3D content that is presented over time (e.g. a video of 3D point-based frames), where the 3D content includes only content of interest, e.g., showing just one particular person, the floor near that person, and objects with which the person is near or interacting. The presented content may be stabilized within the viewers environment, for example, by removing content changes corresponding to movement of the capturing device.
-
公开(公告)号:US20240203055A1
公开(公告)日:2024-06-20
申请号:US18582757
申请日:2024-02-21
Applicant: APPLE INC.
Inventor: Long H. NGO , Alexandre DA VEIGA
IPC: G06T17/20
CPC classification number: G06T17/20
Abstract: Various implementations disclosed herein include devices, systems, and methods that generate a 3D representation of a physical environment by generating a point cloud and selectively replacing some of the points. For example, points representing flat surfaces (e.g., walls and ceilings) may be replaced with planar elements that are “painted” using image data. In contrast, points representing non-flat portions (e.g. furniture, curtains, wall hangings, etc.) are left as points in the model or altered in a different way. Selectively altering the 3D representation may provide (a) a cleaner feeling and/or (b) a more compact 3D representation for more efficient and faster communication and/or rendering.
-
公开(公告)号:US20230336865A1
公开(公告)日:2023-10-19
申请号:US17992789
申请日:2022-11-22
Applicant: Apple Inc.
Inventor: Alexandre DA VEIGA , Lee S. Broughton , Angel Suet Yan CHEUNG , Stephen O. LEMAY , Chia Yang LIN , Behkish J. MANZARI , Ivan MARKOVIC , Alexander MENZIES , Aaron MORING , Jonathan RAVASZ , Tobias RICK , Bryce L. SCHMIDTCHEN , William A. SORRENTINO, III
CPC classification number: H04N23/635 , H04N23/64 , H04N23/632
Abstract: The present disclosure generally relates to techniques and user interfaces for capturing media, displaying a preview of media, displaying a recording indicator, displaying a camera user interface, and/or displaying previously captured media.
-
公开(公告)号:US20240202944A1
公开(公告)日:2024-06-20
申请号:US18592586
申请日:2024-03-01
Applicant: APPLE INC.
Inventor: Bruno M. SOMMER , Alexandre DA VEIGA , Long H. NGO , Sebastian P. HERSCHER
CPC classification number: G06T7/337 , G06T7/74 , G06T19/20 , G06T2207/10028 , G06T2219/024 , G06T2219/2004
Abstract: Various implementations provide a method for determining position data of a first device relative to a three-dimensional (3D) representation during a communication session. For example, a 3D representation is determined by a first device to correspond to a current physical environment of the first device. Then a spatial relationship is determined between the 3D representation and the current physical environment. Then position data is determined to correspond to a position of the first device relative to the 3D representation and based on a location of the first device in the current physical environment and the spatial relationship between the 3D representation and the current physical environment. The position data is then provided during a communication session between the first device and a second device with a view of the 3D representation including a representation of a user of the first device presented to a user of the second device.
-
公开(公告)号:US20230298278A1
公开(公告)日:2023-09-21
申请号:US17980584
申请日:2022-11-04
Applicant: APPLE INC.
Inventor: Alexandre DA VEIGA , Jeffrey S. NORRIS , Madhurani R. SAPRE , Spencer H. RAY
CPC classification number: G06T19/006 , G06T7/70 , G06T5/003 , G06T15/08 , G06T15/60 , G06T5/008 , G06T5/005
Abstract: Various implementations disclosed herein include devices, systems, and methods that determine how to present a three-dimensional (3D) photo in an extended reality (XR) environment (e.g., in 3D, 2D, blurry, or not at all) based on viewing position of a user active in the XR environment relative to a placement of the 3D photo in the XR environment. In some implementations, at an electronic device having a processor, a 3D photo that is an incomplete 3D representation created based on one or more images captured by an image capture device is obtained. In some implementations, a viewing position of the electronic device relative to a placement position of the 3D photo is determined, and a presentation mode for the 3D photo is determined based on the viewing position. In some implementations, the 3D photo is provided at the placement position based on the presentation mode in the XR environment.
-
公开(公告)号:US20230281933A1
公开(公告)日:2023-09-07
申请号:US17984282
申请日:2022-11-10
Applicant: APPLE INC.
Inventor: Timothy R. PEASE , Alexandre DA VEIGA , Benjamin H. BOESEL , David H. HUANG , Jonathan PERRON , Shih-Sang CHIU , Spencer H. RAY
CPC classification number: G06T19/006 , G06T7/30 , G06T7/70 , G06T2207/10024 , G06T2207/10016 , G06T2200/04 , G06T2207/10028 , G06T2210/56 , G06T2207/20021
Abstract: Various implementations disclosed herein include devices, systems, and methods that create a 3D video that includes determining first adjustments (e.g., first transforms) to video frames (e.g., one or more RGB images and depth images per frame) to align content in a coordinate system to remove the effects of capturing camera motion. Various implementations disclosed herein include devices, systems, and methods that playback a 3D video and includes determining second adjustments (e.g., second transforms) to remove the effects of movement of a viewing electronic device relative to a viewing environment during playback of the 3D video. Some implementations distinguish static content and moving content of the video frames to playback only moving objects or facilitate concurrent playback of multiple spatially related 3D videos. The 3D video may include images, audio, or 3D video of a video-capture-device user.
-
-
-
-
-
-
-
-
-