-
公开(公告)号:US20240062413A1
公开(公告)日:2024-02-22
申请号:US18384352
申请日:2023-10-26
Applicant: Apple Inc.
Inventor: Jeffrey S. Norris , Alexandre Da Veiga , Bruno M. Sommer , Ye Cong , Tobias Eble , Moinul Khan , Nicolas Bonnier , Hao Pan
CPC classification number: G06T7/73 , G02B27/017 , G06V20/20 , G06V10/462 , G06V10/245 , G06T2207/30204
Abstract: A method includes obtaining first pass-through image data characterized by a first pose. The method includes obtaining respective pixel characterization vectors for pixels in the first pass-through image data. The method includes identifying a feature of an object within the first pass-through image data in accordance with a determination that pixel characterization vectors for the feature satisfy a feature confidence threshold. The method includes displaying the first pass-through image data and an AR display marker that corresponds to the feature. The method includes obtaining second pass-through image data characterized by a second pose. The method includes transforming the AR display marker to a position associated with the second pose in order to track the feature. The method includes displaying the second pass-through image data and maintaining display of the AR display marker that corresponds to the feature of the object based on the transformation.
-
公开(公告)号:US11836885B2
公开(公告)日:2023-12-05
申请号:US17053181
申请日:2019-05-06
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
CPC classification number: G06T3/0093 , G06T3/40 , G06T9/001
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US20230289993A1
公开(公告)日:2023-09-14
申请号:US18119792
申请日:2023-03-09
Applicant: Apple Inc.
Inventor: Boyuan Sun , Bin Liu , Feng Tang , Peng Wu , Ye Cong
CPC classification number: G06T7/62 , G06T7/11 , G06T19/006 , G06T2207/10028 , G06T2210/12
Abstract: Various implementations provide 3D representations of objects. Such representations may be based on 3D point cloud and/or 2D image inputs that are obtained based on sensor data, e.g., images, depth data, motion data, etc. 3D point cloud input may be used for part segmentation and/or to determine position and/or orientation of object parts, e.g., generating 3D bounding boxes representing the sizes, positions, and orientations, of object parts. 2D image input may be used for part attribute recognition, e.g., to determine whether a chair legs part has a particular type such as star-shaped, straight down, crossed-shaped, etc. Part attributes may be used to produce a relatively simple and relatively accurate representation of the shape of each part within a respective area, e.g., within a bounding box determined for each part using the 3D point cloud input.
-
公开(公告)号:US20250014143A1
公开(公告)日:2025-01-09
申请号:US18898295
申请日:2024-09-26
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US12131437B2
公开(公告)日:2024-10-29
申请号:US18510916
申请日:2023-11-16
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US11871052B1
公开(公告)日:2024-01-09
申请号:US16580184
申请日:2019-09-24
Applicant: Apple Inc.
Inventor: Hao Pan , Haitao Guo , Ke Chen , Francesco Iacopino , Jim C. Chou , Xiaohua Yang , Linfeng Guo , Munehiro Nakazato , Krishnakanth Rapaka , Ye Cong
IPC: G06F15/16 , H04N21/2343 , G02B27/00 , G06T19/00 , H04N21/2662
CPC classification number: H04N21/2343 , G02B27/0093 , G06T19/006 , H04N21/2662
Abstract: In one implementation, a method of generating a bit stream encoding a video stream is performed by a device including one or more processors and non-transitory memory. The method includes decomposing a video stream into a plurality of frequency band video streams. The method includes determining a target bitrate and determining, for each frequency band video stream, a respective frequency band bit rate based on the target bit rate. The method includes encoding each of the plurality of frequency band video streams at its respective frequency band bit rate and transmitting, over a channel, each encoded frequency band video stream.
-
公开(公告)号:US20240087080A1
公开(公告)日:2024-03-14
申请号:US18510916
申请日:2023-11-16
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
CPC classification number: G06T3/0093 , G06T3/40 , G06T9/001
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US11830214B2
公开(公告)日:2023-11-28
申请号:US16424937
申请日:2019-05-29
Applicant: Apple Inc.
Inventor: Jeffrey S. Norris , Alexandre Da Veiga , Bruno M. Sommer , Ye Cong , Tobias Eble , Moinul Khan , Nicolas Bonnier , Hao Pan
CPC classification number: G06T7/73 , G02B27/017 , G06V10/245 , G06V10/462 , G06V20/20 , G06T2207/30204
Abstract: A method includes obtaining first pass-through image data characterized by a first pose. The method includes obtaining respective pixel characterization vectors for pixels in the first pass-through image data. The method includes identifying a feature of an object within the first pass-through image data in accordance with a determination that pixel characterization vectors for the feature satisfy a feature confidence threshold. The method includes displaying the first pass-through image data and an AR display marker that corresponds to the feature. The method includes obtaining second pass-through image data characterized by a second pose. The method includes transforming the AR display marker to a position associated with the second pose in order to track the feature. The method includes displaying the second pass-through image data and maintaining display of the AR display marker that corresponds to the feature of the object based on the transformation.
-
公开(公告)号:US20210142443A1
公开(公告)日:2021-05-13
申请号:US17053181
申请日:2019-05-06
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
-
-
-
-
-
-
-