-
公开(公告)号:US10205967B2
公开(公告)日:2019-02-12
申请号:US15070620
申请日:2016-03-15
Applicant: Apple Inc.
Inventor: Hao Pan , Yingjun Bai , Xuemei Zhang , Haitao Guo , Munehiro Nakazato , Xiaohua Yang
IPC: H04N19/86 , H04N19/12 , H04N19/156 , H04N19/186 , H04N19/44
Abstract: This disclosure relates to a wide gamut encoder capable of receiving a wide gamut color image in accordance with a wide gamut standard. The encoder can encode one or more wide gamut color image pixel values into portions of narrow gamut encoding elements for transmission to a video encoder. The encoder can implement an advanced extended YCC format that is backward compatible with a P3 color gamut.
-
公开(公告)号:US09888240B2
公开(公告)日:2018-02-06
申请号:US14056043
申请日:2013-10-17
Applicant: Apple Inc.
Inventor: Yeping Su , Chris Y. Chung , Hao Pan , Hsi-Jung Wu , Ke Zhang
IPC: H04N19/117 , H04N19/136
CPC classification number: H04N19/117 , H04N19/136
Abstract: Video coding systems and methods are provided that protect against various artifacts (e.g., banding artifacts) in decoded frame content. The embodiments to protect against introducing artifacts include pre-processing the input video frame, controlling the encoding parameters and/or post-processing the decoded video frame. A method for encoding a frame may include calculating a dark-scene score for the frame based on measured statistics of the frame. The dark-scene score may be compared to a threshold to determine if the banding artifacts may be present in the frame. Based on the comparison, filtering parameters for the frame may be altered to reduce the amount of noise filtered from the frame. The frame may be filtered based on the altered filtering parameters and encoded.
-
公开(公告)号:US20140029663A1
公开(公告)日:2014-01-30
申请号:US13707404
申请日:2012-12-06
Applicant: APPLE INC.
Inventor: Yeping Su , Hsi-Jung Wu , Hao Pan
IPC: H04N7/26
CPC classification number: H04N19/10 , H04N19/117 , H04N19/14 , H04N19/17 , H04N19/176 , H04N19/463 , H04N19/577 , H04N19/61 , H04N19/80
Abstract: Video encoders often produce banding artifacts on areas with smooth gradients and low levels of detail/noise. In this disclosure, a video encoding system identifies the banded areas and adjusts coding parameters accordingly. The video coder may include a pre-coding banding detector and a post-coding banding detector. The pre-coding detector may identify regions in the input picture with smooth gradients that are likely to have banding artifacts after encoding. The post-coding detector may identify regions in the reconstructed picture with visible banding. Usage of pre-coding detector and/or post-coding detector depends on how an encoder operates. In a single-pass encoding or during the first pass of a multi-pass encoding, the pre-coding detection maps are used. During picture re-encoding or during later passes of a multi-pass encoding, the post-coding detector maps are used.
Abstract translation: 视频编码器经常在平滑梯度和低细节/噪音水平的区域产生带状伪影。 在本公开中,视频编码系统识别带状区域并相应地调整编码参数。 视频编码器可以包括预编码带状检测器和后编码条带检测器。 预编码检测器可以在编码后可能具有可能具有带状伪影的平滑梯度来识别输入图像中的区域。 后编码检测器可以用可见条带识别重建图像中的区域。 预编码检测器和/或后编码检测器的使用取决于编码器如何工作。 在单遍编码中或在多遍编码的第一遍期间,使用预编码检测图。 在图像重新编码期间或在多遍编码的稍后通过期间,使用后编码检测器图。
-
公开(公告)号:US20250014143A1
公开(公告)日:2025-01-09
申请号:US18898295
申请日:2024-09-26
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US12131437B2
公开(公告)日:2024-10-29
申请号:US18510916
申请日:2023-11-16
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US12086919B2
公开(公告)日:2024-09-10
申请号:US18344294
申请日:2023-06-29
Applicant: Apple Inc.
Inventor: Arthur Y Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
公开(公告)号:US11871052B1
公开(公告)日:2024-01-09
申请号:US16580184
申请日:2019-09-24
Applicant: Apple Inc.
Inventor: Hao Pan , Haitao Guo , Ke Chen , Francesco Iacopino , Jim C. Chou , Xiaohua Yang , Linfeng Guo , Munehiro Nakazato , Krishnakanth Rapaka , Ye Cong
IPC: G06F15/16 , H04N21/2343 , G02B27/00 , G06T19/00 , H04N21/2662
CPC classification number: H04N21/2343 , G02B27/0093 , G06T19/006 , H04N21/2662
Abstract: In one implementation, a method of generating a bit stream encoding a video stream is performed by a device including one or more processors and non-transitory memory. The method includes decomposing a video stream into a plurality of frequency band video streams. The method includes determining a target bitrate and determining, for each frequency band video stream, a respective frequency band bit rate based on the target bit rate. The method includes encoding each of the plurality of frequency band video streams at its respective frequency band bit rate and transmitting, over a channel, each encoded frequency band video stream.
-
公开(公告)号:US11816820B2
公开(公告)日:2023-11-14
申请号:US17711808
申请日:2022-04-01
Applicant: Apple Inc.
Inventor: Can Jin , Nicolas Peirre Marie Frederic Bonnier , Hao Pan
CPC classification number: G06T5/20 , G02B27/017 , G06F3/013 , G06T19/006
Abstract: A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.
-
公开(公告)号:US20230298146A1
公开(公告)日:2023-09-21
申请号:US18167786
申请日:2023-02-10
Applicant: Apple Inc.
Inventor: Can Jin , Nicolas Peirre Marie Frederic Bonnier , Hao Pan
CPC classification number: G06T5/20 , G02B27/017 , G06F3/013 , G06T19/006
Abstract: A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.
-
公开(公告)号:US20220329805A1
公开(公告)日:2022-10-13
申请号:US17843160
申请日:2022-06-17
Applicant: Apple Inc.
Inventor: Krishnakanth Rapaka , Munehiro Nakazato , Jiandong Shen , Ganesh G. Yadav , Sorin Constantin Cismas , Jim C. Chou , Hao Pan
IPC: H04N19/124 , H04N19/60
Abstract: In one implementation, a method of encoding an image is performed at a device including one or more processors and non-transitory memory. The method includes determining a category of a spatial portion of an image based on a relation between a plurality of thresholds associated with a plurality of quantization scaling parameters and a bit rate of the spatial portion of the image at the plurality of quantization scaling parameters. The method includes quantizing the spatial portion of the image based on the categorization.
-
-
-
-
-
-
-
-
-