-
51.
公开(公告)号:US20130328771A1
公开(公告)日:2013-12-12
申请号:US13631263
申请日:2012-09-28
Applicant: APPLE INC.
Inventor: Yao-Chung Lin , Xiaosong Zhou , Hsi-Jung Wu
IPC: G06F3/033
CPC classification number: G06F3/03 , G06F1/1694 , G06F2200/1636 , H04N7/183
Abstract: Embodiments of the present invention generate estimates of device motion from two data sources on a computing device—a motion sensor and a camera. The device may compare the estimates to each other to determine if they agree. If they agree, the device may confirm that device motion estimates based on the motion sensor are accurate and may output those estimates to an application within the device. If the device motion estimates disagree, the device may alter the motion estimates obtained from the motion sensor before outputting them to the application.
Abstract translation: 本发明的实施例从计算设备上的两个数据源(运动传感器和照相机)生成设备运动的估计。 设备可以将估计值相互比较以确定它们是否一致。 如果他们同意,设备可以确认基于运动传感器的设备运动估计是准确的,并且可以将这些估计值输出到设备内的应用。 如果设备运动估计不同意,则在将其输出到应用程序之前,设备可以改变从运动传感器获得的运动估计。
-
公开(公告)号:US20130235928A1
公开(公告)日:2013-09-12
申请号:US13652311
申请日:2012-10-15
Applicant: APPLE, INC.
Inventor: Chris Y. Chung , Hao Pan , Jiefu Zhai , Yeping Su , Douglas Scott Price , Hsi-Jung Wu , Xiaosong Zhou
CPC classification number: H04N19/577 , H04N19/107 , H04N19/117 , H04N19/124 , H04N19/139 , H04N19/149 , H04N19/15 , H04N19/154 , H04N19/156 , H04N19/172 , H04N19/192 , H04N19/46 , H04N19/58
Abstract: Embodiments of the present invention provide techniques for efficiently coding/decoding video data during circumstances when constraints are imposed on the video data. A frame from a video sequence may be marked as a delayed decoder refresh frame. Frames successive to the delayed decoder refresh frame in coding order may predictively coded without reference to frames preceding the delayed decoder refresh frame in coding order. The distance between the delayed decoder refresh frame and the successive frames may exceed a distance threshold. Frames successive to a current frame in decoding order may be decoded without reference to frames preceding the current frame in decoding order. The distance between the current frame and the successive frames may exceed a distance threshold.
Abstract translation: 本发明的实施例提供了在对视频数据施加约束的情况下有效地对视频数据进行编码/解码的技术。 来自视频序列的帧可被标记为延迟解码器刷新帧。 以编码顺序连续到延迟解码器刷新帧的帧可以以编码顺序预先编码而不参考延迟解码器刷新帧之前的帧。 延迟解码器刷新帧和连续帧之间的距离可以超过距离阈值。 可以解码顺序对当前帧连续的帧进行解码,而不参考当前帧之前的帧。 当前帧与连续帧之间的距离可能会超过距离阈值。
-
公开(公告)号:US20250071345A1
公开(公告)日:2025-02-27
申请号:US18945408
申请日:2024-11-12
Applicant: Apple Inc.
Inventor: Yixin Du , Alexandros Tourapis , Alican Nalci , Guoxin Jin , Hilmi Enes Egilmez , Hsi-Jung Wu , Jun Xin , Yeqing Wu , Yunfei Zheng
IPC: H04N19/86 , H04N19/117 , H04N19/139 , H04N19/176 , H04N19/82
Abstract: Disclosed is a method that includes receiving an image frame having a plurality of coded blocks, determining a prediction unit (PU) from the plurality of coded blocks, determining one or more motion compensation units arranged in an array within the PU, and applying a filter to one or more boundaries of the one or more motion compensation units. Also disclosed is a method that includes receiving a reference frame that includes a reference block, determining a timing for deblocking a current block, performing motion compensation on the reference frame to obtain a predicted frame that includes a predicted block, performing reconstruction on the predicted frame to obtain a reconstructed frame that includes a reconstructed PU, and applying, at the timing for deblocking the current block, a deblocking filter based on one or more parameters to the reference block, the predicted block, or the reconstructed PU.
-
公开(公告)号:US20240388720A1
公开(公告)日:2024-11-21
申请号:US18784149
申请日:2024-07-25
Applicant: Apple Inc.
Inventor: Yunfei Zheng , Alexandros Tourapis , Alican Nalci , Felix C. Fernandes , Hilmi Enes Egilmez , Hsi-Jung Wu , Jaehong Chon , Jun Xin , Yeqing Wu , Yixin Du
IPC: H04N19/159 , H04N19/105 , H04N19/172 , H04N19/43 , H04N19/58
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for reducing a quantity of buffers for a video codec. One of the methods includes determining, from a plurality of prediction modes, a prediction mode for data that represents frame data in a frame; in response to determining the prediction mode, selecting, using the prediction mode, one or more buffers from a plurality of buffers, each buffer of which is for a prediction mode from the plurality of prediction modes, a first quantity of buffers in the plurality of buffers being less than a second quantity of prediction modes in the plurality of prediction modes; retrieving, from each of the one or more buffers, historical data for the frame data; and in response to retrieving the historical data, generating, using the historical data, updated data for the frame data in the frame of the video sequence.
-
公开(公告)号:US20240146892A1
公开(公告)日:2024-05-02
申请号:US18407198
申请日:2024-01-08
Applicant: Apple Inc.
Inventor: Fanyi Duanmu , Jun Xin , Hsi-Jung Wu , Xiaosong Zhou
IPC: H04N13/117 , H04N13/178 , H04N21/218 , H04N21/24
CPC classification number: H04N13/117 , H04N13/178 , H04N21/21805 , H04N21/2401 , H04N21/2402
Abstract: A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.
-
公开(公告)号:US11956295B2
公开(公告)日:2024-04-09
申请号:US16825381
申请日:2020-03-20
Applicant: Apple Inc.
Inventor: Fanyi Duanmu , Alexandros Tourapis , Jun Xin , Hsi-Jung Wu , Xiaosong Zhou
IPC: H04L65/75 , H04L65/70 , H04N13/111 , H04N13/161 , H04N13/194 , H04N13/344
CPC classification number: H04L65/764 , H04L65/70 , H04N13/111 , H04N13/161 , H04N13/194 , H04N13/344
Abstract: Techniques for multi-view video streaming are described in the present disclosure, wherein a viewport prediction may be employed at a client-end based on analysis of pre-fetched media item data and ancillary information. A streaming method may first prefetch a portion of content of a multi-view media item. The method may next identify a salient region from the prefetched content and may then download additional content of the media item that corresponds to the identified salient region.
-
公开(公告)号:US11553200B2
公开(公告)日:2023-01-10
申请号:US16871378
申请日:2020-05-11
Applicant: Apple Inc.
Inventor: Xing Wen , Dazhong Zhang , Peikang Song , Xiaosong Zhou , Sudeng Hu , Hsi-Jung Wu , Jae Hoon Kim
IPC: H04N19/51 , H04N19/44 , H04N19/65 , H04N19/176 , H04N19/91
Abstract: Techniques are disclosed for coding and decoding video data using object recognition and object modeling as a basis of coding and error recovery. A video decoder may decode coded video data received from a channel. The video decoder may perform object recognition on decoded video data obtained therefrom, and, when an object is recognized in the decoded video data, the video decoder may generate a model representing the recognized object. It may store data representing the model locally. The video decoder may communicate the model data to an encoder, which may form a basis of error mitigation and recovery. The video decoder also may monitor deviation patterns in the object model and associated patterns in audio content; if/when video decoding is suspended due to operational errors, the video decoder may generate simulated video data by analyzing audio data received during the suspension period and developing video data from the data model and deviation(s) associated with patterns detected from the audio data.
-
公开(公告)号:US11202098B2
公开(公告)日:2021-12-14
申请号:US16503933
申请日:2019-07-05
Applicant: Apple Inc.
Inventor: Khaled Mammou , Yeping Su , Jungsun Kim , Valery G. Valentin , David W. Singer , Fabrice A. Robinet , Hsi-Jung Wu , Alexandros Tourapis
IPC: H04N19/597 , H04N19/85 , H04N19/463
Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.
-
公开(公告)号:US20210377547A1
公开(公告)日:2021-12-02
申请号:US17404452
申请日:2021-08-17
Applicant: Apple Inc.
Inventor: Alexandros Tourapis , Yeping Su , David W. Singer , Hsi-Jung Wu
IPC: H04N19/186 , H04N19/189 , H04N9/64 , H04N11/20 , H04N19/70 , H04N19/46 , H04N19/117 , H04N19/132 , H04N19/154 , H04N19/59 , H04N9/67 , H04N19/82 , H04N19/147 , H04N19/80 , H04N19/85 , H04N19/44
Abstract: A method of adaptive chroma downsampling is presented. The method comprises converting a source image to a converted image in an output color format, applying a plurality of downsample filters to the converted image and estimating a distortion for each filter chose the filter that produces the minimum distortion. The distortion estimation includes applying an upsample filter, and a pixel is output based on the chosen filter. Methods for closed loop conversions are also presented.
-
公开(公告)号:US11166027B2
公开(公告)日:2021-11-02
申请号:US15614881
申请日:2017-06-06
Applicant: Apple Inc.
Inventor: Yeping Su , Xingyu Zhang , Chris Chung , Jun Xin , Hsi-Jung Wu
IPC: H04B1/66 , H04N19/136 , H04N19/103 , G06N20/00 , H04N19/179 , H04N21/845 , H04N21/2343
Abstract: Techniques are disclosed by which a coding parameter is determined to encode video data resulting in encoded video data possessing a highest possible video quality. Features may be extracted from an input video sequence. The extracted features may be compared to features described in a model of coding parameters generated by a machine learning algorithm from reviews of previously-coded videos, extracted features of the previously-coded videos, and coding parameters of the previously-coded videos. When a match is detected between the extracted features of the input video sequence and extracted features represented in the model, a determination may be made as to whether coding parameters that correspond to the matching extracted feature correspond to a tier of service to which the input video sequence is to be coded. When the coding parameters that correspond to the matching extracted feature correspond to the tier of service to which the input video sequence is to be coded, the input video sequence may be coded according to the coding parameters.
-
-
-
-
-
-
-
-
-