Camera-Assisted Motion Estimation for Application Control
    51.
    发明申请
    Camera-Assisted Motion Estimation for Application Control 有权
    摄像机辅助运动估计应用控制

    公开(公告)号:US20130328771A1

    公开(公告)日:2013-12-12

    申请号:US13631263

    申请日:2012-09-28

    Applicant: APPLE INC.

    CPC classification number: G06F3/03 G06F1/1694 G06F2200/1636 H04N7/183

    Abstract: Embodiments of the present invention generate estimates of device motion from two data sources on a computing device—a motion sensor and a camera. The device may compare the estimates to each other to determine if they agree. If they agree, the device may confirm that device motion estimates based on the motion sensor are accurate and may output those estimates to an application within the device. If the device motion estimates disagree, the device may alter the motion estimates obtained from the motion sensor before outputting them to the application.

    Abstract translation: 本发明的实施例从计算设备上的两个数据源(运动传感器和照相机)生成设备运动的估计。 设备可以将估计值相互比较以确定它们是否一致。 如果他们同意,设备可以确认基于运动传感器的设备运动估计是准确的,并且可以将这些估计值输出到设备内的应用。 如果设备运动估计不同意,则在将其输出到应用程序之前,设备可以改变从运动传感器获得的运动估计。

    ADVANCED CODING TECHNIQUES
    52.
    发明申请
    ADVANCED CODING TECHNIQUES 审中-公开
    先进的编码技术

    公开(公告)号:US20130235928A1

    公开(公告)日:2013-09-12

    申请号:US13652311

    申请日:2012-10-15

    Applicant: APPLE, INC.

    Abstract: Embodiments of the present invention provide techniques for efficiently coding/decoding video data during circumstances when constraints are imposed on the video data. A frame from a video sequence may be marked as a delayed decoder refresh frame. Frames successive to the delayed decoder refresh frame in coding order may predictively coded without reference to frames preceding the delayed decoder refresh frame in coding order. The distance between the delayed decoder refresh frame and the successive frames may exceed a distance threshold. Frames successive to a current frame in decoding order may be decoded without reference to frames preceding the current frame in decoding order. The distance between the current frame and the successive frames may exceed a distance threshold.

    Abstract translation: 本发明的实施例提供了在对视频数据施加约束的情况下有效地对视频数据进行编码/解码的技术。 来自视频序列的帧可被标记为延迟解码器刷新帧。 以编码顺序连续到延迟解码器刷新帧的帧可以以编码顺序预先编码而不参考延迟解码器刷新帧之前的帧。 延迟解码器刷新帧和连续帧之间的距离可以超过距离阈值。 可以解码顺序对当前帧连续的帧进行解码,而不参考当前帧之前的帧。 当前帧与连续帧之间的距离可能会超过距离阈值。

    REDUCING BLOCKINESS FOR CODECS
    53.
    发明申请

    公开(公告)号:US20250071345A1

    公开(公告)日:2025-02-27

    申请号:US18945408

    申请日:2024-11-12

    Applicant: Apple Inc.

    Abstract: Disclosed is a method that includes receiving an image frame having a plurality of coded blocks, determining a prediction unit (PU) from the plurality of coded blocks, determining one or more motion compensation units arranged in an array within the PU, and applying a filter to one or more boundaries of the one or more motion compensation units. Also disclosed is a method that includes receiving a reference frame that includes a reference block, determining a timing for deblocking a current block, performing motion compensation on the reference frame to obtain a predicted frame that includes a predicted block, performing reconstruction on the predicted frame to obtain a reconstructed frame that includes a reconstructed PU, and applying, at the timing for deblocking the current block, a deblocking filter based on one or more parameters to the reference block, the predicted block, or the reconstructed PU.

    VIDEO CODEC BUFFER QUANTITY REDUCTION

    公开(公告)号:US20240388720A1

    公开(公告)日:2024-11-21

    申请号:US18784149

    申请日:2024-07-25

    Applicant: Apple Inc.

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for reducing a quantity of buffers for a video codec. One of the methods includes determining, from a plurality of prediction modes, a prediction mode for data that represents frame data in a frame; in response to determining the prediction mode, selecting, using the prediction mode, one or more buffers from a plurality of buffers, each buffer of which is for a prediction mode from the plurality of prediction modes, a first quantity of buffers in the plurality of buffers being less than a second quantity of prediction modes in the plurality of prediction modes; retrieving, from each of the one or more buffers, historical data for the frame data; and in response to retrieving the historical data, generating, using the historical data, updated data for the frame data in the frame of the video sequence.

    Immersive Video Streaming Using View-Adaptive Prefetching and Buffer Control

    公开(公告)号:US20240146892A1

    公开(公告)日:2024-05-02

    申请号:US18407198

    申请日:2024-01-08

    Applicant: Apple Inc.

    Abstract: A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.

    Applications for decoder-side modeling of objects identified in decoded video data

    公开(公告)号:US11553200B2

    公开(公告)日:2023-01-10

    申请号:US16871378

    申请日:2020-05-11

    Applicant: Apple Inc.

    Abstract: Techniques are disclosed for coding and decoding video data using object recognition and object modeling as a basis of coding and error recovery. A video decoder may decode coded video data received from a channel. The video decoder may perform object recognition on decoded video data obtained therefrom, and, when an object is recognized in the decoded video data, the video decoder may generate a model representing the recognized object. It may store data representing the model locally. The video decoder may communicate the model data to an encoder, which may form a basis of error mitigation and recovery. The video decoder also may monitor deviation patterns in the object model and associated patterns in audio content; if/when video decoding is suspended due to operational errors, the video decoder may generate simulated video data by analyzing audio data received during the suspension period and developing video data from the data model and deviation(s) associated with patterns detected from the audio data.

    Content adaptation for streaming
    60.
    发明授权

    公开(公告)号:US11166027B2

    公开(公告)日:2021-11-02

    申请号:US15614881

    申请日:2017-06-06

    Applicant: Apple Inc.

    Abstract: Techniques are disclosed by which a coding parameter is determined to encode video data resulting in encoded video data possessing a highest possible video quality. Features may be extracted from an input video sequence. The extracted features may be compared to features described in a model of coding parameters generated by a machine learning algorithm from reviews of previously-coded videos, extracted features of the previously-coded videos, and coding parameters of the previously-coded videos. When a match is detected between the extracted features of the input video sequence and extracted features represented in the model, a determination may be made as to whether coding parameters that correspond to the matching extracted feature correspond to a tier of service to which the input video sequence is to be coded. When the coding parameters that correspond to the matching extracted feature correspond to the tier of service to which the input video sequence is to be coded, the input video sequence may be coded according to the coding parameters.

Patent Agency Ranking