Predictive video coder with low power reference picture transformation

    公开(公告)号:US09769473B2

    公开(公告)日:2017-09-19

    申请号:US13755928

    申请日:2013-01-31

    Applicant: Apple Inc.

    CPC classification number: H04N19/51 H04N19/503

    Abstract: Video coders may perform perspective transformation of reference frames during coding in a manner that conserves processing resources. When a new input frame is available for coding, a camera position for the input frame may be estimated. A video coder may search for reference pictures having similar camera positions as the position of the input frame and, for each reference picture identified, the video coder may perform a prediction search to identify a reference picture that is the best prediction match for the input frame. Once the video coder identifies a reference picture to serve as a prediction source for the input frame, the video coder may derive a transform to match the reference frame data to the input frame data and may transform the reference picture accordingly. The video coder may code the input frame using the transformed reference picture as a prediction reference and may transmit coded frame data and the camera position of the input frame to a decoder. Thus, the video coder may perform derivation and execution of transforms on a limited basis which conserves system resources.

    EFFICIENT STILL IMAGE CODING WITH VIDEO COMPRESSION TECHNIQUES
    188.
    发明申请
    EFFICIENT STILL IMAGE CODING WITH VIDEO COMPRESSION TECHNIQUES 审中-公开
    有效的图像编码与视频压缩技术

    公开(公告)号:US20160360231A1

    公开(公告)日:2016-12-08

    申请号:US14732393

    申请日:2015-06-05

    Applicant: Apple Inc.

    CPC classification number: H04N19/85 H04N19/33 H04N19/503 H04N19/88

    Abstract: Coding techniques for image data may cause a still image to be converted to a “phantom” video sequence, which is coded by motion compensated prediction techniques. Thus, coded video data obtained from the coding operation may include temporal prediction references between frames of the video sequence. Metadata may be generated that identifies allocations of content from the still image to the frames of the video sequence. The coded data and the metadata may be transmitted to another device, whereupon it may be decoded by motion compensated prediction techniques and converted back to a still image data. Other techniques may involve coding an image in both a base layer representation and at least one coded enhancement layer representation. The enhancement layer representation may be coded predictively with reference to the base layer representation. The coded base layer representation may be partitioned into a plurality of individually-transmittable segments and stored. Prediction references of elements of the enhancement layer representation may be confined to segments of the base layer representation that correspond to a location of those elements. Meaning, when a pixel block of an enhancement layer maps to a given segment of the base layer representation, prediction references are confined to that segment and do not reference portions of the base layer representation that may be found in other segment(s).

    Abstract translation: 用于图像数据的编码技术可以使静止图像被转换成通过运动补偿预测技术编码的“幻影”视频序列。 因此,从编码操作获得的编码视频数据可以包括视频序列的帧之间的时间预测参考。 可以生成元数据,其识别从静止图像到视频序列的帧的内容的分配。 编码数据和元数据可以被发送到另一个设备,于是可以通过运动补偿预测技术对其进行解码并转换成静止图像数据。 其他技术可以包括在基本层表示和至少一个编码的增强层表示中对图像进行编码。 增强层表示可以参考基本层表示预测地编码。 编码的基本层表示可以被划分成多个可单独传送的段并被存储。 增强层表示的元素的预测参考可以被限制为对应于那些元素的位置的基本层表示的段。 意思是,当增强层的像素块映射到基本层表示的给定段时,预测参考限于该段,并且不引用可能在其他段中找到的基本层表示的部分。

    Adaptive scaler switching
    189.
    发明授权
    Adaptive scaler switching 有权
    自适应缩放器切换

    公开(公告)号:US09516305B2

    公开(公告)日:2016-12-06

    申请号:US13744049

    申请日:2013-01-17

    Applicant: Apple Inc.

    Abstract: An adaptive scaler switching system may implement multiple scalers including both a software scaler and a hardware scaler, and a controller that may manage the switch between scalers by considering the real-time constraints of the system and the available system resources. Information about the availability of system resources may be received in real-time, for example the controller may receive information about the system thermal status, the timing requirements for processing the video data, the quality of the scaled data, and any other relevant system statistics that may affect the scaler switch decision. According to an embodiment, the system may maintain statistics in a table, and update the table information as necessary.

    Abstract translation: 自适应缩放器交换系统可以实现包括软件缩放器和硬件缩放器两者的多个定标器,以及可以通过考虑系统的实时约束和可用系统资源来管理定标器之间的切换的控制器。 可以实时接收关于系统资源的可用性的信息,例如,控制器可以接收关于系统热状态,处理视频数据的时序要求,缩放数据的质量以及任何其它相关系统统计信息 这可能会影响缩放器切换的决定。 根据实施例,系统可以维护表中的统计信息,并根据需要更新表信息。

Patent Agency Ranking