Processing of Equirectangular Object Data to Compensate for Distortion by Spherical Projections

    公开(公告)号:US20180234700A1

    公开(公告)日:2018-08-16

    申请号:US15433505

    申请日:2017-02-15

    Applicant: Apple Inc.

    Abstract: Multi-directional image data often contains distortions of image content that cause problems when processed by video coders that are designed to process traditional, “flat” image content. Embodiments of the present disclosure provide techniques for coding multi-directional image data using such coders. For each pixel block in a frame to be coded, an encoder may transform reference picture data within a search window about a location of the input pixel block based on displacement respectively between the location of the input pixel block and portions of the reference picture within the search window. The encoder may perform a prediction search among the transformed reference picture data to identify a match between the input pixel block and a portion of the transformed reference picture and, when a match is identified, the encoder may code the input pixel block differentially with respect to the matching portion of the transformed reference picture. The transform may counter-act distortions imposed on image content of the reference picture data by the multi-directional format, which aligns the content with image content of the input picture. The techniques apply both for intra-coding and inter-coding.

    EFFICIENT STILL IMAGE CODING WITH VIDEO COMPRESSION TECHNIQUES
    69.
    发明申请
    EFFICIENT STILL IMAGE CODING WITH VIDEO COMPRESSION TECHNIQUES 审中-公开
    有效的图像编码与视频压缩技术

    公开(公告)号:US20160360231A1

    公开(公告)日:2016-12-08

    申请号:US14732393

    申请日:2015-06-05

    Applicant: Apple Inc.

    CPC classification number: H04N19/85 H04N19/33 H04N19/503 H04N19/88

    Abstract: Coding techniques for image data may cause a still image to be converted to a “phantom” video sequence, which is coded by motion compensated prediction techniques. Thus, coded video data obtained from the coding operation may include temporal prediction references between frames of the video sequence. Metadata may be generated that identifies allocations of content from the still image to the frames of the video sequence. The coded data and the metadata may be transmitted to another device, whereupon it may be decoded by motion compensated prediction techniques and converted back to a still image data. Other techniques may involve coding an image in both a base layer representation and at least one coded enhancement layer representation. The enhancement layer representation may be coded predictively with reference to the base layer representation. The coded base layer representation may be partitioned into a plurality of individually-transmittable segments and stored. Prediction references of elements of the enhancement layer representation may be confined to segments of the base layer representation that correspond to a location of those elements. Meaning, when a pixel block of an enhancement layer maps to a given segment of the base layer representation, prediction references are confined to that segment and do not reference portions of the base layer representation that may be found in other segment(s).

    Abstract translation: 用于图像数据的编码技术可以使静止图像被转换成通过运动补偿预测技术编码的“幻影”视频序列。 因此,从编码操作获得的编码视频数据可以包括视频序列的帧之间的时间预测参考。 可以生成元数据,其识别从静止图像到视频序列的帧的内容的分配。 编码数据和元数据可以被发送到另一个设备,于是可以通过运动补偿预测技术对其进行解码并转换成静止图像数据。 其他技术可以包括在基本层表示和至少一个编码的增强层表示中对图像进行编码。 增强层表示可以参考基本层表示预测地编码。 编码的基本层表示可以被划分成多个可单独传送的段并被存储。 增强层表示的元素的预测参考可以被限制为对应于那些元素的位置的基本层表示的段。 意思是,当增强层的像素块映射到基本层表示的给定段时,预测参考限于该段,并且不引用可能在其他段中找到的基本层表示的部分。

    Adaptive scaler switching
    70.
    发明授权
    Adaptive scaler switching 有权
    自适应缩放器切换

    公开(公告)号:US09516305B2

    公开(公告)日:2016-12-06

    申请号:US13744049

    申请日:2013-01-17

    Applicant: Apple Inc.

    Abstract: An adaptive scaler switching system may implement multiple scalers including both a software scaler and a hardware scaler, and a controller that may manage the switch between scalers by considering the real-time constraints of the system and the available system resources. Information about the availability of system resources may be received in real-time, for example the controller may receive information about the system thermal status, the timing requirements for processing the video data, the quality of the scaled data, and any other relevant system statistics that may affect the scaler switch decision. According to an embodiment, the system may maintain statistics in a table, and update the table information as necessary.

    Abstract translation: 自适应缩放器交换系统可以实现包括软件缩放器和硬件缩放器两者的多个定标器,以及可以通过考虑系统的实时约束和可用系统资源来管理定标器之间的切换的控制器。 可以实时接收关于系统资源的可用性的信息,例如,控制器可以接收关于系统热状态,处理视频数据的时序要求,缩放数据的质量以及任何其它相关系统统计信息 这可能会影响缩放器切换的决定。 根据实施例,系统可以维护表中的统计信息,并根据需要更新表信息。

Patent Agency Ranking