Applications for Decoder-Side Modeling of Objects Identified in Decoded Video Data

    公开(公告)号:US20190306524A1

    公开(公告)日:2019-10-03

    申请号:US15938158

    申请日:2018-03-28

    Applicant: Apple Inc.

    Abstract: Techniques are disclosed for coding and decoding video data using object recognition and object modeling as a basis of coding and error recovery. A video decoder may decode coded video data received from a channel. The video decoder may perform object recognition on decoded video data obtained therefrom, and, when an object is recognized in the decoded video data, the video decoder may generate a model representing the recognized object. It may store data representing the model locally. The video decoder may communicate the model data to an encoder, which may form a basis of error mitigation and recovery. The video decoder also may monitor deviation patterns in the object model and associated patterns in audio content; if/when video decoding is suspended due to operational errors, the video decoder may generate simulated video data by analyzing audio data received during the suspension period and developing video data from the data model and deviation(s) associated with patterns detected from the audio data.

    Video Coding Techniques for Multi-View Video
    45.
    发明申请

    公开(公告)号:US20180249164A1

    公开(公告)日:2018-08-30

    申请号:US15443342

    申请日:2017-02-27

    Applicant: Apple Inc.

    Abstract: Techniques are disclosed for coding and decoding video captured as cube map images. According to these techniques, padded reference images are generated for use during predicting input data. A reference image is stored in a cube map format. A padded reference image is generated from the reference image in which image data of a first view contained in reference image is replicated and placed adjacent to a second view contained in the cube map image. When coding a pixel block of an input image, a prediction search may be performed between the input pixel block and content of the padded reference image. When the prediction search identifies a match, the pixel block may be coded with respect to matching data from the padded reference image. Presence of replicated data in the padded reference image is expected to increase the likelihood that adequate prediction matches will be identified for input pixel block data, which will increase overall efficiency of the video coding.

    IN LOOP CHROMA DEBLOCKING FILTER
    47.
    发明申请
    IN LOOP CHROMA DEBLOCKING FILTER 审中-公开
    循环色谱去除过滤器

    公开(公告)号:US20150350687A1

    公开(公告)日:2015-12-03

    申请号:US14290873

    申请日:2014-05-29

    Applicant: Apple Inc.

    CPC classification number: H04N19/82 H04N19/186

    Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.

    Abstract translation: 可以执行重构的视频样本的色度去块滤波以去除块状伪影并且减少颜色伪影而不会过度平滑。 在第一种方法中,可以对最小变换大小的边界样本执行色度解块,而与分区和编码模式无关。 在第二种方法中,当边界强度大于0时,可以执行色度去块。在第三种方法中,可以执行色度去块,而不管边界强度如何。 在第四种方法中,要执行的色度去块的类型可以通过标志在片头中发出信号。 此外,亮度去块滤波技术可以应用于色度去块滤波。

    IMAGE COMPRESSION BASED ON DEVICE ORIENTATION AND LOCATION INFORMATION
    48.
    发明申请
    IMAGE COMPRESSION BASED ON DEVICE ORIENTATION AND LOCATION INFORMATION 审中-公开
    基于设备定位和位置信息的图像压缩

    公开(公告)号:US20150350653A1

    公开(公告)日:2015-12-03

    申请号:US14288969

    申请日:2014-05-28

    Applicant: Apple Inc.

    CPC classification number: H04N19/137 H04N19/142 H04N19/51 H04N19/52

    Abstract: An encoding system may include a video source that provides video data to be coded, a video coder, a transmitter, and a controller to manage operation of the system. The controller may control the video coder to code and compress the image information from the video source into video data, based upon one or more motion prediction parameters. The transmitter may transmit the video data. A decoding system may decode the video data based upon the motion prediction parameters.

    Abstract translation: 编码系统可以包括提供要编码的视频数据的视频源,视频编码器,发射机和控制器,以管理系统的操作。 控制器可以基于一个或多个运动预测参数来控制视频编码器对来自视频源的图像信息进行编码和压缩成视频数据。 发射机可以发送视频数据。 解码系统可以基于运动预测参数解码视频数据。

    Coherence groups: region descriptors for low bit rate encoding
    49.
    发明授权
    Coherence groups: region descriptors for low bit rate encoding 有权
    相干组:用于低比特率编码的区域描述符

    公开(公告)号:US08923640B1

    公开(公告)日:2014-12-30

    申请号:US13913169

    申请日:2013-06-07

    Applicant: Apple Inc.

    Abstract: The invention is directed to an efficient way for encoding and decoding video. Embodiments include identifying different coding units that share a similar characteristic. The characteristic can be, for example: quantization values, modes, block sizes, color space, motion vectors, depth, facial and non-facial regions, and filter values. An encoder may then group the units together as a coherence group. An encoder may similarly create a table or other data structure of the coding units. An encoder may then extract the commonly repeating characteristic or attribute from the coding units. The encoder may transmit the coherence groups along with the data structure, and other coding units which were not part of a coherence group. The decoder may receive the data, and utilize the shared characteristic by storing locally in cache, for faster repeated decoding, and decode the coherence group together.

    Abstract translation: 本发明涉及用于对视频进行编码和解码的有效方式。 实施例包括识别共享相似特征的不同编码单元。 特征可以是例如:量化值,模式,块大小,颜色空间,运动矢量,深度,面部和非面部区域以及滤波器值。 然后,编码器可以将这些单元组合在一起作为一致性组。 编码器可以类似地创建编码单元的表或其他数据结构。 然后,编码器可以从编码单元中提取常见的重复特性或属性。 编码器可以连同数据结构以及不是相干组的一部分的其他编码单元一起发送相干组。 解码器可以接收数据,并通过将本地存储在高速缓存中来利用共享特性,以便更快的重复解码,并将相干组一起解码。

    ERROR RESILIENT MANAGEMENT OF PICTURE ORDER COUNT IN PREDICTIVE CODING SYSTEMS
    50.
    发明申请
    ERROR RESILIENT MANAGEMENT OF PICTURE ORDER COUNT IN PREDICTIVE CODING SYSTEMS 有权
    预测编码系统中图像订单的错误恢复管理

    公开(公告)号:US20140086315A1

    公开(公告)日:2014-03-27

    申请号:US13626730

    申请日:2012-09-25

    Applicant: APPLE INC.

    Abstract: Coding techniques for input video may include assigning picture identifiers to input frames in either long-form or short-form formats. If a network error has occurred that results in loss of previously-coded video data, a new input frame may be assigned a picture identifier that is coded in a long-form coding format. If no network error has occurred, the input frame may be assigned a picture identifier that is coded in a short-form coding format. Long-form coding may mitigate against loss of synchronization between an encoder and a decoder by picture identifiers.

    Abstract translation: 用于输入视频的编码技术可以包括将图像标识符分配给长格式或短格式格式的输入帧。 如果发生导致先前编码的视频数据丢失的网络错误,则可以为新的输入帧分配以长格式编码格式编码的图像标识符。 如果没有发生网络错误,则可以为输入帧分配以短格式编码格式编码的图像标识符。 长格式编码可以通过图像标识符减轻编码器和解码器之间的同步丢失。

Patent Agency Ranking