Predictive video coder with low power reference picture transformation

    公开(公告)号:US09769473B2

    公开(公告)日:2017-09-19

    申请号:US13755928

    申请日:2013-01-31

    Applicant: Apple Inc.

    CPC classification number: H04N19/51 H04N19/503

    Abstract: Video coders may perform perspective transformation of reference frames during coding in a manner that conserves processing resources. When a new input frame is available for coding, a camera position for the input frame may be estimated. A video coder may search for reference pictures having similar camera positions as the position of the input frame and, for each reference picture identified, the video coder may perform a prediction search to identify a reference picture that is the best prediction match for the input frame. Once the video coder identifies a reference picture to serve as a prediction source for the input frame, the video coder may derive a transform to match the reference frame data to the input frame data and may transform the reference picture accordingly. The video coder may code the input frame using the transformed reference picture as a prediction reference and may transmit coded frame data and the camera position of the input frame to a decoder. Thus, the video coder may perform derivation and execution of transforms on a limited basis which conserves system resources.

    CODEC TECHNIQUES FOR FAST SWITCHING
    3.
    发明申请

    公开(公告)号:US20190075342A1

    公开(公告)日:2019-03-07

    申请号:US16180115

    申请日:2018-11-05

    Applicant: Apple Inc.

    Abstract: A video streaming method for transitioning between multiple sequences of coded video data may include receiving and decoding transmission units from a first sequence of coded video data. In response to a request to transition to a second sequence of coded video data, the method may determine whether a time to transition to the second sequence of coded video data can be reduced by transitioning to the second sequence of coded video data via an intermediate sequence of coded video data. If the time can be reduced, the method may include receiving at least one transmission unit from an intermediate sequence of coded video data that corresponds to the request to transition, decoding the transmission unit from the intermediate sequence, and transitioning from the first sequence to the second sequence via the decoded transmission unit from the intermediate sequence.

    Temporal aliasing reduction and coding of upsampled video
    7.
    发明授权
    Temporal aliasing reduction and coding of upsampled video 有权
    上采样视频的时间混叠减少和编码

    公开(公告)号:US08976254B2

    公开(公告)日:2015-03-10

    申请号:US13691163

    申请日:2012-11-30

    Applicant: Apple Inc.

    Abstract: Embodiments of the invention provide techniques for upsampling a video sequence for coding. According to the method, an estimate of camera motion may be obtained from motion sensor data. Video data may be analyzed to detect motion within frames output from a camera that is not induced by the camera motion. When non-camera motion falls within a predetermined operational limit, video upsampling processes may be engaged. In another embodiment, video upsampling may be performed by twice estimating image content for a hypothetical new a frame using two different sources as inputs. A determination may be made whether the two estimates of the frame match each other sufficiently well. If so, the two estimates may be merged to yield a final estimated frame and the new frame may be integrated into a stream of video data.

    Abstract translation: 本发明的实施例提供了用于对用于编码的视频序列进行上采样的技术。 根据该方法,可以从运动传感器数据获得相机运动的估计。 可以分析视频数据以检测来自摄像机输出的不是由摄像机运动引起的帧内的运动。 当非相机运动落在预定的操作限制内时,可以使用视频上采样处理。 在另一个实施例中,视频上采样可以通过使用两个不同的源作为输入来对假设的新帧的两次估计图像内容来执行。 可以确定帧的两个估计是否足够好地匹配。 如果是这样,则两个估计可以被合并以产生最终的估计帧,并且新的帧可以被集成到视频数据流中。

    ADVANCED CODING TECHNIQUES
    8.
    发明申请
    ADVANCED CODING TECHNIQUES 审中-公开
    先进的编码技术

    公开(公告)号:US20130235928A1

    公开(公告)日:2013-09-12

    申请号:US13652311

    申请日:2012-10-15

    Applicant: APPLE, INC.

    Abstract: Embodiments of the present invention provide techniques for efficiently coding/decoding video data during circumstances when constraints are imposed on the video data. A frame from a video sequence may be marked as a delayed decoder refresh frame. Frames successive to the delayed decoder refresh frame in coding order may predictively coded without reference to frames preceding the delayed decoder refresh frame in coding order. The distance between the delayed decoder refresh frame and the successive frames may exceed a distance threshold. Frames successive to a current frame in decoding order may be decoded without reference to frames preceding the current frame in decoding order. The distance between the current frame and the successive frames may exceed a distance threshold.

    Abstract translation: 本发明的实施例提供了在对视频数据施加约束的情况下有效地对视频数据进行编码/解码的技术。 来自视频序列的帧可被标记为延迟解码器刷新帧。 以编码顺序连续到延迟解码器刷新帧的帧可以以编码顺序预先编码而不参考延迟解码器刷新帧之前的帧。 延迟解码器刷新帧和连续帧之间的距离可以超过距离阈值。 可以解码顺序对当前帧连续的帧进行解码,而不参考当前帧之前的帧。 当前帧与连续帧之间的距离可能会超过距离阈值。

    TEMPORAL ALIASING REDUCTION AND CODING OF UPSAMPLED VIDEO
    9.
    发明申请
    TEMPORAL ALIASING REDUCTION AND CODING OF UPSAMPLED VIDEO 有权
    延时视频的时间缩减和编码

    公开(公告)号:US20130329064A1

    公开(公告)日:2013-12-12

    申请号:US13691163

    申请日:2012-11-30

    Applicant: APPLE INC.

    Abstract: Embodiments of the invention provide techniques for upsampling a video sequence for coding. According to the method, an estimate of camera motion may be obtained from motion sensor data. Video data may be analyzed to detect motion within frames output from a camera that is not induced by the camera motion. When non-camera motion falls within a predetermined operational limit, video upsampling processes may be engaged. In another embodiment, video upsampling may be performed by twice estimating image content for a hypothetical new a frame using two different sources as inputs. A determination may be made whether the two estimates of the frame match each other sufficiently well. If so, the two estimates may be merged to yield a final estimated frame and the new frame may be integrated into a stream of video data.

    Abstract translation: 本发明的实施例提供了用于对用于编码的视频序列进行上采样的技术。 根据该方法,可以从运动传感器数据获得相机运动的估计。 可以分析视频数据以检测来自摄像机输出的不是由摄像机运动引起的帧内的运动。 当非相机运动落在预定的操作限制内时,可以使用视频上采样处理。 在另一个实施例中,视频上采样可以通过使用两个不同的源作为输入来对假设的新帧的两次估计图像内容来执行。 可以确定帧的两个估计是否足够好地匹配。 如果是这样,则两个估计可以被合并以产生最终的估计帧,并且新的帧可以被集成到视频数据流中。

Patent Agency Ranking