-
公开(公告)号:US09769473B2
公开(公告)日:2017-09-19
申请号:US13755928
申请日:2013-01-31
Applicant: Apple Inc.
Inventor: Yao-Chung Lin , Xiaosong Zhou , Hsi-Jung Wu , Douglas Scott Price , Chris Y. Chung , Dazhong Zhang
IPC: H04N19/503 , H04N19/51
CPC classification number: H04N19/51 , H04N19/503
Abstract: Video coders may perform perspective transformation of reference frames during coding in a manner that conserves processing resources. When a new input frame is available for coding, a camera position for the input frame may be estimated. A video coder may search for reference pictures having similar camera positions as the position of the input frame and, for each reference picture identified, the video coder may perform a prediction search to identify a reference picture that is the best prediction match for the input frame. Once the video coder identifies a reference picture to serve as a prediction source for the input frame, the video coder may derive a transform to match the reference frame data to the input frame data and may transform the reference picture accordingly. The video coder may code the input frame using the transformed reference picture as a prediction reference and may transmit coded frame data and the camera position of the input frame to a decoder. Thus, the video coder may perform derivation and execution of transforms on a limited basis which conserves system resources.
-
公开(公告)号:US20150016804A1
公开(公告)日:2015-01-15
申请号:US13941174
申请日:2013-07-12
Applicant: Apple Inc.
Inventor: David L. Biderman , Xiaosong Zhou , Douglas Scott Price , Yeping Su , Chris Y. Chung , Hsi-Jung Wu , Zhenheng Li , John Su , James D. Batson
CPC classification number: H04N21/6125 , G06K9/00718 , G06K2009/00738 , G11B27/005 , G11B27/3081 , H04N21/262 , H04N21/440281 , H04N21/6587 , H04N21/8456
Abstract: System and methods for improved playback of a video stream are presented. Video snippets are identified that include a number of consecutive frames for playback. Snippets may be evenly temporally spaced in the video stream or may be content adaptive. Then the first frame of a snippet may be selected as the first frame of a scene or other appropriate stopping point. Scene detection, object detection, motion detection, video metadata, or other information generated during encoding or decoding of the video stream may aid in appropriate snippet selection.
Abstract translation: 介绍了改进视频流播放的系统和方法。 识别包括多个连续帧进行播放的视频片段。 片段可以在视频流中均匀地间隔开,或者可以是内容自适应的。 然后,片段的第一帧可以被选择为场景或其他适当停止点的第一帧。 在视频流的编码或解码过程中产生的场景检测,对象检测,运动检测,视频元数据或其他信息可能有助于适当的片段选择。
-
公开(公告)号:US20190075342A1
公开(公告)日:2019-03-07
申请号:US16180115
申请日:2018-11-05
Applicant: Apple Inc.
Inventor: Yeping Su , Chris Y. Chung , Xiaosong Zhou , James Oliver Normile , Hsi-Jung Wu , Thomas Jansen , Hyeonkuk Jeong , Joe S. Abuan , Douglas Scott Price
IPC: H04N21/2343 , H04N21/44 , H04N21/438 , H04N21/2381
Abstract: A video streaming method for transitioning between multiple sequences of coded video data may include receiving and decoding transmission units from a first sequence of coded video data. In response to a request to transition to a second sequence of coded video data, the method may determine whether a time to transition to the second sequence of coded video data can be reduced by transitioning to the second sequence of coded video data via an intermediate sequence of coded video data. If the time can be reduced, the method may include receiving at least one transmission unit from an intermediate sequence of coded video data that corresponds to the request to transition, decoding the transmission unit from the intermediate sequence, and transitioning from the first sequence to the second sequence via the decoded transmission unit from the intermediate sequence.
-
公开(公告)号:US20180109824A1
公开(公告)日:2018-04-19
申请号:US15845287
申请日:2017-12-18
Applicant: Apple Inc.
Inventor: Yeping Su , Chris Y. Chung , Xiaosong Zhou , James Oliver Normile , Hsi-Jung Wu , Thomas Jansen , Hyeonkuk Jeong , Joe S. Abuan , Douglas Scott Price
IPC: H04N21/2343 , H04N21/44 , H04N21/438 , H04N21/2381
CPC classification number: H04N21/234372 , H04N21/23439 , H04N21/2381 , H04N21/4384 , H04N21/44004
Abstract: A video streaming method for transitioning between multiple sequences of coded video data may include receiving and decoding transmission units from a first sequence of coded video data. In response to a request to transition to a second sequence of coded video data, the method may determine whether a time to transition to the second sequence of coded video data can be reduced by transitioning to the second sequence of coded video data via an intermediate sequence of coded video data. If the time can be reduced, the method may include receiving at least one transmission unit from an intermediate sequence of coded video data that corresponds to the request to transition, decoding the transmission unit from the intermediate sequence, and transitioning from the first sequence to the second sequence via the decoded transmission unit from the intermediate sequence.
-
公开(公告)号:US10382830B2
公开(公告)日:2019-08-13
申请号:US15296156
申请日:2016-10-18
Applicant: Apple Inc.
Inventor: David L. Biderman , Xiaosong Zhou , Douglas Scott Price , Yeping Su , Chris Y. Chung , Hsi-Jung Wu , Zhenheng Li , John Su , James D. Batson
IPC: H04N21/61 , G06K9/00 , H04N21/262 , H04N21/845 , H04N21/6587 , H04N21/4402 , G11B27/30 , G11B27/00
Abstract: System and methods for improved playback of a video stream are presented. Video snippets are identified that include a number of consecutive frames for playback. Snippets may be evenly temporally spaced in the video stream or may be content adaptive. Then the first frame of a snippet may be selected as the first frame of a scene or other appropriate stopping point. Scene detection, object detection, motion detection, video metadata, or other information generated during encoding or decoding of the video stream may aid in appropriate snippet selection.
-
公开(公告)号:US09900629B2
公开(公告)日:2018-02-20
申请号:US13800905
申请日:2013-03-13
Applicant: Apple Inc.
Inventor: Yeping Su , Chris Y. Chung , Xiaosong Zhou , James Oliver Normile , Hsi-Jung Wu , Thomas Jansen , Hyeonkuk Jeong , Joe S. Abuan , Douglas Scott Price
IPC: H04N7/12 , H04N21/2343 , H04N21/2381 , H04N21/438 , H04N21/44
CPC classification number: H04N21/234372 , H04N21/23439 , H04N21/2381 , H04N21/4384 , H04N21/44004
Abstract: A video streaming method for transitioning between multiple sequences of coded video data may include receiving and decoding transmission units from a first sequence of coded video data. In response to a request to transition to a second sequence of coded video data, the method may determine whether a time to transition to the second sequence of coded video data can be reduced by transitioning to the second sequence of coded video data via an intermediate sequence of coded video data. If the time can be reduced, the method may include receiving at least one transmission unit from an intermediate sequence of coded video data that corresponds to the request to transition, decoding the transmission unit from the intermediate sequence, and transitioning from the first sequence to the second sequence via the decoded transmission unit from the intermediate sequence.
-
7.
公开(公告)号:US08976254B2
公开(公告)日:2015-03-10
申请号:US13691163
申请日:2012-11-30
Applicant: Apple Inc.
Inventor: Douglas Scott Price , Xiaosong Zhou , Hsi-Jung Wu
IPC: H04N5/228 , H04N7/01 , H04N19/132 , H04N19/136 , H04N19/587 , H04N5/77 , H04N19/80
CPC classification number: H04N7/0102 , H04N5/772 , H04N7/0127 , H04N7/0135 , H04N7/0137 , H04N19/132 , H04N19/136 , H04N19/587 , H04N19/80
Abstract: Embodiments of the invention provide techniques for upsampling a video sequence for coding. According to the method, an estimate of camera motion may be obtained from motion sensor data. Video data may be analyzed to detect motion within frames output from a camera that is not induced by the camera motion. When non-camera motion falls within a predetermined operational limit, video upsampling processes may be engaged. In another embodiment, video upsampling may be performed by twice estimating image content for a hypothetical new a frame using two different sources as inputs. A determination may be made whether the two estimates of the frame match each other sufficiently well. If so, the two estimates may be merged to yield a final estimated frame and the new frame may be integrated into a stream of video data.
Abstract translation: 本发明的实施例提供了用于对用于编码的视频序列进行上采样的技术。 根据该方法,可以从运动传感器数据获得相机运动的估计。 可以分析视频数据以检测来自摄像机输出的不是由摄像机运动引起的帧内的运动。 当非相机运动落在预定的操作限制内时,可以使用视频上采样处理。 在另一个实施例中,视频上采样可以通过使用两个不同的源作为输入来对假设的新帧的两次估计图像内容来执行。 可以确定帧的两个估计是否足够好地匹配。 如果是这样,则两个估计可以被合并以产生最终的估计帧,并且新的帧可以被集成到视频数据流中。
-
公开(公告)号:US20130235928A1
公开(公告)日:2013-09-12
申请号:US13652311
申请日:2012-10-15
Applicant: APPLE, INC.
Inventor: Chris Y. Chung , Hao Pan , Jiefu Zhai , Yeping Su , Douglas Scott Price , Hsi-Jung Wu , Xiaosong Zhou
CPC classification number: H04N19/577 , H04N19/107 , H04N19/117 , H04N19/124 , H04N19/139 , H04N19/149 , H04N19/15 , H04N19/154 , H04N19/156 , H04N19/172 , H04N19/192 , H04N19/46 , H04N19/58
Abstract: Embodiments of the present invention provide techniques for efficiently coding/decoding video data during circumstances when constraints are imposed on the video data. A frame from a video sequence may be marked as a delayed decoder refresh frame. Frames successive to the delayed decoder refresh frame in coding order may predictively coded without reference to frames preceding the delayed decoder refresh frame in coding order. The distance between the delayed decoder refresh frame and the successive frames may exceed a distance threshold. Frames successive to a current frame in decoding order may be decoded without reference to frames preceding the current frame in decoding order. The distance between the current frame and the successive frames may exceed a distance threshold.
Abstract translation: 本发明的实施例提供了在对视频数据施加约束的情况下有效地对视频数据进行编码/解码的技术。 来自视频序列的帧可被标记为延迟解码器刷新帧。 以编码顺序连续到延迟解码器刷新帧的帧可以以编码顺序预先编码而不参考延迟解码器刷新帧之前的帧。 延迟解码器刷新帧和连续帧之间的距离可以超过距离阈值。 可以解码顺序对当前帧连续的帧进行解码,而不参考当前帧之前的帧。 当前帧与连续帧之间的距离可能会超过距离阈值。
-
9.
公开(公告)号:US20130329064A1
公开(公告)日:2013-12-12
申请号:US13691163
申请日:2012-11-30
Applicant: APPLE INC.
Inventor: Douglas Scott Price , Xiaosong Zhou , Hsi-Jung Wu
IPC: H04N7/01
CPC classification number: H04N7/0102 , H04N5/772 , H04N7/0127 , H04N7/0135 , H04N7/0137 , H04N19/132 , H04N19/136 , H04N19/587 , H04N19/80
Abstract: Embodiments of the invention provide techniques for upsampling a video sequence for coding. According to the method, an estimate of camera motion may be obtained from motion sensor data. Video data may be analyzed to detect motion within frames output from a camera that is not induced by the camera motion. When non-camera motion falls within a predetermined operational limit, video upsampling processes may be engaged. In another embodiment, video upsampling may be performed by twice estimating image content for a hypothetical new a frame using two different sources as inputs. A determination may be made whether the two estimates of the frame match each other sufficiently well. If so, the two estimates may be merged to yield a final estimated frame and the new frame may be integrated into a stream of video data.
Abstract translation: 本发明的实施例提供了用于对用于编码的视频序列进行上采样的技术。 根据该方法,可以从运动传感器数据获得相机运动的估计。 可以分析视频数据以检测来自摄像机输出的不是由摄像机运动引起的帧内的运动。 当非相机运动落在预定的操作限制内时,可以使用视频上采样处理。 在另一个实施例中,视频上采样可以通过使用两个不同的源作为输入来对假设的新帧的两次估计图像内容来执行。 可以确定帧的两个估计是否足够好地匹配。 如果是这样,则两个估计可以被合并以产生最终的估计帧,并且新的帧可以被集成到视频数据流中。
-
公开(公告)号:US20170041681A1
公开(公告)日:2017-02-09
申请号:US15296156
申请日:2016-10-18
Applicant: Apple Inc.
Inventor: David L. Biderman , Xiaosong Zhou , Douglas Scott Price , Yeping Su , Chris Y. Chung , Hsi-Jung Wu , Zhenheng Li , John Su , James D. Batson
IPC: H04N21/61 , G06K9/00 , H04N21/262 , H04N21/6587 , H04N21/845
CPC classification number: H04N21/6125 , G06K9/00718 , G06K2009/00738 , G11B27/005 , G11B27/3081 , H04N21/262 , H04N21/440281 , H04N21/6587 , H04N21/8456
Abstract: System and methods for improved playback of a video stream are presented. Video snippets are identified that include a number of consecutive frames for playback. Snippets may be evenly temporally spaced in the video stream or may be content adaptive. Then the first frame of a snippet may be selected as the first frame of a scene or other appropriate stopping point. Scene detection, object detection, motion detection, video metadata, or other information generated during encoding or decoding of the video stream may aid in appropriate snippet selection.
Abstract translation: 介绍了改进视频流播放的系统和方法。 识别包括多个连续帧进行播放的视频片段。 片段可以在视频流中均匀地间隔开,或者可以是内容自适应的。 然后,片段的第一帧可以被选择为场景或其他适当停止点的第一帧。 在视频流的编码或解码过程中产生的场景检测,对象检测,运动检测,视频元数据或其他信息可能有助于适当的片段选择。
-
-
-
-
-
-
-
-
-