公开(公告)号：US20160359937A1

公开(公告)日：2016-12-08

申请号：US15169641

申请日：2016-05-31

Applicant: Apple Inc.

Inventor： Chris Y . Chung ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jae Hoon Kim ,  Jingteng Xue

IPC: H04L29/06 ,  H04W88/02

Abstract: Methods and apparatus for contextual video content adaptation are disclosed. Video content is adapted based on any number of criteria such as a target device type, viewing conditions, network conditions or various use cases, for example. A target adaptation of content may be defined for a specified video source. For example, based on receiving a request from a portable device for a live sports feed, a shortened and reduced resolution version of the live sport feed video may be defined for the portable device. The source content may be accessed and adapted (e.g., adapted temporally, spatially, etc.) and an adapted version of content generated. For example, the source content may be cropped to a particular spatial region of interest and/or reduced in length to a particular scene. The generated adaptation may be transmitted to a device in response to the request, or stored to a storage device.

Abstract translation: 公开了用于上下文视频内容适配的方法和装置。 基于诸如目标设备类型，观看条件，网络条件或各种用例的任何数量的标准来适配视频内容。 可以为指定的视频源定义内容的目标适配。 例如，基于从便携式设备接收用于实时运动饲料的请求，可以为便携式设备定义实时运动饲料视频的缩短和降低的分辨率版本。 源内容可以被访问和适应（例如，在时间上，空间上等等）和生成的内容的适应版本。 例如，源内容可以被裁剪到感兴趣的特定空间区域和/或缩小到特定场景的长度。 生成的适配可以响应于该请求而发送到设备，或者存储到存储设备。

公开(公告)号：US20160094823A1

公开(公告)日：2016-03-31

申请号：US14603109

申请日：2015-01-22

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Yeping Su ,  Hsi-Jung Wu ,  Chris Y. Chung ,  Xiaosong Zhou ,  Ke Zhang

IPC: H04N9/67 ,  H04N9/64

CPC classification number: H04N9/67 ,  H04N1/646 ,  H04N9/646

Abstract: An encoder may include a luma transform, a transformer, and a chroma transform. The luma transform may determine a linear luminance value based upon a plurality of primary color values of a pixel. The transformer may generate a transformed luminance value based upon the linear luminance value and a plurality of transformed color values based upon corresponding more than one of the primary color values of the pixel. The chroma transform may determine a plurality of chroma values based upon corresponding plurality of transformed color values and the transformed luminance value of the pixel.

Abstract translation: 编码器可以包括亮度变换，变压器和色度变换。 亮度变换可以基于像素的多个基色值来确定线性亮度值。 所述变压器可以基于所述线性亮度值和基于所述像素的主要颜色值中的多于一个的多个变换颜色值来生成经变换的亮度值。 色度变换可以基于对应的多个变换颜色值和像素的变换亮度值来确定多个色度值。

公开(公告)号：US09264661B2

公开(公告)日：2016-02-16

申请号：US14082852

申请日：2013-11-18

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Chris Y. Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N7/14 ,  H04N19/117

CPC classification number: H04N7/141 ,  H04N19/117

Abstract: A system may include a receiver, a decoder, a post-processor, and a controller. The receiver may receive encoded video data. The decoder may decode the encoded video data. The post-processor may perform post-processing on frames of decoded video sequence from the decoder. The controller may adjust post-processing of a current frame, based upon at least one condition parameters detected at the system.

Abstract translation: 系统可以包括接收器，解码器，后处理器和控制器。 接收机可以接收编码的视频数据。 解码器可以解码编码的视频数据。 后处理器可以对来自解码器的解码视频序列的帧执行后处理。 控制器可以基于在系统处检测到的至少一个条件参数来调整当前帧的后处理。

公开(公告)号：US20150358581A1

公开(公告)日：2015-12-10

申请号：US14296349

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/15

CPC classification number: H04N7/15 ,  H04N7/147

Abstract: Computing devices may implement dynamic detection of pause and resume for video communications. Video communication data may be capture at a participant device in a video communication. The video communication data may be evaluated to detect a pause or resume event for the transmission of the video communication data. Various types of video, audio, and other sensor analysis may be used to detect when a pause event or a resume event may be triggered. For triggered pause events, at least some of the video communication data my no longer be transmitted as part of the video communication. For triggered resume events, a pause state may cease and all of the video communication data may be transmitted.

Abstract translation: 计算设备可以实现视频通信的暂停和恢复的动态检测。 可以在视频通信中的参与者设备处捕获视频通信数据。 可以评估视频通信数据以检测用于传输视频通信数据的暂停或恢复事件。 可以使用各种类型的视频，音频和其他传感器分析来检测何时可以触发暂停事件或恢复事件。 对于触发暂停事件，视频通信数据中的至少一些不再作为视频通信的一部分传送。 对于触发的恢复事件，可以停止暂停状态，并且可以发送所有的视频通信数据。

公开(公告)号：US20150358580A1

公开(公告)日：2015-12-10

申请号：US14296348

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/15

CPC classification number: H04N7/15 ,  H04L51/04 ,  H04L51/10 ,  H04N7/147

Abstract: Computing devices may implement dynamic display of video communication data. Video communication data for a video communication may be received at a computing device where another application is currently displaying image data on an electronic display. A display location may be determined for the video communication data according to display attributes that are configured by the other application at runtime. Once determined, the video communication data may then be displayed in the determined location. In some embodiments, the video communication data may be integrated with other data displayed on the electronic display for the other application.

Abstract translation: 计算设备可以实现视频通信数据的动态显示。 用于视频通信的视频通信数据可以在其他应用当前正在电子显示器上显示图像数据的计算设备处被接收。 可以根据在运行时由其他应用配置的显示属性来确定视频通信数据的显示位置。 一旦确定，则可以在确定的位置显示视频通信数据。 在一些实施例中，视频通信数据可以与用于另一应用的电子显示器上显示的其他数据集成。

公开(公告)号：US20150350686A1

公开(公告)日：2015-12-03

申请号：US14290304

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Chris Y. Chung ,  David R. Conrad ,  Dazhong Zhang ,  Feng Yi ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Peikang Song ,  Yunfei Zheng

IPC: H04N19/85 ,  H04N19/115 ,  H04N19/517 ,  H04N19/51 ,  H04N19/172 ,  H04N19/176

CPC classification number: H04N19/42 ,  H04N19/103

Abstract: A method and system of using a pre-encoder to improve encoder efficiency. The encoder may conform to ITU-T H.265 and the pre-encoder may conform to ITU-T H. 264. The pre-encoder may receive source video data and provide information regarding various coding modes, candidate modes, and a selected mode for coding the source video data. In an embodiment, the encoder may directly use the mode selected by the pre-encoder. In another embodiment, the encoder may receive both the source video data and information regarding the various coding modes (e.g., motion information, macroblock size, intra prediction direction, rate-distortion cost, and block pixel statistics) to simplify and/or refine its mode decision process. For example, the information provided by the pre-encoder may indicate unlikely modes, which unlikely modes need not be tested by the encoder, thus saving power and time.

Abstract translation: 一种使用预编码器来提高编码器效率的方法和系统。 编码器可以符合ITU-T H.265标准，并且预编码器可以符合ITU-T H.264的要求。预编码器可以接收源视频数据并提供关于各种编码模式，候选模式和选择模式的信息 用于对源视频数据进行编码。 在一个实施例中，编码器可以直接使用由预编码器选择的模式。 在另一个实施例中，编码器可以接收源视频数据和关于各种编码模式的信息（例如，运动信息，宏块大小，帧内预测方向，速率失真成本和块像素统计），以简化和/或改进其 模式决策过程。 例如，预编码器提供的信息可能指示不太可能的模式，不可能的模式不需要被编码器测试，从而节省功率和时间。

公开(公告)号：US20150350654A1

公开(公告)日：2015-12-03

申请号：US14290432

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Dazhong Zhang

IPC: H04N19/146 ,  H04N19/156 ,  H04N19/51 ,  H04N19/172 ,  H04N19/46 ,  H04N19/127 ,  H04N19/44

CPC classification number: H04N19/46 ,  H04N19/132 ,  H04N19/154 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/587

Abstract: During video coding, frame rate conversion (FRC) capabilities of a decoder may be estimated. Based on the estimated FRC capabilities, an encoder may select a frame rate for a video coding session and may alter a frame rate of source video to match the selected frame rate. Thereafter, the resultant video may be coded and output to a channel. By incorporating knowledge of a decoder's FRC capabilities as source video is being coded, an encoder may reduce the frame rate of source video opportunistically. Bandwidth that is conserved by avoiding coding of video data in excess of the selected frame rate may be directed to coding of the remaining video at a higher bitrate, which can lead to increased quality of the coding session as a whole.

Abstract translation: 在视频编码期间，可以估计解码器的帧速率转换（FRC）能力。 基于估计的FRC能力，编码器可以选择用于视频编码会话的帧速率，并且可以改变源视频的帧速率以匹配所选择的帧速率。 此后，所得到的视频可被编码并输出到频道。 当编码源视频时，通过结合解码器的FRC能力的知识，编码器可以机会地降低源视频的帧速率。 通过避免超过所选帧速率的视频数据的编码而节省的带宽可以以更高的比特率对剩余视频进行编码，这可以导致整个编码会话的质量提高。

公开(公告)号：US20150350514A1

公开(公告)日：2015-12-03

申请号：US14726331

申请日：2015-05-29

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N5/235 ,  H04N19/59

CPC classification number: H04N5/2355 ,  H04N5/23219 ,  H04N5/2351 ,  H04N5/2353 ,  H04N19/115 ,  H04N19/117 ,  H04N19/14 ,  H04N19/154 ,  H04N19/156 ,  H04N19/176

Abstract: Systems and methods are provided for capturing high quality video data, including data having a high dynamic range, for use with conventional encoders and decoders. High dynamic range data is captured using multiple groups of pixels where each group is captured using different exposure times to create groups of pixels. The pixels that are captured at different exposure times may be determined adaptively based on the content of the image, the parameters of the encoding system, or on the available resources within the encoding system. The transition from single exposure to using two different exposure times may be implemented gradually.

Abstract translation: 提供了系统和方法，用于捕获高质量视频数据，包括具有高动态范围的数据，用于常规编码器和解码器。 使用多组像素捕获高动态范围数据，其中使用不同的曝光时间拍摄每组，以创建像素组。 可以基于图像的内容，编码系统的参数或编码系统内的可用资源自适应地确定在不同曝光时间捕获的像素。 从单次曝光到使用两种不同曝光时间的过渡可能逐渐实现。

公开(公告)号：US08830892B2

公开(公告)日：2014-09-09

申请号：US13667814

申请日：2012-11-02

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Wen Zhao ,  Luciano M. Verger ,  Hyeonkuk Jeong ,  Gang Lu ,  Srinivasan Vasudevan ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  James O. Normile

IPC: G08C17/00

CPC classification number: H04N7/15 ,  H04L12/1827 ,  H04L65/1069 ,  H04N5/23241 ,  H04N5/372 ,  H04W52/02 ,  H04W52/0209 ,  H04W52/0216 ,  Y02D70/00 ,  Y02D70/1224 ,  Y02D70/1242 ,  Y02D70/1262 ,  Y02D70/142 ,  Y02D70/144 ,  Y02D70/146 ,  Y02D70/164 ,  Y02D70/168 ,  Y02D70/24

Abstract: In video conferencing over a radio network, the radio equipment is a major power consumer especially in cellular networks such as LTE. In order to reduce the radio power consumption in video conferencing, it is important to introduce an enough radio inactive time. Several types of data buffering and bundling can be employed within a reasonable range of latency that doesn't significantly disrupt the real-time nature of video conferencing. In addition, the data transmission can be synchronized to the data reception in a controlled manner, which can result in an even longer radio inactive time and thus take advantage of radio power saving modes such as LTE C-DRX.

Abstract translation: 在无线电网络的视频会议中，无线电设备是主要的电力消费者，特别是在诸如LTE的蜂窝网络中。 为了降低视频会议中的无线电功耗，重要的是要引入足够的无线电时间。 几种类型的数据缓冲和捆绑可以在合理的延迟范围内使用，不会显着破坏视频会议的实时性质。 此外，可以以受控的方式将数据传输同步到数据接收，这可以导致更长的无线电时间，从而利用诸如LTE C-DRX之类的无线电节能模式。

公开(公告)号：US20140029663A1

公开(公告)日：2014-01-30

申请号：US13707404

申请日：2012-12-06

Applicant: APPLE INC.

Inventor： Yeping Su ,  Hsi-Jung Wu ,  Hao Pan

IPC: H04N7/26

CPC classification number: H04N19/10 ,  H04N19/117 ,  H04N19/14 ,  H04N19/17 ,  H04N19/176 ,  H04N19/463 ,  H04N19/577 ,  H04N19/61 ,  H04N19/80

Abstract: Video encoders often produce banding artifacts on areas with smooth gradients and low levels of detail/noise. In this disclosure, a video encoding system identifies the banded areas and adjusts coding parameters accordingly. The video coder may include a pre-coding banding detector and a post-coding banding detector. The pre-coding detector may identify regions in the input picture with smooth gradients that are likely to have banding artifacts after encoding. The post-coding detector may identify regions in the reconstructed picture with visible banding. Usage of pre-coding detector and/or post-coding detector depends on how an encoder operates. In a single-pass encoding or during the first pass of a multi-pass encoding, the pre-coding detection maps are used. During picture re-encoding or during later passes of a multi-pass encoding, the post-coding detector maps are used.

Abstract translation: 视频编码器经常在平滑梯度和低细节/噪音水平的区域产生带状伪影。 在本公开中，视频编码系统识别带状区域并相应地调整编码参数。 视频编码器可以包括预编码带状检测器和后编码条带检测器。 预编码检测器可以在编码后可能具有可能具有带状伪影的平滑梯度来识别输入图像中的区域。 后编码检测器可以用可见条带识别重建图像中的区域。 预编码检测器和/或后编码检测器的使用取决于编码器如何工作。 在单遍编码中或在多遍编码的第一遍期间，使用预编码检测图。 在图像重新编码期间或在多遍编码的稍后通过期间，使用后编码检测器图。