公开(公告)号：US20170359590A1

公开(公告)日：2017-12-14

申请号：US15585581

申请日：2017-05-03

Applicant: Apple Inc.

Inventor： Dazhong Zhang ,  Hang Yuan ,  Peikang Song ,  Jae Hoon Kim ,  Xing Wen ,  Sudeng Hu ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/423

CPC classification number: H04N19/423 ,  H04N19/463 ,  H04N21/44004 ,  H04N21/6373 ,  H04N21/6379

Abstract: Techniques are disclosed for managing memory allocations when coding video data according to multiple codec configurations. According to these techniques, devices may negotiate parameters of a coding session that include parameters of a plurality of different codec configurations that may be used during the coding session. A device may estimate sizes of decoded picture buffers for each of the negotiated codec configurations and allocate in its memory a portion of memory sized according to a largest size of the estimated decoded picture buffers. Thereafter, the devices may exchange coded video data. The exchange may involve decoding coded data of reference pictures and storing the decoded reference pictures in the allocated memory. During the coding session, the devices may toggle among the different negotiated codec configurations. As they do, reallocations of memory may be avoided.

公开(公告)号：US20170358059A1

公开(公告)日：2017-12-14

申请号：US15618967

申请日：2017-06-09

Applicant: Apple Inc.

Inventor： Ke Zhang ,  Jiefu Zhai ,  Yunfei Zheng ,  Shujie Liu ,  Albert E. Keinath ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: G06T5/00 ,  G06T7/194 ,  G06T7/11 ,  G11B27/031

CPC classification number: G06T7/194 ,  G06K9/3233 ,  G06K9/346 ,  G06T7/11 ,  G06T2207/20132 ,  G11B27/031

Abstract: Techniques for cropping images containing an occlusion are presented. A method for image editing is presented comprising, when an occlusion is detected in an original digital image, determining an area occupied by the occlusion, assigning importance scores to different content elements of the original digital image, defining a cropping window around an area of the original digital image that does not include the area occupied by the occlusion and that is based on the importance scores, and cropping the original digital image to the cropping window.

公开(公告)号：US09654727B2

公开(公告)日：2017-05-16

申请号：US14727471

申请日：2015-06-01

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Dazhong Zhang ,  Hsi-Jung Wu ,  Xiaosong Zhou

IPC: H04N7/14 ,  H04N7/15 ,  H04L29/06 ,  G06F17/24

CPC classification number: H04N7/147 ,  G06F17/241 ,  H04L65/403 ,  H04L65/601 ,  H04N5/147 ,  H04N7/155 ,  H04N21/242 ,  H04N21/4307

Abstract: Techniques are disclosed for overcoming communication lag between interactive operations among devices in a streaming session. According to the techniques, a first device streaming video content to a second device and an annotation is entered to a first frame being displayed at the second device, which is communicated back to the first device. Responsive to a communication that identifies the annotation, a first device may identify an element of video content from the first frame to which the annotation applies and determine whether the identified element is present in a second frame of video content currently displayed at the first terminal. If so, the first device may display the annotation with the second frame in a location where the identified element is present. If not, the first device may display the annotation via an alternate technique.

公开(公告)号：US20160360220A1

公开(公告)日：2016-12-08

申请号：US14730830

申请日：2015-06-04

Applicant: Apple Inc.

Inventor： Peikang Song ,  Jae Hoon Kim ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Dazhong Zhang

IPC: H04N19/51 ,  H04N19/172 ,  H04N19/159 ,  H04N19/139 ,  H04N19/142

CPC classification number: H04N19/172 ,  H04N19/132 ,  H04N19/139 ,  H04N19/142 ,  H04N19/154 ,  H04N19/159 ,  H04N19/164

Abstract: Techniques are described for responding to changes in bandwidth that are available to transmit coded video data between an encoder and a decoder. When such changes in bandwidth occur, estimates may be derived of visual significance of coded video data that has not yet been transmitted and also video data that is next to be coded. These estimates may be compared to each other. When the estimated visual significance of the coded video data that has not yet been transmitted is greater than the estimated visual significance of the video data that is next to be coded, transmission of the coded video data that has not yet been transmitted may be prioritized over coding of the video data that is next to be coded. When the estimated visual significance of the video data that is next to be coded is greater than the estimated visual significance of the coded video data that has not yet been transmitted, coding of the video data that is next to be coded may be prioritized over transmission of the coded video data that has not yet been transmitted. Resources may be allocated to the prioritized coder operation.

Abstract translation: 描述了用于响应可用于在编码器和解码器之间传输编码视频数据的带宽变化的技术。 当这种带宽变化发生时，可能导出尚未被发送的编码视频数据的视觉重要性的估计，以及接下来被编码的视频数据。 这些估计可以相互比较。 当尚未被发送的编码视频数据的估计视觉含义大于接下来要被编码的视频数据的估计视觉有效性时，还没有发送的编码视频数据的传输可以优先于 对接下来被编码的视频数据进行编码。 当接下来被编码的视频数据的估计视觉含义大于尚未发送的编码视频数据的估计视觉有效性时，下一个被编码的视频数据的编码可以通过传输优先化 的尚未被发送的编码视频数据。 可以将资源分配给优先编码器操作。

公开(公告)号：US20160359937A1

公开(公告)日：2016-12-08

申请号：US15169641

申请日：2016-05-31

Applicant: Apple Inc.

Inventor： Chris Y . Chung ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jae Hoon Kim ,  Jingteng Xue

IPC: H04L29/06 ,  H04W88/02

Abstract: Methods and apparatus for contextual video content adaptation are disclosed. Video content is adapted based on any number of criteria such as a target device type, viewing conditions, network conditions or various use cases, for example. A target adaptation of content may be defined for a specified video source. For example, based on receiving a request from a portable device for a live sports feed, a shortened and reduced resolution version of the live sport feed video may be defined for the portable device. The source content may be accessed and adapted (e.g., adapted temporally, spatially, etc.) and an adapted version of content generated. For example, the source content may be cropped to a particular spatial region of interest and/or reduced in length to a particular scene. The generated adaptation may be transmitted to a device in response to the request, or stored to a storage device.

Abstract translation: 公开了用于上下文视频内容适配的方法和装置。 基于诸如目标设备类型，观看条件，网络条件或各种用例的任何数量的标准来适配视频内容。 可以为指定的视频源定义内容的目标适配。 例如，基于从便携式设备接收用于实时运动饲料的请求，可以为便携式设备定义实时运动饲料视频的缩短和降低的分辨率版本。 源内容可以被访问和适应（例如，在时间上，空间上等等）和生成的内容的适应版本。 例如，源内容可以被裁剪到感兴趣的特定空间区域和/或缩小到特定场景的长度。 生成的适配可以响应于该请求而发送到设备，或者存储到存储设备。

公开(公告)号：US20160094823A1

公开(公告)日：2016-03-31

申请号：US14603109

申请日：2015-01-22

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Yeping Su ,  Hsi-Jung Wu ,  Chris Y. Chung ,  Xiaosong Zhou ,  Ke Zhang

IPC: H04N9/67 ,  H04N9/64

CPC classification number: H04N9/67 ,  H04N1/646 ,  H04N9/646

Abstract: An encoder may include a luma transform, a transformer, and a chroma transform. The luma transform may determine a linear luminance value based upon a plurality of primary color values of a pixel. The transformer may generate a transformed luminance value based upon the linear luminance value and a plurality of transformed color values based upon corresponding more than one of the primary color values of the pixel. The chroma transform may determine a plurality of chroma values based upon corresponding plurality of transformed color values and the transformed luminance value of the pixel.

Abstract translation: 编码器可以包括亮度变换，变压器和色度变换。 亮度变换可以基于像素的多个基色值来确定线性亮度值。 所述变压器可以基于所述线性亮度值和基于所述像素的主要颜色值中的多于一个的多个变换颜色值来生成经变换的亮度值。 色度变换可以基于对应的多个变换颜色值和像素的变换亮度值来确定多个色度值。

公开(公告)号：US09264661B2

公开(公告)日：2016-02-16

申请号：US14082852

申请日：2013-11-18

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Chris Y. Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N7/14 ,  H04N19/117

CPC classification number: H04N7/141 ,  H04N19/117

Abstract: A system may include a receiver, a decoder, a post-processor, and a controller. The receiver may receive encoded video data. The decoder may decode the encoded video data. The post-processor may perform post-processing on frames of decoded video sequence from the decoder. The controller may adjust post-processing of a current frame, based upon at least one condition parameters detected at the system.

Abstract translation: 系统可以包括接收器，解码器，后处理器和控制器。 接收机可以接收编码的视频数据。 解码器可以解码编码的视频数据。 后处理器可以对来自解码器的解码视频序列的帧执行后处理。 控制器可以基于在系统处检测到的至少一个条件参数来调整当前帧的后处理。

公开(公告)号：US20150358581A1

公开(公告)日：2015-12-10

申请号：US14296349

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/15

CPC classification number: H04N7/15 ,  H04N7/147

Abstract: Computing devices may implement dynamic detection of pause and resume for video communications. Video communication data may be capture at a participant device in a video communication. The video communication data may be evaluated to detect a pause or resume event for the transmission of the video communication data. Various types of video, audio, and other sensor analysis may be used to detect when a pause event or a resume event may be triggered. For triggered pause events, at least some of the video communication data my no longer be transmitted as part of the video communication. For triggered resume events, a pause state may cease and all of the video communication data may be transmitted.

Abstract translation: 计算设备可以实现视频通信的暂停和恢复的动态检测。 可以在视频通信中的参与者设备处捕获视频通信数据。 可以评估视频通信数据以检测用于传输视频通信数据的暂停或恢复事件。 可以使用各种类型的视频，音频和其他传感器分析来检测何时可以触发暂停事件或恢复事件。 对于触发暂停事件，视频通信数据中的至少一些不再作为视频通信的一部分传送。 对于触发的恢复事件，可以停止暂停状态，并且可以发送所有的视频通信数据。

公开(公告)号：US20150358580A1

公开(公告)日：2015-12-10

申请号：US14296348

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/15

CPC classification number: H04N7/15 ,  H04L51/04 ,  H04L51/10 ,  H04N7/147

Abstract: Computing devices may implement dynamic display of video communication data. Video communication data for a video communication may be received at a computing device where another application is currently displaying image data on an electronic display. A display location may be determined for the video communication data according to display attributes that are configured by the other application at runtime. Once determined, the video communication data may then be displayed in the determined location. In some embodiments, the video communication data may be integrated with other data displayed on the electronic display for the other application.

Abstract translation: 计算设备可以实现视频通信数据的动态显示。 用于视频通信的视频通信数据可以在其他应用当前正在电子显示器上显示图像数据的计算设备处被接收。 可以根据在运行时由其他应用配置的显示属性来确定视频通信数据的显示位置。 一旦确定，则可以在确定的位置显示视频通信数据。 在一些实施例中，视频通信数据可以与用于另一应用的电子显示器上显示的其他数据集成。

公开(公告)号：US20150350686A1

公开(公告)日：2015-12-03

申请号：US14290304

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Chris Y. Chung ,  David R. Conrad ,  Dazhong Zhang ,  Feng Yi ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Peikang Song ,  Yunfei Zheng

IPC: H04N19/85 ,  H04N19/115 ,  H04N19/517 ,  H04N19/51 ,  H04N19/172 ,  H04N19/176

CPC classification number: H04N19/42 ,  H04N19/103

Abstract: A method and system of using a pre-encoder to improve encoder efficiency. The encoder may conform to ITU-T H.265 and the pre-encoder may conform to ITU-T H. 264. The pre-encoder may receive source video data and provide information regarding various coding modes, candidate modes, and a selected mode for coding the source video data. In an embodiment, the encoder may directly use the mode selected by the pre-encoder. In another embodiment, the encoder may receive both the source video data and information regarding the various coding modes (e.g., motion information, macroblock size, intra prediction direction, rate-distortion cost, and block pixel statistics) to simplify and/or refine its mode decision process. For example, the information provided by the pre-encoder may indicate unlikely modes, which unlikely modes need not be tested by the encoder, thus saving power and time.

Abstract translation: 一种使用预编码器来提高编码器效率的方法和系统。 编码器可以符合ITU-T H.265标准，并且预编码器可以符合ITU-T H.264的要求。预编码器可以接收源视频数据并提供关于各种编码模式，候选模式和选择模式的信息 用于对源视频数据进行编码。 在一个实施例中，编码器可以直接使用由预编码器选择的模式。 在另一个实施例中，编码器可以接收源视频数据和关于各种编码模式的信息（例如，运动信息，宏块大小，帧内预测方向，速率失真成本和块像素统计），以简化和/或改进其 模式决策过程。 例如，预编码器提供的信息可能指示不太可能的模式，不可能的模式不需要被编码器测试，从而节省功率和时间。