公开(公告)号：US20150358581A1

公开(公告)日：2015-12-10

申请号：US14296349

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/15

CPC classification number: H04N7/15 ,  H04N7/147

Abstract: Computing devices may implement dynamic detection of pause and resume for video communications. Video communication data may be capture at a participant device in a video communication. The video communication data may be evaluated to detect a pause or resume event for the transmission of the video communication data. Various types of video, audio, and other sensor analysis may be used to detect when a pause event or a resume event may be triggered. For triggered pause events, at least some of the video communication data my no longer be transmitted as part of the video communication. For triggered resume events, a pause state may cease and all of the video communication data may be transmitted.

Abstract translation: 计算设备可以实现视频通信的暂停和恢复的动态检测。 可以在视频通信中的参与者设备处捕获视频通信数据。 可以评估视频通信数据以检测用于传输视频通信数据的暂停或恢复事件。 可以使用各种类型的视频，音频和其他传感器分析来检测何时可以触发暂停事件或恢复事件。 对于触发暂停事件，视频通信数据中的至少一些不再作为视频通信的一部分传送。 对于触发的恢复事件，可以停止暂停状态，并且可以发送所有的视频通信数据。

公开(公告)号：US20150358580A1

公开(公告)日：2015-12-10

申请号：US14296348

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/15

CPC classification number: H04N7/15 ,  H04L51/04 ,  H04L51/10 ,  H04N7/147

Abstract: Computing devices may implement dynamic display of video communication data. Video communication data for a video communication may be received at a computing device where another application is currently displaying image data on an electronic display. A display location may be determined for the video communication data according to display attributes that are configured by the other application at runtime. Once determined, the video communication data may then be displayed in the determined location. In some embodiments, the video communication data may be integrated with other data displayed on the electronic display for the other application.

Abstract translation: 计算设备可以实现视频通信数据的动态显示。 用于视频通信的视频通信数据可以在其他应用当前正在电子显示器上显示图像数据的计算设备处被接收。 可以根据在运行时由其他应用配置的显示属性来确定视频通信数据的显示位置。 一旦确定，则可以在确定的位置显示视频通信数据。 在一些实施例中，视频通信数据可以与用于另一应用的电子显示器上显示的其他数据集成。

公开(公告)号：US20150350686A1

公开(公告)日：2015-12-03

申请号：US14290304

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Chris Y. Chung ,  David R. Conrad ,  Dazhong Zhang ,  Feng Yi ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Peikang Song ,  Yunfei Zheng

IPC: H04N19/85 ,  H04N19/115 ,  H04N19/517 ,  H04N19/51 ,  H04N19/172 ,  H04N19/176

CPC classification number: H04N19/42 ,  H04N19/103

Abstract: A method and system of using a pre-encoder to improve encoder efficiency. The encoder may conform to ITU-T H.265 and the pre-encoder may conform to ITU-T H. 264. The pre-encoder may receive source video data and provide information regarding various coding modes, candidate modes, and a selected mode for coding the source video data. In an embodiment, the encoder may directly use the mode selected by the pre-encoder. In another embodiment, the encoder may receive both the source video data and information regarding the various coding modes (e.g., motion information, macroblock size, intra prediction direction, rate-distortion cost, and block pixel statistics) to simplify and/or refine its mode decision process. For example, the information provided by the pre-encoder may indicate unlikely modes, which unlikely modes need not be tested by the encoder, thus saving power and time.

Abstract translation: 一种使用预编码器来提高编码器效率的方法和系统。 编码器可以符合ITU-T H.265标准，并且预编码器可以符合ITU-T H.264的要求。预编码器可以接收源视频数据并提供关于各种编码模式，候选模式和选择模式的信息 用于对源视频数据进行编码。 在一个实施例中，编码器可以直接使用由预编码器选择的模式。 在另一个实施例中，编码器可以接收源视频数据和关于各种编码模式的信息（例如，运动信息，宏块大小，帧内预测方向，速率失真成本和块像素统计），以简化和/或改进其 模式决策过程。 例如，预编码器提供的信息可能指示不太可能的模式，不可能的模式不需要被编码器测试，从而节省功率和时间。

公开(公告)号：US20150350654A1

公开(公告)日：2015-12-03

申请号：US14290432

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Dazhong Zhang

IPC: H04N19/146 ,  H04N19/156 ,  H04N19/51 ,  H04N19/172 ,  H04N19/46 ,  H04N19/127 ,  H04N19/44

CPC classification number: H04N19/46 ,  H04N19/132 ,  H04N19/154 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/587

Abstract: During video coding, frame rate conversion (FRC) capabilities of a decoder may be estimated. Based on the estimated FRC capabilities, an encoder may select a frame rate for a video coding session and may alter a frame rate of source video to match the selected frame rate. Thereafter, the resultant video may be coded and output to a channel. By incorporating knowledge of a decoder's FRC capabilities as source video is being coded, an encoder may reduce the frame rate of source video opportunistically. Bandwidth that is conserved by avoiding coding of video data in excess of the selected frame rate may be directed to coding of the remaining video at a higher bitrate, which can lead to increased quality of the coding session as a whole.

Abstract translation: 在视频编码期间，可以估计解码器的帧速率转换（FRC）能力。 基于估计的FRC能力，编码器可以选择用于视频编码会话的帧速率，并且可以改变源视频的帧速率以匹配所选择的帧速率。 此后，所得到的视频可被编码并输出到频道。 当编码源视频时，通过结合解码器的FRC能力的知识，编码器可以机会地降低源视频的帧速率。 通过避免超过所选帧速率的视频数据的编码而节省的带宽可以以更高的比特率对剩余视频进行编码，这可以导致整个编码会话的质量提高。

公开(公告)号：US20150350514A1

公开(公告)日：2015-12-03

申请号：US14726331

申请日：2015-05-29

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N5/235 ,  H04N19/59

CPC classification number: H04N5/2355 ,  H04N5/23219 ,  H04N5/2351 ,  H04N5/2353 ,  H04N19/115 ,  H04N19/117 ,  H04N19/14 ,  H04N19/154 ,  H04N19/156 ,  H04N19/176

Abstract: Systems and methods are provided for capturing high quality video data, including data having a high dynamic range, for use with conventional encoders and decoders. High dynamic range data is captured using multiple groups of pixels where each group is captured using different exposure times to create groups of pixels. The pixels that are captured at different exposure times may be determined adaptively based on the content of the image, the parameters of the encoding system, or on the available resources within the encoding system. The transition from single exposure to using two different exposure times may be implemented gradually.

Abstract translation: 提供了系统和方法，用于捕获高质量视频数据，包括具有高动态范围的数据，用于常规编码器和解码器。 使用多组像素捕获高动态范围数据，其中使用不同的曝光时间拍摄每组，以创建像素组。 可以基于图像的内容，编码系统的参数或编码系统内的可用资源自适应地确定在不同曝光时间捕获的像素。 从单次曝光到使用两种不同曝光时间的过渡可能逐渐实现。

公开(公告)号：US08830892B2

公开(公告)日：2014-09-09

申请号：US13667814

申请日：2012-11-02

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Wen Zhao ,  Luciano M. Verger ,  Hyeonkuk Jeong ,  Gang Lu ,  Srinivasan Vasudevan ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  James O. Normile

IPC: G08C17/00

CPC classification number: H04N7/15 ,  H04L12/1827 ,  H04L65/1069 ,  H04N5/23241 ,  H04N5/372 ,  H04W52/02 ,  H04W52/0209 ,  H04W52/0216 ,  Y02D70/00 ,  Y02D70/1224 ,  Y02D70/1242 ,  Y02D70/1262 ,  Y02D70/142 ,  Y02D70/144 ,  Y02D70/146 ,  Y02D70/164 ,  Y02D70/168 ,  Y02D70/24

Abstract: In video conferencing over a radio network, the radio equipment is a major power consumer especially in cellular networks such as LTE. In order to reduce the radio power consumption in video conferencing, it is important to introduce an enough radio inactive time. Several types of data buffering and bundling can be employed within a reasonable range of latency that doesn't significantly disrupt the real-time nature of video conferencing. In addition, the data transmission can be synchronized to the data reception in a controlled manner, which can result in an even longer radio inactive time and thus take advantage of radio power saving modes such as LTE C-DRX.

Abstract translation: 在无线电网络的视频会议中，无线电设备是主要的电力消费者，特别是在诸如LTE的蜂窝网络中。 为了降低视频会议中的无线电功耗，重要的是要引入足够的无线电时间。 几种类型的数据缓冲和捆绑可以在合理的延迟范围内使用，不会显着破坏视频会议的实时性质。 此外，可以以受控的方式将数据传输同步到数据接收，这可以导致更长的无线电时间，从而利用诸如LTE C-DRX之类的无线电节能模式。

公开(公告)号：US11102515B2

公开(公告)日：2021-08-24

申请号：US16890245

申请日：2020-06-02

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Peikang Song ,  David R. Conrad ,  Jae Hoon Kim ,  Yunfei Zheng

IPC: H04N19/82 ,  H04N19/186

Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.

公开(公告)号：US11025933B2

公开(公告)日：2021-06-01

申请号：US15585581

申请日：2017-05-03

Applicant: Apple Inc.

Inventor： Dazhong Zhang ,  Hang Yuan ,  Peikang Song ,  Jae Hoon Kim ,  Xing Wen ,  Sudeng Hu ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/423 ,  H04N19/463 ,  H04N21/44 ,  H04N21/6379 ,  H04N21/6373

Abstract: Techniques are disclosed for managing memory allocations when coding video data according to multiple codec configurations. According to these techniques, devices may negotiate parameters of a coding session that include parameters of a plurality of different codec configurations that may be used during the coding session. A device may estimate sizes of decoded picture buffers for each of the negotiated codec configurations and allocate in its memory a portion of memory sized according to a largest size of the estimated decoded picture buffers. Thereafter, the devices may exchange coded video data. The exchange may involve decoding coded data of reference pictures and storing the decoded reference pictures in the allocated memory. During the coding session, the devices may toggle among the different negotiated codec configurations. As they do, reallocations of memory may be avoided.

公开(公告)号：US10924747B2

公开(公告)日：2021-02-16

申请号：US15443342

申请日：2017-02-27

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jiefu Zhai ,  Xiaosong Zhou

IPC: H04B1/66 ,  H04N19/176 ,  H04N19/105 ,  H04N19/112 ,  H04N19/174 ,  H04N19/593 ,  H04N19/597

Abstract: Techniques are disclosed for coding and decoding video captured as cube map images. According to these techniques, padded reference images are generated for use during predicting input data. A reference image is stored in a cube map format. A padded reference image is generated from the reference image in which image data of a first view contained in reference image is replicated and placed adjacent to a second view contained in the cube map image. When coding a pixel block of an input image, a prediction search may be performed between the input pixel block and content of the padded reference image. When the prediction search identifies a match, the pixel block may be coded with respect to matching data from the padded reference image. Presence of replicated data in the padded reference image is expected to increase the likelihood that adequate prediction matches will be identified for input pixel block data, which will increase overall efficiency of the video coding.

公开(公告)号：US10812832B2

公开(公告)日：2020-10-20

申请号：US14732393

申请日：2015-06-05

Applicant: Apple Inc.

Inventor： Hang Yuan ,  Chris Y. Chung ,  Jae Hoon Kim ,  Yeping Su ,  Jiefu Zhai ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/85 ,  H04N19/33 ,  H04N19/88 ,  H04N19/503

Abstract: Coding techniques for image data may cause a still image to be converted to a “phantom” video sequence, which is coded by motion compensated prediction techniques. Thus, coded video data obtained from the coding operation may include temporal prediction references between frames of the video sequence. Metadata may be generated that identifies allocations of content from the still image to the frames of the video sequence. The coded data and the metadata may be transmitted to another device, whereupon it may be decoded by motion compensated prediction techniques and converted back to a still image data. Other techniques may involve coding an image in both a base layer representation and at least one coded enhancement layer representation. The enhancement layer representation may be coded predictively with reference to the base layer representation. The coded base layer representation may be partitioned into a plurality of individually-transmittable segments and stored. Prediction references of elements of the enhancement layer representation may be confined to segments of the base layer representation that correspond to a location of those elements. Meaning, when a pixel block of an enhancement layer maps to a given segment of the base layer representation, prediction references are confined to that segment and do not reference portions of the base layer representation that may be found in other segment(s).