公开(公告)号：US20200092571A1

公开(公告)日：2020-03-19

申请号：US16132219

申请日：2018-09-14

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: H04N19/29 ,  H04N21/44 ,  G09G5/14 ,  H04N19/103

Abstract: Aspects of the present disclosure provide techniques for reducing latency and improving image quality of a viewport extracted from multi-directional video communications. According to such techniques, first streams of coded video data are received from a source. The first streams include coded data for each of a plurality of tiles representing a multi-directional video, where each tile corresponding to a predetermined spatial region of the multi-directional video, and at least one tile of the plurality of tiles in the first streams contains a current viewport location at a receiver. The techniques include decoding the first streams and displaying the tile containing the current viewport location. When the viewport location at the receiver changes to include a new tile of the plurality of tiles, retrieving and decoding first streams for the new tile, displaying the decoded content for the changed viewport location, and transmitting the changed viewport location to the source.

公开(公告)号：US10462420B2

公开(公告)日：2019-10-29

申请号：US15725868

申请日：2017-10-05

Applicant: Apple Inc.

Inventor： Elizabeth C. Cranfill ,  Stephen O. Lemay ,  Joe S. Abuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Roberto Garcia, Jr.

IPC: H04N7/14 ,  H04N7/15 ,  G06F3/0484 ,  G09G5/14 ,  H04N5/262 ,  H04N5/272 ,  H04N5/225 ,  G06F9/451 ,  H04M1/725 ,  G06F3/0488 ,  G06F3/0481

Abstract: Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

公开(公告)号：US10402677B2

公开(公告)日：2019-09-03

申请号：US15618909

申请日：2017-06-09

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Ke Zhang ,  Yunfei Zheng ,  Shujie Liu ,  Albert Keinath ,  Xiaosong Zhou ,  Chris Chung ,  Hsi-Jung Wu

IPC: G06K9/00 ,  G06K9/46 ,  G06K9/62

Abstract: Techniques are disclosed for estimating quality of images in an automated fashion. According to these techniques, a source image may be downsampled to generate at least two downsampled images at different levels of downsampling. Blurriness of the images may be estimated starting with a most-heavily downsampled image. Blocks of a given image may be evaluated for blurriness and, when a block of a given image is estimated to be blurry, the block of the image and co-located blocks of higher resolution image(s) may be designated as blurry. Thereafter, a blurriness score may be calculated for the source image from the number of blocks of the source image designated as blurry.

公开(公告)号：US10402226B2

公开(公告)日：2019-09-03

申请号：US15173047

申请日：2016-06-03

Applicant: Apple Inc.

Inventor： Albert Keinath ,  Ke Zhang ,  Yunfei Zheng ,  Shujie Liu ,  Jiefu Zhai ,  Chris Y. Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: G06F9/46 ,  G06F9/50 ,  G06F9/48 ,  H04L29/08 ,  H04N21/443 ,  H04N21/414

Abstract: A system for processing media on a resource restricted device, the system including a memory to store data representing media assets and associated descriptors, and program instructions representing an application and a media processing system, and a processor to execute the program instructions, wherein the program instructions represent the media processing system, in response to a call from an application defining a plurality of services to be performed on an asset, determine a tiered schedule of processing operations to be performed upon the asset based on a processing budget associated therewith, and iteratively execute the processing operations on a tier-by-tier basis, unless interrupted.

公开(公告)号：US10382830B2

公开(公告)日：2019-08-13

申请号：US15296156

申请日：2016-10-18

Applicant: Apple Inc.

Inventor： David L. Biderman ,  Xiaosong Zhou ,  Douglas Scott Price ,  Yeping Su ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Zhenheng Li ,  John Su ,  James D. Batson

IPC: H04N21/61 ,  G06K9/00 ,  H04N21/262 ,  H04N21/845 ,  H04N21/6587 ,  H04N21/4402 ,  G11B27/30 ,  G11B27/00

Abstract: System and methods for improved playback of a video stream are presented. Video snippets are identified that include a number of consecutive frames for playback. Snippets may be evenly temporally spaced in the video stream or may be content adaptive. Then the first frame of a snippet may be selected as the first frame of a scene or other appropriate stopping point. Scene detection, object detection, motion detection, video metadata, or other information generated during encoding or decoding of the video stream may aid in appropriate snippet selection.

公开(公告)号：US10366497B2

公开(公告)日：2019-07-30

申请号：US15618967

申请日：2017-06-09

Applicant: Apple Inc.

Inventor： Ke Zhang ,  Jiefu Zhai ,  Yunfei Zheng ,  Shujie Liu ,  Albert E. Keinath ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: G06T5/00 ,  G06T7/194 ,  G06T7/11 ,  G11B27/031

Abstract: Techniques for cropping images containing an occlusion are presented. A method for image editing is presented comprising, when an occlusion is detected in an original digital image, determining an area occupied by the occlusion, assigning importance scores to different content elements of the original digital image, defining a cropping window around an area of the original digital image that does not include the area occupied by the occlusion and that is based on the importance scores, and cropping the original digital image to the cropping window.

公开(公告)号：US20180352264A1

公开(公告)日：2018-12-06

申请号：US15612806

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Mei Guo ,  Feng Yi ,  Jun Xin ,  Chris Y. Chung ,  Yeping Su ,  Xiaosong Zhou ,  Jun Xu ,  Hsi-Jung Wu ,  Jingteng Xue

IPC: H04N19/86 ,  H04N19/117

CPC classification number: H04N19/86 ,  H04N19/117 ,  H04N19/159

Abstract: Methods of in-loop deblocking filter for high dynamic range (HDR) video compression are disclosed. HDR processing and standard dynamic range (SDR) processing adopt different electro-optical transfer function (EOTF) to convert digital code words to linear luminance. For compressing HDR video, EOTF is proposed to be involved in the selection of two deblocking parameters, β and tC, which control the strength of deblocking filter. In local activity checking for filter decisions, the calculated local signal characteristics and the thresholds are adjusted according to EOTF. After deblocking filter, the clipping range is modified based on EOTF. The chroma deblocking filter is also extended to inter-inter block boundary.

公开(公告)号：US20180352259A1

公开(公告)日：2018-12-06

申请号：US15613081

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Mei Guo ,  Jun Xin ,  Yeping Su ,  Chris Chung ,  Dazhong Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/61 ,  H04N19/52 ,  H04N19/122 ,  H04N19/18 ,  H04N19/82 ,  H04N19/182 ,  H04N19/124 ,  H04N19/91

Abstract: Techniques are disclosed for coding high dynamic range (HDR) data. According to such techniques, HDR data may be converted to a domain of uniform luminance data. The uniform domain data may be coded by motion compensated predictive coding. The HDR data also may be coded by motion compensated predictive coding, using a coding parameter that is derived from a counterpart coding parameter of the coding of the uniform domain data. In another technique, HDR data may be coded using coding parameters that are derived from HDR domain processing but distortion measurements may be performed in a uniform domain.

公开(公告)号：US20180349705A1

公开(公告)日：2018-12-06

申请号：US15613130

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Hang Yuan ,  Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Chung ,  Hsi-Jung Wu

IPC: G06K9/00 ,  G06T7/292 ,  G06K9/32

Abstract: Techniques are disclosed for managing display of content from multi-view video data. According to these techniques, an object may be identified from content of the multi-view video. The object's location may be tracked across a sequence of multi-view video. The technique may extract a sub-set of video that is contained within a view window that is shifted in an image space of the multi-view video in correspondence to the tracked object's location. These techniques may be implemented either in an image source device or an image sink device.

公开(公告)号：US20180338161A1

公开(公告)日：2018-11-22

申请号：US16050744

申请日：2018-07-31

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Peikang Song ,  David R. Conrad ,  Jae Hoon Kim ,  Yunfei Zheng

IPC: H04N19/82 ,  H04N19/186

CPC classification number: H04N19/82 ,  H04N19/186

Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.