公开(公告)号：US20220286644A1

公开(公告)日：2022-09-08

申请号：US17826116

申请日：2022-05-26

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Christopher Jansen

IPC: H04N7/14 ,  H04L65/1069 ,  H04N7/15 ,  H04L51/10 ,  H04L51/04

Abstract: Computing devices may implement instant video communication connections for video communications. Connection information for mobile computing devices may be maintained. A request to initiate an instant video communication may be received, and if authorized, the connection information for the particular recipient mobile computing device may be accessed. Video communication data may then be sent to the recipient mobile computing device according to the connection information so that the video communication data may be displayed at the recipient device as it is received. New connection information for different mobile computing devices may be added, or updates to existing connection information may also be performed. Connection information for some mobile computing devices may be removed.

公开(公告)号：US20220103851A1

公开(公告)日：2022-03-31

申请号：US17493607

申请日：2021-10-04

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Yeping Su ,  David Singer ,  Hsi-Jung Wu

IPC: H04N19/50 ,  H04N19/184 ,  H04N19/167 ,  H04N19/436 ,  H04N19/186 ,  H04N19/132 ,  H04N19/124 ,  H04N19/13 ,  H04N19/15 ,  H04N19/30 ,  H04N19/42 ,  H04N19/48

Abstract: Video compression and decompression techniques are disclosed that provide improved bandwidth control for video compression and decompression systems. In particular, video coding and decoding techniques quantize input video in multiple dimensions. According to these techniques, pixel residuals may be generated from a comparison of an array of input data to an array of prediction data. The pixel residuals may be quantized in a first dimension. After the quantization, the quantized pixel residuals may be transformed to an array of transform coefficients. The transform coefficients may be quantized in a second dimension and entropy coded. Decoding techniques invert these processes. In still other embodiments, multiple quantizers may be provided upstream of the transform stage, either in parallel or in cascade, which provide greater flexibility to video coders to quantize data in different dimensions in an effort to balance the competing interest in compression efficiency and quality of reconstructed video.

公开(公告)号：US11282543B2

公开(公告)日：2022-03-22

申请号：US15917441

申请日：2018-03-09

Applicant: Apple Inc.

Inventor： Hang Yuan ,  Jiefu Zhai ,  Ming Chen ,  Jae Hoon Kim ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: G11B27/031 ,  G06T5/00 ,  G06T7/73 ,  G06K9/00 ,  G06T19/20

Abstract: Techniques are presented for modifying images of an object in video, for example to correct for lens distortion, or to beautify a face. These techniques include extracting and validating features of an object from a source video frame, tracking those features over time, estimating a pose of the object, modifying a 3D model of the object based on the features, and rendering a modified video frame based on the modified 3D model and modified intrinsic and extrinsic matrices. These techniques may be applied in real-time to an object in a sequence of video frames.

公开(公告)号：US20210321133A1

公开(公告)日：2021-10-14

申请号：US17207267

申请日：2021-03-19

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Xiaosong Zhou ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/105 ,  H04N19/547

Abstract: Techniques are disclosed for coding video data predictively based on predictions made from spherical-domain projections of input pictures to be coded and reference pictures that are prediction candidates. Spherical projection of an input picture and the candidate reference pictures may be generated. Thereafter, a search may be conducted for a match between the spherical-domain representation of a pixel block to be coded and a spherical-domain representation of the reference picture. On a match, an offset may be determined between the spherical-domain representation of the pixel block to a matching portion of the of the reference picture in the spherical-domain representation. The spherical-domain offset may be transformed to a motion vector in a source-domain representation of the input picture, and the pixel block may be coded predictively with reference to a source-domain representation of the matching portion of the reference picture.

公开(公告)号：US11109042B2

公开(公告)日：2021-08-31

申请号：US16420740

申请日：2019-05-23

Applicant: Apple Inc.

Inventor： Sudeng Hu ,  Xing Wen ,  Jae Hoon Kim ,  Peikang Song ,  Hang Yuan ,  Dazhong Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Christopher Garrido ,  Ming Jin ,  Patrick Miauton ,  Karthick Santhanam

IPC: H04N19/172 ,  H04N19/182 ,  H04N19/124 ,  H04N19/176 ,  H04N19/52 ,  H04N19/159

Abstract: Systems and methods for coding a video to be overlaid by annotations are devised. A motion compensated predictive coding is employed, wherein coding parameters of video pixel blocks are determined based on the pixel blocks' relation to the annotations. A decoder decodes the video and annotates it based on metadata, obtained from the coder or other sources, describing the annotations' appearance and rendering mode.

公开(公告)号：US20210256735A1

公开(公告)日：2021-08-19

申请号：US17306863

申请日：2021-05-03

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T17/20 ,  H03M7/30 ,  G06T3/40

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.

公开(公告)号：US20210243409A1

公开(公告)日：2021-08-05

申请号：US17175544

申请日：2021-02-12

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Christopher Jansen

IPC: H04N7/14 ,  H04L29/06 ,  H04N7/15 ,  H04L12/58

Abstract: Computing devices may implement instant video communication connections for video communications. Connection information for mobile computing devices may be maintained. A request to initiate an instant video communication may be received, and if authorized, the connection information for the particular recipient mobile computing device may be accessed. Video communication data may then be sent to the recipient mobile computing device according to the connection information so that the video communication data may be displayed at the recipient device as it is received. New connection information for different mobile computing devices may be added, or updates to existing connection information may also be performed. Connection information for some mobile computing devices may be removed.

公开(公告)号：US11025861B2

公开(公告)日：2021-06-01

申请号：US16666073

申请日：2019-10-28

Applicant: Apple Inc.

Inventor： Elizabeth C. Cranfill ,  Stephen O. Lemay ,  Joe S. Abuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Roberto Garcia, Jr.

IPC: H04N7/14 ,  G09G5/14 ,  H04N5/225 ,  G06F3/0488 ,  G06F9/451 ,  G06F3/0481 ,  G06F3/0482 ,  H04N7/15 ,  H04M1/725 ,  G06F3/0486 ,  G06F3/0484 ,  H04N5/262 ,  H04N5/272

Abstract: Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

公开(公告)号：US10924707B2

公开(公告)日：2021-02-16

申请号：US16112540

申请日：2018-08-24

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Christopher Jansen

IPC: H04N7/14 ,  H04L29/06 ,  H04N7/15 ,  H04L12/58

Abstract: Computing devices may implement instant video communication connections for video communications. Connection information for mobile computing devices may be maintained. A request to initiate an instant video communication may be received, and if authorized, the connection information for the particular recipient mobile computing device may be accessed. Video communication data may then be sent to the recipient mobile computing device according to the connection information so that the video communication data may be displayed at the recipient device as it is received. New connection information for different mobile computing devices may be added, or updates to existing connection information may also be performed. Connection information for some mobile computing devices may be removed.

公开(公告)号：US20200382745A1

公开(公告)日：2020-12-03

申请号：US16689458

申请日：2019-11-20

Applicant: Apple Inc.

Inventor： Johnny Trenh ,  Hsi-Jung Wu ,  Sarah K. Herrlinger ,  Xiaoxia Sun ,  Ian J. Baird ,  Dazhong Zhang ,  Xiaosong Zhou ,  Christopher M. Garrido

IPC: H04N7/14 ,  H04N7/15 ,  G06N3/08 ,  G06F3/01

Abstract: Techniques are presented for managing for visual prominence of participants in a video conference, including conferences where participants communicate visually, such as with sign language. According to these techniques, a visual prominence indication of a participant in a video conference may be estimated, a video stream of the participant may be encoded, and the encoded video stream may be transmitted along with an indication of the estimated visual prominence to a receiving device in the video conference.