公开(公告)号：US20180120953A1

公开(公告)日：2018-05-03

申请号：US15789876

申请日：2017-10-20

Applicant: Apple Inc.

Inventor： Yao-Chung Lin ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: G06F3/03 ,  G06F1/16 ,  H04N7/18

Abstract: Embodiments of the present invention generate estimates of device motion from two data sources on a computing device—a motion sensor and a camera. The device may compare the estimates to each other to determine if they agree. If they agree, the device may confirm that device motion estimates based on the motion sensor are accurate and may output those estimates to an application within the device. If the device motion estimates disagree, the device may alter the motion estimates obtained from the motion sensor before outputting them to the application.

公开(公告)号：US20180063544A1

公开(公告)日：2018-03-01

申请号：US15250608

申请日：2016-08-29

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Yeping Su ,  David Singer ,  Hsi-Jung Wu

IPC: H04N19/50 ,  H04N19/124 ,  H04N19/48 ,  H04N19/13 ,  H04N19/15 ,  H04N19/42 ,  H04N19/30

Abstract: Video compression and decompression techniques are disclosed that provide improved bandwidth control for video compression and decompression systems. In particular, video coding and decoding techniques quantize input video in multiple dimensions. According to these techniques, pixel residuals may be generated from a comparison of an array of input data to an array of prediction data. The pixel residuals may be quantized in a first dimension. After the quantization, the quantized pixel residuals may be transformed to an array of transform coefficients. The transform coefficients may be quantized in a second dimension and entropy coded. Decoding techniques invert these processes. In still other embodiments, multiple quantizers may be provided upstream of the transform stage, either in parallel or in cascade, which provide greater flexibility to video coders to quantize data in different dimensions in an effort to balance the competing interest in compression efficiency and quality of reconstructed video.

公开(公告)号：US20180035113A1

公开(公告)日：2018-02-01

申请号：US15682922

申请日：2017-08-22

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Yunfei Zheng ,  Xiaosong Zhou

IPC: H04N19/129 ,  H04N19/184

CPC classification number: H04N19/129 ,  H04N19/117 ,  H04N19/136 ,  H04N19/176 ,  H04N19/184 ,  H04N19/186 ,  H04N19/46 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

Abstract: Methods and systems provide efficient sample adaptive offset (SAO) signaling by reducing a number of bits consumed for signaling SAO compared with conventional methods. In an embodiment, a single flag is used if a coding unit to a first scanning direction with respect to a given coding unit is off. In an embodiment, further bits may be saved if some neighboring coding units are not present, i.e. the given coding unit is an edge. For example, a flag may be skipped, e.g., not signaled, if the given coding unit does not have a neighbor. In an embodiment, a syntax element, one or more flags may signal whether SAO filtering is performed in a coding unit. Based on the syntax element, a merge flag may be skipped to save bits. In an embodiment, SAO syntax may be signaled at a slice level.

公开(公告)号：US20170357871A1

公开(公告)日：2017-12-14

申请号：US15618909

申请日：2017-06-09

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Ke Zhang ,  Yunfei Zheng ,  Shujie Liu ,  Albert Keinath ,  Xiaosong Zhou ,  Chris Chung ,  Hsi-Jung Wu

IPC: G06K9/46 ,  G06K9/62 ,  G06K9/00

CPC classification number: G06K9/4642 ,  G06K9/00711 ,  G06K9/03 ,  G06K9/52 ,  G06K9/6256 ,  G06K9/6267 ,  G06K9/627

Abstract: Techniques are disclosed for estimating quality of images in an automated fashion. According to these techniques, a source image may be downsampled to generate at least two downsampled images at different levels of downsampling. Blurriness of the images may be estimated starting with a most-heavily downsampled image. Blocks of a given image may be evaluated for blurriness and, when a block of a given image is estimated to be blurry, the block of the image and co-located blocks of higher resolution image(s) may be designated as blurry. Thereafter, a blurriness score may be calculated for the source image from the number of blocks of the source image designated as blurry.

公开(公告)号：US09678581B2

公开(公告)日：2017-06-13

申请号：US14664308

申请日：2015-03-20

Applicant: Apple Inc.

Inventor： Yao-Chung Lin ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: G09G5/00 ,  G06F3/03 ,  G06F1/16 ,  H04N7/18

Abstract: Embodiments of the present invention generate estimates of device motion from two data sources on a computing device—a motion sensor and a camera. The device may compare the estimates to each other to determine if they agree. If they agree, the device may confirm that device motion estimates based on the motion sensor are accurate and may output those estimates to an application within the device. If the device motion estimates disagree, the device may alter the motion estimates obtained from the motion sensor before outputting them to the application.

公开(公告)号：US09621885B2

公开(公告)日：2017-04-11

申请号：US14216159

申请日：2014-03-17

Applicant: Apple Inc.

Inventor： Hsi-Jung Wu ,  Ionut Hristodorescu ,  James Oliver Normile

IPC: H04N19/513 ,  H04N19/436 ,  H04N19/176 ,  H04N19/61 ,  H04N19/103 ,  H04N19/156 ,  H04N19/44 ,  H04N19/42 ,  H04N19/88

CPC classification number: H04N19/436 ,  H04N19/103 ,  H04N19/156 ,  H04N19/176 ,  H04N19/42 ,  H04N19/44 ,  H04N19/61 ,  H04N19/88

Abstract: A method and system are provided for decoding coded video data by turning off or not loading at least one functional unit or functional subunit of the decoder while decoding a portion of the coded video data. A schedule may be created prior to substantive decoding and then the schedule may be used to decode coded video data. The coded video data may be reordered based on the functional units or subunits the portions of the coded video data need for decoding. The portions of the coded video data are reordered into their original order in an output buffer after being decoded. The decoder may determine which functional units or subunits are needed for decoding based on administration information included with the coded video data. The decoder may decode portions of the coded video data in parallel.

公开(公告)号：US20170041681A1

公开(公告)日：2017-02-09

申请号：US15296156

申请日：2016-10-18

Applicant: Apple Inc.

Inventor： David L. Biderman ,  Xiaosong Zhou ,  Douglas Scott Price ,  Yeping Su ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Zhenheng Li ,  John Su ,  James D. Batson

IPC: H04N21/61 ,  G06K9/00 ,  H04N21/262 ,  H04N21/6587 ,  H04N21/845

CPC classification number: H04N21/6125 ,  G06K9/00718 ,  G06K2009/00738 ,  G11B27/005 ,  G11B27/3081 ,  H04N21/262 ,  H04N21/440281 ,  H04N21/6587 ,  H04N21/8456

Abstract: System and methods for improved playback of a video stream are presented. Video snippets are identified that include a number of consecutive frames for playback. Snippets may be evenly temporally spaced in the video stream or may be content adaptive. Then the first frame of a snippet may be selected as the first frame of a scene or other appropriate stopping point. Scene detection, object detection, motion detection, video metadata, or other information generated during encoding or decoding of the video stream may aid in appropriate snippet selection.

Abstract translation: 介绍了改进视频流播放的系统和方法。 识别包括多个连续帧进行播放的视频片段。 片段可以在视频流中均匀地间隔开，或者可以是内容自适应的。 然后，片段的第一帧可以被选择为场景或其他适当停止点的第一帧。 在视频流的编码或解码过程中产生的场景检测，对象检测，运动检测，视频元数据或其他信息可能有助于适当的片段选择。

公开(公告)号：US09544540B2

公开(公告)日：2017-01-10

申请号：US14296348

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/14 ,  H04N7/15 ,  H04L12/58

CPC classification number: H04N7/15 ,  H04L51/04 ,  H04L51/10 ,  H04N7/147

Abstract: Computing devices may implement dynamic display of video communication data. Video communication data for a video communication may be received at a computing device where another application is currently displaying image data on an electronic display. A display location may be determined for the video communication data according to display attributes that are configured by the other application at runtime. Once determined, the video communication data may then be displayed in the determined location. In some embodiments, the video communication data may be integrated with other data displayed on the electronic display for the other application.

Abstract translation: 计算设备可以实现视频通信数据的动态显示。 用于视频通信的视频通信数据可以在其他应用当前正在电子显示器上显示图像数据的计算设备处被接收。 可以根据在运行时由其他应用配置的显示属性来确定视频通信数据的显示位置。 一旦确定，则可以在确定的位置显示视频通信数据。 在一些实施例中，视频通信数据可以与用于另一应用的电子显示器上显示的其他数据集成。

公开(公告)号：US20160358628A1

公开(公告)日：2016-12-08

申请号：US15173465

申请日：2016-06-03

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Yunfei Zheng ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Ke Zhang ,  Albert E. Keinath ,  Chris Y. Chung

IPC: G11B27/031 ,  G06K9/00

CPC classification number: G11B27/031 ,  G06K9/00718 ,  G06K9/00751 ,  G06K9/00765

Abstract: Methods for organizing media data by automatically segmenting media data into hierarchical layers of scenes are described. The media data may include metadata and content having still image, video or audio data. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to organize the media data.

Abstract translation: 描述了通过将媒体数据自动分割成层级的场景来组织媒体数据的方法。 媒体数据可以包括具有静止图像，视频或音频数据的元数据和内容。 元数据可以是基于内容的（例如，相邻帧之间的差异，曝光数据，关键帧识别数据，运动数据或面部检测数据）或非基于内容的（例如，曝光，焦点，位置，时间）并且被使用 对视频的部分进行优先排序和/或分类。 元数据可以在图像捕获时或在后处理期间生成。 诸如图像数据的各个部分的得分的优先级信息可以基于元数据和/或图像数据。 可以基于元数据和/或图像数据来确定诸如场景的类型或质量的分类信息。 分类和优先化信息可以是元数据，并且可以用于组织媒体数据。

公开(公告)号：US20160357605A1

公开(公告)日：2016-12-08

申请号：US15173047

申请日：2016-06-03

Applicant: Apple Inc.

Inventor： Albert Keinath ,  Ke Zhang ,  Yunfei Zheng ,  Shujie Liu ,  Jiefu Zhai ,  Chris Y. Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: G06F9/50 ,  H04L29/08 ,  G06F9/48

CPC classification number: G06F9/5011 ,  G06F9/46 ,  G06F9/4881 ,  H04L67/34 ,  H04N21/41407 ,  H04N21/4433

Abstract: A system for processing media on a resource restricted device, the system including a memory to store data representing media assets and associated descriptors, and program instructions representing an application and a media processing system, and a processor to execute the program instructions, wherein the program instructions represent the media processing system, in response to a call from an application defining a plurality of services to be performed on an asset, determine a tiered schedule of processing operations to be performed upon the asset based on a processing budget associated therewith, and iteratively execute the processing operations on a tier-by-tier basis, unless interrupted.

Abstract translation: 一种用于在资源受限设备上处理媒体的系统，所述系统包括用于存储表示媒体资产和相关联描述符的数据的存储器，以及表示应用和媒体处理系统的程序指令以及执行所述程序指令的处理器，其中所述程序 指令代表媒体处理系统，响应于来自定义要在资产上执行的多个服务的应用的呼叫，基于与其相关联的处理预算来确定要在资产上执行的处理操作的分层调度，并且迭代地 除非中断，否则逐级执行处理操作。