公开(公告)号：US20170094308A1

公开(公告)日：2017-03-30

申请号：US15377885

申请日：2016-12-13

Applicant: Apple Inc.

Inventor： Barin Geoffry Haskell ,  David William Singer ,  Adriana Dumitras ,  Atul Puri

IPC: H04N19/52 ,  H04N19/146 ,  H04N19/132 ,  H04N19/139 ,  H04N19/625 ,  H04N19/124

CPC classification number: H04N19/52 ,  H04N7/50 ,  H04N19/107 ,  H04N19/124 ,  H04N19/13 ,  H04N19/132 ,  H04N19/137 ,  H04N19/139 ,  H04N19/146 ,  H04N19/15 ,  H04N19/152 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/196 ,  H04N19/40 ,  H04N19/46 ,  H04N19/463 ,  H04N19/48 ,  H04N19/51 ,  H04N19/513 ,  H04N19/577 ,  H04N19/587 ,  H04N19/61 ,  H04N19/625

Abstract: A method and apparatus for performing motion estimation in a digital video system is disclosed. Specifically, the present invention discloses a system that quickly calculates estimated motion vectors in a very efficient manner. In one embodiment, a first multiplicand is determined by multiplying a first display time difference between a first video picture and a second video picture by a power of two scale value. This step scales up a numerator for a ratio. Next, the system determines a scaled ratio by dividing that scaled numerator by a second first display time difference between said second video picture and a third video picture. The scaled ratio is then stored calculating motion vector estimations. By storing the scaled ratio, all the estimated motion vectors can be calculated quickly with good precision since the scaled ratio saves significant bits and reducing the scale is performed by simple shifts.

公开(公告)号：US09516337B2

公开(公告)日：2016-12-06

申请号：US14929145

申请日：2015-10-30

Applicant: Apple Inc.

Inventor： Barin Geoffry Haskell ,  David William Singer ,  Adriana Dumitras ,  Atul Puri

IPC: H04N7/12 ,  H04N19/513 ,  H04N19/176 ,  H04N19/61 ,  H04N21/43 ,  G06T9/00 ,  H04N19/503 ,  H04N19/46 ,  H04N19/51 ,  H04N19/13 ,  H04N19/91 ,  H04N19/132 ,  H04N19/43 ,  H04N19/587 ,  H04N19/577 ,  H04N19/40 ,  H04N19/00

CPC classification number: H04N19/513 ,  G06T9/005 ,  H04N19/13 ,  H04N19/132 ,  H04N19/176 ,  H04N19/40 ,  H04N19/43 ,  H04N19/44 ,  H04N19/46 ,  H04N19/503 ,  H04N19/51 ,  H04N19/577 ,  H04N19/587 ,  H04N19/61 ,  H04N19/91 ,  H04N21/4305

Abstract: A method and apparatus for variable accuracy inter-picture timing specification for digital video encoding is disclosed. Specifically, the present invention discloses a system that allows the relative timing of nearby video pictures to be encoded in a very efficient manner. In one embodiment, the display time difference between a current video picture and a nearby video picture is determined. The display time difference is then encoded into a digital representation of the video picture. In a preferred embodiment, the nearby video picture is the most recently transmitted stored picture. For coding efficiency, the display time difference may be encoded using a variable length coding system or arithmetic coding. In an alternate embodiment, the display time difference is encoded as a power of two to reduce the number of bits transmitted.

公开(公告)号：US20190297338A1

公开(公告)日：2019-09-26

申请号：US16435327

申请日：2019-06-07

Applicant: Apple Inc.

Inventor： Alexandros Michael Tourapis ,  Yeping Su ,  David William Singer ,  Hsi-Jung Wu

IPC: H04N19/186 ,  H04N9/67 ,  H04N19/189 ,  H04N19/59 ,  H04N19/154 ,  H04N19/132 ,  H04N19/117 ,  H04N19/46 ,  H04N19/70 ,  H04N11/20 ,  H04N9/64 ,  H04N19/82 ,  H04N19/85 ,  H04N19/80 ,  H04N19/147 ,  H04N19/44

Abstract: A method of adaptive chroma downsampling is presented. The method comprises converting a source image to a converted image in an output color format, applying a plurality of downsample filters to the converted image and estimating a distortion for each filter chose the filter that produces the minimum distortion. The distortion estimation includes applying an upsample filter, and a pixel is output based on the chosen filter. Methods for closed loop conversions are also presented.

公开(公告)号：US09838707B2

公开(公告)日：2017-12-05

申请号：US15340976

申请日：2016-11-01

Applicant: Apple Inc.

Inventor： Barin Geoffry Haskell ,  David William Singer ,  Adriana Dumitras ,  Atul Puri

IPC: H04N19/513 ,  H04N19/176 ,  H04N19/40 ,  H04N21/43 ,  G06T9/00 ,  H04N19/503 ,  H04N19/46 ,  H04N19/51 ,  H04N19/13 ,  H04N19/61 ,  H04N19/91 ,  H04N19/132 ,  H04N19/43 ,  H04N19/587 ,  H04N19/577 ,  H04N19/44

CPC classification number: H04N19/513 ,  G06T9/005 ,  H04N19/13 ,  H04N19/132 ,  H04N19/176 ,  H04N19/40 ,  H04N19/43 ,  H04N19/44 ,  H04N19/46 ,  H04N19/503 ,  H04N19/51 ,  H04N19/577 ,  H04N19/587 ,  H04N19/61 ,  H04N19/91 ,  H04N21/4305

Abstract: A method and apparatus for variable accuracy inter-picture timing specification for digital video encoding is disclosed. Specifically, the present invention discloses a system that allows the relative timing of nearby video pictures to be encoded in a very efficient manner. In one embodiment, the display time difference between a current video picture and a nearby video picture is determined. The display time difference is then encoded into a digital representation of the video picture. In a preferred embodiment, the nearby video picture is the most recently transmitted stored picture. For coding efficiency, the display time difference may be encoded using a variable length coding system or arithmetic coding. In an alternate embodiment, the display time difference is encoded as a power of two to reduce the number of bits transmitted.

公开(公告)号：US20170318191A1

公开(公告)日：2017-11-02

申请号：US15650750

申请日：2017-07-14

Applicant: Apple Inc.

Inventor： Alexandros Michael Tourapis ,  Yeping Su ,  David William Singer ,  Hsi-Jung Wu

IPC: H04N1/60 ,  H04N19/85 ,  H04N19/186 ,  H04N19/46 ,  H04N9/67

CPC classification number: H04N1/6005 ,  H04N1/6058 ,  H04N9/67 ,  H04N19/186 ,  H04N19/46 ,  H04N19/85

Abstract: Image and video processing techniques are disclosed for processing components of a color space individually by determining limits for each component based on the relationship between each component in a color space. These limits may then be used to clip each component such that the component values are within the determined range for that component. In this manner, more efficient processing of images and/or video may be achieved.

公开(公告)号：US20170054994A1

公开(公告)日：2017-02-23

申请号：US15340976

申请日：2016-11-01

Applicant: Apple Inc.

Inventor： Barin Geoffry Haskell ,  David William Singer ,  Adriana Dumitras ,  Atul Puri

IPC: H04N19/513 ,  H04N19/43 ,  H04N19/577 ,  H04N19/176

CPC classification number: H04N19/513 ,  G06T9/005 ,  H04N19/13 ,  H04N19/132 ,  H04N19/176 ,  H04N19/40 ,  H04N19/43 ,  H04N19/44 ,  H04N19/46 ,  H04N19/503 ,  H04N19/51 ,  H04N19/577 ,  H04N19/587 ,  H04N19/61 ,  H04N19/91 ,  H04N21/4305

Abstract: A method and apparatus for variable accuracy inter-picture timing specification for digital video encoding is disclosed. Specifically, the present invention discloses a system that allows the relative timing of nearby video pictures to be encoded in a very efficient manner. In one embodiment, the display time difference between a current video picture and a nearby video picture is determined. The display time difference is then encoded into a digital representation of the video picture. In a preferred embodiment, the nearby video picture is the most recently transmitted stored picture. For coding efficiency, the display time difference may be encoded using a variable length coding system or arithmetic coding. In an alternate embodiment, the display time difference is encoded as a power of two to reduce the number of bits transmitted.

Abstract translation: 公开了一种用于数字视频编码的可变精度画面间时序规范的方法和装置。 具体地说，本发明公开了一种允许以非常有效的方式编码附近视频图像的相对定时的系统。 在一个实施例中，确定当前视频图像和附近视频图像之间的显示时间差。 然后将显示时间差编码为视频图像的数字表示。 在优选实施例中，附近的视频图像是最近发送的存储图像。 对于编码效率，可以使用可变长度编码系统或算术编码对显示时间差进行编码。 在替代实施例中，显示时间差被编码为2的幂，以减少发送的比特数。

公开(公告)号：US09554151B2

公开(公告)日：2017-01-24

申请号：US14530519

申请日：2014-10-31

Applicant: Apple Inc.

Inventor： Barin Geoffry Haskell ,  David William Singer ,  Adriana Dumitras ,  Atul Puri

IPC: H04N7/12 ,  H04N19/52 ,  H04N19/159 ,  H04N19/176 ,  H04N19/46 ,  H04N19/51 ,  H04N19/513 ,  H04N19/196 ,  H04N19/15 ,  H04N19/61 ,  H04N19/107 ,  H04N19/463 ,  H04N19/124 ,  H04N19/152 ,  H04N19/48 ,  H04N19/40 ,  H04N19/577 ,  H04N19/13 ,  H04N19/137 ,  H04N19/139 ,  H04N19/146 ,  H04N19/132 ,  H04N19/587

CPC classification number: H04N19/52 ,  H04N7/50 ,  H04N19/107 ,  H04N19/124 ,  H04N19/13 ,  H04N19/132 ,  H04N19/137 ,  H04N19/139 ,  H04N19/146 ,  H04N19/15 ,  H04N19/152 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/196 ,  H04N19/40 ,  H04N19/46 ,  H04N19/463 ,  H04N19/48 ,  H04N19/51 ,  H04N19/513 ,  H04N19/577 ,  H04N19/587 ,  H04N19/61 ,  H04N19/625

Abstract: A method and apparatus for performing motion estimation in a digital video system is disclosed. Specifically, the present invention discloses a system that quickly calculates estimated motion vectors in a very efficient manner. In one embodiment, a first multiplicand is determined by multiplying a first display time difference between a first video picture and a second video picture by a power of two scale value. This step scales up a numerator for a ratio. Next, the system determines a scaled ratio by dividing that scaled numerator by a second first display time difference between said second video picture and a third video picture. The scaled ratio is then stored calculating motion vector estimations. By storing the scaled ratio, all the estimated motion vectors can be calculated quickly with good precision since the scaled ratio saves significant bits and reducing the scale is performed by simple shifts.

Abstract translation: 公开了一种用于在数字视频系统中执行运动估计的方法和装置。 具体地，本发明公开了一种以非常有效的方式快速计算估计的运动矢量的系统。 在一个实施例中，通过将第一视频图像和第二视频图像之间的第一显示时间差乘以两个比例值的幂来确定第一被乘数。 这个步骤可以扩大一个比例的分子。 接下来，系统通过将所述缩放分子除以所述第二视频图像和第三视频图像之间的第二第一显示时间差来确定缩放比例。 然后存储计算运动矢量估计的缩放比例。 通过存储缩放比例，可以以高精度快速计算所有估计的运动矢量，因为缩放比例可以节省有效位，并且通过简单的移位来减小刻度。

公开(公告)号：US20150049815A1

公开(公告)日：2015-02-19

申请号：US14462396

申请日：2014-08-18

Applicant: Apple Inc.

Inventor： Barin Geoffry Haskell ,  David William Singer ,  Adriana Dumitras ,  Atul Puri

IPC: H04N19/513 ,  H04N19/577

CPC classification number: H04N19/513 ,  G06T9/005 ,  H04N19/13 ,  H04N19/132 ,  H04N19/176 ,  H04N19/40 ,  H04N19/43 ,  H04N19/44 ,  H04N19/46 ,  H04N19/503 ,  H04N19/51 ,  H04N19/577 ,  H04N19/587 ,  H04N19/61 ,  H04N19/91 ,  H04N21/4305

Abstract: A method and apparatus for variable accuracy inter-picture timing specification for digital video encoding is disclosed. Specifically, the present invention discloses a system that allows the relative timing of nearby video pictures to be encoded in a very efficient manner. In one embodiment, the display time difference between a current video picture and a nearby video picture is determined. The display time difference is then encoded into a digital representation of the video picture. In a preferred embodiment, the nearby video picture is the most recently transmitted stored picture. For coding efficiency, the display time difference may be encoded using a variable length coding system or arithmetic coding. In an alternate embodiment, the display time difference is encoded as a power of two to reduce the number of bits transmitted.

Abstract translation: 公开了一种用于数字视频编码的可变精度画面间时序规范的方法和装置。 具体地说，本发明公开了一种允许以非常有效的方式编码附近视频图像的相对定时的系统。 在一个实施例中，确定当前视频图像和附近视频图像之间的显示时间差。 然后将显示时间差编码为视频图像的数字表示。 在优选实施例中，附近的视频图像是最近发送的存储图像。 对于编码效率，可以使用可变长度编码系统或算术编码对显示时间差进行编码。 在替代实施例中，显示时间差被编码为2的幂，以减少发送的比特数。

公开(公告)号：US08744195B2

公开(公告)日：2014-06-03

申请号：US13961034

申请日：2013-08-07

Applicant: Apple Inc.

Inventor： David William Singer ,  Courtney Ann Kennedy

IPC: G06K9/46

CPC classification number: H04N5/907 ,  G06F17/30265 ,  G06F17/30793 ,  G06F17/30817 ,  G06K9/00221 ,  G06K9/00255 ,  G06K9/46 ,  G06T7/73

Abstract: A perimeter around a detected object in a frame of image data can be generated in a first coordinate system. The perimeter can be converted from the first coordinate system into a second coordinate system having the same aspect ratio as the first coordinate system. A first metadata entry can include dimensions of image data in the second coordinate system. A second metadata entry can provide a location and dimensions of the converted perimeter in the second coordinate space. Additional metadata can indicate matching objects between frames, position of an object relative to other objects in a frame, a probability that an object is correctly detected, and a total number of objects detected across multiple frames of image data.

Abstract translation: 可以在第一坐标系中生成图像数据的帧中的检测对象周围的周边。 周边可以从第一坐标系转换成具有与第一坐标系相同的纵横比的第二坐标系。 第一元数据条目可以包括第二坐标系中的图像数据的尺寸。 第二元数据条目可以提供第二坐标空间中转换的周边的位置和尺寸。 附加元数据可以指示帧之间的匹配对象，对象相对于帧中的其他对象的位置，正确检测对象的概率以及跨多个图像数据帧检测到的对象的总数。

公开(公告)号：US08509540B2

公开(公告)日：2013-08-13

申请号：US13681039

申请日：2012-11-19

Applicant: Apple Inc.

Inventor： David William Singer ,  Courtney Ann Kennedy

IPC: G06K9/46

CPC classification number: H04N5/907 ,  G06F17/30265 ,  G06F17/30793 ,  G06F17/30817 ,  G06K9/00221 ,  G06K9/00255 ,  G06K9/46 ,  G06T7/73

Abstract: A perimeter around a detected object in a frame of image data can be generated in a first coordinate system. The perimeter can be converted from the first coordinate system into a second coordinate system having the same aspect ratio as the first coordinate system. A first metadata entry can include dimensions of image data in the second coordinate system. A second metadata entry can provide a location and dimensions of the converted perimeter in the second coordinate space. Additional metadata can indicate matching objects between frames, position of an object relative to other objects in a frame, a probability that an object is correctly detected, and a total number of objects detected across multiple frames of image data.