公开(公告)号：US10706631B2

公开(公告)日：2020-07-07

申请号：US16176578

申请日：2018-10-31

Applicant: Advanced Micro Devices, Inc.

Inventor： Michael L. Schmit ,  Nathaniel David Naegle

IPC: G06T19/00 ,  G06F3/01

Abstract: Systems, methods, and devices for generating an image frame for display to a user. Brain activity sensor data correlated with movement of a user is received. A predicted field of view of the user is determined based on the brain activity sensor data. An image frame is generated based on the predicted field of view. The image frame is transmitted to a display for display to a user. Some implementations provide for receiving and displaying a foveated image frame based on a predicted field of view of a user. Brain activity information of a user is captured. The brain activity information is communicated to a transceiver. The brain activity information is transmitted to a rendering device using the transceiver to generate a foveated image frame based on a predicted field of view of the user. The foveated image frame is received from the rendering device, decoded, and displayed to the user.

公开(公告)号：US20200167999A1

公开(公告)日：2020-05-28

申请号：US16176578

申请日：2018-10-31

Applicant: Advanced Micro Devices, Inc.

Inventor： Michael L. Schmit ,  Nathaniel David Naegle

IPC: G06T19/00 ,  G06F3/01

Abstract: Systems, methods, and devices for generating an image frame for display to a user. Brain activity sensor data correlated with movement of a user is received. A predicted field of view of the user is determined based on the brain activity sensor data. An image frame is generated based on the predicted field of view. The image frame is transmitted to a display for display to a user. Some implementations provide for receiving and displaying a foveated image frame based on a predicted field of view of a user. Brain activity information of a user is captured. The brain activity information is communicated to a transceiver. The brain activity information is transmitted to a rendering device using the transceiver to generate a foveated image frame based on a predicted field of view of the user. The foveated image frame is received from the rendering device, decoded, and displayed to the user.

公开(公告)号：US10440359B2

公开(公告)日：2019-10-08

申请号：US13905770

申请日：2013-05-30

Applicant: Advanced Micro Devices, Inc.

Inventor： Michael L. Schmit ,  Radhakrishna Giduthuri ,  Rajy Meeyakhan Rawther ,  Vicky W. Tsang ,  Passant V. Karunaratne

IPC: H04N19/51 ,  H04N19/577 ,  H04N19/105 ,  H04N19/172 ,  H04N19/15 ,  H04N19/115 ,  H04N19/142 ,  H04N19/42

Abstract: Methods and apparatus for video processing are disclosed. In one embodiment the work of processing of different types of video frames is allocated between a plurality of computing resources. For example, different computing resources for can be used for I, P and B frames, where an I frame is an intra-frame encoded with no other frames as a reference; a P frame is encoded with one previous I or P frame as a reference and a B frame is encoded with one previous and one future frame as references. In one example, a central processing unit (CPU) performs encoding of I frames and P frames of a video and a graphics processing unit (GPU) performs initial encoding of B frames of the video in connection with a fixed function video encoder configured to perform entropy encoding of the B frames.

公开(公告)号：US10321052B2

公开(公告)日：2019-06-11

申请号：US15582460

申请日：2017-04-28

Applicant: Advanced Micro Devices, Inc.

Inventor： Michael L. Schmit ,  Radhakrishna Giduthuri ,  Kiriti Nagesh Gowda

IPC: H04N5/232 ,  H04N5/247

Abstract: A method and apparatus of seam finding includes determining an overlap area between a first image and a second image. The first image is captured by a first image capturing device and the second image is captured by a second image capturing device. A plurality of seam paths for stitching the first image with the second image is computed and a cost is computed for each seam path. A seam is selected to stitch the first image to the second image based upon the cost for the seam path for that seam being less than a cost for all other computed seam paths, that seam is maintained as the selected seam for stitching based upon a predefined criteria.

公开(公告)号：US20180343470A1

公开(公告)日：2018-11-29

申请号：US15605441

申请日：2017-05-25

Applicant: Advanced Micro Devices, Inc.

Inventor： Michael L. Schmit

IPC: H04N19/593 ,  G06T9/00 ,  H04N19/46 ,  G06T3/00 ,  H04N5/92 ,  H04N13/00

Abstract: Described herein is a method and apparatus for using cube mapping and mapping metadata with encoders. Video data, such as 360° video data, is sent by a capturing device to an application, such as video editing software, which generates cube mapped video data and mapping metadata from the 360° video data. An encoder then applies the mapping metadata to the cube mapped video data to minimize or eliminate search regions when performing motion estimation, minimize or eliminate neighbor regions when performing intra coding prediction and assign zero weights to edges having no relational meaning.

公开(公告)号：US20160173896A1

公开(公告)日：2016-06-16

申请号：US14571982

申请日：2014-12-16

Applicant: Advanced Micro Devices, Inc.

Inventor： Michael L. Schmit ,  Ashish Farmer ,  Radhakrishna Giduthuri

IPC: H04N19/43 ,  H04N19/433 ,  H04N19/436 ,  H04N19/513 ,  H04N19/44

CPC classification number: H04N19/43 ,  H04N19/129 ,  H04N19/159 ,  H04N19/176 ,  H04N19/433 ,  H04N19/436 ,  H04N19/44

Abstract: Methods and apparatus for decoding video are presented herein. The methods and apparatus may comprise a host processor, such as a central processing unit (CPU), programmed to execute a software driver that causes the host processor to generate a motion compensation command for a plurality of cores of a massively parallel processor, such as a graphics processing unit (GPU), to provide motion compensation for encoded video. The motion compensation command for the plurality of cores of the massively parallel processor contains executable instructions for processing a plurality of motion vectors grouped by a plurality of prediction modes from a re-ordered motion vector buffer by the plurality of cores of the massively parallel processor.

Abstract translation: 本文给出了解码视频的方法和装置。 方法和装置可以包括主处理器，诸如中央处理单元（CPU），其被编程为执行软件驱动器，该软件驱动器使得主处理器为大规模并行处理器的多个核心生成运动补偿命令，诸如 图形处理单元（GPU），用于为编码视频提供运动补偿。 大规模并行处理器的多个核心的运动补偿命令包括用于通过大规模并行处理器的多个核心从重新排序的运动向量缓冲器处理由多个预测模式分组的多个运动向量的可执行指令。

公开(公告)号：US20150172687A1

公开(公告)日：2015-06-18

申请号：US14635604

申请日：2015-03-02

Applicant: Advanced Micro Devices, Inc.

Inventor： Michael L. Schmit ,  Vicky W. Tsang ,  Radhakrishna Giduthuri

IPC: H04N19/43 ,  H04N19/513 ,  H04N19/436

CPC classification number: H04N19/43 ,  H04N19/176 ,  H04N19/196 ,  H04N19/198 ,  H04N19/40 ,  H04N19/436 ,  H04N19/46 ,  H04N19/513 ,  H04N19/521 ,  H04N19/53 ,  H04N19/61 ,  H04N19/80

Abstract: A system and method of performing motion estimation in a video encoder is enclosed. The system and method include calculating one or more candidate motion vectors for each macroblock of a video image to form a list of candidate motion vectors, calculating a second one or more candidate motion vectors using a sub-region of at least one macroblock of the video image to include in the list of candidate motion vectors, and comparing the calculated candidate motion vectors of a first macroblock with the calculated candidate motion vectors of at least one sub-region of the first macroblock to provide the estimated contribution to the candidate motion vector of the macroblock. The calculating a second one or more candidate motion vectors using a sub-region of at least one macroblock may include using an approximation different from the calculating one or more candidate motion vectors for each macroblock.

Abstract translation: 封闭了在视频编码器中执行运动估计的系统和方法。 该系统和方法包括为视频图像的每个宏块计算一个或多个候选运动矢量以形成候选运动矢量的列表，使用视频的至少一个宏块的子区域来计算第二个一个或多个候选运动矢量 图像以包括在候选运动矢量列表中，并且将所计算的第一宏块的候选运动矢量与所计算的第一宏块的至少一个子区域的候选运动矢量进行比较，以将估计的贡献提供给候选运动矢量的候选运动矢量 宏块。 使用至少一个宏块的子区域来计算第二个一个或多个候选运动矢量可以包括使用与为每个宏块计算一个或多个候选运动矢量不同的近似。