公开(公告)号：US20150317772A1

公开(公告)日：2015-11-05

申请号：US14796916

申请日：2015-07-10

Applicant: APPLE INC.

Inventor： Suk Hwan Lim ,  Mark Zimmer

IPC: G06T5/00 ,  G06T5/20

CPC classification number: G06T5/20 ,  G06T5/002 ,  G06T2207/10024

Abstract: Systems and methods for reducing chrominance (chroma) noise in image data are provided. In one example of such a method, image data in YCC format may be received into logic of an image signal processor. Using the logic, noise may be filtered from a first chrominance component or a second chrominance component, or both, of the image data, using a sparse filter and a noise threshold. The noise threshold may be determined based at least in part on two of the components of the YCC image data.

Abstract translation: 提供了降低图像数据中色度（色度）噪声的系统和方法。 在这种方法的一个示例中，YCC格式的图像数据可以被接收到图像信号处理器的逻辑中。 使用该逻辑，可以使用稀疏滤波器和噪声阈值从图像数据的第一色度分量或第二​​色度分量或两者中滤除噪声。 噪声阈值可以至少部分地基于YCC图像数据的两个分量来确定。

公开(公告)号：US20170345123A1

公开(公告)日：2017-11-30

申请号：US15629272

申请日：2017-06-21

Applicant: Apple Inc.

Inventor： John Harper ,  Ralph Brunner ,  Peter Graffagnino ,  Mark Zimmer

IPC: G06T1/20 ,  G06F15/76 ,  G06F15/80 ,  G09G5/02

CPC classification number: G06T1/20 ,  G06F15/76 ,  G06F15/80 ,  G09G5/02

Abstract: Disclosed is a system for producing images including techniques for reducing the memory and processing power required for such operations. The system provides techniques for programmatically representing a graphics problem. The system further provides techniques for reducing and optimizing graphics problems for rendering with consideration of the system resources, such as the availability of a compatible GPU.

公开(公告)号：US09619862B2

公开(公告)日：2017-04-11

申请号：US14726386

申请日：2015-05-29

Applicant: Apple Inc.

Inventor： Mark Zimmer

IPC: G06T3/40 ,  G06T5/00 ,  G06K9/40 ,  G06K9/46 ,  G09G5/02 ,  G09G5/28 ,  H04N5/21

CPC classification number: G06T3/4015 ,  G06T5/002 ,  G06T2207/10024 ,  G06T2207/20016 ,  G06T2207/20021 ,  H04N5/21

Abstract: This disclosure pertains to novel devices, methods, and computer readable media for performing raw camera noise reduction using a novel, so-called “alignment mapping” technique to more effectively separate structure from noise in an image, in order to aid in the denoising process. Alignment mapping allows for the extraction of more structure from the image and also the ability to understand the image structure, yielding information for edge direction, edge length, and corner locations within the image. This information can be used to smooth long edges properly and to prevent tight image details, e.g., text, from being overly smoothed. In alignment maps, the amount of noise may be used to compute thresholds and scaling parameters used in the preparation of the alignment map. According to some embodiments, a feature map may also be created for the image. Finally, the image may be smoothed using the created feature map as a mask.

公开(公告)号：US20150348244A1

公开(公告)日：2015-12-03

申请号：US14726356

申请日：2015-05-29

Applicant: Apple Inc.

Inventor： Mark Zimmer

IPC: G06T5/00 ,  G06T3/40

CPC classification number: G06T5/003 ,  G06T3/4015 ,  G06T5/20 ,  G06T2207/10024 ,  G06T2207/20012

Abstract: This disclosure pertains to novel devices, methods, and computer readable media for performing “blind” color defringing on images. In one embodiment, the blind defringing process begins with blind color edge alignment. This process largely cancels every kind of fringe, except for axial chromatic aberration. Next, the process looks at the edges and computes natural high and low colors to either side of the edge, attempting to get new pixel colors that aren't contaminated by the fringe color. Next, the process resolves the pixel's estimated new color by interpolating between the low and high colors, based on the green variation across the edge and the amount of green in the pixel that is being repaired. Care is taken to prevent artifacts in areas that generally do not fringe, like red-black boundaries and skin tone. Finally, the process computes the final repaired color by using luminance-scaling of the new pixel color estimate.

Abstract translation: 本公开涉及用于对图像执行“盲目”着色的新颖设备，方法和计算机可读介质。 在一个实施例中，盲目排除过程以盲色边缘对准开始。 除了轴向色差外，该过程大大抵消了各种边缘。 接下来，该过程查看边缘，并计算边缘任意一侧的自然高低颜色，尝试获取不受边缘颜色污染的新像素颜色。 接下来，该过程基于边缘上的绿色变化和正在修复的像素中的绿色量在低和高颜色之间进行内插来解决像素的估计新颜色。 注意防止通常不会流失的区域的伪像，如红黑色边界和肤色。 最后，该过程通过使用新的像素颜色估计的亮度调整来计算最终修复的颜色。

公开(公告)号：US20150106768A1

公开(公告)日：2015-04-16

申请号：US14571062

申请日：2014-12-15

Applicant: Apple Inc.

Inventor： Mark Zimmer ,  Geoff Stahl ,  David Hayward ,  Frank Doepke

IPC: G06F3/0481 ,  G06F3/01

CPC classification number: G06F3/04815 ,  G06F3/005 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/0488 ,  G06F2203/0381 ,  G06T15/20

Abstract: The techniques disclosed herein use a compass, MEMS accelerometer, GPS module, and MEMS gyrometer to infer a frame of reference for a hand-held device. This can provide a true Frenet frame, i.e., X- and Y-vectors for the display, and also a Z-vector that points perpendicularly to the display. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track the Frenet frame of the device in real time to provide a continuous 3D frame-of-reference. Once this continuous frame of reference is known, the position of a user's eyes may either be inferred or calculated directly by using a device's front-facing camera. With the position of the user's eyes and a continuous 3D frame-of-reference for the display, more realistic virtual 3D depictions of the objects on the device's display may be created and interacted with by the user.

Abstract translation: 本文公开的技术使用罗盘，MEMS加速度计，GPS模块和MEMS陀螺仪来推断用于手持设备的参考框架。 这可以提供真正的Frenet帧，即用于显示的X和Y向量，以及垂直于显示器指向的Z向量。 事实上，随着来自加速度计，陀螺仪和其他实时报告状态的仪器的各种惯性线索，可以实时跟踪设备的Frenet帧，以提供连续的3D参考帧。 一旦知道了这个连续的参考框架，用户的眼睛的位置可以通过使用设备的前置摄像机来直接推断或计算。 随着用户眼睛的位置和用于显示器的连续的3D参考框架，可以创建和显示设备显示器上的对象的更逼真的虚拟3D描绘，并由用户进行交互。

公开(公告)号：US09778815B2

公开(公告)日：2017-10-03

申请号：US15208771

申请日：2016-07-13

Applicant: Apple Inc.

Inventor： Ricardo Motta ,  Mark Zimmer ,  Geoff Stahl ,  David Hayward ,  Frank Doepke

IPC: G06T15/00 ,  G06F3/0481 ,  G06F3/01 ,  G06T15/20 ,  G06F3/0488 ,  G06F3/00

CPC classification number: G06F3/04815 ,  G06F3/005 ,  G06F3/012 ,  G06F3/013 ,  G06F3/0346 ,  G06F3/04883 ,  G06F2203/0381 ,  G06T15/20 ,  G06T2200/04 ,  G06T2200/24

Abstract: The techniques disclosed herein may use various sensors to infer a frame of reference for a hand-held device. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track a Frenet frame of the device in real time to provide an instantaneous (or continuous) 3D frame-of-reference. In addition to—or in place of—calculating this instantaneous (or continuous) frame of reference, the position of a user's head may either be inferred or calculated directly by using one or more of a device's optical sensors, e.g., an optical camera, infrared camera, laser, etc. With knowledge of the 3D frame-of-reference for the display and/or knowledge of the position of the user's head, more realistic virtual 3D depictions of the graphical objects on the device's display may be created—and interacted with—by the user.

公开(公告)号：US09417763B2

公开(公告)日：2016-08-16

申请号：US14571062

申请日：2014-12-15

Applicant: Apple Inc.

Inventor： Mark Zimmer ,  Geoff Stahl ,  David Hayward ,  Frank Doepke

IPC: G06T15/00 ,  G06F3/0481 ,  G06T15/20 ,  G06F3/0488 ,  G06F3/00 ,  G06F3/0346 ,  G06F3/01

CPC classification number: G06F3/04815 ,  G06F3/005 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/0488 ,  G06F2203/0381 ,  G06T15/20

Abstract: The techniques disclosed herein use a compass, MEMS accelerometer, GPS module, and MEMS gyrometer to infer a frame of reference for a hand-held device. This can provide a true Frenet frame, i.e., X- and Y-vectors for the display, and also a Z-vector that points perpendicularly to the display. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track the Frenet frame of the device in real time to provide a continuous 3D frame-of-reference. Once this continuous frame of reference is known, the position of a user's eyes may either be inferred or calculated directly by using a device's front-facing camera. With the position of the user's eyes and a continuous 3D frame-of-reference for the display, more realistic virtual 3D depictions of the objects on the device's display may be created and interacted with by the user.

Abstract translation: 本文公开的技术使用罗盘，MEMS加速度计，GPS模块和MEMS陀螺仪来推断用于手持设备的参考框架。 这可以提供真正的Frenet帧，即用于显示的X和Y向量，以及垂直于显示器指向的Z向量。 事实上，随着来自加速度计，陀螺仪和其他实时报告状态的仪器的各种惯性线索，可以实时跟踪设备的Frenet帧，以提供连续的3D参考帧。 一旦知道了这个连续的参考框架，用户的眼睛的位置可以通过使用设备的前置摄像机来直接推断或计算。 随着用户眼睛的位置和用于显示器的连续的3D参考框架，可以创建和显示设备显示器上的对象的更逼真的虚拟3D描绘，并由用户进行交互。

公开(公告)号：US20160189686A1

公开(公告)日：2016-06-30

申请号：US15064485

申请日：2016-03-08

Applicant: Apple Inc.

Inventor： Mark Zimmer ,  Ralph Brunner ,  Imran Chaudhri

IPC: G09G5/36 ,  G06T11/00 ,  G06F9/44 ,  G06T1/20

CPC classification number: G09G5/363 ,  G06F9/451 ,  G06T1/20 ,  G06T11/001 ,  G09G5/14

Abstract: Disclosed are a system and method for computing a picture. Instead of loading a file that contains the image from memory, the present invention provides for a system and method for opening and retaining a procedural recipe and a small set of instructions that can be executed to compute a picture. The picture can be computed very quickly using a GPU (graphics processing unit), and can be made to move on demand. When a part of the image is needed to composite, that part is computed using a fragment program on the GPU using the procedural recipe and a specially written fragment program into a temporary VRAM buffer. After it is computed and composited, the buffer containing the result of the fragment program may be discarded.

Abstract translation: 公开了一种用于计算图像的系统和方法。 本发明不是加载来自存储器的包含图像的文件，而是提供了用于打开和保留程序配方的系统和方法以及可以执行以计算图片的一小组指令。 可以使用GPU（图形处理单元）非常快速地计算图像，并且可以根据需要进行移动。 当图像的一部分需要复合时，该部分使用GPU上的片段程序使用过程配方和特殊写入的片段程序计算到临时VRAM缓冲区中。 在计算和合成之后，可能会丢弃包含片段程序结果的缓冲区。

公开(公告)号：US09292944B2

公开(公告)日：2016-03-22

申请号：US14305523

申请日：2014-06-16

Applicant: Apple Inc.

Inventor： Mark Zimmer ,  Ralph Brunner ,  Imran Chaudhri

IPC: G06T11/00 ,  G06F9/44 ,  G09G5/36 ,  G09G5/14

CPC classification number: G09G5/363 ,  G06F9/451 ,  G06T1/20 ,  G06T11/001 ,  G09G5/14

Abstract: Disclosed are a system and method for computing a picture. Instead of loading a file that contains the image from memory, the present invention provides for a system and method for opening and retaining a procedural recipe and a small set of instructions that can be executed to compute a picture. The picture can be computed very quickly using a GPU (graphics processing unit), and can be made to move on demand. When a part of the image is needed to composite, that part is computed using a fragment program on the GPU using the procedural recipe and a specially written fragment program into a temporary VRAM buffer. After it is computed and composited, the buffer containing the result of the fragment program may be discarded.

Abstract translation: 公开了一种用于计算图像的系统和方法。 本发明不是加载来自存储器的包含图像的文件，而是提供了用于打开和保留程序配方的系统和方法以及可以执行以计算图片的一小组指令。 可以使用GPU（图形处理单元）非常快速地计算图像，并且可以根据需要进行移动。 当图像的一部分需要复合时，该部分使用GPU上的片段程序使用过程配方和特殊写入的片段程序计算到临时VRAM缓冲区中。 在计算和合成之后，可能会丢弃包含片段程序结果的缓冲区。

公开(公告)号：US20150009130A1

公开(公告)日：2015-01-08

申请号：US14329777

申请日：2014-07-11

Applicant: Apple Inc.

Inventor： Ricardo Motta ,  Mark Zimmer ,  Geoff Stahl ,  David Hayward ,  Frank Doepke

IPC: G06F3/01 ,  G06T15/20

CPC classification number: G06F3/04815 ,  G06F3/005 ,  G06F3/012 ,  G06F3/013 ,  G06F3/0346 ,  G06F3/04883 ,  G06F2203/0381 ,  G06T15/20 ,  G06T2200/04 ,  G06T2200/24

Abstract: The techniques disclosed herein may use various sensors to infer a frame of reference for a hand-held device. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track a Frenet frame of the device in real time to provide an instantaneous (or continuous) 3D frame-of-reference. In addition to—or in place of—calculating this instantaneous (or continuous) frame of reference, the position of a user's head may either be inferred or calculated directly by using one or more of a device's optical sensors, e.g., an optical camera, infrared camera, laser, etc. With knowledge of the 3D frame-of-reference for the display and/or knowledge of the position of the user's head, more realistic virtual 3D depictions of the graphical objects on the device's display may be created—and interacted with—by the user.

Abstract translation: 本文公开的技术可以使用各种传感器来推断用于手持设备的参考帧。 事实上，由于来自加速度计，陀螺仪和其他实时报告其状态的仪器的各种惯性线索，可以实时跟踪设备的Frenet帧，以提供瞬时（或连续）3D帧 - 参考。 除了或代替计算这个瞬时（或连续的）参照系，用户头部的位置可以通过使用设备的一个或多个光学传感器（例如，光学摄像机）来直接推断或计算， 红外摄像机，激光器等。通过了解用于显示和/或用户头部位置的知识的3D参考框架，可以创建设备显示器上的图形对象的更逼真的虚拟3D描绘，以及 与用户进行交互。