公开(公告)号：US20160357532A1

公开(公告)日：2016-12-08

申请号：US15081451

申请日：2016-03-25

Applicant: Apple Inc.

Inventor： Jacques P. Gasselin de Richebourg ,  Domenico P. Porcino ,  Timothy R. Oriol

IPC: G06F9/45 ,  G06T1/20 ,  G06T15/80

Abstract: The disclosure pertains to the operation of graphics systems and to a variety of architectures for design and/or operation of a graphics system spanning from the output of an application program and extending to the presentation of visual content in the form of pixels or otherwise. In general, many embodiments of the invention envision the processing of graphics programming according to an on-the-fly decision made regarding how best to use the specific available hardware and software. In some embodiments, a software arrangement may be used to evaluate the specific system hardware and software capabilities, then make a decision regarding what is the best graphics programming path to follow for any particular graphics request. The decision regarding the best path may be made after evaluating the hardware and software alternatives for the path in view of the particulars of the graphics program to be processed.

Abstract translation: 本公开涉及图形系统的操作以及用于从应用程序的输出跨越到以像素或其他形式呈现视觉内容的图形系统的设计和/或操作的各种架构。 通常，本发明的许多实施例根据关于如何最好地使用特定的可用硬件和软件的即时决定来设想图形编程的处理。 在一些实施例中，可以使用软件布置来评估特定的系统硬件和软件能力，然后作出关于什么是用于任何特定图形请求的最佳图形编程路径的决定。 考虑到要处理的图形程序的细节，可以在评估路径的硬件和软件替代方案之后做出关于最佳路径的决定。

公开(公告)号：US09245358B2

公开(公告)日：2016-01-26

申请号：US14292731

申请日：2014-05-30

Applicant: Apple Inc.

Inventor： Norman N. Wang ,  Timothy R. Oriol ,  Jacques P. Gasselin de Richebourg ,  Domenico P. Porcino

IPC: G09G5/00 ,  G06T11/00 ,  G09G5/02 ,  G06T5/00 ,  G06T3/40

CPC classification number: G06T11/001 ,  G06T3/40 ,  G06T5/002 ,  G06T5/003 ,  G06T15/04 ,  G06T15/503 ,  G09G5/026

Abstract: Systems, methods and program storage devices are disclosed, which comprise instructions to cause one or more processing units to dynamically generate refined normal maps for 2D texture maps, e.g., supplied by a programmer or artist. Generally speaking, there are two pertinent properties to keep in balance when generating normal vectors comprising a normal map: “smoothness” and “bumpiness.” The smoothness of the normal vectors is influenced by how many neighboring pixels are involved in the “smoothening” calculation. Incorporating the influence of a greater number of neighboring pixels' values reduces the overall bumpiness of the normal map, as each pixel's value takes weight from those neighboring pixels. Thus, the techniques described herein iteratively: downsample height maps; generate normal maps; scale the normal maps to maintain bumpiness; and blend the generated scaled normal maps with generated normal maps from previous iterations—until the smoothness of the resultant normal map has reached desired levels.

Abstract translation: 公开了系统，方法和程序存储设备，其包括使一个或多个处理单元动态地生成2D纹理贴图的精细法线贴图的指令，例如由程序员或艺术家提供。 一般来说，当产生包含法线贴图的法向矢量时，有两个相关的属性保持平衡：“平滑度”和“颠簸”。法向矢量的平滑度受“平滑”计算中涉及的相邻像素数量的影响 。 结合更多数量的相邻像素值的影响可减少法线贴图的整体颠簸，因为每个像素的值从这些相邻像素获取权重。 因此，本文描述的技术迭代地：下采样高度图; 生成法线贴图; 缩放法线贴图以保持颠簸; 并将生成的缩放法线图与先前迭代中生成的法线贴图混合，直到得到的法线贴图的平滑度达到期望水平。

公开(公告)号：US20150348511A1

公开(公告)日：2015-12-03

申请号：US14291464

申请日：2014-05-30

Applicant: Apple Inc.

Inventor： Timothy R. Oriol ,  Norman N. Wang ,  Domenico P. Porcino ,  Jacques P. Gasselin de Richebourg

IPC: G09G5/36 ,  G06F3/01

CPC classification number: G06F3/01 ,  G06F1/1694 ,  G06F1/3265 ,  G06F3/011 ,  G09G5/003 ,  G09G2320/0261 ,  G09G2320/103 ,  G09G2330/021 ,  G09G2330/022 ,  G09G2340/0435 ,  G09G2356/00 ,  H04N5/23241

Abstract: The refresh rate of a display of a portable display device is dependent on the degree of device motion detected by one or more motion sensors included in the portable display device, according to an embodiment of the invention. In an embodiment, when no device motion is detected by the one or more sensors, the display of the portable display device is refreshed at an initial refresh rate. When the one or more motion sensors detects a degree of device motion above a motion threshold, the refresh rate of the display is decreased to a motion-based refresh rate, according to an embodiment. In an embodiment, the degree of motion of moving content on the display is also taken into account when determining the display refresh rate.

Abstract translation: 根据本发明的实施例，便携式显示设备的显示器的刷新率取决于由便携式显示设备中包括的一个或多个运动传感器检测到的设备运动的程度。 在一个实施例中，当一个或多个传感器没有检测到装置运动时，以初始刷新率刷新便携式显示装置的显示。 当一个或多个运动传感器检测到高于运动阈值的装置运动程度时，根据实施例，显示器的刷新率被降低到基于运动的刷新率。 在一个实施例中，当确定显示刷新率时也考虑移动内容在显示器上的运动程度。

公开(公告)号：US20150348316A1

公开(公告)日：2015-12-03

申请号：US14292761

申请日：2014-05-30

Applicant: APPLE INC.

Inventor： Domenico P. Porcino ,  Timothy R. Oriol ,  Norman N. Wang ,  Jacques P. Gasselin de Richebourg

IPC: G06T15/80 ,  G06T1/20 ,  G06T13/20 ,  G06T7/40 ,  G06K9/46

CPC classification number: G06T1/20 ,  G06K9/2027 ,  G06K9/4661 ,  G06T7/40 ,  G06T15/04

Abstract: Systems, methods and program storage devices are disclosed, which cause one or more processing units to: obtain one or more two-dimensional components and one or more three-dimensional components; convert the pixel color values of the two-dimensional components into luminance values; create height maps over the two-dimensional components using the converted luminance values; calculate a normal vector for each pixel in each of two-dimensional components; and cause one or more processing units to render three-dimensional lighting effects on the one or more two-dimensional components and one or more three-dimensional components in a mixed scene, wherein the calculated normal vectors are used as the normal maps for the two-dimensional components, the pixel color values are used as the texture maps for the two-dimensional components, and the one or more three-dimensional components are rendered in the scene according their respective depth values, textures, and/or vertices—along with the one or more two-dimensional components.

Abstract translation: 公开了一种系统，方法和程序存储设备，其使一个或多个处理单元获得一个或多个二维分量和一个或多个三维分量; 将二维分量的像素颜色值转换为亮度值; 使用转换的亮度值在二维分量上创建高度图; 为每个二维分量中的每个像素计算法向量; 并且使一个或多个处理单元对混合场景中的一个或多个二维分量和一个或多个三维分量呈现三维照明效果，其中所计算的法向量用作两者的法线图 将像素颜色值用作二维分量的纹理图，并且根据其各自的深度值，纹理和/或顶点在场景中呈现一个或多个三维分量，以及 一个或多个二维组件。

公开(公告)号：US20140184606A1

公开(公告)日：2014-07-03

申请号：US14063970

申请日：2013-10-25

Applicant: Apple Inc.

Inventor： Jacques P. Gasselin de Richebourg ,  Norman N. Wang ,  Timothy R. Oriol ,  Geoffrey G. Stahl

IPC: G06T11/20

CPC classification number: G06T1/20 ,  G06T1/60 ,  G06T13/80 ,  G06T15/005 ,  G06T15/04 ,  G06T2210/61

Abstract: A set of tools, in the form of a software developers kit (SDK) for a graphics rendering system, is provided to improve overall graphics operations. In general, the tools are directed to analyzing a scene tree and optimizing its presentation to one or more graphics processing units (GPUs) so as to improve rendering operations. This overall goal is provided through a number of different capabilities, each of which is presented to software developers through a new applications programming interface (API).

Abstract translation: 提供了一套用于图形渲染系统的软件开发工具包（SDK）的工具，以改善整体图形操作。 通常，这些工具旨在分析场景树并将其呈现优化到一个或多个图形处理单元（GPU），以便改进渲染操作。 这个总体目标是通过许多不同的功能提供的，每个功能都通过新的应用程序编程接口（API）提供给软件开发人员。

公开(公告)号：US12010155B2

公开(公告)日：2024-06-11

申请号：US17224077

申请日：2021-04-06

Applicant: Apple Inc.

Inventor： Geoffrey Stahl ,  Jeffrey S. Norris ,  Timothy R. Oriol ,  Joel N. Kerr ,  Srinivas Vedula ,  Bruno Sommer

IPC: G06F15/16 ,  H04L65/401 ,  H04L65/403

CPC classification number: H04L65/401 ,  H04L65/403

Abstract: A device for providing operating system managed group communication sessions may include a memory and at least one processor. The at least one processor may be configured to receive, by an operating system level process executing on a device and from an application process executing on a device, a request to initiate a group session between a user associated with the device and another user. The at least one processor may be further configured to identify, by the operating system level process, another device associated with the other user. The at least one processor may be further configured to initiate, by the operating system level process, the group session with the user via the other device. The at least one processor may be further configured to manage, by the operating system level process, the group session.

公开(公告)号：US20230350538A1

公开(公告)日：2023-11-02

申请号：US18217711

申请日：2023-07-03

Applicant: Apple Inc.

Inventor： Edwin Iskandar ,  Ittinop Dumnernchanvanit ,  Samuel L. Iglesias ,  Timothy R. Oriol

IPC: G06F3/04815 ,  G06F3/01 ,  G06F3/04842 ,  G06F3/16 ,  G06F3/04845

CPC classification number: G06F3/04815 ,  G06F3/017 ,  G06F3/04842 ,  G06F3/167 ,  G06F3/04845 ,  G06F3/013

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide a CGR environment in which virtual objects from one or more apps are included. User interactions with the virtual objects are detected and interpreted by a system that is separate from the apps that provide the virtual objects. The system detects user interactions received via one or more input modalities and interprets those user interactions as events. These events provide a higher-level, input modality-independent, abstractions of the lower-level input-modality dependent user interactions that are detected. The system uses UI capability data provided by the apps to interpret user interactions with respect to the virtual object provided by the apps. For example, the UI capability data can identify whether a virtual object is moveable, actionable, hover-able, etc. and the system interprets user interactions at or near the virtual object accordingly.

公开(公告)号：US11733824B2

公开(公告)日：2023-08-22

申请号：US16440048

申请日：2019-06-13

Applicant: Apple Inc.

Inventor： Edwin Iskandar ,  Ittinop Dumnernchanvanit ,  Samuel L. Iglesias ,  Timothy R. Oriol

IPC: G06F3/04815 ,  G06F3/01 ,  G06F3/04842 ,  G06F3/16 ,  G06F3/04845

CPC classification number: G06F3/04815 ,  G06F3/013 ,  G06F3/017 ,  G06F3/04842 ,  G06F3/04845 ,  G06F3/167

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide a CGR environment in which virtual objects from one or more apps are included. User interactions with the virtual objects are detected and interpreted by a system that is separate from the apps that provide the virtual objects. The system detects user interactions received via one or more input modalities and interprets those user interactions as events. These events provide a higher-level, input modality-independent, abstractions of the lower-level input-modality dependent user interactions that are detected. The system uses UI capability data provided by the apps to interpret user interactions with respect to the virtual object provided by the apps. For example, the UI capability data can identify whether a virtual object is moveable, actionable, hover-able, etc. and the system interprets user interactions at or near the virtual object accordingly.

公开(公告)号：US11714592B2

公开(公告)日：2023-08-01

申请号：US17486646

申请日：2021-09-27

Applicant: Apple Inc.

Inventor： Avi Bar-Zeev ,  Ryan S. Burgoyne ,  Devin W. Chalmers ,  Luis R. Deliz Centeno ,  Rahul Nair ,  Timothy R. Oriol ,  Alexis H. Palangie

IPC: G06F3/048 ,  G06F3/14 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20

CPC classification number: G06F3/1423 ,  G02B27/0093 ,  G02B27/017 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/04815 ,  G06F3/04842 ,  G06T7/74 ,  G06T19/006 ,  G06V20/20 ,  G06V40/20 ,  H04B5/0025 ,  G02B2027/0187

Abstract: In an exemplary process for interacting with user interface objects using an eye gaze, an affordance associated with a first object is displayed. A gaze direction or a gaze depth is determined. While the gaze direction or the gaze depth is determined to correspond to a gaze at the affordance, a first input representing user instruction to take action on the affordance is received, and the affordance is selected responsive to receiving the first input.

公开(公告)号：US11348316B2

公开(公告)日：2022-05-31

申请号：US16549483

申请日：2019-08-23

Applicant: Apple Inc.

Inventor： Aaron M. Burns ,  Bruno M. Sommer ,  Timothy R. Oriol

IPC: G06T19/00 ,  G06T19/20 ,  G02B27/01

Abstract: Various implementations disclosed herein include devices, systems, and methods that enable a device to provide a view of virtual elements and a physical environment where the presentation of the virtual elements is based on positioning relative to the physical environment. In one example, a device is configured to detect a change in positioning of a virtual element, for example, when a virtual element is added, moved, or the physical environment around the virtual element is changed. The location of the virtual element in the physical environment is used to detect an attribute of the physical environment upon which the presentation of the virtual element depends. Thus, the device is further configured to detect an attribute (e.g., surface, table, mid-air, etc.) of the physical environment based on the placement of the virtual element and present the virtual element based on the detected attribute.