公开(公告)号：US20240211279A1

公开(公告)日：2024-06-27

申请号：US18411363

申请日：2024-01-12

Applicant: Apple Inc.

Inventor： Helmut GARSTENAUER ,  Martin GARSTENAUER ,  Edwin ISKANDAR ,  Timothy R. ORIOL ,  Geoffrey STAHL ,  Cody J. WHITE

IPC: G06F9/451 ,  G06F3/01 ,  G06T19/00

CPC classification number: G06F9/451 ,  G06F3/011 ,  G06T19/006

Abstract: The present disclosure relates to providing a computer-generated reality (CGR) platform for generating CGR environments including virtual and augmented reality environments. In some embodiments, information related to an object to be simulated and rendered in the CGR environment is provided to the CGR platform, and a three-dimensional representation of the object is displayed in the CGR environment.

公开(公告)号：US20230325140A1

公开(公告)日：2023-10-12

申请号：US18209931

申请日：2023-06-14

Applicant: Apple Inc.

Inventor： Avi BAR-ZEEV ,  Ryan S. BURGOYNE ,  Devin W. CHALMERS ,  Luis R. DELIZ CENTENO ,  Rahul NAIR ,  Timothy R. ORIOL ,  Alexis H. PALANGIE

IPC: G06F3/14 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20

CPC classification number: G06F3/1423 ,  G06T19/006 ,  H04B5/0025 ,  G06T7/74 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G02B27/0093 ,  G02B27/017 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20 ,  G02B2027/0187

Abstract: In an exemplary process for interacting with user interface objects using an eye gaze, a placement point for a selected object is designated at a first position based on a gaze position. In response to a user input, the placement point is moved to a second position that is not based on the gaze position, and the object is placed at the second position.

公开(公告)号：US20220092847A1

公开(公告)日：2022-03-24

申请号：US17540138

申请日：2021-12-01

Applicant: Apple Inc.

Inventor： Timothy R. ORIOL ,  Peter L. HAJAS ,  Daniel T. KURTZ ,  Edwin ISKANDAR ,  Charles MAGAHERN ,  Jeremy G. BRIDON ,  Naveen K. VEMURI

IPC: G06T15/20 ,  G06T11/60 ,  G06T17/00 ,  G06T5/00 ,  H04N13/261

Abstract: A device implementing a system for managing multi-modal rendering of application content includes at least one processor configured to receive content, provided by an application running on a device, for display. The at least one processor is further configured to determine that the content corresponds to two-dimensional content. The at least one processor is further configured to identify a portion of the two-dimensional content for enhancement by a three-dimensional render. The at least one processor is further configured to enhance, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer. The at least one processor is further configured to provide for display of the enhanced portion of the two-dimensional content on a display of the device.

公开(公告)号：US20230394170A1

公开(公告)日：2023-12-07

申请号：US18234583

申请日：2023-08-16

Applicant: Apple Inc.

Inventor： Clément Pierre Nicolas BOISSIÈRE ,  Timothy R. ORIOL

IPC: G06F21/62 ,  G06F3/14 ,  G09G5/38

CPC classification number: G06F21/6245 ,  G06F3/1423 ,  G09G5/38 ,  G09G2354/00

Abstract: A first device coupled with a first display and an image sensor receives output data from a second device having a second display different from the first display. The output data represents content displayable by the second device on the second display. The first device determines, using the image sensor, a position of the second display relative to the first device and causes the first display to display content based on the output data received from the second device and the determined position of the second display relative to the first device.

公开(公告)号：US20220113926A1

公开(公告)日：2022-04-14

申请号：US17561043

申请日：2021-12-23

Applicant: Apple Inc.

Inventor： Clément Pierre Nicolas BOISSIÈRE ,  Timothy R. ORIOL

IPC: G06F3/14 ,  G06V20/00 ,  G09G5/38

Abstract: A first device coupled with a first display and an image sensor receives output data from a second device having a second display different from the first display. The output data represents content displayable by the second device on the second display. The first device determines, using the image sensor, a position of the second display relative to the first device and causes the first display to display content based on the output data received from the second device and the determined position of the second display relative to the first device.

公开(公告)号：US20200225901A1

公开(公告)日：2020-07-16

申请号：US16833230

申请日：2020-03-27

Applicant: Apple Inc.

Inventor： Clément Pierre Nicolas BOISSIÈRE ,  Timothy R. ORIOL

IPC: G06F3/14 ,  G09G5/38 ,  G06K9/00

Abstract: A first device coupled with a first display and an image sensor receives output data from a second device having a second display different from the first display. The output data represents content displayable by the second device on the second display. The first device determines, using the image sensor, a position of the second display relative to the first device and causes the first display to display content based on the output data received from the second device and the determined position of the second display relative to the first device.

公开(公告)号：US20220269338A1

公开(公告)日：2022-08-25

申请号：US17742674

申请日：2022-05-12

Applicant: APPLE INC.

Inventor： Adam M. O'HERN ,  Eddie G. MENDOZA ,  Mohamed Selim BEN HIMANE ,  Timothy R. ORIOL

IPC: G06F3/01 ,  G06F3/0354 ,  G06F3/04815 ,  G06F3/04886 ,  G06F3/0489

Abstract: Implementations use a first device (e.g., an HMD) to provide a CGR environment that augments the input and output capabilities of a second device, e.g., a laptop, smart speaker, etc. In some implementations, the first device communicates with a second device in its proximate physical environment to exchange input or output data. For example, an HMD may capture an image of a physical environment that includes a laptop. The HMD may detect the laptop, send a request the laptop's content, receive content from the laptop (e.g., the content that the laptop is currently displaying and additional content), identify the location of the laptop, and display a virtual object with the received content in the CGR environment on or near the laptop. The size, shape, orientation, or position of the virtual object (e.g., a virtual monitor or monitor extension) may also be configured to provide a better user experience.

公开(公告)号：US20210065436A1

公开(公告)日：2021-03-04

申请号：US17010762

申请日：2020-09-02

Applicant: Apple Inc.

Inventor： Timothy R. ORIOL ,  Peter L. HAJAS ,  Daniel T. KURTZ ,  Edwin ISKANDAR ,  Charles MAGAHERN ,  Jeremy G. BRIDON ,  Naveen K. VEMURI

IPC: G06T15/20 ,  G06T11/60 ,  G06T17/00 ,  G06T5/00 ,  H04N13/261

Abstract: A device implementing a system for managing multi-modal rendering of application content includes at least one processor configured to receive content, provided by an application running on a device, for displaying in a three-dimensional display mode. The at least one processor is further configured to determine that the content corresponds to two-dimensional content. The at least one processor is further configured to identify a portion of the two-dimensional content for enhancement by a three-dimensional render. The at least one processor is further configured to enhance, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer. The at least one processor is further configured to provide for display of the enhanced portion of the two-dimensional content on a display of the device in the three-dimensional display mode.

公开(公告)号：US20230206912A1

公开(公告)日：2023-06-29

申请号：US18114877

申请日：2023-02-27

Applicant: Apple Inc.

Inventor： Kurt W. PIERSOL ,  Cedric BRAY ,  Keith S. BRISSON ,  Helmut GARSTENAUER ,  Timothy R. ORIOL ,  Jessica J. PECK ,  Lewis N. PERKINS ,  Luca SIMONELLI ,  Nathan D. TAYLOR

IPC: G10L15/18 ,  G10L15/22 ,  G10L15/06 ,  G06F3/16

CPC classification number: G10L15/1822 ,  G10L15/22 ,  G10L15/063 ,  G06F3/167 ,  G10L2015/223

Abstract: Systems and processes for operating a digital assistant are provided. An example method includes, at an electronic device with one or more processors and memory, while an application is open on the electronic device: receiving a spoken input including a command, determining whether the command matches at least a portion of a metadata associated with an action of the application, and in accordance with a determination that the command matches at least the portion of the metadata associated with the action of the application, associating the command with the action, storing the association of the command with the action for subsequent use with the application by the digital assistant, and executing the action with the application.

公开(公告)号：US20220318035A1

公开(公告)日：2022-10-06

申请号：US17845708

申请日：2022-06-21

Applicant: Apple Inc.

Inventor： Helmut GARSTENAUER ,  Martin GARSTENAUER ,  Edwin ISKANDAR ,  Timothy R. ORIOL ,  Geoffrey STAHL ,  Cody J. WHITE

IPC: G06F9/451 ,  G06F3/01 ,  G06T19/00

Abstract: The present disclosure relates to providing a computer-generated reality (CGR) platform for generating CGR environments including virtual and augmented reality environments. In some embodiments, information related to an object to be simulated and rendered in the CGR environment is provided to the CGR platform, and a three-dimensional representation of the object is displayed in the CGR environment.