公开(公告)号：US20230401795A1

公开(公告)日：2023-12-14

申请号：US18202849

申请日：2023-05-26

Applicant: Apple Inc.

Inventor： Lynn I. STREJA ,  Saurabh ADYA ,  Keith P. AVERY ,  Karan M. DARYANANI ,  Stephen O. LEMAY ,  Myra C. LUKENS ,  Sreeneel K. MADDIKA ,  Chaitanya MANNEMALA ,  Aswath MANOHARAN ,  Pedro MARI ,  Jay MOON ,  Abhishek RAWAT ,  Garrett L. WEINBERG

IPC: G06T19/00 ,  G06T13/40 ,  G10L15/22 ,  G06F3/01

CPC classification number: G06T19/003 ,  G06T13/40 ,  G10L15/22 ,  G06F3/013 ,  G06F3/017 ,  G06T2219/2012 ,  G06T2219/2016 ,  G06T2219/2021 ,  G10L2015/223

Abstract: An example process includes: while displaying a portion of an extended reality (XR) environment representing a current field of view of a user: detecting a user gaze at a first object displayed in the XR environment, where the first object is persistent in the current field of view of the XR environment; in response to detecting the user gaze at the first object, expanding the first object into a list of objects including a second object representing a digital assistant; detecting a user gaze at the second object; in accordance with detecting the user gaze at the second object, displaying a first animation of the second object indicating that a digital assistant session is initiated; receiving a first audio input from the user; and displaying a second animation of the second object indicating that the digital assistant is actively listening to the user.

公开(公告)号：US20210027199A1

公开(公告)日：2021-01-28

申请号：US16937479

申请日：2020-07-23

Applicant: Apple Inc.

Inventor： Keith P. AVERY ,  Jamil DHANANI ,  Harveen KAUR ,  Varun MAUDGALYA ,  Timothy S. PAEK ,  Dmytro RUDCHENKO ,  Brandt M. WESTING ,  Minwoo JEONG

IPC: G06N20/00 ,  G06F3/01 ,  G06F3/0488 ,  H04R3/04

Abstract: The subject technology receives, from a first sensor of a device, first sensor output of a first type. The subject technology receives, from a second sensor of the device, second sensor output of a second type, the first and second sensors being non-touch sensors. The subject technology provides the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted touch-based gesture based on sensor output of the first type and sensor output of the second type. The subject technology provides a predicted touch-based gesture based on output from the machine learning model. Further, the subject technology adjusts an audio output level of the device based on the predicted gesture, and where the device is an audio output device.

公开(公告)号：US20230401486A1

公开(公告)日：2023-12-14

申请号：US18203635

申请日：2023-05-30

Applicant: Apple Inc.

Inventor： Keith P. AVERY ,  Jamil DHANANI ,  Harveen KAUR ,  Varun MAUDGALYA ,  Timothy S. PAEK ,  Dmytro RUDCHENKO ,  Brandt M. WESTING ,  Minwoo JEONG

IPC: G06N20/00 ,  G06F3/01 ,  G06F3/04883 ,  H04R3/04

CPC classification number: G06N20/00 ,  G06F3/011 ,  G06F3/017 ,  G06F3/04883 ,  H04R3/04 ,  G06N3/08

Abstract: The subject technology receives, from a first sensor of a device, first sensor output of a first type. The subject technology receives, from a second sensor of the device, second sensor output of a second type, the first and second sensors being non-touch sensors. The subject technology provides the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted touch-based gesture based on sensor output of the first type and sensor output of the second type. The subject technology provides a predicted touch-based gesture based on output from the machine learning model. Further, the subject technology adjusts an audio output level of the device based on the predicted gesture, and where the device is an audio output device.

公开(公告)号：US20220083211A1

公开(公告)日：2022-03-17

申请号：US17167896

申请日：2021-02-04

Applicant: Apple Inc.

Inventor： John NEFULDA ,  Keith P. AVERY ,  Madhusudan CHINTHAKUNTA ,  Christopher B. FLEIZACH ,  Varun MAUDGALYA ,  Sommer Elizabeth PANAGE

IPC: G06F3/0484 ,  H04M1/72466 ,  G06F3/01 ,  G06F3/0482

Abstract: The present disclosure generally relates to assigning tasks to various user inputs, and detecting and responding to user inputs.

公开(公告)号：US20200379740A1

公开(公告)日：2020-12-03

申请号：US16583191

申请日：2019-09-25

Applicant: Apple Inc.

Inventor： Timothy S. PAEK ,  Francesco ROSSI ,  Jamil DHANANI ,  Keith P. AVERY ,  Minwoo JEONG ,  Xiaojin SHI ,  Harveen KAUR ,  Brandt M. WESTING

IPC: G06F8/41 ,  G06N3/04 ,  G06N3/08 ,  G06F8/60

Abstract: The subject technology receives a neural network model in a model format, the model format including information for a set of layers of the neural network model, each layer of the set of layers including a set of respective operations. The subject technology generates neural network (NN) code from the neural network model, the NN code being in a programming language distinct from the model format, and the NN code comprising a respective memory allocation for each respective layer of the set of layers of the neural network model, where the generating comprises determining the respective memory allocation for each respective layer based at least in part on a resource constraint of a target device. The subject technology compiles the NN code into a binary format. The subject technology generates a package for deploying the compiled NN code on the target device.