公开(公告)号：US12131097B2

公开(公告)日：2024-10-29

申请号：US18134527

申请日：2023-04-13

Applicant: Apple Inc.

Inventor： Stuart John Wood ,  Martin E. Johnson ,  Darius A. Satongar

IPC: G06F3/048 ,  G06F3/0481 ,  G06F3/0486 ,  G06F3/04883 ,  G06F3/16 ,  H04S1/00 ,  H04S7/00

CPC classification number: G06F3/165 ,  G06F3/0481 ,  G06F3/0486 ,  G06F3/04883 ,  H04S1/007 ,  H04S7/302

Abstract: The present disclosure generally relates to user interfaces for managing spatial audio. Some exemplary techniques include user interfaces for transitioning between visual elements. Some exemplary techniques include user interfaces for previewing audio. Some exemplary techniques include user interfaces for discovering music. Some exemplary techniques include user interfaces for managing headphone transparency. Some exemplary techniques include user interfaces for manipulating multiple audio streams of an audio source.

公开(公告)号：US20240073638A1

公开(公告)日：2024-02-29

申请号：US18497933

申请日：2023-10-30

Applicant: Apple Inc.

Inventor： Jonathan D. Sheaffer ,  Daniel K. Boothe ,  Martin E. Johnson ,  Neal D. Evans ,  Nikolas T. Vitt ,  Christopher T. Eubank ,  Peter V. Jupin ,  Symeon Delikaris Manias ,  Shai Messingher Lang

IPC: H04S7/00 ,  H04R1/10 ,  H04R1/40 ,  H04R29/00

CPC classification number: H04S7/301 ,  H04R1/1008 ,  H04R1/403 ,  H04R1/406 ,  H04R29/005 ,  H04S2400/01 ,  H04S2420/01

Abstract: A method for self-calibrating a sound pickup process that uses a microphone array in a wearable device that also includes a loudspeaker, where the microphone array being in a physical arrangement with respect to the loudspeaker. The method obtains, for each of several microphones of the microphone array, one or more transfer functions that each represent a response of the microphone to sound from a position in an acoustic space. The method determines whether a physical arrangement of the microphone array with respect to the loudspeaker has changed and adjusts the transfer function, for at least one of the microphones of the several microphones, in response to determining that the current physical arrangement of the microphone array with respect to the loudspeaker has changed.

公开(公告)号：US20230410458A1

公开(公告)日：2023-12-21

申请号：US18211518

申请日：2023-06-19

Applicant: Apple Inc.

Inventor： Brett D. Miller ,  Daniel K. Boothe ,  Martin E. Johnson

IPC: G06V10/26 ,  G06V10/764 ,  G06V10/82 ,  G06F3/16

CPC classification number: G06V10/26 ,  G06V10/764 ,  G06V10/82 ,  G06F3/167

Abstract: In one implementation, a method of detecting an occlusion of an image sensor is performed at a device including one or more image sensors, one or more speakers, one or more processors, and non-transitory memory. The method includes receiving, from the one or more image sensors, an image of a physical environment. The method includes detecting, based on the image of the physical environment, an occlusion at least partially occluding the one or more image sensors. The method includes classifying the occlusion as one of a plurality of occlusion types. The method includes playing, via the one or more speakers, an occlusion notification based on the classification.

公开(公告)号：US20230410348A1

公开(公告)日：2023-12-21

申请号：US18211513

申请日：2023-06-19

Applicant: Apple Inc.

Inventor： Brett D. Miller ,  Daniel K. Boothe ,  Martin E. Johnson

IPC: G06T7/70 ,  G06T7/20 ,  G06F3/01 ,  G06F3/16 ,  H04S7/00 ,  H04R5/033

CPC classification number: G06T7/70 ,  G06T7/20 ,  G06F3/013 ,  G06F3/167 ,  H04S7/304 ,  H04R5/033 ,  H04S2400/11

Abstract: In one implementation, a method of playing an audio notification is performed at a device including one or more image sensors, one or more speakers, one or more processors, and non-transitory memory. The method includes receiving, from the one or more image sensors, an image of a physical environment having a device field-of-view different than a user field-of-view. The method includes detecting, in the image of the physical environment, an object at a location in the physical environment. The method includes determining that the location in the physical environment is outside an area of the user field-of-view. The method includes, in response to determining that the location in the physical environment is outside the area of the user field-of-view, playing, via the speaker, an audio notification of the detection.

公开(公告)号：US11640275B2

公开(公告)日：2023-05-02

申请号：US17369374

申请日：2021-07-07

Applicant: Apple Inc.

Inventor： Aleksandar Pance ,  Brett Bilbrey ,  Darby E. Hadley ,  Martin E. Johnson ,  Ronald Nadim Isaac

IPC: H04N7/15 ,  G06F3/16 ,  H04N21/422 ,  H04N21/439 ,  H04N21/442 ,  H04N21/4143 ,  H04N21/4223 ,  H04S7/00 ,  G06F3/0484 ,  G10L17/00 ,  H04N5/232 ,  H04R3/04 ,  H04R29/00 ,  H04N5/60 ,  H04N7/14 ,  H04N21/45 ,  H04N21/485

Abstract: A system for enhancing audio including a plurality of sensors, an output device, and a processor in communication with the plurality of sensors and the output device. The processor is configured to process data captured by the plurality of sensors, and based on that, modify an output of the output device. The processor also is configured to determine whether there are a plurality of users associated with a video conferencing session, determine which user of the plurality of users is speaking, and enhance the audio or video output of the speaking user on the output device.

公开(公告)号：US11635938B2

公开(公告)日：2023-04-25

申请号：US17890979

申请日：2022-08-18

Applicant: Apple Inc.

Inventor： Stuart John Wood ,  Martin E. Johnson ,  Darius A. Satongar

IPC: G06F3/048 ,  G06F3/16 ,  G06F3/0481 ,  G06F3/0486 ,  G06F3/04883 ,  H04S1/00 ,  H04S7/00

Abstract: The present disclosure generally relates to user interfaces for managing spatial audio. Some exemplary techniques include user interfaces for transitioning between visual elements. Some exemplary techniques include user interfaces for previewing audio. Some exemplary techniques include user interfaces for discovering music. Some exemplary techniques include user interfaces for managing headphone transparency. Some exemplary techniques include user interfaces for manipulating multiple audio streams of an audio source.

公开(公告)号：US20230020542A1

公开(公告)日：2023-01-19

申请号：US17947042

申请日：2022-09-16

Applicant: Apple Inc.

Inventor： Darius A. Satongar ,  Per Håkan Linus Persson ,  Sean B. Kelly ,  Martin E. Johnson ,  Tony S. Verma ,  Peter D. Callaway ,  Jae Woo Chang ,  Daniel K. Boothe ,  Sean A. Ramprashad ,  Patrick Miauton ,  Christopher M. Garrido ,  Mitchell R. Lerner ,  Charles C. Hoyt

IPC: H04S7/00 ,  G06F3/0486 ,  G06F3/16 ,  H04N7/15

Abstract: A computer system outputs audio content via one or more audio output devices. If the audio content includes information that enables spatialization of the audio content, the system outputs the audio content in a simulated three-dimensional environment, including, if the audio content corresponds to a first category of content, causing the one or more audio output devices to simulate production of the audio content in a first virtual space, and if the audio content corresponds to a second category of content, causing the one or more audio output devices to simulate production of the audio content in a second virtual space that has different simulated acoustic properties than simulated acoustic properties of the first virtual space.

公开(公告)号：US11432095B1

公开(公告)日：2022-08-30

申请号：US16847443

申请日：2020-04-13

Applicant: Apple Inc.

Inventor： Darius A. Satongar ,  Martin E. Johnson

IPC: H04S7/00 ,  H04R5/02 ,  G06F3/01 ,  H04R1/10

Abstract: Virtualizing speakers for a headphone set can include determining a location of a display. Locations of one or more virtual speakers can be assigned based on the location of the display. A first virtual speaker can be located at the display. A position of a head of a user can be tracked. Audio content can be spatialized with a spatial renderer to generate spatialized audio signals, based on the tracked position of the head and the locations of the virtual speakers. Other aspects are also described and claimed.

公开(公告)号：US11429342B2

公开(公告)日：2022-08-30

申请号：US17227910

申请日：2021-04-12

Applicant: Apple Inc.

Inventor： Stuart John Wood ,  Martin E. Johnson ,  Darius A. Satongar

IPC: G06F3/048 ,  G06F3/16 ,  G06F3/0481 ,  G06F3/0486 ,  G06F3/04883 ,  H04S1/00 ,  H04S7/00

Abstract: The present disclosure generally relates to user interfaces for managing spatial audio. Some exemplary techniques include user interfaces for transitioning between visual elements. Some exemplary techniques include user interfaces for previewing audio. Some exemplary techniques include user interfaces for discovering music. Some exemplary techniques include user interfaces for managing headphone transparency. Some exemplary techniques include user interfaces for manipulating multiple audio streams of an audio source.

公开(公告)号：US11417347B2

公开(公告)日：2022-08-16

申请号：US17316408

申请日：2021-05-10

Applicant: Apple Inc.

Inventor： Martin E. Johnson ,  Juha O. Merimaa

IPC: G10L19/008 ,  H04S7/00 ,  H04S3/00

Abstract: A binaural room impulse response (BRIR) can be generated based on a position of a listener's head, and a plurality of head related impulse responses (HRIRs). Each of the plurality of HRIRs are selected for a respective one of a plurality of acoustic reflections which, when taken together, approximate reverberation of a room. Each of the acoustic reflections have a direction and a delay. The BRIR filter is applied to source audio to generate binaural audio output.