Electronic devices with voice command and contextual data processing capabilities

    公开(公告)号:US11348582B2

    公开(公告)日:2022-05-31

    申请号:US16836226

    申请日:2020-03-31

    Applicant: Apple Inc.

    Inventor: Aram M. Lindahl

    Abstract: An electronic device may capture a voice command from a user. The electronic device may store contextual information about the state of the electronic device when the voice command is received. The electronic device may transmit the voice command and the contextual information to computing equipment such as a desktop computer or a remote server. The computing equipment may perform a speech recognition operation on the voice command and may process the contextual information. The computing equipment may respond to the voice command. The computing equipment may also transmit information to the electronic device that allows the electronic device to respond to the voice command.

    METHOD TO DETERMINE LOUDSPEAKER CHANGE OF PLACEMENT

    公开(公告)号:US20210385602A1

    公开(公告)日:2021-12-09

    申请号:US17411893

    申请日:2021-08-25

    Applicant: Apple Inc.

    Abstract: A system and method is described for determining whether a loudspeaker device has relocated, tilted, rotated, or changed environment such that one or more parameters for driving the loudspeaker may be modified and/or a complete reconfiguration of the loudspeaker system may be performed. In one embodiment, the system may include a set of sensors. The sensors provide readings that are analyzed to determine 1) whether the loudspeaker has moved since a previous analysis and/or 2) a distance of movement and/or a degree change in orientation of the loudspeaker since the previous analysis. Upon determining the level of movement is below a threshold value, the system adjusts previous parameters used to drive one or more of the loudspeakers. By adjusting previous parameters instead of performing a complete recalibration, the system provides a more efficient technique for ensuring that the loudspeakers continue to produce accurate sound for the listener.

    Automatic speech recognition triggering system

    公开(公告)号:US11102568B2

    公开(公告)日:2021-08-24

    申请号:US16396470

    申请日:2019-04-26

    Applicant: Apple Inc.

    Abstract: An automatic speech recognition (ASR) triggering system, and a method of providing an ASR trigger signal, is described. The ASR triggering system can include a microphone to generate an acoustic signal representing an acoustic vibration and an accelerometer worn in an ear canal of a user to generate a non-acoustic signal representing a bone conduction vibration. A processor of the ASR triggering system can receive an acoustic trigger signal based on the acoustic signal and a non-acoustic trigger signal based on the non-acoustic signal, and combine the trigger signals to gate an ASR trigger signal. For example, the ASR trigger signal may be provided to an ASR server only when the trigger signals are simultaneously asserted. Other embodiments are also described and claimed.

    Automatic processing of double-system recording

    公开(公告)号:US10825480B2

    公开(公告)日:2020-11-03

    申请号:US15610431

    申请日:2017-05-31

    Applicant: Apple Inc.

    Abstract: A method for automatically producing a video and audio mix at a first portable electronic device. The method receives a request to capture video and audio, performs a network discovery process to find a second portable electronic device, and sends a message to the second device indicating when to start recording audio for a double system recording session. The method initiates the recording session, such that both devices record concurrently. In response to the first device stopping the recording of audio and sound, signaling the second device to stop recording for the identified recording session. In response to the first device receiving a first audio track from the second device that contains an audio signal recorded during the recording session, automatically generating a mix of video and audio, such that one of the audio signals from the first and second tracks is ducked relative to the other.

    Speech recognition wake-up of a handheld portable electronic device

    公开(公告)号:US10332524B2

    公开(公告)日:2019-06-25

    申请号:US15656165

    申请日:2017-07-21

    Applicant: Apple Inc.

    Inventor: Aram M. Lindahl

    Abstract: A system and method for parallel speech recognition processing of multiple audio signals produced by multiple microphones in a handheld portable electronic device. In one embodiment, a primary processor transitions to a power-saving mode while an auxiliary processor remains active. The auxiliary processor then monitors the speech of a user of the device to detect a wake-up command by speech recognition processing the audio signals in parallel. When the auxiliary processor detects the command it then signals the primary processor to transition to active mode. The auxiliary processor may also identify to the primary processor which microphone resulted in the command being recognized with the highest confidence. Other embodiments are also described.

    Assistive apparatus having accelerometer-based accessibility

    公开(公告)号:US10303436B2

    公开(公告)日:2019-05-28

    申请号:US15269920

    申请日:2016-09-19

    Applicant: Apple Inc.

    Abstract: An assistive apparatus, and a method of providing an accessibility switch output by the assistive apparatus, is described. The assistive apparatus may include an accelerometer to be worn in an ear canal of a user, and a display having a graphical user interface. The accelerometer may generate an input signal representing an input command made by the user, and more particularly, the generated input command may represent one or more hums transmitted from vocal cords of the user to the accelerometer in the ear canal via bone conduction. The assistive apparatus may provide an accessibility switch output in response to the input signals representing the input command. For example, the accessibility switch output may cause a selection of a user interface element of the graphical user interface. Other embodiments are also described and claimed.

    BEAM SELECTION FOR NOISE SUPPRESSION BASED ON SEPARATION

    公开(公告)号:US20170337932A1

    公开(公告)日:2017-11-23

    申请号:US15159698

    申请日:2016-05-19

    Applicant: Apple Inc.

    Abstract: An audio system has a housing in which are integrated a number of microphones. A programmed processor accesses the microphone signals and produces a number of acoustic pick up beams. A number of separation values are computed, each being a measure of the difference between strength of a respective beam and strength of a noise reference input signal. One of the beams is selected whose separation value is the largest, and the selected beam is applied to a first input of a two-channel noise suppression process, while the noise reference input signal is applied to the second input of the noise suppression process. Other embodiments are also described and claimed.

    Loudspeaker array protection management

    公开(公告)号:US09743201B1

    公开(公告)日:2017-08-22

    申请号:US14210100

    申请日:2014-03-13

    Applicant: Apple Inc.

    CPC classification number: H04R29/002 H04R3/04 H04R3/12

    Abstract: A protection management unit is described that detects one or more poor performing transducers in a loudspeaker array. Upon detection of one or more poor performing transducers, the protection management unit adjusts driving signals for neighboring transducers to compensate for the reduced capabilities of the poor performing transducers. By adjusting driving signals to neighboring transducers, the protection management unit ensures that a desired tone and spatial response for sound emitted by the loudspeaker array is maintained despite one or more poor performing transducers. Other embodiments are also described.

    Speech recognition wake-up of a handheld portable electronic device

    公开(公告)号:US09734830B2

    公开(公告)日:2017-08-15

    申请号:US14981636

    申请日:2015-12-28

    Applicant: Apple Inc.

    Inventor: Aram M. Lindahl

    Abstract: A system and method for parallel speech recognition processing of multiple audio signals produced by multiple microphones in a handheld portable electronic device. In one embodiment, a primary processor transitions to a power-saving mode while an auxiliary processor remains active. The auxiliary processor then monitors the speech of a user of the device to detect a wake-up command by speech recognition processing the audio signals in parallel. When the auxiliary processor detects the command it then signals the primary processor to transition to active mode. The auxiliary processor may also identify to the primary processor which microphone resulted in the command being recognized with the highest confidence. Other embodiments are also described.

    Detecting the positions of earbuds and use of these positions for selecting the optimum microphones in a headset
    10.
    发明授权
    Detecting the positions of earbuds and use of these positions for selecting the optimum microphones in a headset 有权
    检测耳塞的位置并使用这些位置来选择耳机中的最佳麦克风

    公开(公告)号:US09516442B1

    公开(公告)日:2016-12-06

    申请号:US14160427

    申请日:2014-01-21

    Applicant: Apple Inc.

    Abstract: Embodiments of the invention determine whether speaker earbuds of a headset are positioned in a user's ears. The headset may be a “Y” shaped headset with two earbuds having speakers and a plug for insertion into a jack of the audio device. Multiple microphones are located on wired lengths to the earbuds and a common wire between the lengths and the plug, to receive speech from the user's mouth. Each earbud may have a front and rear microphone, and an accelerometer. Embodiments can detect user speech vibrations at one or more of the microphones, and in the accelerometers in the earbuds. Based on these detections, it can be determined whether one or both of the earbuds are in user's ears. To provide more accurate beamforming, when only one of the earbuds is in the user's ears, only the microphones leading to that earbud are selected for beamforming input.

    Abstract translation: 本发明的实施例确定耳机的扬声器耳塞是否位于用户的耳朵中。 耳机可以是具有两个具有扬声器的耳塞的“Y”形耳机,以及用于插入到音频设备的插孔中的插头。 多个麦克风位于耳机的有线长度上,长度和插头之间有一条公共线,用于从用户口中接收语音。 每个耳塞可能有一个前后麦克风和一个加速度计。 实施例可以在一个或多个麦克风以及耳塞中的加速度计中检测用户语音振动。 基于这些检测,可以确定耳塞中的一个或两个是否在用户的耳朵中。 为了提供更准确的波束成形,当只有一个耳塞在用户的耳朵中时,仅选择导致该耳塞的麦克风用于波束成形输入。

Patent Agency Ranking