MULTI-DEVICE LOCALIZATION
    1.
    发明申请

    公开(公告)号:US20240381045A1

    公开(公告)日:2024-11-14

    申请号:US18779258

    申请日:2024-07-22

    Abstract: A system configured to create a flexible home theater group using a variety of different devices. To enable the home theater group to generate synchronized audio, the system performs device localization to generate map data, which represents locations of devices in a device map. The map data may include a listening position and/or television, such that the map data is centered on the listening position with the television along a vertical axis. To generate the map data, the system selects a primary device that determines calibration data indicating a sequence when each of the individual devices generates playback audio. The primary device sends the calibration data to secondary devices and each device generates playback audio at a designated time in the sequence, enabling other devices to capture the output audio and determine a relative position of the playback device (for example using angle of arrival and distance information). The playback audio may be outside a human hearing range.

    Monitoring non-stationary object distance using ultrasonic signals

    公开(公告)号:US11921187B1

    公开(公告)日:2024-03-05

    申请号:US17232649

    申请日:2021-04-16

    CPC classification number: G01S13/56 G01S7/4056 G01S13/581 G01S13/584 G01S13/84

    Abstract: Techniques for monitoring devices to use ultrasonic signals to detect and track the locations of moving objects in an environment. To determine distance information, the monitoring devices emit a frequency-modulated continuous wave (FMCW) signal at an ultrasound frequency range. Reflections of the FMCW ultrasonic signal are used to generate time-of-arrival (TOA) profiles that indicate distances between the monitoring device and objects in the environment. The reflections can be processed to suppress undesirable interferences, such as reflections off non-mobile objects in the environment (e.g., walls, furniture, etc.), vibrations off the floorings or the ceilings, etc. After processing the reflections, a heatmap can be used to plot the intensity of the reflections for the different TOAs of the reflections, and depict the movement of the user over time. Finally, a Kalman filter is used to smooth the peaks in the intensity values on the plot, and determine the trajectory of the human.

    Method for wall detection and localization

    公开(公告)号:US12072413B1

    公开(公告)日:2024-08-27

    申请号:US17218274

    申请日:2021-03-31

    CPC classification number: G01S15/101 G01N29/46 G01N29/48 H04R3/04 H04R2430/23

    Abstract: A system that performs wall detection and localization to determine a position of a device relative to acoustically reflective surfaces. The device emits an audible sound including a frequency modulated signal and captures reflections of the audible sound. The frequency modulated signal enables the device to determine an amplitude of the reflections at different time-of-arrivals, which corresponds to a direction of the reflection. The device then performs beamforming to generate a 2D intensity map that represents an intensity of the reflections at each spatial location around the device. The device detects wall(s) in proximity to the device by identifying peak intensities represented in the 2D intensity map. In some examples, instead of performing beamforming, the device can perform directional wall detection by physically rotating the device and emitting the audible sound in multiple directions. The device may perform ultrasonic wall detection using ultrasonic sound frequencies.

    Sound source localization
    4.
    发明授权

    公开(公告)号:US11762052B1

    公开(公告)日:2023-09-19

    申请号:US17475888

    申请日:2021-09-15

    CPC classification number: G01S3/8083 G01S5/20 G06T7/70 G10L15/22 G10L2015/223

    Abstract: Techniques for improving sound source localization (SSL) are provided. A method for probabilistic SSL using a deep neural network (DNN) may include receiving audio data including a representation of audio such as a wakeword from a microphone array. The audio data may be processed by a DNN to output a plurality of values where each value indicates a probability that the audio originated from a direction corresponding to that value. A sensor may provide computer vision or other data which may be used to inform the plurality of values based on detecting presence of a human or obstacle. A probability that the audio originated from one of the directions of the plurality of directions may be determined based at least in part on the DNN output and the computer vision or other data.

    User localization
    5.
    发明授权

    公开(公告)号:US12143789B1

    公开(公告)日:2024-11-12

    申请号:US17825613

    申请日:2022-05-26

    Abstract: A system configured to improve user localization used to determine a listening position and/or user orientation for a device map. Multiple devices may generate audio data representing user speech and the system may use the audio data to determine a first spatial likelihood function (SLF) based on angle measurements, determine a second SLF based on timing information, and determine a location of the user based on a combination of the two SLFs. The SLFs represent the environment using a grid comprising a plurality of grid cells, and each grid cell has a value indicating a likelihood that the grid cell corresponds to the location of the user. An individual device may generate a portion of the angle measurements based on multi-channel audio data generated using multiple microphones of the device, while the system may generate the timing information based on single-channel audio data received from each of the multiple devices.

    Multi-device localization
    6.
    发明授权

    公开(公告)号:US12003948B1

    公开(公告)日:2024-06-04

    申请号:US17546670

    申请日:2021-12-09

    Inventor: Spencer Russell

    CPC classification number: H04S7/303 G01S5/0289

    Abstract: A system configured to create a flexible home theater group using a variety of different devices. To enable synchronized audio output, the system performs device localization to generate map data representing locations of the devices. The system may generate the map data based on a listening position and/or location of a television, such that the map data is centered on the listening position with the television along a vertical axis. To generate the map data, the system processes measurement data representing relative directions between the devices and timing information that can be used to determine relative distances between the devices. Using the relative distances, the system determines relative positions of the devices (e.g., optimal arrangement). Knowing the relative directions and the relative positions, the system can determine an orientation of an individual device and use the orientation to determine the listening position and/or the location of the television.

    Direction of arrival estimation
    7.
    发明授权

    公开(公告)号:US12276741B1

    公开(公告)日:2025-04-15

    申请号:US17879634

    申请日:2022-08-02

    Inventor: Spencer Russell

    Abstract: A system configured to determine an estimated angle of arrival in reverberant environments. When a first device detects a calibration tone generated by a second device, the first device may generate multichannel audio representing the calibration tone and process the multichannel audio using a combination of detection filtering and subspace processing to determine a relative direction of the second device. For example, the first device may perform matched filtering to isolate a direct-path peak for the calibration tone, and then may sweep through all potential azimuth directions to identify an azimuth value corresponding to the direct-path peak. In some examples, the first device identifies a steering vector associated with a particular direction (e.g., signal subspace) that minimizes components in all other directions (e.g., noise subspace). The device may determine this steering vector independently for each frequency band and calculate the estimated angle of arrival by averaging results across frequency bands.

    Multi-device localization
    8.
    发明授权

    公开(公告)号:US12058509B1

    公开(公告)日:2024-08-06

    申请号:US17546567

    申请日:2021-12-09

    CPC classification number: H04S3/008 H04R3/12 H04R5/04 H04S7/301

    Abstract: A system configured to create a flexible home theater group using a variety of different devices. To enable the home theater group to generate synchronized audio, the system performs device localization to generate map data, which represents locations of devices in a device map. The map data may include a listening position and/or television, such that the map data is centered on the listening position with the television along a vertical axis. To generate the map data, the system selects a primary device that determines calibration data indicating a sequence when each of the individual devices generates playback audio. The primary device sends the calibration data to secondary devices and each device generates playback audio at a designated time in the sequence, enabling other devices to capture the output audio and determine a relative position of the playback device (for example using angle of arrival and distance information).

    Presence detection using ultrasonic signals with concurrent audio playback

    公开(公告)号:US11564036B1

    公开(公告)日:2023-01-24

    申请号:US17076584

    申请日:2020-10-21

    Abstract: Techniques for presence-detection devices to detect movement of a person in an environment by emitting ultrasonic signals using a loudspeaker that is concurrently outputting audible sound. To detect movement by the person, the devices characterize the change in the frequency, or the Doppler shift, of the reflections of the ultrasonic signals off the person caused by the movement of the person. However, when a loudspeaker plays audible sound while emitting the ultrasonic signal, audio signals generated by microphones of the devices include distortions caused by the loudspeaker. These distortions can be interpreted by the presence-detection devices as indicating movement of a person when there is no movement, or as indicating lack of movement when a user is moving. The techniques include processing audio signals to remove distortions to more accurately identify changes in the frequency of the reflections of the ultrasonic signals caused by the movement of the person.

Patent Agency Ranking