Abstract:
The present disclosure provides techniques for determining the position and/or orientation of a pointing device relative to the screen on a touchscreen device. A method may include receiving first orientation data from a first device that may include a capacitive touch surface. A touch point may be received indicating a location of a touch by a user on the capacitive touch surface. Second orientation data may be received from a second device. The first and second orientation data may be correlated to determine a relative orientation of the first device to the second device. A position of a pointing device may be determined based on the touch point and the relative orientation of the first and second devices. Additionally, multiple distances relative to a capacitive touch surface may be received, and based on the multiple distances, a position of a user's finger, hand, and/or arm may be determined.
Abstract:
The present disclosure provides techniques for determining the position and/or orientation of a pointing device relative to the screen on a touchscreen device. A method may include receiving first orientation data from a first device that may include a capacitive touch surface. A touch point may be received indicating a location of a touch by a user on the capacitive touch surface. Second orientation data may be received from a second device. The first and second orientation data may be correlated to determine a relative orientation of the first device to the second device. A position of a pointing device may be determined based on the touch point and the relative orientation of the first and second devices. Additionally, multiple distances relative to a capacitive touch surface may be received, and based on the multiple distances, a position of a user's finger, hand, and/or arm may be determined.
Abstract:
The present disclosure provides techniques for determining the position and/or orientation of a pointing device relative to the screen on a touchscreen device. A method may include receiving first orientation data from a first device that may include a capacitive touch surface. A touch point may be received indicating a location of a touch by a user on the capacitive touch surface. Second orientation data may be received from a second device. The first and second orientation data may be correlated to determine a relative orientation of the first device to the second device. A position of a pointing device may be determined based on the touch point and the relative orientation of the first and second devices. Additionally, multiple distances relative to a capacitive touch surface may be received, and based on the multiple distances, a position of a user's finger, hand, and/or arm may be determined.
Abstract:
Described is a system and technique allowing a user to interact with a device using self-referential gestures. Self-referential gestures allow a user to rely on their inherent knowledge of body positioning to allow movements such as hand movements to be intuitively performed. The disclosure describes determining various reference points on the user and detecting hand movements relative to these reference points. In addition, a device may define axes and/or an origin in a three-dimensional space relative to a position of the user within a field-of-view of a capture device. Accordingly, gesture movements may be detected and/or measured based on references that correspond to the user's body in order to provide a more intuitive interaction experience.
Abstract:
Methods, systems, and media for synchronizing media content using audio timecodes are provided. In some implementations, the method comprises: identifying, using a secondary device, a media content item that is being presented on a primary device; detecting, using the secondary device, a tone embedded within a portion of audio content of the media content item; identifying, using the secondary device, a current playback position of the media content item on the primary device based on the detected tone; determining, using the secondary device, supplemental content relevant to the media content item at the current playback position; and causing the supplemental content to be presented on the secondary device.
Abstract:
In some implementations, a process for communicating data over audio is performed. In one aspect, one or more ordered sequences of audio attribute values that are selected based on a musical relationship between the audio attribute values and associated with data values may be played by a first device and received by a second device. This technique may allow for sound-based communications to take place between devices that listeners may find pleasant.
Abstract:
The present disclosure provides techniques for improving IMU-based gesture detection by a device using ultrasonic Doppler. A method may include detecting the onset of a gesture at a first device based on motion data obtained from an IMU of the first device. An indication of the detection of the onset of the gesture may be provided to a second device. Next, a first audio signal may be received from the second device. As a result, the gesture may be identified based on the motion data and the received first audio signal. In some cases, a first token encoded within the first audio signal may be decoded and the first token may be provided to a third coordinating device. A confirmation message may be received from the third coordinating device based on the first token provided and identifying the gesture may be further based on the confirmation message.
Abstract:
Described is a system and technique to supplement speech commands with gestures. A user interface may be improved by providing the ability for a user to intuitively provide speech commands with the aid of gestures. By providing gestures contemporaneously with a speech command, the user may delimit the commencement and end of a command thereby allowing the system to provide an immediate response. In addition, gestures may be detected in order to determine a source of a provided speech command, and accordingly, user specific actions may be performed based on the identity of the source.
Abstract:
An interaction spot is provided that may detect the presence of an electronic device such as a smartphone. A user may make a physical motion with the smartphone proximal to the interaction spot such as moving it upward. The interaction spot may communicate with a second device such as a light or a household appliance. A setting of the second device may be adjusted based on the motion of the electronic device.
Abstract:
The present disclosure provides techniques for improving IMU-based gesture detection by a device using ultrasonic Doppler. A method may include detecting the onset of a gesture at a first device based on motion data obtained from an IMU of the first device. An indication of the detection of the onset of the gesture may be provided to a second device. Next, a first audio signal may be received from the second device. As a result, the gesture may be identified based on the motion data and the received first audio signal. In some cases, a first token encoded within the first audio signal may be decoded and the first token may be provided to a third coordinating device. A confirmation message may be received from the third coordinating device based on the first token provided and identifying the gesture may be further based on the confirmation message.