Abstract:
A glove interface object is provided, comprising: a plurality of electromagnets positioned at a wrist area of the glove interface object; a plurality of magnetic sensors respectively positioned at fingertip areas of the glove interface object, wherein each magnetic sensor is configured to generate data indicating distances to each of the electromagnets when each of the electromagnets is activated; a controller configured to control activation of the electromagnets and reading of the magnetic sensors in a time-division multiplexed arrangement, wherein each of the magnetic sensors is read during activation of a single magnetic sensor; a transmitter configured to transmit data derived from the reading of the magnetic sensors to a computing device for processing to generate data representing a pose of a virtual hand, the virtual hand capable of being rendered in a virtual environment presented on a head-mounted display.
Abstract:
Consumer electronic devices have been developed with enormous information processing capabilities, high quality audio and video outputs, large amounts of memory, and may also include wired and/or wireless networking capabilities. Additionally, relatively unsophisticated and inexpensive sensors, such as microphones, video camera, GPS or other position sensors, when coupled with devices having these enhanced capabilities, can be used to detect subtle features about users and their environments. A variety of audio, video, simulation and user interface paradigms have been developed to utilize the enhanced capabilities of these devices. These paradigms can be used separately or together in any combination. One paradigm automatically creating user identities using speaker identification. Another paradigm includes a control button with 3-axis pressure sensitivity for use with game controllers and other input devices.
Abstract:
Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video.
Abstract:
One or more chat servers receives voice signals and pose (location and orientation) signals from devices such as VR headsets associated with respective chat participants. For each participant, the server renders a single stream representing the voices of the other participants, with the voice data in each stream being modified to account for the orientation of the head of the receiving participant. The server sends the streams to the participants for whom the streams are tailored. The voice information representing the chat of the other participants in a stream intended for a particular participant can also be modified to account for the distances between participants and orientations of speakers' heads relative to the particular participant for whom the stream is tailored.
Abstract:
Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video.
Abstract:
A method for executing computer instructions for presenting an interactive environment in a head-mounted display (HMD) is described. The method includes identifying content associated with the interactive environment to be presented on the HMD for a user and determining whether an interactive object within the identified content satisfies a threshold for presentation to the user. The method includes augmenting the interactive object with augmentation data. The augmented data acts to change a characteristic of the interactive object. The operation of augmenting the interactive object is performed after determining that the interactive object does not satisfy the threshold for presentation to the user. The augmentation data modifies the interactive object to conform the interactive object to be within the threshold.
Abstract:
A method is provided, including: activating a plurality of glove emitters positioned on a glove interface object; using a plurality of proximity sensors positioned at fingertip portions of the glove interface object to determine a proximity of the fingertip portions to the glove emitters; in response to determining a location of the glove interface object within a predefined distance of a peripheral device, activating a plurality of peripheral emitters positioned at the peripheral device, and transitioning, from using the proximity sensors to determine the proximity of the fingertip portions to the glove emitters, to using the proximity sensors to determine a proximity of the fingertip portions to the peripheral emitters.
Abstract:
Systems and methods for executing content to be rendered on a screen of a head mounted display (HMD) are provided. One method includes executing the content to render interactive scenes on the screen and tracking an orientation direction of the HMD when worn on a head of a user and the interactive scenes are being rendered on the screen. The method includes changing view directions into the interactive scenes based on changes in the orientation direction of the HMD, such that movements of the head of the user causes the changes in the view directions into the interactive scenes. The method further includes receiving images of a real world space using a camera of the HMD. The camera of the HMD is configured to capture a location of real world objects in the real world space relative to the user of the HMD. The method includes detecting that at least one real world object is becoming proximate to the user of the HMD and generating a warning or message to be presented to the HMD, the warning or message indicating that the user is likely to bump or contact the at least one real world object. The method further includes transitioning at least a portion of the screen to a transparent mode. The transparent mode provides at least a partial view into the real world space using the camera of the HMD.
Abstract:
A handheld device is provided, comprising: a sensor configured to generate sensor data for determining and tracking a position and orientation of the handheld device during an interactive session of an interactive application presented on a main display, the interactive session being defined for interactivity between a user and the interactive application; a communications module configured to send the sensor data to a computing device, the communications module being further configured to receive from the computing device a spectator video stream of the interactive session that is generated based on a state of the interactive application and the tracked position and orientation of the handheld device, the state of the interactive application being determined based on the interactivity between the user and the interactive application; a display configured to render the spectator video stream.
Abstract:
A method for processing graphics for a GPU program, translating instructions from a shading language into an intermediate language with a front end of a GPU compiler; translating the instructions from the intermediate language into a GPU object language with a back end of the GPU compiler; wherein the instructions in the shading language include instructions defining a layout of resources for the GPU program.