AUGMENTED AND VIRTUAL REALITY BOT INFRASTRUCTURE

    公开(公告)号:US20190325629A1

    公开(公告)日:2019-10-24

    申请号:US16459160

    申请日:2019-07-01

    摘要: Representative embodiments disclose mechanisms for presenting content into a virtual reality or augmented reality (VR/AR) system in a manner that does not distract the user from their primary workflow in the VR/AR system. The system monitors a user's workflow in a virtual reality or augmented reality (VR/AR) system. Based on the user's workflow, the user's emotional state, and other data, the system selects one or more bots to inject into the user's workflow. The bots provide content and functional extensibility for the system and/or the VR/AR system. Content from the selected bot(s) is identified and placed in a location that is in the periphery of the user at a low rendering fidelity. If the user shows interest in the content, the fidelity of the content is increased until the user can interact with the content, using the functionality provided by the bot.

    ONLINE PERSPECTIVE SEARCH FOR 3D COMPONENTS
    2.
    发明申请

    公开(公告)号:US20170351705A1

    公开(公告)日:2017-12-07

    申请号:US15169776

    申请日:2016-06-01

    IPC分类号: G06F17/30

    摘要: Techniques for formulating queries and retrieving relevant results for 3D components in a virtual or augmented reality system. In an aspect, a user works with a 3D component using a workflow, and views the 3D component from one or more selected perspective views. Data associated with the workflow and the selected perspective views are transmitted to an online engine. The online engine may include a query formulation module for automatically forming a query based on the received workflow data and selected perspective views. The formulated query may be supplied to a search engine to retrieve online results based on relevance to the formulated queries. One or more most relevant online results may be seamlessly served to the user as part of the workflow.

    Proactive presentation of multitask workflow components to increase user efficiency and interaction performance
    3.
    发明授权
    Proactive presentation of multitask workflow components to increase user efficiency and interaction performance 有权
    主动介绍多任务工作流组件,以提高用户效率和交互性能

    公开(公告)号:US09495208B2

    公开(公告)日:2016-11-15

    申请号:US14560790

    申请日:2014-12-04

    摘要: A multitask workflow is proactively identified based upon user context information. For discrete tasks of the multitask workflow, modules directed to such tasks are identified from among other modules also directed to the same task, and are proactively presented to the user. Modules are selected based upon predetermined values associated with such modules, which can be indicative of capabilities, relationships, incentives associated with presentation of the modules to the user, and other like valuations. The modules offer visually enticing experiences to aid the user in performing a task, of the multitask workflow, and thereby increasing the user's interaction performance. Additionally, the modules exchange information to increase user efficiency in performing the multitask workflow. Multiple computing devices associated with a user can execute different modules of the multitask workflow, enabling two or more users to collaborate on the multitask workflow or otherwise research and perform tasks associated with the multitask workflow.

    摘要翻译: 基于用户上下文信息主动识别多任务工作流。 对于多任务工作流的离散任务,定向到这些任务的模块从也被定向到相同任务的其他模块中识别,并且被主动呈现给用户。 基于与这样的模块相关联的预定值来选择模块,其可以指示与向用户呈现模块相关联的能力,关系,激励以及其他类似的估价。 这些模块提供视觉诱惑的体验,以帮助用户执行多任务工作流的任务,从而增加用户的交互性能。 此外,模块交换信息以提高用户执行多任务工作流程的效率。 与用户相关联的多个计算设备可以执行多任务工作流程的不同模块,使得两个或多个用户能够在多任务工作流上进行协作,或以其他方式研究和执行与多任务工作流相关联的任务。

    Subtractive rendering for augmented and virtual reality systems

    公开(公告)号:US10373385B2

    公开(公告)日:2019-08-06

    申请号:US15378373

    申请日:2016-12-14

    IPC分类号: G06T19/00 G06T19/20

    摘要: Representative embodiments allow rendering of negative space in real world objects in a virtual reality or augmented reality system. Negative space is what exists within a real-world object. Positive space is what exists outside of a real-world object. Scans of a real-world object are submitted to a search engine to retrieve a negative space model for the positive space object. The negative space model is optionally adjusted to account for real world parameters of the negative space. Anchor points are identified for the negative space model. A positive space portion of the real-world object is removed and the negative space model is scaled, rotated and rendered on top of the real-world object at the appropriate location. A user can interact with both the real-world object and negative space object through the virtual reality or augmented reality system.

    Augmented and virtual reality bot infrastructure

    公开(公告)号:US10366522B2

    公开(公告)日:2019-07-30

    申请号:US15717564

    申请日:2017-09-27

    摘要: Representative embodiments disclose mechanisms for presenting content into a virtual reality or augmented reality (VR/AR) system in a manner that does not distract the user from their primary workflow in the VR/AR system. The system monitors a user's workflow in a virtual reality or augmented reality (VR/AR) system. Based on the user's workflow, the user's emotional state, and other data, the system selects one or more bots to inject into the user's workflow. The bots provide content and functional extensibility for the system and/or the VR/AR system. Content from the selected bot(s) is identified and placed in a location that is in the periphery of the user at a low rendering fidelity. If the user shows interest in the content, the fidelity of the content is increased until the user can interact with the content, using the functionality provided by the bot.

    Audio augmented reality system
    6.
    发明授权

    公开(公告)号:US10235456B2

    公开(公告)日:2019-03-19

    申请号:US15935002

    申请日:2018-03-25

    摘要: Techniques for online information search and retrieval for a query including a digital audio waveform. In an aspect, an audio waveform is received and digitized by at least one of a plurality of audio input devices. The digitized audio waveforms are transmitted to a central processing unit, which formulates and submits a query to an online engine. The formulated query may include the at least one digital audio waveform. The online engine retrieves one or more online results relevant to the formulated query. The online results may include one or more relevant visual results, and/or one or more relevant audio results. The retrieved results are served in real-time back to a user, via a device having audio output capability, and/or a device having visual data output capability.

    PROACTIVE PRESENTATION OF MULTITASK WORKFLOW COMPONENTS TO INCREASE USER EFFICIENCY AND INTERACTION PERFORMANCE

    公开(公告)号:US20180136972A1

    公开(公告)日:2018-05-17

    申请号:US15351323

    申请日:2016-11-14

    IPC分类号: G06F9/48

    摘要: A multitask workflow is proactively identified based upon user context information. For discrete tasks of the multitask workflow, modules directed to such tasks are identified from among other modules also directed to the same task, and are proactively presented to the user. Modules are selected based upon predetermined values associated with such modules, which can be indicative of capabilities, relationships, incentives associated with presentation of the modules to the user, and other like valuations. The modules offer visually enticing experiences to aid the user in performing a task, of the multitask workflow, and thereby increasing the user's interaction performance. Additionally, the modules exchange information to increase user efficiency in performing the multitask workflow. Multiple computing devices associated with a user can execute different modules of the multitask workflow, enabling two or more users to collaborate on the multitask workflow or otherwise research and perform tasks associated with the multitask workflow.

    Data and user interaction based on device proximity

    公开(公告)号:US11599201B2

    公开(公告)日:2023-03-07

    申请号:US17384891

    申请日:2021-07-26

    摘要: Architecture that enables the detection of a user by a user device and interaction with content of the user device by the user before the user physically contacts the device. The detection capability can utilize one or more sensors of the device to identify the user and the proximity (distance) of the user to the device. Based on the user identity and the proximity, the device operates/functions in a certain way. Moreover, ongoing interaction can be enabled by recognition of a natural user interface (NUI) gestures, alone or in combination with other recognition techniques (e.g., speech recognition). Device activity can include causing the device to operate in predetermined ways such as power modes, application launching and manipulation to cause control of hardware and other software (local and/or remote) and, obtaining and presenting specific types of content (e.g., advertisements, notifications, messages, reminders, news, incoming communications, etc.).

    System for presenting tailored content based on user sensibilities

    公开(公告)号:US11436265B2

    公开(公告)日:2022-09-06

    申请号:US15620998

    申请日:2017-06-13

    摘要: Systems, methods, and apparatuses for implementing a digital personal assistant. The digital personal assistant determining that a user has initiated a user experience with it. In response, the digital personal assistant collects information concerning the user's sensibilities about content and a current context in which the digital personal assistant is being used. With that information, the digital personal assistant infers facets of the user's sensibilities and deduces a context of use. With those inferences and that deduction, the digital personal assistant evaluates whether the presentation of responsive content should be modified to better comport with the user's sensibilities and to be more appropriate for the context of use. Additionally, in response to determining a user's need for content, the digital personal assistant can use the inference and deduction to supply suggested content to the user.