-
公开(公告)号:US20220244834A1
公开(公告)日:2022-08-04
申请号:US17658982
申请日:2022-04-12
发明人: Jonathan Ravasz , Jasper Stevens , Adam Tibor Varga , Etienne Pinchon , Simon Charles Tickner , Jennifer Lynn Spurlock , Kyle Eric Sorge-Toomey , Robert Ellis , Barrett Fox
IPC分类号: G06F3/04815 , G02B27/01 , G06F3/01 , G06F3/0482 , G06V40/20
摘要: An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. In one example, an artificial reality system comprises an image capture device configured to capture image data representative of a physical environment; a head-mounted display (HMD) configured to output artificial reality content; a gesture detector configured to identify, from the image data, a gesture comprising a motion of two fingers from a hand to form a pinching configuration and a subsequent pulling motion while in the pinching configuration; a user interface (UI) engine configured to generate a UI input element in response to identifying the gesture; and a rendering engine configured to render the UI input element as an overlay to at least some of the artificial reality content.
-
2.
公开(公告)号:US11003307B1
公开(公告)日:2021-05-11
申请号:US16435086
申请日:2019-06-07
发明人: Jonathan Ravasz , Jasper Stevens , Adam Tibor Varga , Etienne Pinchon , Simon Charles Tickner , Jennifer Lynn Spurlock , Kyle Eric Sorge-Toomey , Robert Ellis , Barrett Fox
IPC分类号: G06F3/0481 , G02B27/01 , G06K9/00 , G06F3/0482
摘要: An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. The artificial reality system includes an image capture device, a head-mounted display (HMD), a user interface (UI) engine, and a rendering engine. The image capture device is configured to capture image data representative of a physical environment. The HMD is configured to output artificial reality content including a representation of a wrist. The rendering engine configured to render a user interface (UI) element. The gesture detector configured to identify a gesture that includes a gripping motion of two or more digits of a hand to form a gripping configuration at the location of the UI element, and a pulling motion away from the wrist while in the gripping configuration.
-
公开(公告)号:US10990240B1
公开(公告)日:2021-04-27
申请号:US16435134
申请日:2019-06-07
发明人: Jonathan Ravasz , Jasper Stevens , Adam Tibor Varga , Etienne Pinchon , Simon Charles Tickner , Jennifer Lynn Spurlock , Kyle Eric Sorge-Toomey , Robert Ellis , Barrett Fox
IPC分类号: G06F3/0481 , G06F3/01 , G06T19/00 , G02B27/01
摘要: An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. The artificial reality system captures image data representative of a physical environment and outputs artificial reality content. The artificial reality system renders a container that includes application content items as an overlay to the artificial reality content. The artificial reality system identifies, from the image data, a selection gesture comprising a configuration of a hand that is substantially stationary for a threshold period of time at a first location corresponding to a first application content item within the container, and a subsequent movement of the hand from the first location to a second location outside the container. The artificial reality system renders the first application content item at the second location in response.
-
公开(公告)号:US11334212B2
公开(公告)日:2022-05-17
申请号:US16435116
申请日:2019-06-07
发明人: Jonathan Ravasz , Jasper Stevens , Adam Tibor Varga , Etienne Pinchon , Simon Charles Tickner , Jennifer Lynn Spurlock , Kyle Eric Sorge-Toomey , Robert Ellis , Barrett Fox
IPC分类号: G06F3/0481 , G06F3/01 , G06F3/04815 , G02B27/01 , G06F3/0482 , G06K9/00
摘要: An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. In one example, an artificial reality system comprises an image capture device configured to capture image data representative of a physical environment; a head-mounted display (HMD) configured to output artificial reality content; a gesture detector configured to identify, from the image data, a gesture comprising a motion of two fingers from a hand to form a pinching configuration and a subsequent pulling motion while in the pinching configuration; a user interface (UI) engine configured to generate a UI input element in response to identifying the gesture; and a rendering engine configured to render the UI input element as an overlay to at least some of the artificial reality content.
-
公开(公告)号:US11227445B1
公开(公告)日:2022-01-18
申请号:US17008487
申请日:2020-08-31
发明人: James Tichenor , Arthur Zwiegincew , Hayden Schoen , Alex Marcolina , Gregory Alt , Todd Harris , Merlyn Deng , Barrett Fox , Michal Hlavac
摘要: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.
-
公开(公告)号:US10890983B2
公开(公告)日:2021-01-12
申请号:US16434919
申请日:2019-06-07
发明人: Jonathan Ravasz , Jasper Stevens , Adam Tibor Varga , Etienne Pinchon , Simon Charles Tickner , Jennifer Lynn Spurlock , Kyle Eric Sorge-Toomey , Robert Ellis , Barrett Fox
IPC分类号: G06F3/01 , G06F3/0484 , G06T19/00
摘要: An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. The artificial reality system can include a menu that can be activated and interacted with using one hand. In response to detecting a menu activation gesture performed using one hand, the artificial reality system can cause a menu to be rendered. A menu sliding gesture (e.g., horizontal motion) of the hand can be used to cause a slidably engageable user interface (UI) element to move along a horizontal dimension of the menu while horizontal positioning of the UI menu is held constant. Motion of the hand orthogonal to the menu sliding gesture (e.g., non-horizontal motion) can cause the menu to be repositioned. The implementation of the artificial reality system does require use of both hands or use of other input devices in order to interact with the artificial reality system.
-
公开(公告)号:US20220122329A1
公开(公告)日:2022-04-21
申请号:US17499233
申请日:2021-10-12
发明人: James Tichenor , Arthur Zwiegincew , Hayden Schoen , Alex Marcolina , Gregory Alt , Todd Harris , Merlyn Deng , Barrett Fox , Michal Hlavac
摘要: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.
-
公开(公告)号:US11176755B1
公开(公告)日:2021-11-16
申请号:US17008478
申请日:2020-08-31
发明人: James Tichenor , Arthur Zwiegincew , Hayden Schoen , Alex Marcolina , Gregory Alt , Todd Harris , Merlyn Deng , Barrett Fox , Michal Hlavac
摘要: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.
-
公开(公告)号:US10955929B2
公开(公告)日:2021-03-23
申请号:US16435139
申请日:2019-06-07
发明人: Jonathan Ravasz , Jasper Stevens , Adam Tibor Varga , Etienne Pinchon , Simon Charles Tickner , Jennifer Lynn Spurlock , Kyle Eric Sorge-Toomey , Robert Ellis , Barrett Fox
IPC分类号: G06F3/01 , G06T19/00 , G06F3/0484 , G06F3/0485 , G02B27/01
摘要: An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. The artificial reality system captures image data representative of a physical environment and outputs the artificial reality content. The artificial reality system identifies, from the image data, a gesture comprising a motion of a first digit of a hand and a second digit of the hand to form a pinching configuration a particular number of times within a threshold amount of time. The artificial reality system assigns one or more input characters to one or more of a plurality of digits of the hand and processes a selection of a first input character of the one or more input characters assigned to the second digit of the hand in response to the identified gesture.
-
10.
公开(公告)号:US10921879B2
公开(公告)日:2021-02-16
申请号:US16435094
申请日:2019-06-07
发明人: Jonathan Ravasz , Jasper Stevens , Adam Tibor Varga , Etienne Pinchon , Simon Charles Tickner , Jennifer Lynn Spurlock , Kyle Eric Sorge-Toomey , Robert Ellis , Barrett Fox
摘要: An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. The artificial reality system includes an image capture device, a head-mounted display (HMD), a user interface (UI) engine, and a rendering engine. The image capture device captures image data representative of a physical environment. The HMD outputs artificial reality content, the artificial reality content including an assistant element. The gesture detector identifies, from the image data, a gesture that includes a gripping motion of two or more digits of a hand to form a gripping configuration at a location that corresponds to the assistant element, and subsequent to the gripping motion, a throwing motion of the hand with respect to the assistant element. The UI engine generates a UI element in response to identifying the gesture.
-
-
-
-
-
-
-
-
-