-
1.
公开(公告)号:US20240338071A1
公开(公告)日:2024-10-10
申请号:US18748987
申请日:2024-06-20
申请人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
CPC分类号: G06F3/011 , G06F1/163 , G06T19/006
摘要: Described are virtual AR interfaces for generating a virtual rotational interface for the purpose of controlling connected IoT devices using the inertial measurement unit (IMU) of a portable electronic device. The IMU control application enables a user of a portable electronic device to activate a virtual rotational interface overlay on a display and adjust a feature of a connected IoT product by rotating a portable electronic device. The device IMU moves a slider on the virtual rotational interface. The IMU control application sends a control signal to the IoT product which executes an action in accordance with the slider position. The virtual rotational interface is presented on the display as a virtual object in an AR environment. The IMU control application detects the device orientation (in the physical environment) and in response presents a corresponding slider element on the virtual rotational interface (in the AR environment).
-
公开(公告)号:US20240077983A1
公开(公告)日:2024-03-07
申请号:US17901589
申请日:2022-09-01
申请人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
IPC分类号: G06F3/04815 , G06F3/01 , G06F3/04842 , G06F3/16 , G06F9/54 , G06T7/70 , G06T19/00 , G06V20/20
CPC分类号: G06F3/04815 , G06F3/011 , G06F3/04842 , G06F3/167 , G06F9/541 , G06T7/70 , G06T19/006 , G06V20/20 , G06T2200/24 , G06T2207/30244
摘要: Recording tools for creating interactive AR experiences. An interaction recording application enables a user with little or no programming skills to perform and record user behaviors that are associated with reactions between story elements such as virtual objects and connected IoT devices. The user behaviors include a range of actions, such as speaking a trigger word and apparently touching a virtual object. The corresponding reactions include starting to record a subsequent scene and executing actions between story elements. The trigger recording interface is presented on the display as an overlay relative to the physical environment.
-
公开(公告)号:US20240077935A1
公开(公告)日:2024-03-07
申请号:US17901630
申请日:2022-09-01
申请人: Youjean Cho , Lei Zhang , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Youjean Cho , Lei Zhang , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
CPC分类号: G06F3/011 , G06F3/017 , G06F3/0334 , G06V10/255 , G06V40/20 , G16Y20/40 , H04N13/111
摘要: A virtual interface application presented in augmented reality (AR) is described for controlling Internet of Things (IoT) products. The virtual interface application enables a user of a portable electronic device to activate a virtual control interface overlay on a display, receive a selection from the user using her hands or feet, and send a control signal to a nearby IoT product which executes an action in accordance with the selection. The virtual control interface is presented on the display as a virtual object in an AR environment. The virtual interface application includes a foot tracking tool for detecting an intersection between the foot location (in the physical environment) and the virtual surface position (in the AR environment). When an intersection is detected, the virtual interface application sends a control signal with instructions to the IoT product.
-
公开(公告)号:US20240077933A1
公开(公告)日:2024-03-07
申请号:US17901483
申请日:2022-09-01
申请人: Daekun Kim , Lei Zhang , Youjean Cho , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Daekun Kim , Lei Zhang , Youjean Cho , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
CPC分类号: G06F3/011 , G06T7/70 , G06T19/006 , G06V40/23 , H04W4/06 , G06T2219/024
摘要: A method for detecting full-body gestures by a mobile device includes a host mobile device detecting the tracked body of a co-located participant in a multi-party session. When the participant's tracked body provides a full-body gesture, the host's mobile device recognizes that there is a tracked body providing a full-body gesture. The host mobile device iterates through the list of participants in the multi-party session and finds the closest participant mobile device with respect to the screen-space position of the head of the gesturing participant. The host mobile device then obtains the user ID of the closest participant mobile device and broadcasts the recognized full-body gesture event to all co-located participants in the multi-party session, along with the obtained user ID. Each participant's mobile device may then handle the gesture event as appropriate for the multi-party session. For example, a character or costume may be assigned to a gesturing participant.
-
公开(公告)号:US20240078759A1
公开(公告)日:2024-03-07
申请号:US17901518
申请日:2022-09-01
申请人: Daekun Kim , Lei Zhang , Youjean Cho , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Daekun Kim , Lei Zhang , Youjean Cho , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
CPC分类号: G06T19/006 , G06T13/40 , G06T17/20 , G06T19/003
摘要: Multi-player co-located AR experiences are augmented by assigning characters and costumes to respective participants (a.k.a. “users” of AR-enabled mobile devices) in multi-player AR sessions for storytelling, play acting, and the like. Body tracking technology and augmented reality (AR) software are used to decorate the bodies of the co-located participants with virtual costumes within the context of the multi-player co-located AR experiences. Tracked bodies are distinguished to determine which body belongs to which user and hence which virtual costume belongs to which tracked body so that corresponding costumes may be assigned for display in augmented reality. A host-guest mechanism is used for networked assignment of characters and corresponding costumes in the co-located multi-player AR session. Body tracking technology is used to move the costume with the body as movement of the assigned body is detected.
-
6.
公开(公告)号:US20240077934A1
公开(公告)日:2024-03-07
申请号:US17901568
申请日:2022-09-01
申请人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
CPC分类号: G06F3/011 , G06F1/163 , G06T19/006
摘要: Described are virtual AR interfaces for generating a virtual rotational interface for the purpose of controlling connected IoT devices using the inertial measurement unit (IMU) of a portable electronic device. The IMU control application enables a user of a portable electronic device to activate a virtual rotational interface overlay on a display and adjust a feature of a connected IoT product by rotating a portable electronic device. The device IMU moves a slider on the virtual rotational interface. The IMU control application sends a control signal to the IoT product which executes an action in accordance with the slider position. The virtual rotational interface is presented on the display as a virtual object in an AR environment. The IMU control application detects the device orientation (in the physical environment) and in response presents a corresponding slider element on the virtual rotational interface (in the AR environment).
-
公开(公告)号:US20240079031A1
公开(公告)日:2024-03-07
申请号:US17901540
申请日:2022-09-01
申请人: Lei Zhang , Daekun Kim , Youjean Cho , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Lei Zhang , Daekun Kim , Youjean Cho , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
IPC分类号: G11B27/031 , G06F3/04817 , G06F3/04842 , G06F3/16 , G06T19/00 , G06V20/20 , G10L15/08 , G10L15/22 , G11B27/34
CPC分类号: G11B27/031 , G06F3/04817 , G06F3/04842 , G06F3/167 , G06T19/006 , G06V20/20 , G10L15/08 , G10L15/22 , G11B27/34 , G06T2200/24 , G10L2015/088
摘要: Described are authoring tools for creating interactive AR experiences. The story-authoring application enables a user with little or no programming skills to create an interactive story that includes recording voice commands for advancing to the next scene, inserting and manipulating virtual objects in a mixed-reality environment, and recording a variety of interactions with connected IoT devices. The story creation interface is presented on the display as a virtual object in an AR environment.
-
8.
公开(公告)号:US20240077984A1
公开(公告)日:2024-03-07
申请号:US17901611
申请日:2022-09-01
申请人: Lei Zhang , Ava Robinson , Daekun Kim , Youjean Cho , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Lei Zhang , Ava Robinson , Daekun Kim , Youjean Cho , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
IPC分类号: G06F3/04815 , G06F3/01 , G06F3/0486 , G06F3/0488 , G06F3/16 , G06T11/00
CPC分类号: G06F3/04815 , G06F3/011 , G06F3/0486 , G06F3/0488 , G06F3/167 , G06T11/00 , G06F3/04842 , G06T2200/24
摘要: Described are recording tools for generating following behaviors and creating interactive AR experiences. The following recording application enables a user with little or no programming skills to virtually connect virtual objects to other elements, including virtual avatars representing fellow users, thereby creating an interactive story in which multiple elements are apparently and persistently connected. The following interface includes methods for selecting objects and instructions for connecting a virtual object to a target object. In one example, the recording application presents on the display a virtual tether between the objects until a connecting action is detected. The following interface is presented on the display as an overlay, in the foreground relative to the physical environment.
-
公开(公告)号:US12073011B2
公开(公告)日:2024-08-27
申请号:US17901630
申请日:2022-09-01
申请人: Youjean Cho , Lei Zhang , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Youjean Cho , Lei Zhang , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
CPC分类号: G06F3/011 , G06F3/017 , G06F3/0334 , G06V10/255 , G06V40/20 , G16Y20/40 , H04N13/111
摘要: A virtual interface application presented in augmented reality (AR) is described for controlling Internet of Things (IoT) products. The virtual interface application enables a user of a portable electronic device to activate a virtual control interface overlay on a display, receive a selection from the user using her hands or feet, and send a control signal to a nearby IoT product which executes an action in accordance with the selection. The virtual control interface is presented on the display as a virtual object in an AR environment. The virtual interface application includes a foot tracking tool for detecting an intersection between the foot location (in the physical environment) and the virtual surface position (in the AR environment). When an intersection is detected, the virtual interface application sends a control signal with instructions to the IoT product.
-
10.
公开(公告)号:US12045383B2
公开(公告)日:2024-07-23
申请号:US17901568
申请日:2022-09-01
申请人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
CPC分类号: G06F3/011 , G06F1/163 , G06T19/006
摘要: Described are virtual AR interfaces for generating a virtual rotational interface for the purpose of controlling connected IoT devices using the inertial measurement unit (IMU) of a portable electronic device. The IMU control application enables a user of a portable electronic device to activate a virtual rotational interface overlay on a display and adjust a feature of a connected IoT product by rotating a portable electronic device. The device IMU moves a slider on the virtual rotational interface. The IMU control application sends a control signal to the IoT product which executes an action in accordance with the slider position. The virtual rotational interface is presented on the display as a virtual object in an AR environment. The IMU control application detects the device orientation (in the physical environment) and in response presents a corresponding slider element on the virtual rotational interface (in the AR environment).
-
-
-
-
-
-
-
-
-