-
公开(公告)号:US20230069042A1
公开(公告)日:2023-03-02
申请号:US17460228
申请日:2021-08-29
IPC分类号: G06F3/0484 , H04N5/232 , G06F3/0482 , G06F3/01 , G06K9/00
摘要: Systems and methods for interfacing augmented reality (AR) camera devices to Internet of Things (IoT) devices include pairing an AR camera device to an IoT device to establish which actions recognized by the AR camera device may control the IoT device, receiving an action identifier representing a gesture or position of a body part that has been recognized by the AR camera device, and sending a command to the IoT device paired with the AR camera device to perform a requested action in response to the action identifier received from the AR camera device. Context information relating to the action identifier from the AR camera may be used to modify the command sent to the IoT device. The AR camera device may be paired with an IoT device pointed at by the AR camera device, selected through a user interface of the AR camera device, or determined from context information.
-
公开(公告)号:US20240077983A1
公开(公告)日:2024-03-07
申请号:US17901589
申请日:2022-09-01
申请人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
IPC分类号: G06F3/04815 , G06F3/01 , G06F3/04842 , G06F3/16 , G06F9/54 , G06T7/70 , G06T19/00 , G06V20/20
CPC分类号: G06F3/04815 , G06F3/011 , G06F3/04842 , G06F3/167 , G06F9/541 , G06T7/70 , G06T19/006 , G06V20/20 , G06T2200/24 , G06T2207/30244
摘要: Recording tools for creating interactive AR experiences. An interaction recording application enables a user with little or no programming skills to perform and record user behaviors that are associated with reactions between story elements such as virtual objects and connected IoT devices. The user behaviors include a range of actions, such as speaking a trigger word and apparently touching a virtual object. The corresponding reactions include starting to record a subsequent scene and executing actions between story elements. The trigger recording interface is presented on the display as an overlay relative to the physical environment.
-
公开(公告)号:US20240077935A1
公开(公告)日:2024-03-07
申请号:US17901630
申请日:2022-09-01
申请人: Youjean Cho , Lei Zhang , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Youjean Cho , Lei Zhang , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
CPC分类号: G06F3/011 , G06F3/017 , G06F3/0334 , G06V10/255 , G06V40/20 , G16Y20/40 , H04N13/111
摘要: A virtual interface application presented in augmented reality (AR) is described for controlling Internet of Things (IoT) products. The virtual interface application enables a user of a portable electronic device to activate a virtual control interface overlay on a display, receive a selection from the user using her hands or feet, and send a control signal to a nearby IoT product which executes an action in accordance with the selection. The virtual control interface is presented on the display as a virtual object in an AR environment. The virtual interface application includes a foot tracking tool for detecting an intersection between the foot location (in the physical environment) and the virtual surface position (in the AR environment). When an intersection is detected, the virtual interface application sends a control signal with instructions to the IoT product.
-
公开(公告)号:US20240077933A1
公开(公告)日:2024-03-07
申请号:US17901483
申请日:2022-09-01
申请人: Daekun Kim , Lei Zhang , Youjean Cho , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Daekun Kim , Lei Zhang , Youjean Cho , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
CPC分类号: G06F3/011 , G06T7/70 , G06T19/006 , G06V40/23 , H04W4/06 , G06T2219/024
摘要: A method for detecting full-body gestures by a mobile device includes a host mobile device detecting the tracked body of a co-located participant in a multi-party session. When the participant's tracked body provides a full-body gesture, the host's mobile device recognizes that there is a tracked body providing a full-body gesture. The host mobile device iterates through the list of participants in the multi-party session and finds the closest participant mobile device with respect to the screen-space position of the head of the gesturing participant. The host mobile device then obtains the user ID of the closest participant mobile device and broadcasts the recognized full-body gesture event to all co-located participants in the multi-party session, along with the obtained user ID. Each participant's mobile device may then handle the gesture event as appropriate for the multi-party session. For example, a character or costume may be assigned to a gesturing participant.
-
15.
公开(公告)号:US20240338071A1
公开(公告)日:2024-10-10
申请号:US18748987
申请日:2024-06-20
申请人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
CPC分类号: G06F3/011 , G06F1/163 , G06T19/006
摘要: Described are virtual AR interfaces for generating a virtual rotational interface for the purpose of controlling connected IoT devices using the inertial measurement unit (IMU) of a portable electronic device. The IMU control application enables a user of a portable electronic device to activate a virtual rotational interface overlay on a display and adjust a feature of a connected IoT product by rotating a portable electronic device. The device IMU moves a slider on the virtual rotational interface. The IMU control application sends a control signal to the IoT product which executes an action in accordance with the slider position. The virtual rotational interface is presented on the display as a virtual object in an AR environment. The IMU control application detects the device orientation (in the physical environment) and in response presents a corresponding slider element on the virtual rotational interface (in the AR environment).
-
公开(公告)号:US20220351279A1
公开(公告)日:2022-11-03
申请号:US17243783
申请日:2021-04-29
摘要: A system and method for viewing a virtual digital object created from components having cryptocurrency value includes receiving a selection of at least one of an avatar, a captured image of the user or a third party, or a digital scene and receiving a selection of the virtual digital object for display on the selected avatar or captured image or within the digital scene. The virtual digital object includes metadata relating to at least one of cryptocurrency value of the virtual digital object, creation of the virtual digital object, and rules governing use and ownership of the virtual digital object. The user may manipulate the displayed virtual digital object within the display and may elect to display at least part of the metadata (e.g., price) along with the virtual digital object. The display of the virtual digital object may be captured and forwarded via a messaging or social media application.
-
公开(公告)号:US20220203223A1
公开(公告)日:2022-06-30
申请号:US17136843
申请日:2020-12-29
IPC分类号: A63F13/213 , A63F13/2145
摘要: Systems, methods, and computer readable media directed to multi-user visual experiences such as interactive gaming experiences and artistic media experiences. A viewing electronic device includes a camera configured to capture images, a display, and a processor coupled to the camera and the display. The processor is configured to capture, with the camera, images of a rotating marker where the rotating marker is presented on a monitor of a remote device and to present, on the display, a visual experience where the visual experience has an adjustable feature. The processor detects a parameter of the rotating marker from the captured images that corresponds to the adjustable feature and updates the visual experience responsive to the detected parameter. The parameter may be one or more of an angle, speed of rotation, direction of rotation, color, or pattern of the rotating marker.
-
公开(公告)号:US12073011B2
公开(公告)日:2024-08-27
申请号:US17901630
申请日:2022-09-01
申请人: Youjean Cho , Lei Zhang , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Youjean Cho , Lei Zhang , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
CPC分类号: G06F3/011 , G06F3/017 , G06F3/0334 , G06V10/255 , G06V40/20 , G16Y20/40 , H04N13/111
摘要: A virtual interface application presented in augmented reality (AR) is described for controlling Internet of Things (IoT) products. The virtual interface application enables a user of a portable electronic device to activate a virtual control interface overlay on a display, receive a selection from the user using her hands or feet, and send a control signal to a nearby IoT product which executes an action in accordance with the selection. The virtual control interface is presented on the display as a virtual object in an AR environment. The virtual interface application includes a foot tracking tool for detecting an intersection between the foot location (in the physical environment) and the virtual surface position (in the AR environment). When an intersection is detected, the virtual interface application sends a control signal with instructions to the IoT product.
-
19.
公开(公告)号:US12045383B2
公开(公告)日:2024-07-23
申请号:US17901568
申请日:2022-09-01
申请人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
发明人: Lei Zhang , Youjean Cho , Daekun Kim , Ava Robinson , Yu Jiang Tham , Rajan Vaish , Andrés Monroy-Hernández
CPC分类号: G06F3/011 , G06F1/163 , G06T19/006
摘要: Described are virtual AR interfaces for generating a virtual rotational interface for the purpose of controlling connected IoT devices using the inertial measurement unit (IMU) of a portable electronic device. The IMU control application enables a user of a portable electronic device to activate a virtual rotational interface overlay on a display and adjust a feature of a connected IoT product by rotating a portable electronic device. The device IMU moves a slider on the virtual rotational interface. The IMU control application sends a control signal to the IoT product which executes an action in accordance with the slider position. The virtual rotational interface is presented on the display as a virtual object in an AR environment. The IMU control application detects the device orientation (in the physical environment) and in response presents a corresponding slider element on the virtual rotational interface (in the AR environment).
-
公开(公告)号:US12106360B2
公开(公告)日:2024-10-01
申请号:US17244252
申请日:2021-04-29
IPC分类号: G06Q30/0601 , G06Q20/12 , G06Q20/36 , G06T19/00
CPC分类号: G06Q30/0643 , G06Q20/1235 , G06Q20/363 , G06Q20/3674 , G06T19/006
摘要: A system and method for creating a virtual digital object comprising a plurality of components includes receiving from a user selections of a plurality of components for use in creating the virtual digital object. Each component has a cost designated in cryptocurrency that is presented for acceptance by the user. Upon acceptance, a cost tally for the virtual digital object is updated. Upon completion, the virtual digital object is minted by subtracting a total cost tally in cryptocurrency from a digital wallet of the user and by interacting with a smart contract including the virtual digital object and metadata relating to at least one of valuation of the virtual digital object, creation of the virtual digital object, and rules governing use and ownership of the virtual digital object. The minted virtual digital object is added to the user's digital wallet and optionally uploaded to an online gallery for purchase.
-
-
-
-
-
-
-
-
-