-
公开(公告)号:US11875022B2
公开(公告)日:2024-01-16
申请号:US17460228
申请日:2021-08-29
IPC分类号: G06V20/20 , G06F3/0484 , H04N23/63 , G06F3/01 , G06F3/0482 , G16Y40/35
CPC分类号: G06F3/0484 , G06F3/017 , G06F3/0482 , G06V20/20 , H04N23/63 , G16Y40/35
摘要: Systems and methods for interfacing augmented reality (AR) camera devices to Internet of Things (IoT) devices include pairing an AR camera device to an IoT device to establish which actions recognized by the AR camera device may control the IoT device, receiving an action identifier representing a gesture or position of a body part that has been recognized by the AR camera device, and sending a command to the IoT device paired with the AR camera device to perform a requested action in response to the action identifier received from the AR camera device. Context information relating to the action identifier from the AR camera may be used to modify the command sent to the IoT device. The AR camera device may be paired with an IoT device pointed at by the AR camera device, selected through a user interface of the AR camera device, or determined from context information.
-
公开(公告)号:US11765115B2
公开(公告)日:2023-09-19
申请号:US17389212
申请日:2021-07-29
申请人: Fannie Liu , Yu Jiang Tham , Tsung-Yu Tsai , Sven Kratz , Andrés Monroy-Hernández , Brian Anthony Smith
发明人: Fannie Liu , Yu Jiang Tham , Tsung-Yu Tsai , Sven Kratz , Andrés Monroy-Hernández , Brian Anthony Smith
IPC分类号: G06F15/16 , H04L51/10 , G06F3/0482
CPC分类号: H04L51/10 , G06F3/0482
摘要: A system and method for recommending emojis to send by a messaging application includes receiving user biosignals from at least one sensor, receiving context information from at least one context source, and selecting, using a rule-based heuristic state selector, a list of plausible user states from possible heuristic states in a heuristic state table based on the received user biosignals and received context information. A state predictor determines, from at least the list of plausible user states and a user model of emojis previously sent in different user states, a list of user states and probabilities that the user will send an emoji for each user state given the context information. The recommended emojis are displayed for selection for sending by the messaging application in order from the highest to the lowest probabilities that the user will send the recommended emojis based on a selected plausible user state.
-
公开(公告)号:US20230069328A1
公开(公告)日:2023-03-02
申请号:US17890439
申请日:2022-08-18
申请人: Hanseul Jun , Sven Kratz , Joanne Leong , Xingyu Liu , Andrés Monroy-Hernández , Brian Anthony Smith , Yu Jiang Tham , Rajan Vaish
发明人: Hanseul Jun , Sven Kratz , Joanne Leong , Xingyu Liu , Andrés Monroy-Hernández , Brian Anthony Smith , Yu Jiang Tham , Rajan Vaish
摘要: Systems and methods are described for sending a snapshot message using an electronic eyewear device by a first user capturing an image, identifying a physical marker in the captured image, and determining that the physical marker in the captured image has been within a field of view of the electronic eyewear device for a predetermined amount of time. A 3D snapshot including an object is captured and, each time the identified object appears in a field of view of the electronic eyewear device, a representation of the object is sent for display to a second user as if the real object was sent. The representation of the object may include the snapshot image, the object extracted from the snapshot image, a stored representation of the object, augmented reality content representing the object, etc.
-
公开(公告)号:US20230062763A1
公开(公告)日:2023-03-02
申请号:US17460243
申请日:2021-08-29
摘要: Systems and methods enable users to build augmented reality (AR) experiences with Internet of Things (IoT) devices. The system includes an AR object studio that includes a list of IoT devices and control signals for the respective IoT devices and a list of AR objects (e.g., an AR lens). The AR object studio receives selections from users and correlates at least one IoT device to at least one AR object in response to the user selections. During use, a server receives an indication that an AR object has been activated and interacted with on a display of an AR camera device and, in response, sends a control signal to a correlated IoT device. Conversely, the server may receive a signal from an IoT device and, in response, present and control a correlated AR object on the display of the AR camera device.
-
公开(公告)号:US20230410437A1
公开(公告)日:2023-12-21
申请号:US17841397
申请日:2022-06-15
IPC分类号: G06T19/00 , G06F3/01 , H04L67/025
CPC分类号: G06T19/006 , G06F3/016 , G06F3/011 , H04L67/025
摘要: Interactive experiences are generated using an augmented reality (AR) system that leverages the native input and output capabilities of AR devices to generate immersive and interactive experiences in smart spaces that combine visually-represented programming logic, AR content, and IoT devices. The system connects IoT devices with each other in a native AR environment, provides virtual content and logic gates, scripts sequences and loops of actions, solves visibility issues for IoT devices that are far apart, and designs logic gates and flow circuits that best support user intentions when generating interactive experiences in smart spaces. The interactive experience is produced by generating a program of behaviors of selected IoT devices using logic gates and control circuits connected to the IoT devices in a visual programming interface of the AR device. Once completed, the program of behaviors is executed by a runtime module to control the IoT devices during the interactive experience.
-
公开(公告)号:US20230409158A1
公开(公告)日:2023-12-21
申请号:US17841365
申请日:2022-06-15
IPC分类号: G06F3/0481 , G06F3/04842 , G06F3/01 , G06T11/00
CPC分类号: G06F3/0481 , G06F3/04842 , G06F3/017 , G06T11/00 , G06T2200/24 , G16Y40/10
摘要: An augmented reality (AR) device is interfaced to an Internet of Things (IoT) device by receiving IoT device information in a standardized schema from the IoT device. The IoT device information includes device inputs and available output information for the IoT device. A predetermined AR user interface widget to render for the IoT device is determined from the received IoT device information. The predetermined AR user interface widget converts user inputs to the AR device into the device inputs for the IoT device. Upon selection of the IoT device by the AR device, the predetermined AR user interface widget for the selected IoT device is provided to the AR device as an overlay on a display of the AR device. Device input received in response to user interaction with the AR user interface widget is provided to the IoT device in an input type expected by the IoT device.
-
公开(公告)号:US20230069042A1
公开(公告)日:2023-03-02
申请号:US17460228
申请日:2021-08-29
IPC分类号: G06F3/0484 , H04N5/232 , G06F3/0482 , G06F3/01 , G06K9/00
摘要: Systems and methods for interfacing augmented reality (AR) camera devices to Internet of Things (IoT) devices include pairing an AR camera device to an IoT device to establish which actions recognized by the AR camera device may control the IoT device, receiving an action identifier representing a gesture or position of a body part that has been recognized by the AR camera device, and sending a command to the IoT device paired with the AR camera device to perform a requested action in response to the action identifier received from the AR camera device. Context information relating to the action identifier from the AR camera may be used to modify the command sent to the IoT device. The AR camera device may be paired with an IoT device pointed at by the AR camera device, selected through a user interface of the AR camera device, or determined from context information.
-
公开(公告)号:US20230063194A1
公开(公告)日:2023-03-02
申请号:US17460230
申请日:2021-08-29
IPC分类号: G06K9/00 , A63F13/216 , A63F13/217 , H04L29/08 , G16Y40/30
摘要: Systems and methods for controlling an Internet of Things (IoT) device through interaction with an augmented reality (AR) object includes pairing an AR object with an IoT device, presenting the AR object on a display of an AR camera device of a user, receiving an interaction signal indicating that the user has interacted with the AR object on the display of the AR camera device, and sending a control signal to the IoT device paired with the AR object in response to the interaction signal. A second user may request presentation of the AR object to the AR display of the AR camera device of the user when the user's AR camera device is located at particular world coordinates. Also, the control signal may be sent when a particular series of interactions with the AR object have been completed, as during game play.
-
公开(公告)号:US20230035961A1
公开(公告)日:2023-02-02
申请号:US17389212
申请日:2021-07-29
申请人: Fannie Liu , Yu Jiang Tham , Tsung-Yu Tsai , Sven Kratz , Andrés Monroy-Hernández , Brian Anthony Smith
发明人: Fannie Liu , Yu Jiang Tham , Tsung-Yu Tsai , Sven Kratz , Andrés Monroy-Hernández , Brian Anthony Smith
IPC分类号: H04L12/58 , G06F3/0482
摘要: A system and method for recommending emojis to send by a messaging application includes receiving user biosignals from at least one sensor, receiving context information from at least one context source, and selecting, using a rule-based heuristic state selector, a list of plausible user states from possible heuristic states in a heuristic state table based on the received user biosignals and received context information. A state predictor determines, from at least the list of plausible user states and a user model of emojis previously sent in different user states, a list of user states and probabilities that the user will send an emoji for each user state given the context information. The recommended emojis are displayed for selection for sending by the messaging application in order from the highest to the lowest probabilities that the user will send the recommended emojis based on a selected plausible user state.
-
公开(公告)号:US12100110B2
公开(公告)日:2024-09-24
申请号:US17841397
申请日:2022-06-15
IPC分类号: G06T19/00 , G06F3/01 , H04L67/025
CPC分类号: G06T19/006 , G06F3/011 , G06F3/016 , H04L67/025
摘要: Interactive experiences are generated using an augmented reality (AR) system that leverages the native input and output capabilities of AR devices to generate immersive and interactive experiences in smart spaces that combine visually-represented programming logic, AR content, and IoT devices. The system connects IoT devices with each other in a native AR environment, provides virtual content and logic gates, scripts sequences and loops of actions, solves visibility issues for IoT devices that are far apart, and designs logic gates and flow circuits that best support user intentions when generating interactive experiences in smart spaces. The interactive experience is produced by generating a program of behaviors of selected IoT devices using logic gates and control circuits connected to the IoT devices in a visual programming interface of the AR device. Once completed, the program of behaviors is executed by a runtime module to control the IoT devices during the interactive experience.
-
-
-
-
-
-
-
-
-