-
公开(公告)号:US11875022B2
公开(公告)日:2024-01-16
申请号:US17460228
申请日:2021-08-29
IPC分类号: G06V20/20 , G06F3/0484 , H04N23/63 , G06F3/01 , G06F3/0482 , G16Y40/35
CPC分类号: G06F3/0484 , G06F3/017 , G06F3/0482 , G06V20/20 , H04N23/63 , G16Y40/35
摘要: Systems and methods for interfacing augmented reality (AR) camera devices to Internet of Things (IoT) devices include pairing an AR camera device to an IoT device to establish which actions recognized by the AR camera device may control the IoT device, receiving an action identifier representing a gesture or position of a body part that has been recognized by the AR camera device, and sending a command to the IoT device paired with the AR camera device to perform a requested action in response to the action identifier received from the AR camera device. Context information relating to the action identifier from the AR camera may be used to modify the command sent to the IoT device. The AR camera device may be paired with an IoT device pointed at by the AR camera device, selected through a user interface of the AR camera device, or determined from context information.
-
公开(公告)号:US11765115B2
公开(公告)日:2023-09-19
申请号:US17389212
申请日:2021-07-29
申请人: Fannie Liu , Yu Jiang Tham , Tsung-Yu Tsai , Sven Kratz , Andrés Monroy-Hernández , Brian Anthony Smith
发明人: Fannie Liu , Yu Jiang Tham , Tsung-Yu Tsai , Sven Kratz , Andrés Monroy-Hernández , Brian Anthony Smith
IPC分类号: G06F15/16 , H04L51/10 , G06F3/0482
CPC分类号: H04L51/10 , G06F3/0482
摘要: A system and method for recommending emojis to send by a messaging application includes receiving user biosignals from at least one sensor, receiving context information from at least one context source, and selecting, using a rule-based heuristic state selector, a list of plausible user states from possible heuristic states in a heuristic state table based on the received user biosignals and received context information. A state predictor determines, from at least the list of plausible user states and a user model of emojis previously sent in different user states, a list of user states and probabilities that the user will send an emoji for each user state given the context information. The recommended emojis are displayed for selection for sending by the messaging application in order from the highest to the lowest probabilities that the user will send the recommended emojis based on a selected plausible user state.
-
公开(公告)号:US20230069328A1
公开(公告)日:2023-03-02
申请号:US17890439
申请日:2022-08-18
申请人: Hanseul Jun , Sven Kratz , Joanne Leong , Xingyu Liu , Andrés Monroy-Hernández , Brian Anthony Smith , Yu Jiang Tham , Rajan Vaish
发明人: Hanseul Jun , Sven Kratz , Joanne Leong , Xingyu Liu , Andrés Monroy-Hernández , Brian Anthony Smith , Yu Jiang Tham , Rajan Vaish
摘要: Systems and methods are described for sending a snapshot message using an electronic eyewear device by a first user capturing an image, identifying a physical marker in the captured image, and determining that the physical marker in the captured image has been within a field of view of the electronic eyewear device for a predetermined amount of time. A 3D snapshot including an object is captured and, each time the identified object appears in a field of view of the electronic eyewear device, a representation of the object is sent for display to a second user as if the real object was sent. The representation of the object may include the snapshot image, the object extracted from the snapshot image, a stored representation of the object, augmented reality content representing the object, etc.
-
公开(公告)号:US20230062763A1
公开(公告)日:2023-03-02
申请号:US17460243
申请日:2021-08-29
摘要: Systems and methods enable users to build augmented reality (AR) experiences with Internet of Things (IoT) devices. The system includes an AR object studio that includes a list of IoT devices and control signals for the respective IoT devices and a list of AR objects (e.g., an AR lens). The AR object studio receives selections from users and correlates at least one IoT device to at least one AR object in response to the user selections. During use, a server receives an indication that an AR object has been activated and interacted with on a display of an AR camera device and, in response, sends a control signal to a correlated IoT device. Conversely, the server may receive a signal from an IoT device and, in response, present and control a correlated AR object on the display of the AR camera device.
-
公开(公告)号:US20230063194A1
公开(公告)日:2023-03-02
申请号:US17460230
申请日:2021-08-29
IPC分类号: G06K9/00 , A63F13/216 , A63F13/217 , H04L29/08 , G16Y40/30
摘要: Systems and methods for controlling an Internet of Things (IoT) device through interaction with an augmented reality (AR) object includes pairing an AR object with an IoT device, presenting the AR object on a display of an AR camera device of a user, receiving an interaction signal indicating that the user has interacted with the AR object on the display of the AR camera device, and sending a control signal to the IoT device paired with the AR object in response to the interaction signal. A second user may request presentation of the AR object to the AR display of the AR camera device of the user when the user's AR camera device is located at particular world coordinates. Also, the control signal may be sent when a particular series of interactions with the AR object have been completed, as during game play.
-
公开(公告)号:US20230035961A1
公开(公告)日:2023-02-02
申请号:US17389212
申请日:2021-07-29
申请人: Fannie Liu , Yu Jiang Tham , Tsung-Yu Tsai , Sven Kratz , Andrés Monroy-Hernández , Brian Anthony Smith
发明人: Fannie Liu , Yu Jiang Tham , Tsung-Yu Tsai , Sven Kratz , Andrés Monroy-Hernández , Brian Anthony Smith
IPC分类号: H04L12/58 , G06F3/0482
摘要: A system and method for recommending emojis to send by a messaging application includes receiving user biosignals from at least one sensor, receiving context information from at least one context source, and selecting, using a rule-based heuristic state selector, a list of plausible user states from possible heuristic states in a heuristic state table based on the received user biosignals and received context information. A state predictor determines, from at least the list of plausible user states and a user model of emojis previously sent in different user states, a list of user states and probabilities that the user will send an emoji for each user state given the context information. The recommended emojis are displayed for selection for sending by the messaging application in order from the highest to the lowest probabilities that the user will send the recommended emojis based on a selected plausible user state.
-
公开(公告)号:US12100110B2
公开(公告)日:2024-09-24
申请号:US17841397
申请日:2022-06-15
IPC分类号: G06T19/00 , G06F3/01 , H04L67/025
CPC分类号: G06T19/006 , G06F3/011 , G06F3/016 , H04L67/025
摘要: Interactive experiences are generated using an augmented reality (AR) system that leverages the native input and output capabilities of AR devices to generate immersive and interactive experiences in smart spaces that combine visually-represented programming logic, AR content, and IoT devices. The system connects IoT devices with each other in a native AR environment, provides virtual content and logic gates, scripts sequences and loops of actions, solves visibility issues for IoT devices that are far apart, and designs logic gates and flow circuits that best support user intentions when generating interactive experiences in smart spaces. The interactive experience is produced by generating a program of behaviors of selected IoT devices using logic gates and control circuits connected to the IoT devices in a visual programming interface of the AR device. Once completed, the program of behaviors is executed by a runtime module to control the IoT devices during the interactive experience.
-
公开(公告)号:US11954774B2
公开(公告)日:2024-04-09
申请号:US17460243
申请日:2021-08-29
CPC分类号: G06T11/60 , G16Y10/65 , H04N23/631
摘要: Systems and methods enable users to build augmented reality (AR) experiences with Internet of Things (IoT) devices. The system includes an AR object studio that includes a list of IoT devices and control signals for the respective IoT devices and a list of AR objects (e.g., an AR lens). The AR object studio receives selections from users and correlates at least one IoT device to at least one AR object in response to the user selections. During use, a server receives an indication that an AR object has been activated and interacted with on a display of an AR camera device and, in response, sends a control signal to a correlated IoT device. Conversely, the server may receive a signal from an IoT device and, in response, present and control a correlated AR object on the display of the AR camera device.
-
公开(公告)号:US11941231B2
公开(公告)日:2024-03-26
申请号:US17460228
申请日:2021-08-29
IPC分类号: G06V20/20 , G06F3/01 , G06F3/0482 , G06F3/0484 , H04N23/63 , G16Y40/35
CPC分类号: G06F3/0484 , G06F3/017 , G06F3/0482 , G06V20/20 , H04N23/63 , G16Y40/35
摘要: Systems and methods for interfacing augmented reality (AR) camera devices to Internet of Things (IoT) devices include pairing an AR camera device to an IoT device to establish which actions recognized by the AR camera device may control the IoT device, receiving an action identifier representing a gesture or position of a body part that has been recognized by the AR camera device, and sending a command to the IoT device paired with the AR camera device to perform a requested action in response to the action identifier received from the AR camera device. Context information relating to the action identifier from the AR camera may be used to modify the command sent to the IoT device. The AR camera device may be paired with an IoT device pointed at by the AR camera device, selected through a user interface of the AR camera device, or determined from context information.
-
公开(公告)号:US20230063944A1
公开(公告)日:2023-03-02
申请号:US17460233
申请日:2021-08-29
摘要: Systems and methods for controlling Internet of Things (IoT) devices using an augmented reality (AR) camera are provided. The system includes a sensor and a server that receives an input from the sensor and presents an AR object on the display of the AR camera device that corresponds to the input from the sensor. A response to the displayed AR object from a user of the AR camera device is used to select a command to send to one or more IoT devices to perform an action corresponding to the user response to the displayed AR object. In an example, an AR smoke object is overlayed on the AR camera display in response to a smoke detection signal from a smoke detector. In response to the user swiping or gesturing to push away the AR smoke object, a window opening command is sent to one or more IoT enabled windows.
-
-
-
-
-
-
-
-
-