公开(公告)号：US20240056524A1

公开(公告)日：2024-02-15

申请号：US18384251

申请日：2023-10-26

Applicant: Andrés Monroy-Hernández ,  Sven Kratz ,  Rajan Vaish

Inventor： Andrés Monroy-Hernández ,  Sven Kratz ,  Rajan Vaish

IPC: H04M1/72469 ,  H04M1/72439 ,  A61L9/012 ,  G06F3/01 ,  G06F3/041 ,  G06F3/0488 ,  G06T11/00

CPC classification number: H04M1/72469 ,  H04M1/72439 ,  A61L9/012 ,  G06F3/011 ,  G06F3/0416 ,  G06F3/0488 ,  G06T11/00 ,  A61L2209/11 ,  G06T2200/24

Abstract: An olfactory sticker used in chats between electronic devices to make messaging more immersive, personalized, and authentic by integrating olfactory information with traditional text-based formats and AR messaging. Olfactory stickers are used to indicate to a recipient that a message includes olfactory information. The olfactory sticker illustrates a graphical representation of a particular scent that can be sent and received via a chat or an AR message. Olfactory stickers provide the recipient control of accessing the transmitted scent at a desired time. This is particularly useful since certain olfactory information, i.e., scents, can be very direct and intrusive. Olfactory stickers are activated (i.e., release their scent) when they are tapped or rubbed by the recipient.

公开(公告)号：US20240027394A1

公开(公告)日：2024-01-25

申请号：US17868445

申请日：2022-07-19

Applicant: Sven Kratz ,  Andrés Monroy-Hernández ,  Rajan Vaish

Inventor： Sven Kratz ,  Andrés Monroy-Hernández ,  Rajan Vaish

IPC: G01N27/414 ,  H04M1/72403

CPC classification number: G01N27/414 ,  H04M1/72403

Abstract: An electronic device including an olfactory detector including an array of olfactory sensors for determining scents proximate the electronic device, such as a smartphone, smart eyewear, and a smart watch. Each sensor in the array of olfactory sensors is tuned to detect the presence and concentration of one or more specific chemical compounds or molecules. A fan creates airflow of ambient air across the olfactory sensors. An analog to digital (A/D) converter receives and processes the sensor outputs of the olfactory sensors and provides the processed sensor output to a processor for further processing. Scent type and intensity can be classified by using the information from the scent sensors as input for a machine learning model, generated through supervised training using labeled example measurements from our sensor array. The processor may display information of the determined scents on a display of the smart device, and the processor can also send information indicative of the determined scents to another device.

公开(公告)号：US11811964B1

公开(公告)日：2023-11-07

申请号：US17868395

申请日：2022-07-19

Applicant: Andrés Monroy-Hernández ,  Sven Kratz ,  Rajan Vaish

Inventor： Andrés Monroy-Hernández ,  Sven Kratz ,  Rajan Vaish

IPC: H04M1/72469 ,  G06F3/041 ,  G06F3/01 ,  G06F3/0488 ,  G06T11/00 ,  A61L9/012 ,  H04M1/72439

CPC classification number: H04M1/72469 ,  A61L9/012 ,  G06F3/011 ,  G06F3/0416 ,  G06F3/0488 ,  G06T11/00 ,  H04M1/72439 ,  A61L2209/11 ,  G06T2200/24

Abstract: An olfactory sticker used in chats between electronic devices to make messaging more immersive, personalized, and authentic by integrating olfactory information with traditional text-based formats and AR messaging. Olfactory stickers are used to indicate to a recipient that a message includes olfactory information. The olfactory sticker illustrates a graphical representation of a particular scent that can be sent and received via a chat or an AR message. Olfactory stickers provide the recipient control of accessing the transmitted scent at a desired time. This is particularly useful since certain olfactory information, i.e., scents, can be very direct and intrusive. Olfactory stickers are activated (i.e., release their scent) when they are tapped or rubbed by the recipient.

公开(公告)号：US20230063194A1

公开(公告)日：2023-03-02

申请号：US17460230

申请日：2021-08-29

Applicant: Yu Jiang Tham ,  Rajan Vaish ,  Andrés Monroy-Hernández ,  Sven Kratz ,  Ana Maria Cardenas Gasca

Inventor： Yu Jiang Tham ,  Rajan Vaish ,  Andrés Monroy-Hernández ,  Sven Kratz ,  Ana Maria Cardenas Gasca

IPC: G06K9/00 ,  A63F13/216 ,  A63F13/217 ,  H04L29/08 ,  G16Y40/30

Abstract: Systems and methods for controlling an Internet of Things (IoT) device through interaction with an augmented reality (AR) object includes pairing an AR object with an IoT device, presenting the AR object on a display of an AR camera device of a user, receiving an interaction signal indicating that the user has interacted with the AR object on the display of the AR camera device, and sending a control signal to the IoT device paired with the AR object in response to the interaction signal. A second user may request presentation of the AR object to the AR display of the AR camera device of the user when the user's AR camera device is located at particular world coordinates. Also, the control signal may be sent when a particular series of interactions with the AR object have been completed, as during game play.

公开(公告)号：US20230035961A1

公开(公告)日：2023-02-02

申请号：US17389212

申请日：2021-07-29

Applicant: Fannie Liu ,  Yu Jiang Tham ,  Tsung-Yu Tsai ,  Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith

Inventor： Fannie Liu ,  Yu Jiang Tham ,  Tsung-Yu Tsai ,  Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith

IPC: H04L12/58 ,  G06F3/0482

Abstract: A system and method for recommending emojis to send by a messaging application includes receiving user biosignals from at least one sensor, receiving context information from at least one context source, and selecting, using a rule-based heuristic state selector, a list of plausible user states from possible heuristic states in a heuristic state table based on the received user biosignals and received context information. A state predictor determines, from at least the list of plausible user states and a user model of emojis previously sent in different user states, a list of user states and probabilities that the user will send an emoji for each user state given the context information. The recommended emojis are displayed for selection for sending by the messaging application in order from the highest to the lowest probabilities that the user will send the recommended emojis based on a selected plausible user state.

公开(公告)号：US20230410437A1

公开(公告)日：2023-12-21

申请号：US17841397

申请日：2022-06-15

Applicant: Sven Kratz ,  Andrés Monroy-Hernández ,  Yu Jiang THAM

Inventor： Sven Kratz ,  Andrés Monroy-Hernández ,  Yu Jiang THAM

IPC: G06T19/00 ,  G06F3/01 ,  H04L67/025

CPC classification number: G06T19/006 ,  G06F3/016 ,  G06F3/011 ,  H04L67/025

Abstract: Interactive experiences are generated using an augmented reality (AR) system that leverages the native input and output capabilities of AR devices to generate immersive and interactive experiences in smart spaces that combine visually-represented programming logic, AR content, and IoT devices. The system connects IoT devices with each other in a native AR environment, provides virtual content and logic gates, scripts sequences and loops of actions, solves visibility issues for IoT devices that are far apart, and designs logic gates and flow circuits that best support user intentions when generating interactive experiences in smart spaces. The interactive experience is produced by generating a program of behaviors of selected IoT devices using logic gates and control circuits connected to the IoT devices in a visual programming interface of the AR device. Once completed, the program of behaviors is executed by a runtime module to control the IoT devices during the interactive experience.

公开(公告)号：US20230409158A1

公开(公告)日：2023-12-21

申请号：US17841365

申请日：2022-06-15

Applicant: Sven Kratz ,  Andrés Monroy-Hernández ,  Yu Jiang THAM

Inventor： Sven Kratz ,  Andrés Monroy-Hernández ,  Yu Jiang THAM

IPC: G06F3/0481 ,  G06F3/04842 ,  G06F3/01 ,  G06T11/00

CPC classification number: G06F3/0481 ,  G06F3/04842 ,  G06F3/017 ,  G06T11/00 ,  G06T2200/24 ,  G16Y40/10

Abstract: An augmented reality (AR) device is interfaced to an Internet of Things (IoT) device by receiving IoT device information in a standardized schema from the IoT device. The IoT device information includes device inputs and available output information for the IoT device. A predetermined AR user interface widget to render for the IoT device is determined from the received IoT device information. The predetermined AR user interface widget converts user inputs to the AR device into the device inputs for the IoT device. Upon selection of the IoT device by the AR device, the predetermined AR user interface widget for the selected IoT device is provided to the AR device as an overlay on a display of the AR device. Device input received in response to user interaction with the AR user interface widget is provided to the IoT device in an input type expected by the IoT device.

公开(公告)号：US20230069042A1

公开(公告)日：2023-03-02

申请号：US17460228

申请日：2021-08-29

Applicant: Yu Jiang Tham ,  Rajan Vaish ,  Andrés Monroy-Hernández ,  Sven Kratz ,  Ana Maria Cardenas Gasca

Inventor： Yu Jiang Tham ,  Rajan Vaish ,  Andrés Monroy-Hernández ,  Sven Kratz ,  Ana Maria Cardenas Gasca

IPC: G06F3/0484 ,  H04N5/232 ,  G06F3/0482 ,  G06F3/01 ,  G06K9/00

Abstract: Systems and methods for interfacing augmented reality (AR) camera devices to Internet of Things (IoT) devices include pairing an AR camera device to an IoT device to establish which actions recognized by the AR camera device may control the IoT device, receiving an action identifier representing a gesture or position of a body part that has been recognized by the AR camera device, and sending a command to the IoT device paired with the AR camera device to perform a requested action in response to the action identifier received from the AR camera device. Context information relating to the action identifier from the AR camera may be used to modify the command sent to the IoT device. The AR camera device may be paired with an IoT device pointed at by the AR camera device, selected through a user interface of the AR camera device, or determined from context information.

公开(公告)号：US12175746B2

公开(公告)日：2024-12-24

申请号：US17460230

申请日：2021-08-29

Applicant: Yu Jiang Tham ,  Rajan Vaish ,  Andrés Monroy-Hernández ,  Sven Kratz ,  Ana Maria Cardenas Gasca

Inventor： Yu Jiang Tham ,  Rajan Vaish ,  Andrés Monroy-Hernández ,  Sven Kratz ,  Ana Maria Cardenas Gasca

IPC: G06V20/20 ,  A63F13/216 ,  A63F13/217 ,  G06F3/04847 ,  G06T19/00 ,  G16Y40/30 ,  H04L67/12

Abstract: Systems and methods for controlling an Internet of Things (IoT) device through interaction with an augmented reality (AR) object includes pairing an AR object with an IoT device, presenting the AR object on a display of an AR camera device of a user, receiving an interaction signal indicating that the user has interacted with the AR object on the display of the AR camera device, and sending a control signal to the IoT device paired with the AR object in response to the interaction signal. A second user may request presentation of the AR object to the AR display of the AR camera device of the user when the user's AR camera device is located at particular world coordinates. Also, the control signal may be sent when a particular series of interactions with the AR object have been completed, as during game play.

公开(公告)号：US20230298247A1

公开(公告)日：2023-09-21

申请号：US17695399

申请日：2022-03-15

Applicant: Yu Jiang Tham ,  Rajan Vaish ,  Sven Kratz

Inventor： Yu Jiang Tham ,  Rajan Vaish ,  Sven Kratz

IPC: H04L65/1089 ,  H04N13/398 ,  H04L51/08 ,  H04L51/222 ,  H04N13/332 ,  H04N13/111 ,  H04L65/1069

CPC classification number: H04L65/1089 ,  H04N13/398 ,  H04L51/08 ,  H04L51/20 ,  H04N13/332 ,  H04N13/111 ,  H04L65/1069 ,  H04N2213/008

Abstract: Users of electronic eyewear devices can interact with each other by sharing 3D objects (e.g., 2D or 3D augmented reality (AR) objects or scanned 2D or 3D images of real-world objects) with each other via local objects (real or virtual) in each user's environment established as personalized anchor points for social connection. When a user receives an object from another user, the user has the option to generate a connected session with other users that are co-located (physically or virtually at the same location) with the user. The co-located group of users in this new connected session may view the received object either on their personal electronic devices (e.g., smartphones) or on their electronic eyewear devices and can modify and annotate the shared object using collaboration software and AR display tools that enable modification and manipulation of the shared object.