-
公开(公告)号:US11954774B2
公开(公告)日:2024-04-09
申请号:US17460243
申请日:2021-08-29
CPC分类号: G06T11/60 , G16Y10/65 , H04N23/631
摘要: Systems and methods enable users to build augmented reality (AR) experiences with Internet of Things (IoT) devices. The system includes an AR object studio that includes a list of IoT devices and control signals for the respective IoT devices and a list of AR objects (e.g., an AR lens). The AR object studio receives selections from users and correlates at least one IoT device to at least one AR object in response to the user selections. During use, a server receives an indication that an AR object has been activated and interacted with on a display of an AR camera device and, in response, sends a control signal to a correlated IoT device. Conversely, the server may receive a signal from an IoT device and, in response, present and control a correlated AR object on the display of the AR camera device.
-
公开(公告)号:US11941231B2
公开(公告)日:2024-03-26
申请号:US17460228
申请日:2021-08-29
IPC分类号: G06V20/20 , G06F3/01 , G06F3/0482 , G06F3/0484 , H04N23/63 , G16Y40/35
CPC分类号: G06F3/0484 , G06F3/017 , G06F3/0482 , G06V20/20 , H04N23/63 , G16Y40/35
摘要: Systems and methods for interfacing augmented reality (AR) camera devices to Internet of Things (IoT) devices include pairing an AR camera device to an IoT device to establish which actions recognized by the AR camera device may control the IoT device, receiving an action identifier representing a gesture or position of a body part that has been recognized by the AR camera device, and sending a command to the IoT device paired with the AR camera device to perform a requested action in response to the action identifier received from the AR camera device. Context information relating to the action identifier from the AR camera may be used to modify the command sent to the IoT device. The AR camera device may be paired with an IoT device pointed at by the AR camera device, selected through a user interface of the AR camera device, or determined from context information.
-
公开(公告)号:US20230063944A1
公开(公告)日:2023-03-02
申请号:US17460233
申请日:2021-08-29
摘要: Systems and methods for controlling Internet of Things (IoT) devices using an augmented reality (AR) camera are provided. The system includes a sensor and a server that receives an input from the sensor and presents an AR object on the display of the AR camera device that corresponds to the input from the sensor. A response to the displayed AR object from a user of the AR camera device is used to select a command to send to one or more IoT devices to perform an action corresponding to the user response to the displayed AR object. In an example, an AR smoke object is overlayed on the AR camera display in response to a smoke detection signal from a smoke detector. In response to the user swiping or gesturing to push away the AR smoke object, a window opening command is sent to one or more IoT enabled windows.
-
公开(公告)号:US20220414989A1
公开(公告)日:2022-12-29
申请号:US17362431
申请日:2021-06-29
申请人: Rajan Vaish , Yu Jiang Tham , Brian Anthony Smith , Sven Kratz , Karen Stoizenberg , David Meisenholder
发明人: Rajan Vaish , Yu Jiang Tham , Brian Anthony Smith , Sven Kratz , Karen Stoizenberg , David Meisenholder
摘要: A virtual mailbox is established for a first user based on a virtual mailbox definition specified by the first user. A message directed to the first user is received from a first device associated with a second user. A location within a real-world environment of the first user corresponding to the virtual mailbox is identified. A marker associated with the virtual mailbox is detected within the real-world environment of the first user. Based on detecting the marker, the second device presents the message overlaid on the real-world environment at the location corresponding to the virtual mailbox.
-
公开(公告)号:US12088781B2
公开(公告)日:2024-09-10
申请号:US17565839
申请日:2021-12-30
申请人: Ilteris Canberk , Shin Hwun Kang , Sven Kratz , Brian Anthony Smith , Yu Jiang Tham , Rajan Vaish
发明人: Ilteris Canberk , Shin Hwun Kang , Sven Kratz , Brian Anthony Smith , Yu Jiang Tham , Rajan Vaish
IPC分类号: H04N13/398 , H04L65/1069 , H04L65/1089 , H04N13/111 , H04N13/332 , H04N13/366
CPC分类号: H04N13/398 , H04L65/1069 , H04L65/1089 , H04N13/111 , H04N13/332 , H04N13/366 , H04N2213/008
摘要: Systems and methods are described for selectively sharing audio and video streams amongst electronic eyewear devices. Each electronic eyewear device includes a camera arranged to capture a video stream in an environment of the wearer, a microphone arranged to capture an audio stream in the environment of the wearer, and a display. A processor of each electronic eyewear device executes instructions to establish an always-on session with other electronic eyewear devices and selectively shares an audio stream, a video stream, or both with other electronic eyewear devices in the session. Each electronic eyewear device also generates and receives annotations from other users in the session for display with the selectively shared video stream on the display of the electronic eyewear device that provided the selectively shared video stream. The annotation may include manipulation of an object in the shared video stream or overlay images registered with the shared video stream.
-
公开(公告)号:US20230217007A1
公开(公告)日:2023-07-06
申请号:US17565839
申请日:2021-12-30
申请人: Ilteris Canberk , Shin Hwun Kang , Sven Kratz , Brian Anthony Smith , Yu Jiang Tham , Rajan Vaish
发明人: Ilteris Canberk , Shin Hwun Kang , Sven Kratz , Brian Anthony Smith , Yu Jiang Tham , Rajan Vaish
IPC分类号: H04N13/398 , H04N13/111 , H04N13/332 , H04L65/1089 , H04L65/1069 , H04N13/366
CPC分类号: H04N13/398 , H04L65/1069 , H04L65/1089 , H04N13/111 , H04N13/332 , H04N13/366 , H04N2213/008
摘要: Systems and methods are described for selectively sharing audio and video streams amongst electronic eyewear devices. Each electronic eyewear device includes a camera arranged to capture a video stream in an environment of the wearer, a microphone arranged to capture an audio stream in the environment of the wearer, and a display. A processor of each electronic eyewear device executes instructions to establish an always-on session with other electronic eyewear devices and selectively shares an audio stream, a video stream, or both with other electronic eyewear devices in the session. Each electronic eyewear device also generates and receives annotations from other users in the session for display with the selectively shared video stream on the display of the electronic eyewear device that provided the selectively shared video stream. The annotation may include manipulation of an object in the shared video stream or overlay images registered with the shared video stream.
-
公开(公告)号:US20240056524A1
公开(公告)日:2024-02-15
申请号:US18384251
申请日:2023-10-26
申请人: Andrés Monroy-Hernández , Sven Kratz , Rajan Vaish
发明人: Andrés Monroy-Hernández , Sven Kratz , Rajan Vaish
IPC分类号: H04M1/72469 , H04M1/72439 , A61L9/012 , G06F3/01 , G06F3/041 , G06F3/0488 , G06T11/00
CPC分类号: H04M1/72469 , H04M1/72439 , A61L9/012 , G06F3/011 , G06F3/0416 , G06F3/0488 , G06T11/00 , A61L2209/11 , G06T2200/24
摘要: An olfactory sticker used in chats between electronic devices to make messaging more immersive, personalized, and authentic by integrating olfactory information with traditional text-based formats and AR messaging. Olfactory stickers are used to indicate to a recipient that a message includes olfactory information. The olfactory sticker illustrates a graphical representation of a particular scent that can be sent and received via a chat or an AR message. Olfactory stickers provide the recipient control of accessing the transmitted scent at a desired time. This is particularly useful since certain olfactory information, i.e., scents, can be very direct and intrusive. Olfactory stickers are activated (i.e., release their scent) when they are tapped or rubbed by the recipient.
-
公开(公告)号:US20240027394A1
公开(公告)日:2024-01-25
申请号:US17868445
申请日:2022-07-19
申请人: Sven Kratz , Andrés Monroy-Hernández , Rajan Vaish
发明人: Sven Kratz , Andrés Monroy-Hernández , Rajan Vaish
IPC分类号: G01N27/414 , H04M1/72403
CPC分类号: G01N27/414 , H04M1/72403
摘要: An electronic device including an olfactory detector including an array of olfactory sensors for determining scents proximate the electronic device, such as a smartphone, smart eyewear, and a smart watch. Each sensor in the array of olfactory sensors is tuned to detect the presence and concentration of one or more specific chemical compounds or molecules. A fan creates airflow of ambient air across the olfactory sensors. An analog to digital (A/D) converter receives and processes the sensor outputs of the olfactory sensors and provides the processed sensor output to a processor for further processing. Scent type and intensity can be classified by using the information from the scent sensors as input for a machine learning model, generated through supervised training using labeled example measurements from our sensor array. The processor may display information of the determined scents on a display of the smart device, and the processor can also send information indicative of the determined scents to another device.
-
公开(公告)号:US11811964B1
公开(公告)日:2023-11-07
申请号:US17868395
申请日:2022-07-19
申请人: Andrés Monroy-Hernández , Sven Kratz , Rajan Vaish
发明人: Andrés Monroy-Hernández , Sven Kratz , Rajan Vaish
IPC分类号: H04M1/72469 , G06F3/041 , G06F3/01 , G06F3/0488 , G06T11/00 , A61L9/012 , H04M1/72439
CPC分类号: H04M1/72469 , A61L9/012 , G06F3/011 , G06F3/0416 , G06F3/0488 , G06T11/00 , H04M1/72439 , A61L2209/11 , G06T2200/24
摘要: An olfactory sticker used in chats between electronic devices to make messaging more immersive, personalized, and authentic by integrating olfactory information with traditional text-based formats and AR messaging. Olfactory stickers are used to indicate to a recipient that a message includes olfactory information. The olfactory sticker illustrates a graphical representation of a particular scent that can be sent and received via a chat or an AR message. Olfactory stickers provide the recipient control of accessing the transmitted scent at a desired time. This is particularly useful since certain olfactory information, i.e., scents, can be very direct and intrusive. Olfactory stickers are activated (i.e., release their scent) when they are tapped or rubbed by the recipient.
-
公开(公告)号:US20230298247A1
公开(公告)日:2023-09-21
申请号:US17695399
申请日:2022-03-15
申请人: Yu Jiang Tham , Rajan Vaish , Sven Kratz
发明人: Yu Jiang Tham , Rajan Vaish , Sven Kratz
IPC分类号: H04L65/1089 , H04N13/398 , H04L51/08 , H04L51/222 , H04N13/332 , H04N13/111 , H04L65/1069
CPC分类号: H04L65/1089 , H04N13/398 , H04L51/08 , H04L51/20 , H04N13/332 , H04N13/111 , H04L65/1069 , H04N2213/008
摘要: Users of electronic eyewear devices can interact with each other by sharing 3D objects (e.g., 2D or 3D augmented reality (AR) objects or scanned 2D or 3D images of real-world objects) with each other via local objects (real or virtual) in each user's environment established as personalized anchor points for social connection. When a user receives an object from another user, the user has the option to generate a connected session with other users that are co-located (physically or virtually at the same location) with the user. The co-located group of users in this new connected session may view the received object either on their personal electronic devices (e.g., smartphones) or on their electronic eyewear devices and can modify and annotate the shared object using collaboration software and AR display tools that enable modification and manipulation of the shared object.
-
-
-
-
-
-
-
-
-