-
公开(公告)号:US11875022B2
公开(公告)日:2024-01-16
申请号:US17460228
申请日:2021-08-29
IPC分类号: G06V20/20 , G06F3/0484 , H04N23/63 , G06F3/01 , G06F3/0482 , G16Y40/35
CPC分类号: G06F3/0484 , G06F3/017 , G06F3/0482 , G06V20/20 , H04N23/63 , G16Y40/35
摘要: Systems and methods for interfacing augmented reality (AR) camera devices to Internet of Things (IoT) devices include pairing an AR camera device to an IoT device to establish which actions recognized by the AR camera device may control the IoT device, receiving an action identifier representing a gesture or position of a body part that has been recognized by the AR camera device, and sending a command to the IoT device paired with the AR camera device to perform a requested action in response to the action identifier received from the AR camera device. Context information relating to the action identifier from the AR camera may be used to modify the command sent to the IoT device. The AR camera device may be paired with an IoT device pointed at by the AR camera device, selected through a user interface of the AR camera device, or determined from context information.
-
公开(公告)号:US20220414989A1
公开(公告)日:2022-12-29
申请号:US17362431
申请日:2021-06-29
申请人: Rajan Vaish , Yu Jiang Tham , Brian Anthony Smith , Sven Kratz , Karen Stoizenberg , David Meisenholder
发明人: Rajan Vaish , Yu Jiang Tham , Brian Anthony Smith , Sven Kratz , Karen Stoizenberg , David Meisenholder
摘要: A virtual mailbox is established for a first user based on a virtual mailbox definition specified by the first user. A message directed to the first user is received from a first device associated with a second user. A location within a real-world environment of the first user corresponding to the virtual mailbox is identified. A marker associated with the virtual mailbox is detected within the real-world environment of the first user. Based on detecting the marker, the second device presents the message overlaid on the real-world environment at the location corresponding to the virtual mailbox.
-
公开(公告)号:US20230298247A1
公开(公告)日:2023-09-21
申请号:US17695399
申请日:2022-03-15
申请人: Yu Jiang Tham , Rajan Vaish , Sven Kratz
发明人: Yu Jiang Tham , Rajan Vaish , Sven Kratz
IPC分类号: H04L65/1089 , H04N13/398 , H04L51/08 , H04L51/222 , H04N13/332 , H04N13/111 , H04L65/1069
CPC分类号: H04L65/1089 , H04N13/398 , H04L51/08 , H04L51/20 , H04N13/332 , H04N13/111 , H04L65/1069 , H04N2213/008
摘要: Users of electronic eyewear devices can interact with each other by sharing 3D objects (e.g., 2D or 3D augmented reality (AR) objects or scanned 2D or 3D images of real-world objects) with each other via local objects (real or virtual) in each user's environment established as personalized anchor points for social connection. When a user receives an object from another user, the user has the option to generate a connected session with other users that are co-located (physically or virtually at the same location) with the user. The co-located group of users in this new connected session may view the received object either on their personal electronic devices (e.g., smartphones) or on their electronic eyewear devices and can modify and annotate the shared object using collaboration software and AR display tools that enable modification and manipulation of the shared object.
-
公开(公告)号:US20230069328A1
公开(公告)日:2023-03-02
申请号:US17890439
申请日:2022-08-18
申请人: Hanseul Jun , Sven Kratz , Joanne Leong , Xingyu Liu , Andrés Monroy-Hernández , Brian Anthony Smith , Yu Jiang Tham , Rajan Vaish
发明人: Hanseul Jun , Sven Kratz , Joanne Leong , Xingyu Liu , Andrés Monroy-Hernández , Brian Anthony Smith , Yu Jiang Tham , Rajan Vaish
摘要: Systems and methods are described for sending a snapshot message using an electronic eyewear device by a first user capturing an image, identifying a physical marker in the captured image, and determining that the physical marker in the captured image has been within a field of view of the electronic eyewear device for a predetermined amount of time. A 3D snapshot including an object is captured and, each time the identified object appears in a field of view of the electronic eyewear device, a representation of the object is sent for display to a second user as if the real object was sent. The representation of the object may include the snapshot image, the object extracted from the snapshot image, a stored representation of the object, augmented reality content representing the object, etc.
-
公开(公告)号:US20230062763A1
公开(公告)日:2023-03-02
申请号:US17460243
申请日:2021-08-29
摘要: Systems and methods enable users to build augmented reality (AR) experiences with Internet of Things (IoT) devices. The system includes an AR object studio that includes a list of IoT devices and control signals for the respective IoT devices and a list of AR objects (e.g., an AR lens). The AR object studio receives selections from users and correlates at least one IoT device to at least one AR object in response to the user selections. During use, a server receives an indication that an AR object has been activated and interacted with on a display of an AR camera device and, in response, sends a control signal to a correlated IoT device. Conversely, the server may receive a signal from an IoT device and, in response, present and control a correlated AR object on the display of the AR camera device.
-
公开(公告)号:US20230063194A1
公开(公告)日:2023-03-02
申请号:US17460230
申请日:2021-08-29
IPC分类号: G06K9/00 , A63F13/216 , A63F13/217 , H04L29/08 , G16Y40/30
摘要: Systems and methods for controlling an Internet of Things (IoT) device through interaction with an augmented reality (AR) object includes pairing an AR object with an IoT device, presenting the AR object on a display of an AR camera device of a user, receiving an interaction signal indicating that the user has interacted with the AR object on the display of the AR camera device, and sending a control signal to the IoT device paired with the AR object in response to the interaction signal. A second user may request presentation of the AR object to the AR display of the AR camera device of the user when the user's AR camera device is located at particular world coordinates. Also, the control signal may be sent when a particular series of interactions with the AR object have been completed, as during game play.
-
公开(公告)号:US20230069042A1
公开(公告)日:2023-03-02
申请号:US17460228
申请日:2021-08-29
IPC分类号: G06F3/0484 , H04N5/232 , G06F3/0482 , G06F3/01 , G06K9/00
摘要: Systems and methods for interfacing augmented reality (AR) camera devices to Internet of Things (IoT) devices include pairing an AR camera device to an IoT device to establish which actions recognized by the AR camera device may control the IoT device, receiving an action identifier representing a gesture or position of a body part that has been recognized by the AR camera device, and sending a command to the IoT device paired with the AR camera device to perform a requested action in response to the action identifier received from the AR camera device. Context information relating to the action identifier from the AR camera may be used to modify the command sent to the IoT device. The AR camera device may be paired with an IoT device pointed at by the AR camera device, selected through a user interface of the AR camera device, or determined from context information.
-
公开(公告)号:US12088781B2
公开(公告)日:2024-09-10
申请号:US17565839
申请日:2021-12-30
申请人: Ilteris Canberk , Shin Hwun Kang , Sven Kratz , Brian Anthony Smith , Yu Jiang Tham , Rajan Vaish
发明人: Ilteris Canberk , Shin Hwun Kang , Sven Kratz , Brian Anthony Smith , Yu Jiang Tham , Rajan Vaish
IPC分类号: H04N13/398 , H04L65/1069 , H04L65/1089 , H04N13/111 , H04N13/332 , H04N13/366
CPC分类号: H04N13/398 , H04L65/1069 , H04L65/1089 , H04N13/111 , H04N13/332 , H04N13/366 , H04N2213/008
摘要: Systems and methods are described for selectively sharing audio and video streams amongst electronic eyewear devices. Each electronic eyewear device includes a camera arranged to capture a video stream in an environment of the wearer, a microphone arranged to capture an audio stream in the environment of the wearer, and a display. A processor of each electronic eyewear device executes instructions to establish an always-on session with other electronic eyewear devices and selectively shares an audio stream, a video stream, or both with other electronic eyewear devices in the session. Each electronic eyewear device also generates and receives annotations from other users in the session for display with the selectively shared video stream on the display of the electronic eyewear device that provided the selectively shared video stream. The annotation may include manipulation of an object in the shared video stream or overlay images registered with the shared video stream.
-
公开(公告)号:US11954774B2
公开(公告)日:2024-04-09
申请号:US17460243
申请日:2021-08-29
CPC分类号: G06T11/60 , G16Y10/65 , H04N23/631
摘要: Systems and methods enable users to build augmented reality (AR) experiences with Internet of Things (IoT) devices. The system includes an AR object studio that includes a list of IoT devices and control signals for the respective IoT devices and a list of AR objects (e.g., an AR lens). The AR object studio receives selections from users and correlates at least one IoT device to at least one AR object in response to the user selections. During use, a server receives an indication that an AR object has been activated and interacted with on a display of an AR camera device and, in response, sends a control signal to a correlated IoT device. Conversely, the server may receive a signal from an IoT device and, in response, present and control a correlated AR object on the display of the AR camera device.
-
公开(公告)号:US11941231B2
公开(公告)日:2024-03-26
申请号:US17460228
申请日:2021-08-29
IPC分类号: G06V20/20 , G06F3/01 , G06F3/0482 , G06F3/0484 , H04N23/63 , G16Y40/35
CPC分类号: G06F3/0484 , G06F3/017 , G06F3/0482 , G06V20/20 , H04N23/63 , G16Y40/35
摘要: Systems and methods for interfacing augmented reality (AR) camera devices to Internet of Things (IoT) devices include pairing an AR camera device to an IoT device to establish which actions recognized by the AR camera device may control the IoT device, receiving an action identifier representing a gesture or position of a body part that has been recognized by the AR camera device, and sending a command to the IoT device paired with the AR camera device to perform a requested action in response to the action identifier received from the AR camera device. Context information relating to the action identifier from the AR camera may be used to modify the command sent to the IoT device. The AR camera device may be paired with an IoT device pointed at by the AR camera device, selected through a user interface of the AR camera device, or determined from context information.
-
-
-
-
-
-
-
-
-