-
公开(公告)号:US20240071000A1
公开(公告)日:2024-02-29
申请号:US17895449
申请日:2022-08-25
Applicant: Snap Inc.
Inventor: Ilteris Kaan CANBERK , Matthew Hallberg , Matthew Saunders , Daria Skrypnyk , Lien Le Hong Tran
CPC classification number: G06T19/006 , G06F3/011 , G06T13/40
Abstract: Systems and methods are provided for performing operations on an augmented reality (AR) device using an external vision system. The system establishes, by the AR device, a communication with an external client device. The system overlays, by the AR device, a first AR object on a real-world environment being viewed using the AR device. The system receives interaction data from the external client device representing movement of a user determined by the external client device. The system, in response to receiving the interaction data from the external client device, modifies the first AR object by the AR device.
-
公开(公告)号:US20240370159A1
公开(公告)日:2024-11-07
申请号:US18312366
申请日:2023-05-04
Applicant: Snap Inc.
Inventor: Luke Cartwright , Matthew Hallberg , Dmytro Kucher , Xiao Li , Shaun Stelmack , Jiyang Zhu
IPC: G06F3/0488 , G06F3/04815 , G06F3/0482 , G06F3/04845 , G06F3/147 , G06T3/40
Abstract: A method for transferring a media item from a portable device to a head-worn device for display in an augmented reality mood board comprises receiving user input at the portable device to transfer the media item from the portable device to the head-worn device, and transmitting, via a short-range data transmission protocol, a low-resolution representation of the media item, from the portable device to the head-worn device. A link to a higher-resolution representation may also be transmitted to the head-worn device, to enable the head-worn device to obtain the higher-resolution representation. The transmission of the low-resolution representation may commence as soon as initiation of the gesture is detected by the portable device.
-
公开(公告)号:US20240355065A1
公开(公告)日:2024-10-24
申请号:US18532887
申请日:2023-12-07
Applicant: Snap Inc.
Inventor: William Miles Miller , Daria Skrypnyk , Matthew Hallberg
CPC classification number: G06T19/006 , G06V40/171 , G06V2201/07
Abstract: Described is a system for dynamically applying model adaptations customized for individual users by detecting an image of a first real-world object from a camera feed, detecting landmarks on the first real-world object, and processing the landmarks on the first real-world object using a generative machine learning model to generate a first custom image template for the first real-world object where portions of the first custom image template are populated with visual content placed based on the first custom image template. The system then applies a content augmentation based on the first custom image template to the camera feed.
-
公开(公告)号:US20240355064A1
公开(公告)日:2024-10-24
申请号:US18497629
申请日:2023-10-30
Applicant: Snap Inc.
Inventor: Daria Skrypnyk , Matthew Hallberg
CPC classification number: G06T19/006 , G06T15/04 , G06T17/20 , G06T19/20 , G10L15/1815 , G10L15/22 , G06T2219/2004 , G06T2219/2012 , G10L2015/223
Abstract: Described is a system for overlaying visual content onto a real-world object by identifying a prompt of a user indicating a user's intent, accessing an image template, wherein the image template includes placement of features within the image template, and processing a combination of data associated with the image template and the prompt using a generative machine learning model to generate a first populated image template in which one or more portions of the image template are populated with visual content representing the user's intent. The system then proceeds to access an image depicting a real-world object and overlay the first populated image template that includes the visual content representative of the user's intent on at least a portion of the real-world object based on the placement of the features of the image template.
-
公开(公告)号:US12051163B2
公开(公告)日:2024-07-30
申请号:US17895449
申请日:2022-08-25
Applicant: Snap Inc.
Inventor: Ilteris Kaan Canberk , Matthew Hallberg , Matthew Saunders , Daria Skrypnyk , Lien Le Hong Tran
CPC classification number: G06T19/006 , G06F3/011 , G06T13/40
Abstract: Systems and methods are provided for performing operations on an augmented reality (AR) device using an external vision system. The system establishes, by the AR device, a communication with an external client device. The system overlays, by the AR device, a first AR object on a real-world environment being viewed using the AR device. The system receives interaction data from the external client device representing movement of a user determined by the external client device. The system, in response to receiving the interaction data from the external client device, modifies the first AR object by the AR device.
-
公开(公告)号:US20240127550A1
公开(公告)日:2024-04-18
申请号:US18046367
申请日:2022-10-13
Applicant: Snap Inc.
Inventor: Ilteris Kaan Canberk , Matthew Hallberg , Bernhard Jung
CPC classification number: G06T19/006 , G06T7/70 , G06T2200/24 , G06T2207/10028 , G06T2210/56 , G06T2219/004
Abstract: Systems, methods, and computer readable media for remote annotations, drawings, and navigation instructions sent to an augmented reality (AR) wearable device from a computing device are disclosed. The AR wearable device captures images and sends them to the remote computing device to provide a real-time view of what the user of the AR wearable device sees. A user of the remote computing device can add navigation instructions and can select an image to annotate or draw on. The AR wearable device provides 3-dimensional (3D) coordinate information within a 3D world of the AR wearable device for the selected image. The user of the remote computing device then annotates or draws on the selected image. The remote computing device determines 3D coordinates for the annotations and drawings within the 3D world of the AR wearable device. The annotations and drawings are sent to the AR wearable device with associated 3D coordinates.
-
公开(公告)号:US20240371110A1
公开(公告)日:2024-11-07
申请号:US18312421
申请日:2023-05-04
Applicant: Snap Inc.
Inventor: Luke Cartwright , Matthew Hallberg , Dmytro Kucher , Xiao Li , Shaun Stelmack , Jiyang Zhu
Abstract: A method for manipulating a gallery of extended reality (XR) media items displayed in a field of view of the head-worn device. The gallery of XR media items is associated with an anchor user interface element. User selection input is detected at a perceived location of the anchor user interface element. Subsequent user motion input moves the perceived location or orientation of the gallery of XR media items in the field of view of the head-worn device. Rotation or translation of the anchor user interface elements results in a corresponding rotation and/or translation of all of the items in the gallery of XR media items.
-
公开(公告)号:US20240236225A9
公开(公告)日:2024-07-11
申请号:US17970274
申请日:2022-10-20
Applicant: Snap Inc.
Inventor: Ilteris Kaan Canberk , Matthew Hallberg , Richard Zhuang
IPC: H04M1/72409 , H04B1/3888 , H04M1/72454
CPC classification number: H04M1/724092 , H04B1/3888 , H04M1/724097 , H04M1/72454
Abstract: A case for a portable device like a smartphone includes light sources such as LEDs, which, when illuminated, can be detected and tracked by a head-worn augmented or virtual reality device. The light sources may be located at the corners of the case and may emit infrared light. A relative pose between the smartphone and the head-worn device can be determined based on computer vision techniques performed on images captured by the head-worn device that includes light from the light sources. Relative movement between the smartphone and the head-worn device can be used to provide user input to the head-worn device, as can touch input on the portable device. In some instances, the case is powered inductively from the portable device.
-
公开(公告)号:US20240050856A1
公开(公告)日:2024-02-15
申请号:US17887215
申请日:2022-08-12
Applicant: Snap Inc.
Inventor: Ilteris Kaan Canberk , Matthew Hallberg , William Miles Miller , Lien Le Hong Tran , Michael Benson Tucker
IPC: A63F13/655 , G06V20/20 , G06F3/0346 , G06T7/20 , G06F3/0488 , G06F3/04845 , G06F3/0482 , G06F3/04815 , A63F13/211 , A63F13/573 , A63F13/533 , G02B27/01
CPC classification number: A63F13/655 , G06V20/20 , G06F3/0346 , G06T7/20 , G06F3/0488 , G06F3/04845 , G06F3/0482 , G06F3/04815 , A63F13/211 , A63F13/573 , A63F13/533 , G02B27/0172 , A63F2300/105 , A63F2300/308 , A63F2300/695 , A63F2300/646 , G02B2027/0178 , G02B2027/014
Abstract: Systems and methods are provided for using an external controller with an AR device. The system establishes, by one or more processors of the AR device, a communication with an external client device. The system overlays, by the AR device, a first AR object on a real-world environment being viewed using the AR device. The system receives interaction data from the external client device representing one or more inputs received by the external client device and, in response, modifies the first AR object by the AR device.
-
公开(公告)号:US20240355010A1
公开(公告)日:2024-10-24
申请号:US18529550
申请日:2023-12-05
Applicant: Snap Inc.
Inventor: Bohdan Ahafonov , Matthew Hallberg , Sergei Korolev , William Miles Miller , Daria Skrypnyk , Aleksei Stoliar
CPC classification number: G06T11/001 , G06T7/11 , G06T11/40 , G06T11/60 , G06V20/20 , G10L15/08 , G10L15/22 , G06T2210/16 , G10L2015/088
Abstract: Methods and systems are disclosed for generating an extended reality (XR) try-on experience. The methods and systems store, in a multimodal memory, interaction data representing use of one or more interaction functions including data in different modalities. The methods and systems detect an object depicted in an image captured by an interaction client and generate, by a machine learning model, a prompt based on the object depicted in the image and the interaction data in the multimodal memory. The methods and systems generate an artificial texture based on the prompt and modify a texture of the object depicted in the image using the artificial texture that has been generated based on the prompt.
-
-
-
-
-
-
-
-
-