-
公开(公告)号:US20240192770A1
公开(公告)日:2024-06-13
申请号:US18108334
申请日:2023-02-10
Applicant: SHOPIFY INC.
Inventor: Russ Maschmeyer , Eric Andrew Florenzano , Brennan Letkeman , Diego Macario Bello , Daniel Beauchamp
IPC: G06F3/01 , G06F3/04845
CPC classification number: G06F3/013 , G06F3/04845 , G06F2203/04804
Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.
-
公开(公告)号:US20230410436A1
公开(公告)日:2023-12-21
申请号:US17824828
申请日:2022-05-25
Applicant: Shopify Inc.
Inventor: Daniel Beauchamp , Byron Leonel Delgado , Jonathan Wade
CPC classification number: G06T19/006 , G06Q30/0643 , G06F3/167
Abstract: Systems and methods described herein allow a customer to employ AR/VR software to generate virtual representations of physical spaces (e.g., house) and sub-spaces (e.g., living room) to preview virtual objects situated in AR/VR virtual environments. A commerce system (or mobile app associated with the commerce system) may generate virtualized environments representing a physical space (e.g., house, apartment) and regions (e.g., living room, kitchen) based on source images uploaded to or otherwise captured by the commerce system. The end-user may operate the software on a client device and interacts with VR or AR presentations of the virtual environment using a voice-based interface recognized by the software. For example, the end-user may say the name of room (region) or an object and the system retrieves data of the identified room or an appropriate room, such as virtual representations of furniture or objects situated in the room.
-
公开(公告)号:US11568620B2
公开(公告)日:2023-01-31
申请号:US17082253
申请日:2020-10-28
Applicant: SHOPIFY INC.
Inventor: Byron Leonel Delgado , Daniel Beauchamp , Maas Mansoor Ali Lalani
Abstract: Apparatuses and methods are provided for augmented reality-assisted assessment of three-dimensional (3D) fit of physical objects within a physical environment in different positions. According to an embodiment, an augmented reality (AR) device obtains 3D dimensions of a virtual object representative of a real-world physical object and displays a 3D representation of the virtual object in an AR space depicted by a user interface of the AR device that is representative of a real-world physical environment in a field of view of the AR device. The 3D representation of the virtual object is proportionally dimensioned relative to the physical environment based on the obtained 3D dimensions of the virtual object and the virtual object is repositionable in the AR space responsive to input received by the AR device to allow assessment of 3D fit of the virtual object within the physical environment in different positions.
-
公开(公告)号:US11527045B2
公开(公告)日:2022-12-13
申请号:US16939278
申请日:2020-07-27
Applicant: SHOPIFY INC.
Inventor: Juho Mikko Haapoja , Byron Leonel Delgado , Stephan Leroux , Daniel Beauchamp
IPC: G06T19/00 , G06T7/70 , G06F3/16 , G06Q10/08 , G06Q10/10 , G06Q30/00 , G06Q30/02 , G06Q30/06 , G06Q50/00
Abstract: Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.
-
公开(公告)号:US20220222741A1
公开(公告)日:2022-07-14
申请号:US17711536
申请日:2022-04-01
Applicant: Shopify Inc.
Inventor: Daniel Beauchamp
IPC: G06Q30/06 , G06F3/04815 , G06V20/64
Abstract: Disclosed are systems and methods for augmenting a customer image with at least one virtual object. One or more customer images depicting a customer environment are received from a customer computing device and 3D feature data for the customer images is determined. A virtual object is determined which corresponds to a desired merchant item. A positioning signal is received which corresponds to a desired location of virtual object in the customer environment, and a corresponding first location in each customer image at which to overlay the virtual object using the positioning signal is determined. An appropriate size and orientation of the virtual object is determined for each customer image based on corresponding 3D feature data, causing an overlay of an appropriately sized and oriented virtual object at the corresponding first location in customer images.
-
公开(公告)号:US12266010B2
公开(公告)日:2025-04-01
申请号:US18470818
申请日:2023-09-20
Applicant: SHOPIFY INC.
Inventor: Daniel Beauchamp
IPC: G06Q30/00 , G06F3/04815 , G06Q30/06 , G06Q30/0601 , G06V20/64
Abstract: Disclosed are systems and methods for augmenting a customer image with at least one virtual object. One or more customer images depicting a customer environment are received from a customer computing device and 3D feature data for the customer images is determined. A virtual object is determined which corresponds to a desired merchant item. A positioning signal is received which corresponds to a desired location of virtual object in the customer environment, and a corresponding first location in each customer image at which to overlay the virtual object using the positioning signal is determined. An appropriate size and orientation of the virtual object is determined for each customer image based on corresponding 3D feature data, causing an overlay of an appropriately sized and oriented virtual object at the corresponding first location in customer images.
-
公开(公告)号:US12198286B2
公开(公告)日:2025-01-14
申请号:US18308324
申请日:2023-04-27
Applicant: SHOPIFY INC.
Inventor: Byron Leonel Delgado , Stephan Leroux , Daniel Beauchamp
IPC: G06T19/20 , G06F16/9538 , G06T19/00 , G06V20/20 , G06Q30/0601
Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.
-
18.
公开(公告)号:US12182848B2
公开(公告)日:2024-12-31
申请号:US18167206
申请日:2023-02-10
Applicant: Shopify Inc.
Inventor: Daniel Beauchamp
IPC: G06Q30/00 , G06Q30/0601
Abstract: Computer-implemented methods and systems including receiving feature data identifying a physical surface determined using augmented reality software and an imaging device operated by a computing device in a physical environment comprising the physical surface; determining a positioning of at least one surface item upon the physical surface based on surface dimensions determined from the feature data; and causing an augmented reality interface to be displayed by the augmented reality software on the computing device, the augmented reality interface comprising an illustrative layout of the physical surface generated using the feature data and showing the determined positioning of the at least one surface item upon the physical surface in the illustrative layout while imaging the physical surface in the physical environment.
-
公开(公告)号:US20240272711A1
公开(公告)日:2024-08-15
申请号:US18642181
申请日:2024-04-22
Applicant: SHOPIFY INC.
Inventor: Russ Maschmeyer , Eric Andrew Florenzano , Brennan Letkeman , Diego Macario Bello , Daniel Beauchamp
IPC: G06F3/01 , G06F3/04845
CPC classification number: G06F3/013 , G06F3/04845 , G06F2203/04804
Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.
-
公开(公告)号:US11847716B2
公开(公告)日:2023-12-19
申请号:US17982669
申请日:2022-11-08
Applicant: Shopify Inc.
Inventor: Juho Mikko Haapoja , Byron Leonel Delgado , Stephan Leroux , Daniel Beauchamp
IPC: G06T19/00 , G06T7/70 , G06F3/16 , G06Q30/0601 , G06Q30/018 , G06Q50/00 , G06Q30/012 , G06Q10/0833 , G06Q30/0201 , G06Q10/10
CPC classification number: G06T19/006 , G06F3/16 , G06T7/70 , G06Q10/0833 , G06Q10/10 , G06Q30/012 , G06Q30/0185 , G06Q30/0201 , G06Q30/0623 , G06Q30/0633 , G06Q30/0643 , G06Q50/01 , G06T2207/30196 , G06T2219/024
Abstract: Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.
-
-
-
-
-
-
-
-
-