-
公开(公告)号:US20250078436A1
公开(公告)日:2025-03-06
申请号:US18950895
申请日:2024-11-18
Applicant: SHOPIFY INC.
Inventor: Daniel Beauchamp , Stephan Leroux , Byron Leonel Delgado
IPC: G06T19/20 , G06F16/9538 , G06Q30/0601 , G06T19/00 , G06V20/20
Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.
-
公开(公告)号:US20240192770A1
公开(公告)日:2024-06-13
申请号:US18108334
申请日:2023-02-10
Applicant: SHOPIFY INC.
Inventor: Russ Maschmeyer , Eric Andrew Florenzano , Brennan Letkeman , Diego Macario Bello , Daniel Beauchamp
IPC: G06F3/01 , G06F3/04845
CPC classification number: G06F3/013 , G06F3/04845 , G06F2203/04804
Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.
-
公开(公告)号:US20230410436A1
公开(公告)日:2023-12-21
申请号:US17824828
申请日:2022-05-25
Applicant: Shopify Inc.
Inventor: Daniel Beauchamp , Byron Leonel Delgado , Jonathan Wade
CPC classification number: G06T19/006 , G06Q30/0643 , G06F3/167
Abstract: Systems and methods described herein allow a customer to employ AR/VR software to generate virtual representations of physical spaces (e.g., house) and sub-spaces (e.g., living room) to preview virtual objects situated in AR/VR virtual environments. A commerce system (or mobile app associated with the commerce system) may generate virtualized environments representing a physical space (e.g., house, apartment) and regions (e.g., living room, kitchen) based on source images uploaded to or otherwise captured by the commerce system. The end-user may operate the software on a client device and interacts with VR or AR presentations of the virtual environment using a voice-based interface recognized by the software. For example, the end-user may say the name of room (region) or an object and the system retrieves data of the identified room or an appropriate room, such as virtual representations of furniture or objects situated in the room.
-
公开(公告)号:US11568620B2
公开(公告)日:2023-01-31
申请号:US17082253
申请日:2020-10-28
Applicant: SHOPIFY INC.
Inventor: Byron Leonel Delgado , Daniel Beauchamp , Maas Mansoor Ali Lalani
Abstract: Apparatuses and methods are provided for augmented reality-assisted assessment of three-dimensional (3D) fit of physical objects within a physical environment in different positions. According to an embodiment, an augmented reality (AR) device obtains 3D dimensions of a virtual object representative of a real-world physical object and displays a 3D representation of the virtual object in an AR space depicted by a user interface of the AR device that is representative of a real-world physical environment in a field of view of the AR device. The 3D representation of the virtual object is proportionally dimensioned relative to the physical environment based on the obtained 3D dimensions of the virtual object and the virtual object is repositionable in the AR space responsive to input received by the AR device to allow assessment of 3D fit of the virtual object within the physical environment in different positions.
-
公开(公告)号:US11527045B2
公开(公告)日:2022-12-13
申请号:US16939278
申请日:2020-07-27
Applicant: SHOPIFY INC.
Inventor: Juho Mikko Haapoja , Byron Leonel Delgado , Stephan Leroux , Daniel Beauchamp
IPC: G06T19/00 , G06T7/70 , G06F3/16 , G06Q10/08 , G06Q10/10 , G06Q30/00 , G06Q30/02 , G06Q30/06 , G06Q50/00
Abstract: Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.
-
公开(公告)号:US20220222741A1
公开(公告)日:2022-07-14
申请号:US17711536
申请日:2022-04-01
Applicant: Shopify Inc.
Inventor: Daniel Beauchamp
IPC: G06Q30/06 , G06F3/04815 , G06V20/64
Abstract: Disclosed are systems and methods for augmenting a customer image with at least one virtual object. One or more customer images depicting a customer environment are received from a customer computing device and 3D feature data for the customer images is determined. A virtual object is determined which corresponds to a desired merchant item. A positioning signal is received which corresponds to a desired location of virtual object in the customer environment, and a corresponding first location in each customer image at which to overlay the virtual object using the positioning signal is determined. An appropriate size and orientation of the virtual object is determined for each customer image based on corresponding 3D feature data, causing an overlay of an appropriately sized and oriented virtual object at the corresponding first location in customer images.
-
7.
公开(公告)号:US20240249443A1
公开(公告)日:2024-07-25
申请号:US18124060
申请日:2023-03-21
Applicant: SHOPIFY INC.
Inventor: Russ Maschmeyer , Eric Andrew Florenzano , Brennan Letkeman , Diego Macario Bello , Daniel Beauchamp
Abstract: To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. Differences in dimension between the proxy object and the virtual model may be such that the object is larger than the virtual model, which may result in portions of the object appearing to protrude from behind the virtual model, decreasing user enjoyment. In some embodiments, an AR system for the overlay of AR content on a proxy object and concealment of the proxy object may be implemented. The system may overlay a virtual model to a proxy object, and then conceal any remaining visible portions of the proxy object from the visual field of a device displaying the AR environment. The system may overlay the virtual model so that any remaining visible portion of the proxy object is a single continuous region.
-
公开(公告)号:US20240249442A1
公开(公告)日:2024-07-25
申请号:US18124059
申请日:2023-03-21
Applicant: SHOPIFY INC.
Inventor: Russ Maschmeyer , Eric Andrew Florenzano , Brennan Letkeman , Diego Macario Bello , Daniel Beauchamp
Abstract: To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. However, issues such as the AR content and the proxy object not being aligned, or occlusion of the proxy object leading to glitching of the AR content, may decrease user enjoyment. In some embodiments, an AR system for the overlay of AR content may be implemented. The system may anchor a virtual model to the proxy object based on detected features on the proxy object. The anchoring may include aligning elements of the virtual model and proxy object. In response to an occluding object occluding some features on the proxy object, the system may anchor the virtual model to the occluding object, or to both the proxy object and the occluding object, based on detected features on the occluding object.
-
公开(公告)号:US20240233286A1
公开(公告)日:2024-07-11
申请号:US18444437
申请日:2024-02-16
Applicant: Shopify Inc.
Inventor: Daniel Beauchamp , Byron Leonel Delgado , Jonathan Wade
IPC: G06T19/00 , G06F3/16 , G06Q30/0601
CPC classification number: G06T19/006 , G06F3/167 , G06Q30/0643
Abstract: Systems and methods described herein allow a customer to employ AR/VR software to generate virtual representations of physical spaces (e.g., house) and sub-spaces (e.g., living room) to preview virtual objects situated in AR/VR virtual environments. A commerce system (or mobile app associated with the commerce system) may generate virtualized environments representing a physical space (e.g., house, apartment) and regions (e.g., living room, kitchen) based on source images uploaded to or otherwise captured by the commerce system. The end-user may operate the software on a client device and interacts with VR or AR presentations of the virtual environment using a voice-based interface recognized by the software. For example, the end-user may say the name of room (region) or an object and the system retrieves data of the identified room or an appropriate room, such as virtual representations of furniture or objects situated in the room.
-
公开(公告)号:US11995232B1
公开(公告)日:2024-05-28
申请号:US18108334
申请日:2023-02-10
Applicant: SHOPIFY INC.
Inventor: Russ Maschmeyer , Eric Andrew Florenzano , Brennan Letkeman , Diego Macario Bello , Daniel Beauchamp
IPC: G06F3/01 , G06F3/04845
CPC classification number: G06F3/013 , G06F3/04845 , G06F2203/04804
Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.
-
-
-
-
-
-
-
-
-