-
公开(公告)号:US20220221976A1
公开(公告)日:2022-07-14
申请号:US17148366
申请日:2021-01-13
Applicant: A9.com, Inc.
Inventor: Mukul Agarwal , Yu Lou , Anandram Sundar , Chun Kai Wang , Jack Mousseau , Kevin May , Xing Zhang , Yadikaer Yasheng , Geng Yan
IPC: G06F3/0481 , G06F3/0486 , G06F3/0484
Abstract: A virtual vertical surface in a three-dimensional space that represents a physical room may be detected. Responsive to a first user input gesture, movement of a virtual object within the three-dimensional space may be displayed. The movement may be to a first location in which a portion of the virtual object intersects a portion of the virtual vertical surface. A virtual vertical surface designator may be displayed corresponding to the virtual vertical surface based at least in part on the portion of the virtual object intersecting the portion of the virtual vertical surface. Upon determining that a second user input gesture meets or exceeds a movement threshold, movement of the three-dimensional object from the first location to a second location within the three-dimensional space may be displayed. The second location may appear beyond the virtual vertical surface.
-
公开(公告)号:US11024069B2
公开(公告)日:2021-06-01
申请号:US16903932
申请日:2020-06-17
Applicant: A9.com, Inc.
Inventor: Jesse Chang , Jared Corso , Xing Zhang , Arnab Sanat Kumar Dhua , Yu Lou , Jason Freund
Abstract: Approaches in accordance with various embodiments provide for the presentation of augmented reality (AR) content with respect to optically challenging surfaces. Such surfaces can be difficult to locate using conventional optical-based approaches that rely on visible features. Embodiments can utilize the fact that horizontal surfaces can be located relatively easily, and can determine intersections or boundaries of those horizontal surfaces that likely indicate the presence of another surface, such as a vertical wall. This boundary can be determined automatically, through user input, or using a combination of such approaches. Once such an intersection is located, a virtual plane can be determined whose relative location to a device displaying AR content can be tracked and used as a reference for displaying AR content.
-
公开(公告)号:US11210863B1
公开(公告)日:2021-12-28
申请号:US17001182
申请日:2020-08-24
Applicant: A9.com, Inc.
Inventor: Geng Yan , Xing Zhang , Amit Kumar K C , Arnab Dhua , Yu Lou
Abstract: Devices, systems, and methods are provided for real-time object placement guidance in augmented reality experience. An example method may include receiving, by a device having a sensor, an indication of an object to be viewed in an physical environment of the device. The example method may also include determining a 3D model of the physical environment using data of the physical environment captured by the sensor. The example method may also include determining that a first surface in the 3D model of the environment is a first floor space, and a second surface in the 3D model of the environment is a first wall space. The example method may also include determining that a portion of the first surface is unoccupied and sized to fit the object. The example method may also include determining a first location in the 3D model of the physical environment for placement of a virtual representation of the object based on a 3D model of the object, wherein the first location corresponds to the portion of the first floor space. The example method may also include generating the virtual representation of the object for display at the first location, the virtual representation of the object having a first orientation, wherein the first orientation is based on a second orientation of the second surface. The example method may also include generating a first real-time view of the physical environment comprising the virtual representation of the object within the portion of the first location and in the first orientation. In some cases, a real-time virtual overlay may also be generated in the physical environment, the real-time virtual overlay indicating a location of a floor space in the physical environment.
-
公开(公告)号:US10762702B1
公开(公告)日:2020-09-01
申请号:US16015997
申请日:2018-06-22
Applicant: A9.com, Inc.
Inventor: Arnab Dhua , Xing Zhang , Karl Hillesland , Himanshu Arora , Nicholas Corso , Brian Graham , Jesse Chang , Jason Canada
Abstract: A complex three-dimensional virtual representation of an object can be rendered. Virtual images can be captured representing a plurality of views of the complex virtual representation. The virtual images can be converted into binary masks depicting the object pixels and non-object pixels in the virtual images. The binary masks can be used to create a three-dimensional representation of the object having lower complexity than the first three-dimensional virtual representation of the object. In embodiments, the low complexity three-dimensional virtual representation of the object and the virtual images are sent to a mobile device to render a low payload representation of the object on the mobile device.
-
公开(公告)号:US10726597B1
公开(公告)日:2020-07-28
申请号:US16016331
申请日:2018-06-22
Applicant: A9.com, Inc.
Inventor: Jesse Chang , Jared Corso , Xing Zhang , Arnab Sanat Kumar Dhua , Yu Lou , Jason Freund
Abstract: Approaches in accordance with various embodiments provide for the presentation of augmented reality (AR) content with respect to optically challenging surfaces. Such surfaces can be difficult to locate using conventional optical-based approaches that rely on visible features. Embodiments can utilize the fact that horizontal surfaces can be located relatively easily, and can determine intersections or boundaries of those horizontal surfaces that likely indicate the presence of another surface, such as a vertical wall. This boundary can be determined automatically, through user input, or using a combination of such approaches. Once such an intersection is located, a virtual plane can be determined whose relative location to a device displaying AR content can be tracked and used as a reference for displaying AR content.
-
公开(公告)号:US11734900B2
公开(公告)日:2023-08-22
申请号:US17510094
申请日:2021-10-25
Applicant: A9.com, Inc.
Inventor: Geng Yan , Xing Zhang , Amit Kumar K C , Arnab Dhua , Yu Lou
CPC classification number: G06T19/006 , G06T19/20 , G06T2200/24 , G06T2210/04 , G06T2219/2004
Abstract: Devices, systems, and methods are provided for real-time object placement guidance in augmented reality experience. An example method may include receiving, by a device having a sensor, an indication of an object to be viewed in an physical environment of the device. The example method may also include determining a 3D model of the physical environment using data of the physical environment captured by the sensor. The example method may also include determining that a first surface in the 3D model of the environment is a first floor space, and a second surface in the 3D model of the environment is a first wall space. The example method may also include determining that a portion of the first surface is unoccupied and sized to fit the object. The example method may also include determining a first location in the 3D model of the physical environment for placement of a virtual representation of the object based on a 3D model of the object, wherein the first location corresponds to the portion of the first floor space. The example method may also include generating the virtual representation of the object for display at the first location, the virtual representation of the object having a first orientation, wherein the first orientation is based on a second orientation of the second surface. The example method may also include generating a first real-time view of the physical environment comprising the virtual representation of the object within the portion of the first location and in the first orientation. In some cases, a real-time virtual overlay may also be generated in the physical environment, the real-time virtual overlay indicating a location of a floor space in the physical environment.
-
公开(公告)号:US20220058883A1
公开(公告)日:2022-02-24
申请号:US17510094
申请日:2021-10-25
Applicant: A9.com, Inc.
Inventor: Geng Yan , Xing Zhang , Amit Kumar K. C. , Arnab Dhua , Yu Lou
Abstract: Devices, systems, and methods are provided for real-time object placement guidance in augmented reality experience. An example method may include receiving, by a device having a sensor, an indication of an object to be viewed in an physical environment of the device. The example method may also include determining a 3D model of the physical environment using data of the physical environment captured by the sensor. The example method may also include determining that a first surface in the 3D model of the environment is a first floor space, and a second surface in the 3D model of the environment is a first wall space. The example method may also include determining that a portion of the first surface is unoccupied and sized to fit the object. The example method may also include determining a first location in the 3D model of the physical environment for placement of a virtual representation of the object based on a 3D model of the object, wherein the first location corresponds to the portion of the first floor space. The example method may also include generating the virtual representation of the object for display at the first location, the virtual representation of the object having a first orientation, wherein the first orientation is based on a second orientation of the second surface. The example method may also include generating a first real-time view of the physical environment comprising the virtual representation of the object within the portion of the first location and in the first orientation. In some cases, a real-time virtual overlay may also be generated in the physical environment, the real-time virtual overlay indicating a location of a floor space in the physical environment.
-
公开(公告)号:US11157740B1
公开(公告)日:2021-10-26
申请号:US16990872
申请日:2020-08-11
Applicant: A9.com, Inc.
Inventor: Mukul Agarwal , Kevin May , Xing Zhang , Karl Hillesland , Simon Fox , Jack Mousseau , Kai Chieh Liu
IPC: G06K9/00 , G06K9/20 , G06F3/0484 , G06F3/0482
Abstract: Systems and methods for displaying digital objects in multiple configurations based on a placement location within an Augmented Reality (AR) display. The systems are enabled to receive image data, identify multiple horizontal surfaces within the image data, and place a digital object model within the image data. The digital object model is placed in the AR display in a first configuration when placed with an anchor of the digital object model on a first horizontal surface and in a second configuration when placed with the anchor on a second horizontal surface.
-
公开(公告)号:US20210248798A1
公开(公告)日:2021-08-12
申请号:US17243273
申请日:2021-04-28
Applicant: A9.com, Inc.
Inventor: Jesse Chang , Jared Corso , Xing Zhang , Arnab Dhua , Yu Lou , Jason Freund
Abstract: Approaches in accordance with various embodiments provide for the presentation of augmented reality (AR) content with respect to optically challenging surfaces. Such surfaces can be difficult to locate using conventional optical-based approaches that rely on visible features. Embodiments can utilize the fact that horizontal surfaces can be located relatively easily, and can determine intersections or boundaries of those horizontal surfaces that likely indicate the presence of another surface, such as a vertical wall. This boundary can be determined automatically, through user input, or using a combination of such approaches. Once such an intersection is located, a virtual plane can be determined whose relative location to a device displaying AR content can be tracked and used as a reference for displaying AR content.
-
10.
公开(公告)号:US11983835B2
公开(公告)日:2024-05-14
申请号:US18045688
申请日:2022-10-11
Applicant: A9.com, Inc.
Inventor: Mukul Agarwal , Jonathan Bernadel-Huey , Kevin May , Xing Zhang , Karl Hillesland , Jack Mousseau , Simon Fox
IPC: G06T19/20 , G06F3/01 , G06Q30/0601 , G06T19/00
CPC classification number: G06T19/20 , G06F3/016 , G06Q30/0643 , G06T19/006 , G06T2210/12 , G06T2210/21
Abstract: Techniques for placing and manipulating multiple three-dimensional (3D) models using mobile augmented reality (AR) are described. One technique includes receiving a first request to initialize an AR simulation of a first product for sale within a physical environment. In response to the first request, a first 3D model of the first product for sale is rendered onto the screen. After rendering the first 3D model, a second request to visualize a second product for sale within the physical environment is received during the AR simulation of the first product for sale. In response to the second request, a second 3D model of the second product for sale is rendered onto the screen with the first 3D model.
-
-
-
-
-
-
-
-
-