Rendering three-dimensional models on mobile devices

    公开(公告)号:US10762702B1

    公开(公告)日:2020-09-01

    申请号:US16015997

    申请日:2018-06-22

    Applicant: A9.com, Inc.

    Abstract: A complex three-dimensional virtual representation of an object can be rendered. Virtual images can be captured representing a plurality of views of the complex virtual representation. The virtual images can be converted into binary masks depicting the object pixels and non-object pixels in the virtual images. The binary masks can be used to create a three-dimensional representation of the object having lower complexity than the first three-dimensional virtual representation of the object. In embodiments, the low complexity three-dimensional virtual representation of the object and the virtual images are sent to a mobile device to render a low payload representation of the object on the mobile device.

    3-D model generation using multiple cameras

    公开(公告)号:US10574974B2

    公开(公告)日:2020-02-25

    申请号:US14318355

    申请日:2014-06-27

    Applicant: A9.com, Inc.

    Abstract: Various embodiments provide for the generation of 3D models of objects. For example, depth data and color image data can be captured from viewpoints around an object using a sensor. A camera having a higher resolution can simultaneously capture image data of the object. Features between images captured by the image sensor and the camera can be extracted and compared to determine a mapping between the camera and the image. Once the mapping between the camera and the image sensor is determined, a second mapping between adjacent viewpoints can be determined for each image around the object. In this example, each viewpoint overlaps with an adjacent viewpoint and features extracted from two overlapping viewpoints are matched to determine their relative alignment. Accordingly, a 3D point cloud can be generated and the images captured by the camera can be projected on the surface of the 3D point cloud to generate the 3D model.

    Creating multi-dimensional object representations

    公开(公告)号:US10453254B2

    公开(公告)日:2019-10-22

    申请号:US16411642

    申请日:2019-05-14

    Applicant: A9.com, Inc.

    Abstract: Objects can be rendered in three-dimensions and viewed and manipulated in an augmented reality environment. Background images are subtracted from object images from multiple viewpoints to provide baseline representations of the object. Morphological operations can be used to remove errors caused by misalignment of an object image and background image. Using two different contrast thresholds, pixels can be identified that can be said at two different confidence levels to be object pixels. An edge detection algorithm can be used to determine object contours. Low confidence pixels can be associated with the object if they can be connected to high confidence pixels without crossing an object contour. Segmentation masks can be created from high confidence pixels and properly associated low confidence pixels. Segmentation masks can be used to create a three-dimensional representation of the object.

    Utilizing color descriptors to determine color content of images
    5.
    发明授权
    Utilizing color descriptors to determine color content of images 有权
    利用颜色描述符来确定图像的颜色内容

    公开(公告)号:US09299009B1

    公开(公告)日:2016-03-29

    申请号:US13892666

    申请日:2013-05-13

    Applicant: A9.com, Inc.

    Abstract: Various embodiments provide a method for determining color information for an image. For example, a color descriptor for an image can be determined and compared against color descriptors stored for each of a number of sample images, which each represent a color in a color space. Upon comparison, matching scores can be generated for a color match between the image and each respective sample image. In this example, the number of sample images with a matching score above a threshold value can be summed and the image can be assigned to a color associated with a highest frequency of the number of sample images. Accordingly, the assigned color of the image can then be used in a “query by color” search or a browse-by-color capability.

    Abstract translation: 各种实施例提供了一种用于确定图像的颜色信息的方法。 例如,可以确定图像的颜色描述符并将其与针对每个表示颜色空间中的颜色的多个样本图像中的每一个存储的颜色描述符进行比较。 相比之下,可以为图像和每个相应样本图像之间的颜色匹配生成匹配分数。 在该示例中,可以将匹配分数高于阈值的样本图像的数量相加,并且可以将图像分配给与样本图像数量的最高频率相关联的颜色。 因此,图像的分配颜色然后可以用于“通过颜色查询”搜索或逐个浏览色彩的能力。

    Visual search utilizing color descriptors
    6.
    发明授权
    Visual search utilizing color descriptors 有权
    利用颜色描述符进行视觉搜索

    公开(公告)号:US09064149B1

    公开(公告)日:2015-06-23

    申请号:US13842328

    申请日:2013-03-15

    Applicant: A9.com, Inc.

    CPC classification number: G06K9/00536 G06K9/4652

    Abstract: Various embodiments provide a method for computing color descriptors of product images. For example, a number of fine color representatives can be determined to describe color variation in an image as a histogram by assigning a saturation value and a brightness value to a plurality of color hues. For each pixel of the image, the closest color among a defined fine color representative set is computed. In this example, each of the pixels is assigned a color ID corresponding to their closest matching fine color representative and at least one family color ID corresponding one or more pure color families. In this example, a histogram of the color representatives and a histogram for the color families are computed. A single color vector descriptor for the image is then determined by combining the family histogram with the color representative histogram.

    Abstract translation: 各种实施例提供了一种用于计算产品图像的颜色描述符的方法。 例如,通过将饱和度值和亮度值分配给多个色调,可以确定许多细色代表以描述图像中的颜色变化作为直方图。 对于图像的每个像素,计算定义的精细颜色代表集合中最接近的颜色。 在该示例中,为每个像素分配与其最接近的匹配细色代表相对应的颜色ID和对应于一个或多个纯色族的至少一个族色ID。 在该示例中,计算颜色代表的直方图和颜色族的直方图。 然后通过将族直方图与颜色代表性直方图组合来确定用于图像的单个颜色矢量描述符。

    Rendering three-dimensional models on mobile devices

    公开(公告)号:US11776211B2

    公开(公告)日:2023-10-03

    申请号:US17181885

    申请日:2021-02-22

    Applicant: A9.com, Inc.

    CPC classification number: G06T17/20 G06T7/70 G06T7/97 G06T19/003

    Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object. Alpha masks indicating which pixels are associated with the object can be used to refine the object mesh structure. A request can be made to view the object from an arbitrary viewpoint which differs from the viewpoints associated with the captured images. A subset of the captured images can be used to create a synthetic image. Different weights can be assigned to the captured image to render a synthetic image that represents the view from the arbitrary viewpoint selected. The input images for the synthetic image can be prefetched, or loaded into memory before the arbitrary view is requested. The images can also be cached for future use or to avoid reloading them for another synthetic image.

    RENDERING THREE-DIMENSIONAL MODELS ON MOBILE DEVICES

    公开(公告)号:US20210174586A1

    公开(公告)日:2021-06-10

    申请号:US17181885

    申请日:2021-02-22

    Applicant: A9.com, Inc.

    Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object. Alpha masks indicating which pixels are associated with the object can be used to refine the object mesh structure. A request can be made to view the object from an arbitrary viewpoint which differs from the viewpoints associated with the captured images. A subset of the captured images can be used to create a synthetic image. Different weights can be assigned to the captured image to render a synthetic image that represents the view from the arbitrary viewpoint selected. The input images for the synthetic image can be prefetched, or loaded into memory before the arbitrary view is requested. The images can also be cached for future use or to avoid reloading them for another synthetic image.

    Rendering three-dimensional models on mobile devices

    公开(公告)号:US10950043B1

    公开(公告)日:2021-03-16

    申请号:US15944717

    申请日:2018-04-03

    Applicant: A9.com, Inc.

    Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object. Alpha masks indicating which pixels are associated with the object can be used to refine the object mesh structure. A request can be made to view the object from an arbitrary viewpoint which differs from the viewpoints associated with the captured images. A subset of the captured images can be used to create a synthetic image. Different weights can be assigned to the captured image to render a synthetic image that represents the view from the arbitrary viewpoint selected. The input images for the synthetic image can be prefetched, or loaded into memory before the arbitrary view is requested. The images can also be cached for future use or to avoid reloading them for another synthetic image.

    Creating multi-dimensional object representations

    公开(公告)号:US10665015B2

    公开(公告)日:2020-05-26

    申请号:US16573157

    申请日:2019-09-17

    Applicant: A9.com, Inc.

    Abstract: Objects can be rendered in three-dimensions and viewed and manipulated in an augmented reality environment. Background images are subtracted from object images from multiple viewpoints to provide baseline representations of the object. Morphological operations can be used to remove errors caused by misalignment of an object image and background image. Using two different contrast thresholds, pixels can be identified that can be said at two different confidence levels to be object pixels. An edge detection algorithm can be used to determine object contours. Low confidence pixels can be associated with the object if they can be connected to high confidence pixels without crossing an object contour. Segmentation masks can be created from high confidence pixels and properly associated low confidence pixels. Segmentation masks can be used to create a three-dimensional representation of the object.

Patent Agency Ranking