-
1.
公开(公告)号:US12216705B2
公开(公告)日:2025-02-04
申请号:US17404367
申请日:2021-08-17
Applicant: Microsoft Technology Licensing, LLC
Inventor: Li Huang , Meenaz Merchant , Houdong Hu , Arun Sacheti
IPC: G06F16/583 , G06F16/2457 , G06F16/248 , G06F16/51 , G06F16/532 , G06F16/56 , G06F18/22 , G06N3/04 , G06N3/08
Abstract: A visual search system includes a computing device, where the computing device includes an image processing engine for generating a feature vector representing a user-selected object in an image. The computing device also includes, an object detection engine for locating one or more objects in the image and for determining a category of a user-selected object from objects in the image, where the object detection engine uses the category to generate a plurality of attributes for the user-selected object. The computing device further includes a product data store for storing a plurality of tables storing one or more attributes associated with a category of the user-selected object. The computing device additionally includes an attribute generation engine for generating a plurality of attribute options and an attribute matching engine for comparing attributes and attribute options of the user-selected object with attributes and attribute options of visually similar products and images.
-
2.
公开(公告)号:US20210382935A1
公开(公告)日:2021-12-09
申请号:US17404367
申请日:2021-08-17
Applicant: Microsoft Technology Licensing, LLC
Inventor: Li Huang , Meenaz Merchant , Houdong Hu , Arun Sacheti
IPC: G06F16/532 , G06F16/51 , G06F16/2457 , G06F16/248 , G06F16/56
Abstract: A visual search system comprised of a computing device, the computing device including an image processing engine for generating a feature vector representing a user-selected object in an image input, an object detection engine for locating one or more objects in the image input and for determining a category of a user-selected object from objects in the image input, the object detection engine using the category to generate a plurality of attributes for the user-selected object, a product data store for storing a plurality of tables storing one or more attributes associated with a category of the user-selected object, an attribute generation engine for generating a plurality of attribute options for each of the attributes of the user-selected object, and an attribute matching engine for comparing attributes and attribute options of the user-selected object with attributes and attribute options of visually similar products and images.
-
公开(公告)号:US11074289B2
公开(公告)日:2021-07-27
申请号:US15885568
申请日:2018-01-31
Applicant: Microsoft Technology Licensing, LLC.
Inventor: Houdong Hu , Yan Wang , Linjun Yang , Li Huang , Xi Chen , Jiapei Huang , Ye Wu , Arun K. Sacheti , Meenaz Merchant
IPC: G06F16/53 , G06F16/532 , G06T7/00 , G06K9/62 , G06K9/46 , G06N3/08 , G06F16/51 , G06F16/56 , G06F16/583 , G06F16/2457
Abstract: Systems and methods can be implemented to conduct searches based on images used as queries in a variety of applications. In various embodiments, a set of visual words representing a query image are generated from features extracted from the query image and are compared with visual words of index images. A set of candidate images is generated from the index images resulting from matching one or more visual words in the comparison. A multi-level ranking is conducted to sort the candidate images of the set of candidate images, and results of the multi-level ranking are returned to a user device that provided the query image. Additional systems and methods are disclosed.
-
公开(公告)号:US10902051B2
公开(公告)日:2021-01-26
申请号:US15954152
申请日:2018-04-16
Applicant: Microsoft Technology Licensing, LLC
Inventor: Houdong Hu , Li Huang
IPC: G06F16/00 , G06F16/55 , G06Q30/06 , G06N3/08 , G06F3/0482 , G06F3/0484 , G06K9/66 , G06K9/62 , G06N20/00 , G06F16/532 , G06F16/53
Abstract: Methods, systems, and computer programs are presented for identifying the brand and model of products embedded within an image. One method includes operations for receiving, via a graphical user interface (GUI), a selection of an image, and for analyzing the image to determine a location within the image of one or more products. For each product in the image, determining a unique identification of the product is determined, the unique identification including a manufacturer of the product and a model identifier. The method further includes an operation for presenting information about the one or more products in the GUI with a selection option for selecting each of the one or more products. Additionally, the method includes operations for receiving a product selection for one of the one or more products, and presenting shopping options in the GUI for purchasing the selected product.
-
公开(公告)号:US20190243910A1
公开(公告)日:2019-08-08
申请号:US15888960
申请日:2018-02-05
Applicant: Microsoft Technology Licensing, LLC
Inventor: Yan Wang , Houdong Hu , Li Huang , Arun K. Sacheti , Linjun Yang
IPC: G06F17/30
CPC classification number: G06F16/5838 , G06F16/24578 , G06F16/51 , G06F16/56 , G06F16/583 , G06F16/5866 , G06F16/587
Abstract: Systems and methods can be implemented to conduct a visual search as a service in a variety of applications. In various embodiments, a system is configured to provide searching capabilities of content provided by a first entity in response to a search request by a second entity. An image provided by the second entity can be used by the system as a query image to search the content of the first entity. In an embodiment, the first entity can be a commercial entity providing such a system with image related content regarding its products and services such that any number of individual consumers can search for particular products and services of the commercial entity via their communication enabled devices. In addition, such systems can be arranged for other embodiments to provide customized searches of a single source by many individual devices. Additional systems and methods are disclosed.
-
公开(公告)号:US20190236167A1
公开(公告)日:2019-08-01
申请号:US15885568
申请日:2018-01-31
Applicant: Microsoft Technology Licensing, LLC.
Inventor: Houdong Hu , Yan Wang , Linjun Yang , Li Huang , Xi Chen , Jiapei Huang , Ye Wu , Arun K. Sacheti , Meenaz Merchant
CPC classification number: G06F16/532 , G06F16/24578 , G06F16/51 , G06F16/56 , G06F16/5838 , G06K9/46 , G06K9/6215 , G06K9/627 , G06K2209/27 , G06N3/08 , G06T7/97 , G06T2207/20084 , G06T2207/30196
Abstract: Systems and methods can be implemented to conduct searches based on images used as queries in a variety of applications. In various embodiments, a set of visual words representing a query image are generated from features extracted from the query image and are compared with visual words of index images. A set of candidate images is generated from the index images resulting from matching one or more visual words in the comparison. A multi-level ranking is conducted to sort the candidate images of the set of candidate images, and results of the multi-level ranking are returned to a user device that provided the query image. Additional systems and methods are disclosed.
-
公开(公告)号:US20190318405A1
公开(公告)日:2019-10-17
申请号:US15954152
申请日:2018-04-16
Applicant: Microsoft Technology Licensing , LLC
Inventor: Houdong Hu , Li Huang
IPC: G06Q30/06 , G06N99/00 , G06N3/08 , G06F17/30 , G06F3/0484 , G06K9/66 , G06K9/62 , G06F3/0482
Abstract: Methods, systems, and computer programs are presented for identifying the brand and model of products embedded within an image. One method includes operations for receiving, via a graphical user interface (GUI), a selection of an image, and for analyzing the image to determine a location within the image of one or more products. For each product in the image, determining a unique identification of the product is determined, the unique identification including a manufacturer of the product and a model identifier. The method further includes an operation for presenting information about the one or more products in the GUI with a selection option for selecting each of the one or more products. Additionally, the method includes operations for receiving a product selection for one of the one or more products, and presenting shopping options in the GUI for purchasing the selected product.
-
公开(公告)号:US20190258895A1
公开(公告)日:2019-08-22
申请号:US15900606
申请日:2018-02-20
Applicant: Microsoft Technology Licensing, LLC
Inventor: Arun Sacheti , Xi Chen , Houdong Hu , Li Huang , Jiapei Huang , Meenaz Merchant
Abstract: Non-limiting examples of the present disclosure relate to object detection processing of image content that categorically classifies specific objects within image content. Exemplary object detection processing may be utilized to enhance visual search processing including content retrieval and curation, among other technical advantages. An exemplary object detection model is implemented to categorically classify an object. In doing, so an exemplary object detection model may classify objects based on: analysis of specific objects within image content, positioning of the objects within the image content and intent associated with the image content, among other examples. The object detection model generates exemplary categorical classification(s) for specific data objects, which may be propagated to enhance processing efficiency and accuracy during visual search processing. Exemplary categorical classifications may comprise hierarchical classifications of a detected object that can be used to retrieve, curate and surface content that is most contextually relevant to a detected object.
-
公开(公告)号:US12032915B2
公开(公告)日:2024-07-09
申请号:US17871968
申请日:2022-07-24
Applicant: Microsoft Technology Licensing, LLC
Inventor: Li Huang , Congyong Su
CPC classification number: G06F40/30 , G06F16/258 , G06N5/04 , G06N20/00
Abstract: A computer-implemented technique uses a machine-trained model to convert input information provided by a user into a natural language expression and a semantic vector. The semantic vector provides a distributed representation of the natural language expression. The technique then uses the generated semantic vector to find a target data record having a target semantic vector that is within a prescribed distance to the generated semantic vector. The technique then outputs at least a target natural language expression that is associated with the target data record. The target data record is produced in an offline process that converts one or more attribute values in an existing structured data record into the target semantic vector and the target natural language expression. Also described herein is a technique for training the machine-trained model and for updating existing collections of data records using the machine-trained model.
-
公开(公告)号:US11429792B2
公开(公告)日:2022-08-30
申请号:US16869336
申请日:2020-05-07
Applicant: Microsoft Technology Licensing, LLC
Inventor: Li Huang , Congyong Su
Abstract: A computer-implemented technique uses a machine-trained model to convert input information provided by a user into a natural language expression and a semantic vector. The semantic vector provides a distributed representation of the natural language expression. The technique then uses the generated semantic vector to find a target data record having a target semantic vector that is within a prescribed distance to the generated semantic vector. The technique then outputs at least a target natural language expression that is associated with the target data record. The target data record is produced in an offline process that converts one or more attribute values in an existing structured data record into the target semantic vector and the target natural language expression. Also described herein is a technique for training the machine-trained model and for updating existing collections of data records using the machine-trained model.
-
-
-
-
-
-
-
-
-