公开(公告)号：US20240153246A1

公开(公告)日：2024-05-09

申请号：US17983327

申请日：2022-11-08

Applicant: eBay Inc.

Inventor： Baohao Liao ,  Sanjika Hewavitharana ,  Michael Damian Kozielski ,  Friedrich Leonard Dahlmann ,  Shahram Khadivi

IPC: G06V10/774 ,  G06F40/284 ,  G06Q30/06 ,  G06V10/74 ,  G06V10/764

CPC classification number: G06V10/774 ,  G06F40/284 ,  G06Q30/0643 ,  G06V10/761 ,  G06V10/764

Abstract: A system may receive, via a first user interface associated with an online marketplace, a multi-modality request to retrieve a listing for an item, the multi-modality request comprising at least a first image and a first natural language text associated with the item. The system may generate an item embedding based on inputting the first image and the first natural language text to a machine learning model and may generate a first vector associated with the first image and the first natural language text included in the multi-modality request. The system may cause presentation, via the first user interface associated with the online marketplace, of one or more listings for the item retrieved based at least in part on a similarity metric between the first vector and a second vector of a plurality of vectors associated with a plurality of listings.