公开(公告)号：US20240028638A1

公开(公告)日：2024-01-25

申请号：US17871531

申请日：2022-07-22

Applicant: Google LLC

Inventor： Balint Miklos ,  Rajan Sharad Patel ,  Severin Heiniger

IPC: G06F16/532 ,  G06F9/451 ,  G06F16/538

CPC classification number: G06F16/532 ,  G06F9/453 ,  G06F16/538

Abstract: Systems and methods of the present disclosure are directed to a computer-implemented method for multimodal search refinement. The method includes obtaining a visual search query from a user comprising one or more query images. The method includes providing a search interface for display to the user, the search interface comprising one or more result images responsive to the one or more query images and an interface element indicative of a request to the user to refine the visual search query. The method includes obtaining, from the user, textual data comprising a refinement to the visual search query. The method includes appending, by the computing system, the textual data to the visual search query to obtain a multimodal search query.