公开(公告)号：US11687583B2

公开(公告)日：2023-06-27

申请号：US17752515

申请日：2022-05-24

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Ruchika Saxena ,  Kapil Sachdeva ,  Maneesh Jain ,  Arun Kumar Singh

IPC: G06F16/00 ,  G06F16/583 ,  G06F16/538 ,  G06F16/532

CPC classification number: G06F16/5846 ,  G06F16/532 ,  G06F16/538

Abstract: A system for retrieving information from an instructional document, includes a processor configured to: receive a query from a user; compare the query with one or more text sections in the instructional document; obtain, from the one or more text sections, top x text sections relevant to the query using a pre-trained encoder; compare the query with one or more images in the instructional document; obtain, from the images, top y images relevant to the query; generate top y image-text sections based on the top y images; obtain top k sections from the top x text sections and the top y image-text sections; obtain one or more most relevant sections from the top k sections using a domain-specific pre-trained encoder and a sequential classification model; and generate an answer based on the one or more most relevant sections and device context information using the domain-specific pre-trained encoder.

公开(公告)号：US12051227B2

公开(公告)日：2024-07-30

申请号：US17948981

申请日：2022-09-20

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Ashima Jain ,  Ruchika Saxena ,  Maneesh Jain ,  Sachin Dev Sharma

IPC: G06V10/25 ,  G06T19/00 ,  G06V20/20 ,  G06V20/62

CPC classification number: G06V10/25 ,  G06T19/006 ,  G06V20/20 ,  G06V20/63

Abstract: A method for selection of a marker in an augmented reality (AR) environment is provided. The method includes capturing a scene in the augmented reality environment; extracting a set of region of interest from the scene captured; identifying a text in the region of interest or from a document associated to the region of interest; determining a set of phrase-action pairs from the text; generating a representation of a set of region of interest and a representation of a set of phrase-action pairs; calculating inter model similarity using the set of region of interest and the set of phrase-action pairs in common embedding space; computing intra model similarity by comparing the extracted ROI with a generated ROI and the extracted phrase-action with generated phrase actions; and selecting a phrase-action-ROI tuple having the highest intra modal similarity as the marker.

公开(公告)号：US20230111356A1

公开(公告)日：2023-04-13

申请号：US17948981

申请日：2022-09-20

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Ashima JAIN ,  Ruchika Saxena ,  Maneesh Jain ,  Sachin Dev Sharma

IPC: G06V10/25 ,  G06T19/00 ,  G06V20/20 ,  G06V20/62

Abstract: A method for selection of a marker in an augmented reality (AR) environment is provided. The method includes capturing a scene in the augmented reality environment; extracting a set of region of interest from the scene captured; identifying a text in the region of interest or from a document associated to the region of interest; determining a set of phrase-action pairs from the text; generating a representation of a set of region of interest and a representation of a set of phrase-action pairs; calculating inter model similarity using the set of region of interest and the set of phrase-action pairs in common embedding space; computing intra model similarity by comparing the extracted ROI with a generated ROI and the extracted phrase-action with generated phrase actions; and selecting a phrase-action-ROI tuple having the highest intra modal similarity as the marker.