公开(公告)号：US20220269719A1

公开(公告)日：2022-08-25

申请号：US17465408

申请日：2021-09-02

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Haotian ZHANG ,  Allan Jepson ,  Iqbal Ismail Mohomed ,  Konstantinos Derpanis ,  Ran Zhang ,  Afsaneh Fazly

IPC: G06F16/535 ,  G06N20/00

Abstract: A method of personalized image retrieval includes obtaining a natural language query including a name; replacing the name in the natural language query with a generic term to provide an anonymized query and named entity information; obtaining a plurality of initial ranking scores and a plurality of attention weights corresponding to a plurality of images using a trained scoring model that inputs the anonymized query and the plurality of images; obtaining a plurality of delta scores corresponding to the plurality of images using a re-scoring model that inputs the plurality of attention weights and the named entity information; and obtaining a plurality of final ranking scores by modifying the plurality of initial ranking scores based on the plurality of delta scores. The trained scoring model performs semantic based searching and the re-scoring model determines a probability that faces detected in the plurality of images correspond to the name.

公开(公告)号：US20240169732A1

公开(公告)日：2024-05-23

申请号：US18227560

申请日：2023-07-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Mikita DVORNIK ,  Isma Hadji ,  Ran Zhang ,  Konstantinos Derpanis ,  Richard Wildes ,  Animesh Garg ,  Allan Douglas Jepson

IPC: G06V20/40 ,  G06F16/735 ,  G06F16/783 ,  G06V10/77 ,  G06V10/86 ,  G09B5/06

CPC classification number: G06V20/46 ,  G06F16/735 ,  G06F16/7844 ,  G06V10/7715 ,  G06V10/86 ,  G06V20/48 ,  G09B5/065

Abstract: The present disclosure provides methods, apparatuses, and computer-readable media for step discovery and localization in an instructional video. In some embodiments, the method includes extracting, from the instructional video using a transformer model, a plurality of step slots corresponding to a plurality of procedure steps depicted in the instructional video, matching, using an order-aware sequence-to-sequence alignment model, a plurality of video segments of the instructional video to the plurality of step slots, generating a temporally-ordered plurality of video segments from the plurality of video segments, receiving a user query requesting a procedure step, selecting, from the plurality of video segments of the instructional video, a corresponding video segment corresponding to the requested procedure step, and providing, in response to the user query, the corresponding video segment and the matching textual step description of the corresponding video segment.

公开(公告)号：US11838641B2

公开(公告)日：2023-12-05

申请号：US17131262

申请日：2020-12-22

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Mahmoud Nasser Mohammed Afifi ,  Michael Scott Brown ,  Konstantinos Derpanis ,  Björn Ommer

IPC: H04N23/00 ,  H04N23/70 ,  G06N3/08 ,  G06T5/00 ,  G06N3/048

CPC classification number: H04N23/70 ,  G06N3/048 ,  G06N3/08 ,  G06T5/007 ,  G06T2207/20084

Abstract: A method for generating an output image may include obtaining an input image having a first exposure value, generating a plurality of levels that are each respectively associated with a respective representation of the input image, based on the input image, generating the output image having a second exposure value, based on a deep neural network (DNN) including a set of sub-networks and the plurality of levels, and providing the output image.

公开(公告)号：US11755638B2

公开(公告)日：2023-09-12

申请号：US17465408

申请日：2021-09-02

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Haotian Zhang ,  Allan Jepson ,  Iqbal Ismail Mohomed ,  Konstantinos Derpanis ,  Ran Zhang ,  Afsaneh Fazly

IPC: G06F16/00 ,  G06F16/535 ,  G06N20/00

CPC classification number: G06F16/535 ,  G06N20/00

Abstract: A method of personalized image retrieval includes obtaining a natural language query including a name; replacing the name in the natural language query with a generic term to provide an anonymized query and named entity information; obtaining a plurality of initial ranking scores and a plurality of attention weights corresponding to a plurality of images using a trained scoring model that inputs the anonymized query and the plurality of images; obtaining a plurality of delta scores corresponding to the plurality of images using a re-scoring model that inputs the plurality of attention weights and the named entity information; and obtaining a plurality of final ranking scores by modifying the plurality of initial ranking scores based on the plurality of delta scores. The trained scoring model performs semantic based searching and the re-scoring model determines a probability that faces detected in the plurality of images correspond to the name.

公开(公告)号：US12153621B2

公开(公告)日：2024-11-26

申请号：US18453838

申请日：2023-08-22

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Haotian Zhang ,  Allan Jepson ,  Iqbal Ismail Mohomed ,  Konstantinos Derpanis ,  Ran Zhang ,  Afsaneh Fazly

IPC: G06F16/535 ,  G06N20/00

Abstract: A method of personalized image retrieval includes obtaining a natural language query including a name; replacing the name in the natural language query with a generic term to provide an anonymized query and named entity information; obtaining a plurality of initial ranking scores and a plurality of attention weights corresponding to a plurality of images using a trained scoring model that inputs the anonymized query and the plurality of images; obtaining a plurality of delta scores corresponding to the plurality of images using a re-scoring model that inputs the plurality of attention weights and the named entity information; and obtaining a plurality of final ranking scores by modifying the plurality of initial ranking scores based on the plurality of delta scores. The trained scoring model performs semantic based searching and the re-scoring model determines a probability that faces detected in the plurality of images correspond to the name.

公开(公告)号：US11580392B2

公开(公告)日：2023-02-14

申请号：US16805051

申请日：2020-02-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Mete Kemertas ,  Leila Pishdad ,  Konstantinos Derpanis ,  Afsaneh Fazly

IPC: G06F16/23 ,  G06N3/08 ,  G06F16/2457

Abstract: An apparatus for providing similar contents, using a neural network, includes a memory storing instructions, and a processor configured to execute the instructions to obtain a plurality of similarity values between a user query and a plurality of images, using a similarity neural network, obtain a rank of each the obtained plurality of similarity values, and provide, as a most similar image to the user query, at least one among the plurality of images that has a respective one among the plurality of similarity values that corresponds to a highest rank among the obtained rank of each of the plurality of similarity values. The similarity neural network is trained with a divergence neural network for outputting a divergence between a first distribution of first similarity values for positive pairs, among the plurality of similarity values, and a second distribution of second similarity values for negative pairs, among the plurality of similarity values.

公开(公告)号：US12164969B2

公开(公告)日：2024-12-10

申请号：US17563813

申请日：2021-12-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Isma Hadji ,  Mikita Andreevich Dvornik ,  Konstantinos Derpanis ,  Allan Douglas Jepson

IPC: G06F9/50

Abstract: A method is provided. The method includes receiving a first signal and a second signal, generating a first sequence based on the first signal by embedding at least one feature in the first signal, generating a second sequence based on the second signal by embedding at least one feature in the second signal, determining a minimum cost path of aligning the first sequence with the second sequence based on the embedded at least one feature in the first sequence and the embedded at least one feature in the second sequence, and aligning the first sequence with second sequence based on the determined minimum cost path.

公开(公告)号：US12050640B2

公开(公告)日：2024-07-30

申请号：US17984685

申请日：2022-11-10

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： He Zhao ,  Mikita Andreevich Dvornik ,  Isma Hadji ,  Richard Wildes ,  Konstantinos Derpanis ,  Allan Douglas Jepson

IPC: G06F16/00 ,  G06F16/532 ,  G06N7/01

CPC classification number: G06F16/532 ,  G06N7/01

Abstract: The present disclosure provides methods and apparatuses for probabilistic procedure planning for generating a plan based on a goal relating to an end state. In some embodiments, a method includes receiving a request from a user to generate an action plan comprising T intermediate actions between a start state and the end state. The method further includes constructing an input query matrix based on T, the start state, the end state, positional encodings, and pseudo-random noise information. The method further includes generating, using a machine learning transformer decoder, the action plan based on the input query matrix and a plurality of learnable vectors. The method further includes providing the action plan to the user. The action plan indicates a probability distribution of a plurality of distinct action sequences, to be performed by the user, that transform the start state to the end state.

公开(公告)号：US20220237043A1

公开(公告)日：2022-07-28

申请号：US17563813

申请日：2021-12-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Isma HADJI ,  Mikita Andreevich Dvornik ,  Konstantinos Derpanis ,  Allan Douglas Jepson

IPC: G06F9/50 ,  G06K9/00

Abstract: A method is provided. The method includes receiving a first signal and a second signal, generating a first sequence based on the first signal by embedding at least one feature in the first signal, generating a second sequence based on the second signal by embedding at least one feature in the second signal, determining a minimum cost path of aligning the first sequence with the second sequence based on the embedded at least one feature in the first sequence and the embedded at least one feature in the second sequence, and aligning the first sequence with second sequence based on the determined minimum cost path.