公开(公告)号：US20210389872A1

公开(公告)日：2021-12-16

申请号：US17139642

申请日：2020-12-31

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Francois Hogan ,  Michael Jenkin ,  Gregory Lewis Dudek ,  Yogesh Girdhar ,  Sahand Rezaei-Shoshtari ,  David Meger

IPC: G06F3/0488 ,  G06F3/041 ,  G06N20/20

Abstract: A method of sensing an interaction with an object using a semitransparent tactile surface (STS) sensor having an image sensor and a semitransparent membrane includes capturing, by the image sensor, a stream of images; separating the stream of images into a visual stream including light traveling through the semitransparent membrane and a tactile stream including light reflecting off of the semitransparent membrane; and processing the visual stream and tactile stream through a multimodal deep neural network.