-
公开(公告)号：US11042994B2
公开(公告)日：2021-06-22
申请号：US16158831
申请日：2018-10-12
Inventor： Simon Stent , Adria Recasens , Antonio Torralba , Petr Kellnhofer , Wojciech Matusik
Abstract: A system for determining the gaze direction of a subject includes a camera, a computing device and a machine-readable instruction set. The camera is positioned in an environment to capture image data of head of a subject. The computing device is communicatively coupled to the camera and the computing device includes a processor and a non-transitory computer-readable memory. The machine-readable instruction set is stored in the non-transitory computer-readable memory and causes the computing device to: receive image data from the camera, analyze the image data using a convolutional neural network trained on an image dataset comprising images of a head of a subject captured from viewpoints distributed around up to 360-degrees of head yaw, and predict a gaze direction vector of the subject based upon a combination of head appearance and eye appearance image data from the image dataset.
-
公开(公告)号：US12232864B2
公开(公告)日：2025-02-25
申请号：US17226564
申请日：2021-04-09
Applicant: Massachusetts Institute of Technology
Inventor： Wojciech Matusik , Antonio Torralba , Michael J. Foshey , Wan Shou , Yiyue Luo , Pratyusha Sharma , Yunzhu Li , Tomas Palacios
Abstract: Systems and methods are provided for estimating 3D poses of a subject based on tactile interactions with the ground. Test subject interactions with the ground are recorded using a sensor system along with reference information (e.g., synchronized video information) for use in correlating tactile information with specific 3D poses, e.g., by training a neural network based on the reference information. Then, tactile information received in response to a given subject interacting with the ground can be used to estimate the 3D pose of the given subject directly, i.e., without reference to corresponding reference information. Certain exemplary embodiments use a sensor system in the form of a pressure sensing carpet or mat, although other types of sensor systems using pressure or other sensors can be used in various alternative embodiments.
-
公开(公告)号：US11430084B2
公开(公告)日：2022-08-30
申请号：US16121978
申请日：2018-09-05
Inventor： Simon A. I. Stent , Adrià Recasens , Antonio Torralba , Petr Kellnhofer , Wojciech Matusik
Abstract: A method includes receiving, with a computing device, an image, identifying one or more salient features in the image, and generating a saliency map of the image including the one or more salient features. The method further includes sampling the image based on the saliency map such that the one or more salient features are sampled at a first density of sampling and at least one portion of the image other than the one or more salient features are sampled at a second density of sampling, where the first density of sampling is greater than the second density of sampling, and storing the sampled image in a non-transitory computer readable memory.
-
公开(公告)号：US20200074589A1
公开(公告)日：2020-03-05
申请号：US16121978
申请日：2018-09-05
Inventor： Simon A.I. Stent , Adrià Recasens , Antonio Torralba , Petr Kellnhofer , Wojciech Matusik
Abstract: A method includes receiving, with a computing device, an image, identifying one or more salient features in the image, and generating a saliency map of the image including the one or more salient features. The method further includes sampling the image based on the saliency map such that the one or more salient features are sampled at a first density of sampling and at least one portion of the image other than the one or more salient features are sampled at a second density of sampling, where the first density of sampling is greater than the second density of sampling, and storing the sampled image in a non-transitory computer readable memory.
-
Patent Agency Ranking
公开(公告)号：US20190188533A1
公开(公告)日：2019-06-20
申请号：US16225837
申请日：2018-12-19
Applicant: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
Inventor： Dina Katabi , Antonio Torralba , Hang Zhao , Mingmin Zhao , Tianhong ` Li , Mohammad Abualsheikh , Yonglong Tian
CPC classification number: G06K9/6256 , G01B15/00 , G06K9/00348 , G06K9/00369
Abstract: A method for pose recognition includes storing parameters for configuration of an automated pose recognition system for detection of a pose of a subject represented in a radio frequency input signal. The parameters having been determined by a first process including accepting training data including a number of images including poses of subjects and a corresponding number of radio frequency signals and executing a parameter training procedure to determine the parameters. The parameter training procedure including, receiving features characterizing the poses in each of the images, and determining the parameters that configure the automated pose recognition system to match the features characterizing the poses from the corresponding radio frequency signals.
-
公开(公告)号：US11221671B2
公开(公告)日：2022-01-11
申请号：US16744719
申请日：2020-01-16
Inventor： Simon A. I. Stent , Adrià Recasens , Petr Kellnhofer , Wojciech Matusik , Antonio Torralba
Abstract: A system includes a camera positioned in an environment to capture image data of a subject; a computing device communicatively coupled to the camera, the computing device comprising a processor and a non-transitory computer-readable memory; and a machine-readable instruction set stored in the non-transitory computer-readable memory. The machine-readable instruction set causes the computing device to perform at least the following when executed by the processor: receive the image data from the camera; analyze the image data captured by the camera using a neural network trained on training data generated from a 360-degree panoramic camera configured to collect image data of a subject and a visual target that is moved about an environment; and predict a gaze direction vector of the subject with the neural network.
-
公开(公告)号：US20210315485A1
公开(公告)日：2021-10-14
申请号：US17226564
申请日：2021-04-09
Applicant: Massachusetts Institute of Technology
Inventor： Wojciech Matusik , Antonio Torralba , Michael J. Foshey , Wan Shou , Yiyue Luo , Pratyusha Sharma , Yunzhu Li
Abstract: Systems and methods are provided for estimating 3D poses of a subject based on tactile interactions with the ground. Test subject interactions with the ground are recorded using a sensor system along with reference information (e.g., synchronized video information) for use in correlating tactile information with specific 3D poses, e.g., by training a neural network based on the reference information. Then, tactile information received in response to a given subject interacting with the ground can be used to estimate the 3D pose of the given subject directly, i.e., without reference to corresponding reference information. Certain exemplary embodiments use a sensor system in the form of a pressure sensing carpet or mat, although other types of sensor systems using pressure or other sensors can be used in various alternative embodiments.
-
公开(公告)号：US20200249753A1
公开(公告)日：2020-08-06
申请号：US16744719
申请日：2020-01-16
Inventor： Simon A.I. Stent , Adrià Recasens , Petr Kellnhofer , Wojciech Matusik , Antonio Torralba
Abstract: A system includes a camera positioned in an environment to capture image data of a subject; a computing device communicatively coupled to the camera, the computing device comprising a processor and a non-transitory computer-readable memory; and a machine-readable instruction set stored in the non-transitory computer-readable memory. The machine-readable instruction set causes the computing device to perform at least the following when executed by the processor: receive the image data from the camera; analyze the image data captured by the camera using a neural network trained on training data generated from a 360-degree panoramic camera configured to collect image data of a subject and a visual target that is moved about an environment; and predict a gaze direction vector of the subject with the neural network.
-
公开(公告)号：US20190147607A1
公开(公告)日：2019-05-16
申请号：US16158831
申请日：2018-10-12
Inventor： Simon Stent , Adria Recasens , Antonio Torralba , Petr Kellnhofer , Wojciech Matuski
Abstract: A system for determining the gaze direction of a subject includes a camera, a computing device and a machine-readable instruction set. The camera is positioned in an environment to capture image data of head of a subject. The computing device is communicatively coupled to the camera and the computing device includes a processor and a non-transitory computer-readable memory. The machine-readable instruction set is stored in the non-transitory computer-readable memory and causes the computing device to: receive image data from the camera, analyze the image data using a convolutional neural network trained on an image dataset comprising images of a head of a subject captured from viewpoints distributed around up to 360-degrees of head yaw, and predict a gaze direction vector of the subject based upon a combination of head appearance and eye appearance image data from the image dataset.
-
-
-
-
-
-
-
-
Search Results
9
records
(took 0.018 seconds)
