公开(公告)号：US12238263B2

公开(公告)日：2025-02-25

申请号：US17119003

申请日：2020-12-11

Applicant: Sony Group Corporation ,  Sony Pictures Entertainment Inc.

Inventor： Scott Metzger ,  David Bailey

IPC: H04N13/25 ,  H04N13/257 ,  H04N23/11 ,  H04N23/54 ,  H04N23/56 ,  H04N23/90

Abstract: Video capture of a subject, including: a first IR camera, a second IR camera, and a color camera, for capturing video data of the subject; a post, where the first IR camera, the second IR camera, and the color camera are attached to the post, and where the color camera is positioned between the first IR camera and the second IR camera; at least one IR light source, for illuminating the subject; and a processor configured to: generate depth solve data for the subject using data from the first IR camera and the second IR camera; generate projected color data by using data from the color camera to project color onto the depth solve data; and generate final capture data by merging the depth solve data and the projected color data.

公开(公告)号：US12165247B2

公开(公告)日：2024-12-10

申请号：US17711886

申请日：2022-04-01

Applicant: Sony Interactive Entertainment LLC

Inventor： Geoff Wedig

IPC: G06T13/40 ,  A63F13/213 ,  G06T17/20 ,  G06V10/764 ,  G06V10/774 ,  G06V10/776 ,  G06V40/16 ,  H04N13/25

Abstract: Methods and systems are provided for training a model used for animating a facial expression of a game character. The method includes capturing mesh data of a first human actor using a three-dimensional (3D) camera to generate three-dimensional (3D) depth data of a face of the first human actor. In one embodiment, the 3D depth data is output as mesh files corresponding to a frame captured by the 3D camera. The method includes capturing two-dimensional (2D) point cloud data of the first human actor using a 2D camera. In one embodiment, the 2D point cloud data represents tracked dots present on the face of the first human actor. In another embodiment, the 2D point cloud data is processed to generate training label value files (tLVFs). The method includes processing the mesh data in time coordination with the tLVFs associated with the 2D point cloud data to train the model. The model is configured to receive input mesh files captured from a second human actor and generate as output LVFs corresponding to the input mesh files.

公开(公告)号：US12155811B2

公开(公告)日：2024-11-26

申请号：US17601491

申请日：2019-06-11

Applicant: LG ELECTRONICS INC.

Inventor： Chaedeok Lee ,  Myungwon Kim ,  Jongmyoung Park ,  Sunghyun Yi ,  Hyunoh Kang ,  Woodeok Joo

IPC: H04N13/25 ,  G06T7/521 ,  G06T7/70 ,  G06T11/00 ,  H04N13/254 ,  H04N13/257 ,  H04N23/11 ,  G01N15/00 ,  G01N15/075

Abstract: The present invention relates to a dust measurement device for implementing a dust distribution image through a non-coplanar stereo vision camera, and provides a dust measurement device comprising: a stereo vision camera which includes a first camera for obtaining a true color image and a second camera for obtaining an infrared image; a control unit for generating a fine dust distribution image by using a light amount ratio of the amount of light obtained from a first pixel array of the first camera to the amount of light obtained from a second pixel array of the second camera; and a display device for outputting the fine dust distribution image.

公开(公告)号：US12078479B2

公开(公告)日：2024-09-03

申请号：US18188828

申请日：2023-03-23

Applicant: 3SHAPE A/S

Inventor： Nikolaj Deichmann ,  Mike Van Der Poel ,  Karl-Josef Hollenbeck ,  Rune Fisker

IPC: G01B21/18 ,  G01B11/24 ,  G01B11/245 ,  G01B11/25 ,  G01S17/894 ,  G06T17/00 ,  H04N1/00 ,  H04N13/25

CPC classification number: G01B21/18 ,  G01B11/24 ,  G01B11/245 ,  G01B11/25 ,  G01B11/2513 ,  G01B11/2518 ,  G01S17/894 ,  G06T17/00 ,  H04N1/00827 ,  H04N13/25

Abstract: A 3D scanner system includes a scanning device capable of recording first and second data sets of a surface of an object when operating in a first configuration and a second configuration, respectively. A measurement unit is configured for measuring a distance from the scanning device to the surface. A control controls an operation of the scanning device based on the distance measured by the measurement unit, where the scanning device operates in the first configuration when the measured distance is within a first range of distances from the surface and the scanning device operates in the second configuration when the measured distance is within a second range of distances; and a data processor is configured to combine one or more first data sets and one or more second data sets to create a combined virtual 3D model of the object surface.

公开(公告)号：US12069222B2

公开(公告)日：2024-08-20

申请号：US18117910

申请日：2023-03-06

Applicant: Texas Instruments Incorporated

Inventor： Vikram VijayanBabu Appia ,  Ibrahim Ethem Pekkucuksen

IPC: H04N13/106 ,  G06T3/4053 ,  H04N13/00 ,  H04N13/243 ,  H04N13/25 ,  H04N13/282

CPC classification number: H04N13/106 ,  G06T3/4053 ,  H04N13/243 ,  H04N13/25 ,  H04N13/282 ,  H04N2013/0081

Abstract: A method of image processing in a structured light imaging device is provided that includes capturing a plurality of images of a scene into which a structured light pattern is projected by a projector in the structured light imaging device, extracting features in each of the captured images, finding feature matches between a reference image of the plurality of captured images and each of the other images in the plurality of captured images, rectifying each of the other images to align with the reference image, wherein each image of the other images is rectified based on feature matches between the image and the reference image, combining the rectified other images and the reference image using interpolation to generate a high resolution image, and generating a depth image using the high resolution image.

公开(公告)号：US12032278B2

公开(公告)日：2024-07-09

申请号：US17395627

申请日：2021-08-06

Applicant: Photon-X, Inc.

Inventor： Blair Barbour ,  Nicholas Englert ,  Randy Kenneth Chamberlin ,  David Theodore Truch

IPC: H04N13/257 ,  G03B35/08 ,  G06V10/10 ,  H04N13/122 ,  H04N13/25 ,  H04N13/275

CPC classification number: G03B35/08 ,  G06V10/10 ,  H04N13/122 ,  H04N13/25 ,  H04N13/257 ,  H04N13/275

Abstract: In a general aspect, integrated spatial phase imaging is described. In some aspects, an integrated imaging system includes a sensor device and one or more processors. The sensor device is configured to generate a first set of data indicative of a first set of attributes of an object and a second set of data indicative of a second set of attributes of the object. The one or more processors are configured to: generate a first set of primitives based on the first set of data; generate a second set of primitives based on the second set of data; generate a combined data set based on the first set of primitives and the second set of primitives; and determine a plurality of features of the object based on the combined data set.

公开(公告)号：US11869139B2

公开(公告)日：2024-01-09

申请号：US18150444

申请日：2023-01-05

Applicant: PACKSIZE LLC

Inventor： Giulio Marin ,  Abbas Rafii ,  Carlo Dal Mutto ,  Kinh Tieu ,  Giridhar Murali ,  Alvise Memo

IPC: G06T15/50 ,  G06T17/20 ,  G06T7/00 ,  G06T15/04 ,  H04N13/25 ,  H04N13/282 ,  G06T11/00 ,  H04N13/111 ,  H04N13/15 ,  H04N13/271 ,  H04N13/257 ,  H04N13/243 ,  H04N13/133 ,  H04N13/254 ,  G06T7/521 ,  G06T7/593 ,  G06F18/22 ,  G06F18/21 ,  G06F18/2413 ,  G06V10/75 ,  G06V10/764 ,  G06V10/82

CPC classification number: G06T15/506 ,  G06F18/217 ,  G06F18/22 ,  G06F18/2413 ,  G06T7/001 ,  G06T7/521 ,  G06T7/593 ,  G06T11/001 ,  G06T15/04 ,  G06T17/20 ,  G06V10/75 ,  G06V10/764 ,  G06V10/82 ,  H04N13/111 ,  H04N13/133 ,  H04N13/15 ,  H04N13/243 ,  H04N13/25 ,  H04N13/254 ,  H04N13/257 ,  H04N13/271 ,  H04N13/282 ,  G06T2200/08 ,  G06T2207/10021 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/10048 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: A method for generating a three-dimensional (3D) model of an object includes: capturing images of the object from a plurality of viewpoints, the images including color images; generating a 3D model of the object from the images, the 3D model including a plurality of planar patches; for each patch of the planar patches: mapping image regions of the images to the patch, each image region including at least one color vector; and computing, for each patch, at least one minimal color vector among the color vectors of the image regions mapped to the patch; generating a diffuse component of a bidirectional reflectance distribution function (BRDF) for each patch of planar patches of the 3D model in accordance with the at least one minimal color vector computed for each patch; and outputting the 3D model with the BRDF for each patch.

公开(公告)号：US11803981B2

公开(公告)日：2023-10-31

申请号：US17613617

申请日：2020-05-29

Applicant: Mobileye Vision Technologies Ltd.

Inventor： Gideon Stein ,  Itay Blumenthal ,  Nadav Shaag ,  Jeffrey Moskowitz ,  Natalie Carlebach

IPC: G06T7/579 ,  G06T7/292 ,  H04N13/25 ,  B60R1/22 ,  G06V10/774 ,  G06V20/58 ,  G06V10/82 ,  G06T3/00 ,  G06T17/05 ,  G06N3/045 ,  G06V10/25 ,  G06V20/56 ,  G08G1/16 ,  G06T17/00

CPC classification number: G06T7/579 ,  B60R1/22 ,  G06N3/045 ,  G06T3/0093 ,  G06T7/292 ,  G06T17/00 ,  G06T17/05 ,  G06V10/25 ,  G06V10/7747 ,  G06V10/82 ,  G06V20/56 ,  G06V20/58 ,  G08G1/166 ,  H04N13/25 ,  G06T2200/04 ,  G06T2200/08 ,  G06T2207/10016 ,  G06T2207/10021 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30252 ,  G08G1/165

Abstract: Various systems and methods for modeling a scene. A device for modeling a scene includes a hardware interface to obtain a time-ordered sequence of images representative of a scene, the time-ordered sequence including a plurality of images, one of the sequence of images being a current image, the scene captured by a monocular imaging system; and processing circuitry to: provide a data set to an artificial neural network (ANN) to produce a three-dimensional structure of the scene, the data set including: a portion of the sequence of images, the portion of the sequence of images including the current image; and motion of a sensor that captured the sequence of images; and model the scene using the three-dimensional structure of the scene, wherein the three-dimensional structure is determined for both moving and fixed objects in the scene.

公开(公告)号：US20230300308A1

公开(公告)日：2023-09-21

申请号：US18117910

申请日：2023-03-06

Applicant: Texas Instruments Incorporated

Inventor： Vikram VijayanBabu Appia ,  Ibrahim Ethem Pekkucuksen

IPC: H04N13/106 ,  G06T3/40 ,  H04N13/243 ,  H04N13/282 ,  H04N13/25

CPC classification number: H04N13/106 ,  G06T3/4053 ,  H04N13/243 ,  H04N13/282 ,  H04N13/25 ,  H04N2013/0081

Abstract: A method of image processing in a structured light imaging device is provided that includes capturing a plurality of images of a scene into which a structured light pattern is projected by a projector in the structured light imaging device, extracting features in each of the captured images, finding feature matches between a reference image of the plurality of captured images and each of the other images in the plurality of captured images, rectifying each of the other images to align with the reference image, wherein each image of the other images is rectified based on feature matches between the image and the reference image, combining the rectified other images and the reference image using interpolation to generate a high resolution image, and generating a depth image using the high resolution image.

公开(公告)号：US11704776B2

公开(公告)日：2023-07-18

申请号：US17547816

申请日：2021-12-10

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Dong Zhou

IPC: H04N13/128 ,  H04N13/239 ,  G06T5/00 ,  G06T5/50 ,  G06V20/40 ,  G06V20/64 ,  G06F18/00 ,  H04N23/68 ,  H04N13/25 ,  H04N5/265 ,  G06V30/142 ,  H04N13/00

CPC classification number: G06T5/002 ,  G06F18/00 ,  G06T5/50 ,  G06V20/46 ,  G06V20/64 ,  H04N5/265 ,  H04N13/128 ,  H04N13/239 ,  H04N13/25 ,  H04N23/68 ,  H04N23/682 ,  H04N23/683 ,  H04N23/6812 ,  G06T2207/10021 ,  G06T2207/30201 ,  G06V30/142 ,  H04N2013/0081

Abstract: Depth information can be used to assist with image processing functionality, such as image stabilization and blur reduction. In at least some embodiments, depth information obtained from stereo imaging or distance sensing, for example, can be used to determine a foreground object and background object(s) for an image or frame of video. The foreground object then can be located in later frames of video or subsequent images. Small offsets of the foreground object can be determined, and the offset accounted for by adjusting the subsequent frames or images. Such an approach provides image stabilization for at least a foreground object, while providing simplified processing and reduce power consumption. Similarly processes can be used to reduce blur for an identified foreground object in a series of images, where the blur of the identified object is analyzed.