-
公开(公告)号:US10944955B2
公开(公告)日:2021-03-09
申请号:US16284339
申请日:2019-02-25
Inventor: Tatsuya Koyama , Toshiyasu Sugio , Toru Matsunobu , Satoshi Yoshikawa
IPC: H04N13/246 , H04N5/222 , H04N5/232 , H04N7/18 , H04N21/218 , G06T7/80 , G06T7/70 , H04N13/296 , H04N13/243 , H04N13/111 , G06K9/00 , G06T7/20
Abstract: A multiple viewpoint image capturing system includes: a plurality of cameras that capture videos in a predetermined space from different positions; a circumstance sensing unit that senses at least one of circumstances of the respective cameras and circumstances of the predetermined space, and outputs the sensed circumstances in a form of capturing circumstance information; and an event detector that detects a predetermined event based on the capturing circumstance information, determines whether to perform camera calibration in a case of detecting the predetermined event, and outputs camera calibration information that indicates the camera calibration to be performed in a case of determining that the camera calibration is to be performed.
-
公开(公告)号:US10893251B2
公开(公告)日:2021-01-12
申请号:US16295582
申请日:2019-03-07
Inventor: Tatsuya Koyama , Toshiyasu Sugio , Toru Matsunobu , Satoshi Yoshikawa , Pongsak Lasang , Chi Wang
IPC: H04N13/139 , H04N13/282 , G06T7/80 , G06T7/70 , G06T7/55
Abstract: A three-dimensional model generating device includes: a converted image generating unit that, for each of input images included in one or more items of video data and having mutually different viewpoints, generates a converted image from the input image that includes fewer pixels than the input image; a camera parameter estimating unit that detects features in the converted images and estimates, for each of the input images, a camera parameter at a capture time of the input image, based on a pair of similar features between two of the converted images; and a three-dimensional model generating unit that generates a three-dimensional model using the input images and the camera parameters.
-
公开(公告)号:US11176707B2
公开(公告)日:2021-11-16
申请号:US17070290
申请日:2020-10-14
Inventor: Tatsuya Koyama , Masaki Fukuda , Toshiyasu Sugio , Toru Matsunobu , Satoshi Yoshikawa
IPC: G06T7/80 , G06T7/246 , G06T7/73 , H04N13/246
Abstract: A calibration apparatus calibrates parameters of imaging apparatuses which are disposed at different positions and image a common three-dimensional space. The calibration apparatus includes: an obtaining circuit which obtains videos captured by the imaging apparatuses and each including frames; an extraction circuit which extracts feature points from the frames included in the videos, the feature points including first feature points extracted from first frames included in the videos and second feature points extracted from areas containing an image of a moving object in second frames included in the videos and different from the first frames; a matching circuit which performs matching using the feature points, the matching including matching between the first feature points and matching between the second feature points; and a calibration circuit which calculates parameters of the imaging apparatuses based on first matching results obtained through the matching by the matching circuit.
-
公开(公告)号:US11721040B2
公开(公告)日:2023-08-08
申请号:US16577403
申请日:2019-09-20
Inventor: Tatsuya Koyama , Toshiyasu Sugio , Yoichi Sugino , Toru Matsunobu , Satoshi Yoshikawa
IPC: G06T7/80 , G06T7/70 , B64C39/02 , B64U101/30
CPC classification number: G06T7/80 , B64C39/024 , G06T7/70 , B64U2101/30 , G06T2207/10032
Abstract: A calibrator for a camera includes a controlling circuit, a photographing circuit, a calculating circuit, and an instructing circuit. The controlling circuit is configured to control a movable body to move into a shooting area of the camera. A marker is provided on the movable body for calibration of the camera. The photographing circuit is configured to control the camera to photograph the marker. The calculating circuit is configured to calculate at least one parameter of the camera based on the photographed marker. The instructing circuit is configured to transmit the at least one parameter to the camera to calibrate the camera.
-
公开(公告)号:US20240103541A1
公开(公告)日:2024-03-28
申请号:US18530534
申请日:2023-12-06
Inventor: Tatsuya Koyama
CPC classification number: G05D1/2297 , G05D1/2247 , G05D1/622 , G06N5/04
Abstract: An information generation method is performed by an information generation device which generates information for a learning model that infers whether a mobile object is movable in a predetermined region. The information generation method includes: obtaining at least (i) first information and (ii) second information when the mobile object moves in a first region, the first information being obtained from a sensor provided in the mobile object, the second information relating to movement of the mobile object; inferring whether the mobile object is movable in the first region according to the second information; and generating fourth information for a learning model, the fourth information associating the first information, the second information, and third information with one another, the third information indicating an inference result which is obtained in the inferring.
-
公开(公告)号:US11223821B2
公开(公告)日:2022-01-11
申请号:US16053102
申请日:2018-08-02
Inventor: Satoshi Yoshikawa , Toshiyasu Sugio , Toru Matsunobu , Tatsuya Koyama
IPC: H04N13/354 , H04N21/218 , H04N21/438 , H04N21/2668 , H04N21/214 , G08B13/196 , H04N21/2187 , H04N21/6587 , H04N7/18 , G06T7/292 , H04N13/117 , H04N13/398
Abstract: A video display method includes: selecting, as a first selected viewpoint, one first viewpoint from among a plurality of first viewpoints corresponding to a plurality of second videos, and displaying a second video corresponding to the first selected viewpoint; determining whether the first selected viewpoint is included in a plurality of second viewpoints corresponding to a plurality of fourth videos captured after the plurality of second videos; and selecting one second viewpoint from among the plurality of second viewpoints as a second selected viewpoint and displaying a fourth video that is included in the plurality of fourth videos and corresponds to the second selected viewpoint, when the first selected viewpoint is determined to not be included in the plurality of second viewpoints.
-
公开(公告)号:US09493239B2
公开(公告)日:2016-11-15
申请号:US14645108
申请日:2015-03-11
Inventor: Tatsuya Koyama , Kaname Tomita , Mitsuhiro Tosa
CPC classification number: B64D11/00151 , B64D11/0015 , B64D2045/007
Abstract: A seat monitor includes a display unit that displays various types of information, a frame provided so as to surround the display unit, and an indicator provided to call a staff. The indicator is disposed on a side portion of the frame.
Abstract translation: 座椅监视器包括显示各种类型的信息的显示单元,围绕显示单元提供的框架,以及用于呼叫工作人员的指示器。 指示器设置在框架的侧部。
-
8.
公开(公告)号:US11210846B2
公开(公告)日:2021-12-28
申请号:US17066935
申请日:2020-10-09
Inventor: Toru Matsunobu , Toshiyasu Sugio , Satoshi Yoshikawa , Tatsuya Koyama , Masaki Fukuda
Abstract: A three-dimensional model processing method includes: generating, from first images shot by respective cameras at a first time, a first three-dimensional model including: first three-dimensional points indicating a subject at the first time; and first camera parameters indicating positions and orientations of the cameras; generating, from second images shot by the respective cameras at a second time, a second three-dimensional model including: second three-dimensional points indicating the subject at the second time; and second camera parameters indicating positions and orientations of the cameras; detecting a stationary camera among the cameras, whose position and orientation has not changed between the first and second times, or stationary three-dimensional points among the three-dimensional points, whose positions have not changed between the first and second times; and matching world coordinate systems of the first and second three-dimensional models, based on the first camera parameters of the stationary camera or the stationary three-dimensional points detected.
-
公开(公告)号:US11043008B2
公开(公告)日:2021-06-22
申请号:US16580185
申请日:2019-09-24
Inventor: Tatsuya Koyama , Toshiyasu Sugio , Yoichi Sugino , Toru Matsunobu , Satoshi Yoshikawa
IPC: H04N13/246 , G06T7/80 , G06T7/73 , H04N13/243 , B64C39/02 , B64D47/08 , G05D1/00
Abstract: A calibrator for cameras includes a controlling circuit, a photographing circuit, a calculating circuit, and an instructing circuit. The controlling circuit is configured to control a movable body in a shooting area of the cameras. A marker is provided on the movable body for calibration of the cameras. The photographing circuit is configured to control the cameras to photograph the marker at a first position at a first timing to generate first images. The photographing circuit is configured to control the cameras to photograph the marker at a second position at a second timing to generate second images. The calculating circuit is configured to calculate parameters of the cameras based on the first images and the second images. The instructing circuit is configured to transmit the parameters to the cameras to calibrate the cameras.
-
公开(公告)号:US10789765B2
公开(公告)日:2020-09-29
申请号:US16163010
申请日:2018-10-17
Inventor: Toru Matsunobu , Toshiyasu Sugio , Satoshi Yoshikawa , Tatsuya Koyama , Pongsak Lasang , Jian Gao
Abstract: Provided is a three-dimensional reconstruction method of reconstructing a three-dimensional model from multi-view images. The method includes: selecting two frames from the multi-view images; calculating image information of each of the two frames; selecting a method of calculating corresponding keypoints in the two frames, according to the image information; and calculating the corresponding keypoints using the method of calculating corresponding keypoints selected in the selecting of the method of calculating corresponding keypoints.
-
-
-
-
-
-
-
-
-