Multiple view triangulation with improved robustness to observation errors

    公开(公告)号:US11651516B2

    公开(公告)日:2023-05-16

    申请号:US17153273

    申请日:2021-01-20

    申请人: SONY CORPORATION

    发明人: Sangxia Huang

    摘要: Triangulation is applied, by a method and a device, to determine a scene point location in a global coordinate system, GCS, based on location coordinates for observed image points in plural views of a scene, and global-local transformation matrices for the views. The local coordinates are given in local coordinate systems, LCSs, arranged to define distance coordinate axes that are perpendicular to image planes of the views. The scene point location is determined by minimizing a plurality of differences between first and second estimates of the scene point location in the LCSs, the first estimates being given by linear scaling of the location coordinates, and the second estimate being given by operating the transformation matrices on the scene point location. An improved robustness to observation errors is achieved by defining the plurality of differences to penalize differences that includes the linear scaling as applied along the distance coordinate axes.

    Extrinsic calibration of multi-camera system

    公开(公告)号:US11475595B2

    公开(公告)日:2022-10-18

    申请号:US16846521

    申请日:2020-04-13

    申请人: SONY CORPORATION

    IPC分类号: H04N5/247 G06T7/80

    摘要: A method for extrinsic calibration of cameras in a monitoring system, performed by a calibration device, includes obtaining preliminary calibration data of the cameras, obtaining a preliminary pose for an object observed by the cameras, and determining calibration data that results in an optimization of an objective function using the preliminary calibration data and the preliminary pose as starting values for the optimization. The method further includes defining the objective function with calibration data and pose as unknown variables and including a first function yielding aggregated reprojection error, and a second function yielding pose quality based on relative orientation and relative distance between 3D points of the pose. The second function enables improved accuracy of the calibration data and may be configured to yield pose quality for individual poses or motion quality for a time sequence of poses.

    Multi-view three-dimensional positioning

    公开(公告)号:US11501462B2

    公开(公告)日:2022-11-15

    申请号:US17089626

    申请日:2020-11-04

    申请人: SONY CORPORATION

    发明人: Sangxia Huang

    摘要: A device determines positions of objects in a scene. The device obtains object detection data (ODD) which identifies the objects and locations of reference points of the objects in 2D images of the scene. The device processes the ODD to generate candidate association data (CAD) which associates pairs of objects between the images, computes estimated 3D positions in the scene for associated pairs of objects in the CAD, and performs clustering of the estimated positions. The device further generates, based on estimated 3D positions in one or more clusters, final association data (FAD) which associates one or more objects between the images, and computes one or more final 3D positions in the scene for one or more reference points of the one or more objects in the FAD. The final 3D position(s) represent the 3D position or the 3D pose of the respective object in the scene.

    MULTI-VIEW POSITIONING USING REFLECTIONS

    公开(公告)号:US20210304435A1

    公开(公告)日:2021-09-30

    申请号:US17193024

    申请日:2021-03-05

    申请人: SONY CORPORATION

    摘要: A device determines the positioning of objects in a scene by implementing a robust and deterministic method. The device obtains object detection data (ODD) which identifies the objects and locations of reference points of the objects in views of the scene. The obtained ODD is processed to identify a first image object of a first view as a mirror reflection of a real object. A virtual view associated with a virtual camera position is created, including the ODD associated with the first image object of the first view. The ODD associated with the first image object is removed from the first view. Based on the ODD associated with at least said virtual view and a further view of the one or more views, a position of said first image object is computed.

    Method and control arrangement for controlling a response time of a wireless sensor device

    公开(公告)号:US11115923B2

    公开(公告)日:2021-09-07

    申请号:US16539431

    申请日:2019-08-13

    申请人: SONY CORPORATION

    发明人: Sangxia Huang

    摘要: An object monitoring system includes a plurality of wireless sensor devices and at least one user device A method for controlling a response time of one of the wireless sensor devices in such a system includes determining one or more metrics representing a present state of an object; and calculating a probability that one of at least one user devices will interact with the wireless sensor device within a pre-determined time period by executing a trained model with the one or more determined metrics as input and controlling the response time of the wireless sensor device based on the calculated probability.

    METHOD AND APPARATUS FOR SEARCHING AND RELAYING DISCOVERY OF DEVICES

    公开(公告)号:US20210029528A1

    公开(公告)日:2021-01-28

    申请号:US17045349

    申请日:2019-01-25

    申请人: SONY CORPORATION

    摘要: An observer device (12) listens for advertising messages from broadcast devices (14) in an environment, transmits scan request messages to broadcast devices, and subsequently receives scan response messages. The observer device (12) can connect to a broadcast device (14) and configure the broadcast device (14) to a scanning mode. The broadcast device (14) selected for scanning listens for advertising messages from other broadcast devices (14). The broadcast device (14) relays information related to these other broadcast devices (14) back to the observer device (12).

    Rescue support in large-scale emergency situations

    公开(公告)号:US11749074B2

    公开(公告)日:2023-09-05

    申请号:US17087995

    申请日:2020-11-03

    申请人: SONY CORPORATION

    摘要: A method for rescue support involves distributing transponder devices to individuals in a geographic region and causing the transponder devices to be activated. If a large-scale emergency situation occurs, a fleet of unmanned aerial vehicles are operated within the geographic region to receive distress signals transmitted by the activated transponder devices. A computer system processes the distress signals to obtain detection data for the individuals, the detection data comprising a location of the respective transponder device and a health status of the respective individual. The computer system generates, based on the location and health status of the respective individual, a prioritization chart for the geographic region, the prioritization chart being indicative of one or more sub-regions to be prioritized for a rescue operation.

    Multi-view positioning using reflections

    公开(公告)号:US11645777B2

    公开(公告)日:2023-05-09

    申请号:US17193024

    申请日:2021-03-05

    申请人: SONY CORPORATION

    摘要: A device determines the positioning of objects in a scene by implementing a robust and deterministic method. The device obtains object detection data (ODD) which identifies the objects and locations of reference points of the objects in views of the scene. The obtained ODD is processed to identify a first image object of a first view as a mirror reflection of a real object. A virtual view associated with a virtual camera position is created, including the ODD associated with the first image object of the first view. The ODD associated with the first image object is removed from the first view. Based on the ODD associated with at least said virtual view and a further view of the one or more views, a position of said first image object is computed.