公开(公告)号：US20190104255A1

公开(公告)日：2019-04-04

申请号：US15724241

申请日：2017-10-03

Applicant: Google LLC

Inventor： Fuhao Shi ,  Chia-Kai Liang ,  Xue Tu

IPC: H04N5/232

CPC classification number: H04N5/23287 ,  G06T5/003 ,  G06T5/50 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/20201 ,  H04N5/23254 ,  H04N5/23258 ,  H04N5/23267

Abstract: Methods, systems, and apparatus, including computer programs stored on a computer-readable storage medium, for video stabilization. In some implementations, a computer system obtains frames of a video captured by a recording device using an optical image stabilization (OIS) system. The computing system receives (i) OIS position data indicating positions of the OIS system during capture of the frames, and (ii) device position data indicating positions of the recording device during capture of the frames. The computing system determines a first transformation for a particular frame based on the OIS position data for the particular frame and device position data for the particular frame. The computing system determines a second transformation for the particular frame based on the first transformation and positions of the recording device occurring after capture of the particular frame. The computing system generates a stabilized version of the particular frame using the second transformation.

公开(公告)号：US20200007770A1

公开(公告)日：2020-01-02

申请号：US16568931

申请日：2019-09-12

Applicant: Google LLC

Inventor： Fuhao Shi ,  Chia-Kai Liang ,  Xue Tu

IPC: H04N5/232

Abstract: Methods, systems, and apparatus, including computer programs stored on a computer-readable storage medium, for video stabilization. In some implementations, a computer system obtains frames of a video captured by a recording device using an optical image stabilization (OIS) system. The computing system receives (i) OIS position data indicating positions of the OIS system during capture of the frames, and (ii) device position data indicating positions of the recording device during capture of the frames. The computing system determines a first transformation for a particular frame based on the OIS position data for the particular frame and device position data for the particular frame. The computing system determines a second transformation for the particular frame based on the first transformation and positions of the recording device occurring after capture of the particular frame. The computing system generates a stabilized version of the particular frame using the second transformation.

公开(公告)号：US11683586B2

公开(公告)日：2023-06-20

申请号：US17336194

申请日：2021-06-01

Applicant: Google LLC

Inventor： Fuhao Shi ,  Chia-Kai Liang ,  Xue Tu

IPC: H04N5/232 ,  G06T5/00 ,  G06T5/50 ,  G06T7/246 ,  H04N23/68

CPC classification number: H04N23/687 ,  G06T5/003 ,  G06T5/50 ,  G06T7/246 ,  H04N23/683 ,  H04N23/6811 ,  H04N23/6812 ,  G06T2207/10016 ,  G06T2207/20201

Abstract: Methods, systems, and apparatus, including computer programs stored on a computer-readable storage medium, for video stabilization. In some implementations, a computer system obtains frames of a video captured by a recording device using an optical image stabilization (OIS) system. The computing system receives (i) OIS position data indicating positions of the OIS system during capture of the frames, and (ii) device position data indicating positions of the recording device during capture of the frames. The computing system determines a first transformation for a particular frame based on the OIS position data for the particular frame and device position data for the particular frame. The computing system determines a second transformation for the particular frame based on the first transformation and positions of the recording device occurring after capture of the particular frame. The computing system generates a stabilized version of the particular frame using the second transformation.

公开(公告)号：US11064119B2

公开(公告)日：2021-07-13

申请号：US16568931

申请日：2019-09-12

Applicant: Google LLC

Inventor： Fuhao Shi ,  Chia-Kai Liang ,  Xue Tu

IPC: H04N5/232 ,  G06T5/00 ,  G06T5/50 ,  G06T7/246

Abstract: Methods, systems, and apparatus, including computer programs stored on a computer-readable storage medium, for video stabilization. In some implementations, a computer system obtains frames of a video captured by a recording device using an optical image stabilization (OIS) system. The computing system receives (i) OIS position data indicating positions of the OIS system during capture of the frames, and (ii) device position data indicating positions of the recording device during capture of the frames. The computing system determines a first transformation for a particular frame based on the OIS position data for the particular frame and device position data for the particular frame. The computing system determines a second transformation for the particular frame based on the first transformation and positions of the recording device occurring after capture of the particular frame. The computing system generates a stabilized version of the particular frame using the second transformation.

公开(公告)号：US12167134B2

公开(公告)日：2024-12-10

申请号：US18210812

申请日：2023-06-16

Applicant: Google LLC

Inventor： Fuhao Shi ,  Chia-Kai Liang ,  Xue Tu

IPC: H04N23/68 ,  G06T5/50 ,  G06T5/73 ,  G06T7/246

Abstract: Methods, systems, and apparatus, including computer programs stored on a computer-readable storage medium, for video stabilization. In some implementations, a computer system obtains frames of a video captured by a recording device using an optical image stabilization (OIS) system. The computing system receives (i) OIS position data indicating positions of the OIS system during capture of the frames, and (ii) device position data indicating positions of the recording device during capture of the frames. The computing system determines a first transformation for a particular frame based on the OIS position data for the particular frame and device position data for the particular frame. The computing system determines a second transformation for the particular frame based on the first transformation and positions of the recording device occurring after capture of the particular frame. The computing system generates a stabilized version of the particular frame using the second transformation.

公开(公告)号：US20230336873A1

公开(公告)日：2023-10-19

申请号：US18210812

申请日：2023-06-16

Applicant: Google LLC

Inventor： Fuhao Shi ,  Chia-Kai Liang ,  Xue Tu

IPC: H04N5/228 ,  G06T5/50 ,  G06T5/00 ,  G06T7/246

CPC classification number: H04N23/687 ,  H04N23/6812 ,  H04N23/683 ,  G06T5/50 ,  G06T5/003 ,  H04N23/6811 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/20201

Abstract: Methods, systems, and apparatus, including computer programs stored on a computer-readable storage medium, for video stabilization. In some implementations, a computer system obtains frames of a video captured by a recording device using an optical image stabilization (OIS) system. The computing system receives (i) OIS position data indicating positions of the OIS system during capture of the frames, and (ii) device position data indicating positions of the recording device during capture of the frames. The computing system determines a first transformation for a particular frame based on the OIS position data for the particular frame and device position data for the particular frame. The computing system determines a second transformation for the particular frame based on the first transformation and positions of the recording device occurring after capture of the particular frame. The computing system generates a stabilized version of the particular frame using the second transformation.

公开(公告)号：US20210289139A1

公开(公告)日：2021-09-16

申请号：US17336194

申请日：2021-06-01

Applicant: Google LLC

Inventor： Fuhao Shi ,  Chia-Kai Liang ,  Xue Tu

IPC: H04N5/232 ,  G06T5/00 ,  G06T5/50 ,  G06T7/246

Abstract: Methods, systems, and apparatus, including computer programs stored on a computer-readable storage medium, for video stabilization. In some implementations, a computer system obtains frames of a video captured by a recording device using an optical image stabilization (OIS) system. The computing system receives (i) OIS position data indicating positions of the OIS system during capture of the frames, and (ii) device position data indicating positions of the recording device during capture of the frames. The computing system determines a first transformation for a particular frame based on the OIS position data for the particular frame and device position data for the particular frame. The computing system determines a second transformation for the particular frame based on the first transformation and positions of the recording device occurring after capture of the particular frame. The computing system generates a stabilized version of the particular frame using the second transformation.

公开(公告)号：US10462370B2

公开(公告)日：2019-10-29

申请号：US15724241

申请日：2017-10-03

Applicant: Google LLC

Inventor： Fuhao Shi ,  Chia-Kai Liang ,  Xue Tu

IPC: H04N5/228 ,  H04N5/232 ,  G06T5/00 ,  G06T5/50 ,  G06T7/246

Abstract: Methods, systems, and apparatus, including computer programs stored on a computer-readable storage medium, for video stabilization. In some implementations, a computer system obtains frames of a video captured by a recording device using an optical image stabilization (OIS) system. The computing system receives (i) OIS position data indicating positions of the OIS system during capture of the frames, and (ii) device position data indicating positions of the recording device during capture of the frames. The computing system determines a first transformation for a particular frame based on the OIS position data for the particular frame and device position data for the particular frame. The computing system determines a second transformation for the particular frame based on the first transformation and positions of the recording device occurring after capture of the particular frame. The computing system generates a stabilized version of the particular frame using the second transformation.

公开(公告)号：US10200613B2

公开(公告)日：2019-02-05

申请号：US15848289

申请日：2017-12-20

Applicant: Google LLC

Inventor： Chia-Kai Liang ,  Xue Tu ,  Lun-Cheng Chu ,  Jianing Wei

IPC: H04N5/228 ,  H04N5/232 ,  G06T7/20

Abstract: The disclosed technology includes techniques for providing improved video stabilization on a mobile device. Using gyroscope data of the mobile device, the physical camera orientation of the mobile device may be estimated over time. Using the physical camera orientation and historical data, corresponding virtual camera orientations representing a camera orientation with undesired rotational movement removed may be modeled using a non-linear filter to provide for mapping of a real image to a stabilized virtual image. The virtual camera orientation may be modified to prevent undefined pixels from appearing in the output image.

公开(公告)号：US20180115714A1

公开(公告)日：2018-04-26

申请号：US15848289

申请日：2017-12-20

Applicant: Google LLC

Inventor： Chia-Kai Liang ,  Xue Tu ,  Lun-Cheng Chu ,  Jianing Wei

IPC: H04N5/232

CPC classification number: H04N5/23267 ,  G06T7/20 ,  H04N5/23248 ,  H04N5/23258 ,  H04N5/23261 ,  H04N5/23264 ,  H04N5/2329

Abstract: The disclosed technology includes techniques for providing improved video stabilization on a mobile device. Using gyroscope data of the mobile device, the physical camera orientation of the mobile device may be estimated over time. Using the physical camera orientation and historical data, corresponding virtual camera orientations representing a camera orientation with undesired rotational movement removed may be modeled using a non-linear filter to provide for mapping of a real image to a stabilized virtual image. The virtual camera orientation may be modified to prevent undefined pixels from appearing in the output image.