公开(公告)号：US10298834B2

公开(公告)日：2019-05-21

申请号：US15207110

申请日：2016-07-11

Applicant: GOOGLE LLC

Inventor： Colvin Pitts ,  Yi-Ren Ng

IPC: G06T5/50 ,  G06T5/00 ,  H01L27/146 ,  G02B27/00 ,  H04N5/232 ,  H04N13/207 ,  G06T5/20

Abstract: A video refocusing system operates in connection with refocusable video data, information, images and/or frames, which may be light field video data, information, images and/or frames, that may be focused and/or refocused after acquisition or recording. A video acquisition device acquires first refocusable light field video data of a scene, stores first refocusable video data representative of the first refocusable light field video data, acquires second refocusable light field video data of the scene after acquiring the first refocusable light field video data, determines a first virtual focus parameter (such as a virtual focus depth) using the second refocusable light field video data, generates first video data using the stored first refocusable video data and the first virtual focus parameter, wherein the first video data includes a focus depth that is different from an optical focus depth of the first refocusable light field video data, and outputs the first video data.

公开(公告)号：US10154197B2

公开(公告)日：2018-12-11

申请号：US15203643

申请日：2016-07-06

Applicant: Google LLC

Inventor： Jerome Chandra Bhat ,  Brandon Elliott Merle Clarke ,  Graham Butler Myhre ,  Ravi Kiran Nalla ,  Steven David Oliver ,  Tony Yip Pang Poon ,  William D. Houck, II ,  Colvin Pitts ,  Yi-Ren Ng ,  Kurt Akeley

IPC: H04N7/18 ,  G02B7/02 ,  H04N5/232 ,  H04N5/225 ,  G02F1/1337 ,  H04N13/289 ,  G02B27/00 ,  G02B7/08 ,  G02B3/12 ,  H04N13/232 ,  H04N13/296

Abstract: An image capture device, such as a camera, has multiple modes including a light field image capture mode, a conventional 2D image capture mode, and at least one intermediate image capture mode. By changing position and/or properties of the microlens array (MLA) in front of the image sensor, changes in 2D spatial resolution and angular resolution can be attained. In at least one embodiment, such changes can be performed in a continuous manner, allowing a continuum of intermediate modes to be attained.

公开(公告)号：US10129524B2

公开(公告)日：2018-11-13

申请号：US15439710

申请日：2017-02-22

Applicant: Google LLC

Inventor： Yi-Ren Ng ,  Eric Cheng ,  Chia-Kai Liang ,  Kayvon Fatahalian ,  David John Evans ,  Kira Wampler ,  Kristen Berman ,  Kurt Barton Akeley

IPC: G06T15/00 ,  H04N13/128 ,  G06F3/01 ,  G06F21/31

Abstract: According to various embodiments of the invention, a system and method are provided for enabling interaction with, manipulation of, and control of depth-assigned content in depth-enhanced pictures, such as virtual reality images. Depth-assigned content can be assigned to a specified depth value. When a depth-enhanced picture is refocused at a focus depth substantially different from the specified assigned depth value, the depth-assigned content may be omitted, grayed out, blurred, or otherwise visually distinguished. In this manner, content associated with an in-focus image element can be visually distinguished from content associated with an out-of-focus image element. For example, in at least one embodiment, depth-assigned content is visible only when an image element associated with the content is in focus (or nearly in focus). According to various embodiments of the invention, many different types of interactions are facilitated among depth-assigned content, depth-enhanced virtual reality images, and other content.