公开(公告)号：US09576551B2

公开(公告)日：2017-02-21

申请号：US14918097

申请日：2015-10-20

Applicant: Google Inc.

Inventor： Johnny Lee ,  Eric Teller ,  William Graham Patrick ,  Eric Peeters

IPC: G06F3/03 ,  G06F3/048 ,  G09G5/00 ,  G06F3/0354 ,  G06F3/0488 ,  G06K9/00 ,  G06F3/042 ,  H04M1/2755

CPC classification number: G06F3/017 ,  G06F3/0354 ,  G06F3/0425 ,  G06F3/0483 ,  G06F3/0487 ,  G06F3/04883 ,  G06K9/00335 ,  G06K9/78 ,  G09G5/006 ,  G09G2300/026 ,  G09G2354/00 ,  H04M1/2755

Abstract: A method and apparatus for gesture interaction with an image displayed on a painted wall is described. The method may include capturing image data of the image displayed on the painted wall and a user motion performed relative to the image. The method may also include analyzing the captured image data to determine a sequence of one or more physical movements of the user relative to the image displayed on the painted wall. The method may also include determining, based on the analysis, that the user motion is indicative of a gesture associated with the image displayed on the painted wall, and controlling a connected system in response to the gesture.

Abstract translation: 描述了用于与显示在涂漆墙壁上的图像进行姿态交互的方法和装置。 该方法可以包括捕获在涂漆壁上显示的图像的图像数据和相对于图像执行的用户运动。 该方法还可以包括分析所捕获的图像数据，以确定用户相对于在涂漆壁上显示的图像的一个或多个物理移动的顺序。 该方法还可以包括基于分析确定用户运动指示与显示在涂漆墙上的图像相关联的手势，以及响应于手势来控制连接的系统。

公开(公告)号：US09445015B2

公开(公告)日：2016-09-13

申请号：US14185477

申请日：2014-02-20

Applicant: Google Inc.

Inventor： Joel Hesch ,  Ryan Hickman ,  Johnny Lee

IPC: H04N5/262 ,  H04N5/232 ,  H04N5/225 ,  G06T15/20 ,  H04W4/02

CPC classification number: H04N5/2628 ,  G06T15/205 ,  H04N5/2258 ,  H04N5/23229 ,  H04N5/23293 ,  H04N5/2621 ,  H04N2209/047 ,  H04W4/026 ,  H04W4/027

Abstract: Example methods and systems for adjusting sensor viewpoint to a virtual viewpoint are provided. An example method may involve receiving data from a first camera; receiving data from a second camera; transforming, from the first viewpoint to a virtual viewpoint within the device, frames in a first plurality of frames based on an offset from the first camera to the virtual viewpoint; determining, in a second plurality of frames, one or more features and a movement, relative to the second viewpoint, of the one or more features; and transforming, from the second viewpoint to the virtual viewpoint, the movement of the one or more features based on an offset from the second camera to the virtual viewpoint; adjusting the transformed frames of the virtual viewpoint by an amount that is proportional to the transformed movement; and providing for display the adjusted and transformed frames of the first plurality of frames.

Abstract translation: 提供了将传感器视点调整到虚拟视点的示例性方法和系统。 示例性方法可以涉及从第一相机接收数据; 从第二相机接收数据; 基于从第一摄像机到虚拟视点的偏移，从设备内的第一视点到虚拟视点转换第一多个帧中的帧; 在第二多个帧中确定所述一个或多个特征的一个或多个特征和相对于所述第二视点的运动; 并且从第二观点向虚拟视点将基于从第二照相机的偏移到所述虚拟视点的所述一个或多个特征的移动; 将所述虚拟视点的变换帧调整与所述变换的运动成比例的量; 以及提供用于显示所述第一多个帧的已调整和变换的帧。

公开(公告)号：US09277361B2

公开(公告)日：2016-03-01

申请号：US14184929

申请日：2014-02-20

Applicant: Google Inc.

Inventor： James Fung ,  Joel Hesch ,  Johnny Lee

IPC: H04W4/02 ,  G06T7/20

CPC classification number: H04W4/026 ,  G06T7/246 ,  G06T2207/10004 ,  G06T2207/10012 ,  G06T2207/10028 ,  G06T2207/30241

Abstract: Methods and systems for cross-validating sensor data are described. An example method involves receiving image data and first timing information associated with the image data, and receiving sensor data and second timing information associated with the sensor data. The method further involves determining a first estimation of motion of the mobile device based on the image data and the first timing information, and determining a second estimation of the motion of the mobile device based on the sensor data and the second timing information. Additionally, the method involves determining whether the first estimation is within a threshold variance of the second estimation. The method then involves providing an output indicative of a validity of the first timing information and the second timing information based on whether the first estimation is within the threshold variance of the second estimation.

Abstract translation: 描述用于交叉验证传感器数据的方法和系统。 示例性方法包括接收与图像数据相关联的图像数据和第一定时信息，以及接收与传感器数据相关联的传感器数据和第二定时信息。 该方法还包括基于图像数据和第一定时信息确定移动设备的运动的第一估计，以及基于传感器数据和第二定时信息确定移动设备的运动的第二估计。 另外，该方法包括确定第一估计是否在第二估计的阈值方差内。 该方法然后包括基于第一估计是否在第二估计的阈值方差内提供指示第一定时信息和第二定时信息的有效性的输出。

公开(公告)号：US20150194123A1

公开(公告)日：2015-07-09

申请号：US13732654

申请日：2013-01-02

Applicant: Google Inc.

Inventor： Johnny Lee ,  Eric Teller

IPC: G09G5/00

CPC classification number: G09G3/22 ,  G02B3/0037 ,  G02B3/0043 ,  G02B3/0056 ,  G02B6/06 ,  G02B27/022 ,  G02B27/027 ,  G02B27/1066 ,  G06F3/1446 ,  G09F13/04 ,  G09G5/00 ,  G09G2356/00 ,  H05K13/00

Abstract: A display panel to form a multi-panel display includes a rectangular pixel region with pixels for displaying images and an electronic housing including display logic. The electronic housing includes first, second, third, and fourth interconnects coupled to facilitate power and image signals to other electronic housings of other display panels. The first, second, third, and fourth interconnects are coupled to be interconnected on a same side of the rectangular pixel region as the first, second, third, and fourth edges of the rectangular pixel region, respectively. The third edge is mechanically coupled to overhang the third interconnect by a first offset distance and the fourth edge is mechanically coupled to overhang the fourth interconnect by a second offset distance. The first interconnect extends beyond the first edge by the first offset distance and the second interconnect extends beyond the second edge by the second offset distance.

Abstract translation: 用于形成多面板显示器的显示面板包括具有用于显示图像的像素的矩形像素区域和包括显示逻辑的电子外壳。 电子外壳包括第一，第二，第三和第四互连，其耦合以促进对其它显示面板的其它电子外壳的功率和图像信号。 第一，第二，第三和第四互连分别连接在矩形像素区域的与矩形像素区域的第一，第二，第三和第四边缘相同的一侧。 第三边缘被机械耦合以使第三互连突出第一偏移距离，并且第四边缘机械耦合到第四互连突出第二偏移距离。 第一互连延伸超过第一边缘第一偏移距离，并且第二互连延伸超出第二边缘第二偏移距离。

公开(公告)号：US20150193982A1

公开(公告)日：2015-07-09

申请号：US14588515

申请日：2015-01-02

Applicant: Google Inc.

Inventor： Patrick Mihelich ,  Johnny Lee

IPC: G06T19/00 ,  H04L29/06

CPC classification number: G06T19/006 ,  G06T2210/04 ,  H04L67/18 ,  H04L67/38 ,  H04W4/023 ,  H04W4/026 ,  H04W4/029 ,  H04W4/33

Abstract: A system includes a first electronic device and a second electronic device. The first electronic device is to display a first augmented reality overlay on imagery of a local environment captured by the first electronic device, the first augmented reality overlay including a depiction of a virtual object from a first perspective that is based on a position and orientation of the first electronic device using a three-dimensional mapping of the local environment. The second electronic device is to display a second augmented reality overlay on imagery of the local environment captured by the second electronic device, the second augmented reality overlay including a depiction of the virtual object from a perspective based on a position and orientation of the second electronic device using the three-dimensional mapping.

Abstract translation: 系统包括第一电子设备和第二电子设备。 第一电子设备是在由第一电子设备捕获的本地环境的图像上显示第一增强现实覆盖物，第一增强现实覆盖物包括基于第一透视图的位置和取向的虚拟对象的描绘 第一个电子设备使用本地环境的三维映射。 第二电子设备是在由第二电子设备捕获的本地环境的图像上显示第二增强现实覆盖物，第二增强现实覆盖层包括基于第二电子设备的位置和取向的透视图来描绘虚拟对象 设备使用三维映射。

公开(公告)号：US09014417B1

公开(公告)日：2015-04-21

申请号：US13657348

申请日：2012-10-22

Applicant: Google Inc.

Inventor： Johnny Lee ,  Eric Teller ,  William Graham Patrick ,  Eric Peeters

IPC: G06K9/00

CPC classification number: G06K9/00496 ,  A63J1/02 ,  A63J5/021 ,  G03B17/54 ,  G03B21/60

Abstract: A method and apparatus for enabling themes using photo-active surface paint is described. The method may include capturing image data with at least a camera of a painted surface display system. The method may also include analyzing the image data to determine a real-world context proximate to a painted surface, wherein the surface is painted with a photo-active paint. The method may also include selecting a theme based on the determined real-world context. The method may also include generating a theme image, and driving a spatial electromagnetic modulator to emit electromagnetic stimulation in the form of the theme image to cause the photo active paint to display the theme image.

Abstract translation: 描述了使用光活性表面涂料实现主题的方法和装置。 该方法可以包括用至少画面显示系统的照相机拍摄图像数据。 该方法还可以包括分析图像数据以确定接近于涂漆表面的真实世界背景，其中该表面涂上光活性涂料。 该方法还可以包括基于确定的真实世界环境来选择主题。 该方法还可以包括产生主题图像，以及驱动空间电磁调制器以主题图像的形式发射电磁刺激，以使照片活动涂料显示主题图像。

公开(公告)号：US08836222B1

公开(公告)日：2014-09-16

申请号：US13673821

申请日：2012-11-09

Applicant: Google Inc.

Inventor： William Graham Patrick ,  Eric Teller ,  Johnny Lee

IPC: H05B37/02

CPC classification number: H05B37/0227

Abstract: Methods, apparatuses and systems for adaptive light projection are described herein. According to embodiments of the disclosure, optical data of a physical space around a user is received. Light from a light source is then projected onto a projection area that is determined based, at least in part, on the received optical data.User commands may include requests to locate and/or track objects within the physical space around the user. User commands may comprise a combination of the audible user command and a physical user gesture—e.g., a gesture identifying an object or a surface to receive the projected light.

Abstract translation: 本文描述了用于自适应光投射的方法，装置和系统。 根据本公开的实施例，接收用户周围的物理空间的光学数据。 然后将来自光源的光投影到至少部分基于所接收的光学数据确定的投影区域上。 用户命令可以包括在用户周围的物理空间内定位和/或跟踪对象的请求。 用户命令可以包括可听用户命令和物理用户手势的组合，例如，识别用于接收投影光的对象或表面的手势。

公开(公告)号：US20130279012A1

公开(公告)日：2013-10-24

申请号：US13754732

申请日：2013-01-30

Applicant: GOOGLE INC.

Inventor： Johnny Lee ,  Eric Teller

IPC: G02B3/00

CPC classification number: G09G3/22 ,  G02B3/0037 ,  G02B3/0043 ,  G02B3/0056 ,  G02B6/06 ,  G02B27/022 ,  G02B27/027 ,  G02B27/1066 ,  G06F3/1446 ,  G09F13/04 ,  G09G5/00 ,  G09G2356/00 ,  H05K13/00

Abstract: A display panel for use with a multi-panel display. The display panel includes a display panel including an array of display pixels disposed surrounded by a bezel, the array of display pixels for emitting a display image having a first size, and an optical expansion layer disposed over the array of display pixels to magnify the display image to appear to have a second size larger than the first size and to at least partially conceal the bezel surrounding the housing. The optical expansion layer includes a first array of microlenses optically coupled to the array of display pixels to cause light from the display pixels to diverge, a second array of microlenses having complementary optical power to the first array of microlenses; and an optically transparent offset layer disposed between the first and second arrays of microlenses. Other embodiments are disclosed and claimed.

Abstract translation: 用于多面板显示器的显示面板。 显示面板包括显示面板，包括由边框设置的显示像素阵列，用于发射具有第一尺寸的显示图像的显示像素阵列和布置在显示像素阵列上的光学膨胀层，以放大显示器 图像看起来具有比第一尺寸大的第二尺寸，并且至少部分地隐藏围绕壳体的边框。 光学扩展层包括：第一阵列的微透镜，光学耦合到显示像素阵列，以使来自显示像素的光发散;第二阵列的微透镜，具有与第一阵列的微透镜互补的光焦度; 以及设置在所述第一和第二微透镜阵列之间的光学透明偏移层。 公开和要求保护其他实施例。

公开(公告)号：US20190033988A1

公开(公告)日：2019-01-31

申请号：US15660216

申请日：2017-07-26

Applicant: Google Inc.

Inventor： Joel Hesch ,  Shiqi Chen ,  Johnny Lee ,  Rahul Garg

IPC: G06F3/0346 ,  G06T7/73 ,  G06F3/0354 ,  G06F3/01

Abstract: A method for controller tracking with multiple degrees of freedom includes generating depth data at an electronic device based on a local environment proximate the electronic device. A set of positional data is generated for at least one spatial feature associated with a controller based on a pose of the electronic device, as determined using the depth data, relative to the at least one spatial feature associated with the controller. A set of rotational data is received that represents three degrees-of-freedom (3DoF) orientation of the controller within the local environment, and a six degrees-of-freedom (6DoF) position of the controller within the local environment is tracked based on the set of positional data and the set of rotational data.

公开(公告)号：US09485366B2

公开(公告)日：2016-11-01

申请号：US15066105

申请日：2016-03-10

Applicant: Google Inc.

Inventor： James Fung ,  Joel Hesch ,  Johnny Lee

IPC: H04N1/00 ,  H04N5/225 ,  H04N5/232 ,  H04N5/77

CPC classification number: H04N1/00204 ,  H04N1/2133 ,  H04N1/215 ,  H04N1/32128 ,  H04N5/2257 ,  H04N5/232 ,  H04N5/23229 ,  H04N5/772 ,  H04N2201/0084 ,  H04N2201/3247 ,  H04N2201/3252

Abstract: Methods and systems for communicating sensor data on a mobile device are described. An example method involves receiving, by a processor and from an inertial measurement unit (IMU), sensor data corresponding to a first timeframe, and storing the sensor data using a data buffer. The processor may also receive image data and sensor data corresponding to a second timeframe. The processor may then generate a digital image that includes at least the image data corresponding to the second timeframe and the sensor data corresponding to the first timeframe and the second timeframe. The processor may embed the stored sensor data corresponding to the first timeframe and the second timeframe in pixels of the digital image. And the processor may provide the digital image to an application processor of the mobile device.

Abstract translation: 描述了用于在移动设备上传送传感器数据的方法和系统。 一种示例性方法包括由处理器和惯性测量单元（IMU）接收对应于第一时间帧的传感器数据，以及使用数据缓冲器存储传感器数据。 处理器还可以接收对应于第二时间帧的图像数据和传感器数据。 然后，处理器可以生成至少包括对应于第二时间帧的图像数据和对应于第一时间帧和第二时间帧的传感器数据的数字图像。 处理器可以将对应于第一时间帧和第二时间帧的存储的传感器数据嵌入数字图像的像素中。 并且处理器可以将数字图像提供给移动设备的应用处理器。