公开(公告)号：US20170270637A1

公开(公告)日：2017-09-21

申请号：US15073199

申请日：2016-03-17

Applicant: Google Inc.

Inventor： John D. Perreault ,  Johnny Lee ,  Jerry Carollo

IPC: G06T3/40 ,  G02B27/30 ,  G02B26/10 ,  H04N5/232 ,  G02B27/01

CPC classification number: G06T3/4053 ,  G02B26/0808 ,  G02B26/106 ,  G02B27/0172 ,  G02B27/30 ,  G02B2027/0127 ,  G02B2027/0132 ,  G02B2027/0147 ,  H04N5/23232

Abstract: A near-eye display system includes a display panel, a beam steering assembly facing the display panel, a display controller, and a beam steering controller. The beam steering assembly imparts one of a plurality of net deflection angles to incident light. The display controller drives the display panel to display a sequence of images, and the beam steering controller controls the beam steering assembly to impart a different net deflection angle for each displayed image of the sequence. The sequence of images, when displayed within the visual perception interval, may be perceived as a single image having a resolution greater than the resolution of the display panel or having larger apparent pixel sizes that conceal the black space between pixels of the display, or the sequence of images may represent a lightfield with the angular information represented in the net deflection angles imparted into the images as they are projected.

公开(公告)号：US20160098969A1

公开(公告)日：2016-04-07

申请号：US14918097

申请日：2015-10-20

Applicant: Google Inc.

Inventor： Johnny Lee ,  Eric Teller ,  William Graham Patrick ,  Eric Peeters

IPC: G09G5/00 ,  G06K9/00 ,  G06F3/0488

CPC classification number: G06F3/017 ,  G06F3/0354 ,  G06F3/0425 ,  G06F3/0483 ,  G06F3/0487 ,  G06F3/04883 ,  G06K9/00335 ,  G06K9/78 ,  G09G5/006 ,  G09G2300/026 ,  G09G2354/00 ,  H04M1/2755

Abstract: A method and apparatus for gesture interaction with an image displayed on a painted wall is described. The method may include capturing image data of the image displayed on the painted wall and a user motion performed relative to the image. The method may also include analyzing the captured image data to determine a sequence of one or more physical movements of the user relative to the image displayed on the painted wall. The method may also include determining, based on the analysis, that the user motion is indicative of a gesture associated with the image displayed on the painted wall, and controlling a connected system in response to the gesture.

Abstract translation: 描述了用于与显示在涂漆墙壁上的图像进行姿态交互的方法和装置。 该方法可以包括捕获在涂漆壁上显示的图像的图像数据和相对于图像执行的用户运动。 该方法还可以包括分析所捕获的图像数据，以确定用户相对于在涂漆壁上显示的图像的一个或多个物理移动的顺序。 该方法还可以包括基于分析确定用户运动指示与显示在涂漆墙上的图像相关联的手势，以及响应于手势来控制连接的系统。

公开(公告)号：US09195320B1

公开(公告)日：2015-11-24

申请号：US13657372

申请日：2012-10-22

Applicant: Google Inc.

Inventor： Johnny Lee ,  Eric Teller ,  William Graham Patrick ,  Eric Peeters

IPC: G06F3/03 ,  H04M1/2755

CPC classification number: G06F3/017 ,  G06F3/0304 ,  H04M1/2755

Abstract: A method and apparatus for generating dynamic signage using a painted surface display system is described. The method may include capturing image data with at least a camera of a painted surface display system. The method may also include analyzing the image data to determine a real-world context proximate to a painted surface, wherein the painted surface is painted with a photo-active paint. The method may also include determining electronic signage data based on the determined real-world context. The method may also include generating a sign image from the determined electronic signage data based on the determined real-world context, and driving a spatial electromagnetic modulator to emit electromagnetic stimulation in the form of the sign image to cause the photo active paint to display the sign image.

Abstract translation: 描述了使用油漆表面显示系统产生动态标牌的方法和装置。 该方法可以包括用至少画面显示系统的照相机拍摄图像数据。 该方法还可以包括分析图像数据以确定靠近涂漆表面的真实世界背景，其中涂漆的表面涂上光活性涂料。 该方法还可以包括基于确定的真实世界上下文来确定电子标牌数据。 该方法还可以包括基于确定的真实世界环境从确定的电子标牌数据生成符号图像，以及驱动空间电磁调制器以标志图像的形式发射电磁刺激，以使照片活动涂料显示 标志图像。

公开(公告)号：US09164596B1

公开(公告)日：2015-10-20

申请号：US13657363

申请日：2012-10-22

Applicant: Google Inc.

Inventor： Johnny Lee ,  Eric Teller ,  William Graham Patrick ,  Eric Peeters

IPC: G06F3/0354 ,  G06F3/0488 ,  H04M1/2755

CPC classification number: G06F3/017 ,  G06F3/0354 ,  G06F3/0425 ,  G06F3/0483 ,  G06F3/0487 ,  G06F3/04883 ,  G06K9/00335 ,  G06K9/78 ,  G09G5/006 ,  G09G2300/026 ,  G09G2354/00 ,  H04M1/2755

Abstract: A method and apparatus for gesture interaction with a photo-active painted surface is described. The method may include driving a spatial electromagnetic modulator to emit electromagnetic stimulation in the form of an image to cause photo-active paint to display the image. The method may also include capturing, with at least a camera of a painted surface display system, image data of the image displayed on the photo-active paint applied to a surface and a user motion performed relative to the image. The method may also include analyzing the captured image data to determine a sequence of one or more physical movements of the user relative to the image displayed on the photo-active paint. The method may also include determining, based on the analysis, that the user motion is indicative of a gesture, and driving the spatial electromagnetic modulator to update.

Abstract translation: 描述了一种用于与光活性涂漆表面进行姿态交互的方法和装置。 该方法可以包括驱动空间电磁调制器以图像的形式发射电磁刺激以引起光活性涂料显示图像。 该方法还可以包括使用涂漆表面显示系统的至少一个照相机拍摄在施加到表面上的光活性涂料上显示的图像的图像数据和相对于图像执行的用户运动。 该方法还可以包括分析所捕获的图像数据以确定用户相对于在光活性涂料上显示的图像的一个或多个物理移动的顺序。 该方法还可以包括基于分析来确定用户运动指示手势，并且驱动空间电磁调制器进行更新。

公开(公告)号：US20150233743A1

公开(公告)日：2015-08-20

申请号：US14185176

申请日：2014-02-20

Applicant: Google Inc.

Inventor： James Fung ,  Joel Hesch ,  Johnny Lee

IPC: G01D21/02

CPC classification number: G01C23/00

Abstract: Methods and systems for acquiring sensor data using multiple acquisition modes are described. An example method involves receiving, by a co-processor and from an application processor, a request for sensor data. The request identifies at least two sensors of a plurality of sensors for which data is requested. The at least two sensors are configured to acquire sensor data in a plurality of acquisition modes, and the request further identifies for the at least two sensors respective acquisition modes for acquiring data that are selected from among the plurality of acquisition modes. In response to receiving the request, the co-processor causes the at least two sensors to acquire data in the respective acquisition modes. The co-processor receives first sensor data from a first sensor and second sensor data from a second sensor, and the co-processor provides the first sensor data and the second sensor data to the application processor.

Abstract translation: 描述使用多种采集模式获取传感器数据的方法和系统。 一种示例性方法涉及由协处理器和应用处理器接收对传感器数据的请求。 该请求识别要求数据的多个传感器中的至少两个传感器。 所述至少两个传感器被配置为以多个获取模式获取传感器数据，并且所述请求还针对所述至少两个传感器识别用于获取从所述多个采集模式中选择的数据的各自的获取模式。 响应于接收到该请求，协处理器使得至少两个传感器以相应的采集模式获取数据。 协处理器从第一传感器接收第一传感器数据并从第二传感器接收第二传感器数据，并且协处理器将第一传感器数据和第二传感器数据提供给应用处理器。

公开(公告)号：US09053648B1

公开(公告)日：2015-06-09

申请号：US13754750

申请日：2013-01-30

Applicant: Google Inc.

Inventor： Johnny Lee ,  Eric Teller

IPC: G09F13/04 ,  G02B27/02 ,  H05K13/00

CPC classification number: G09G3/22 ,  G02B3/0037 ,  G02B3/0043 ,  G02B3/0056 ,  G02B6/06 ,  G02B27/022 ,  G02B27/027 ,  G02B27/1066 ,  G06F3/1446 ,  G09F13/04 ,  G09G5/00 ,  G09G2356/00 ,  H05K13/00

Abstract: A modular display including a monolithic backlight module to generate light and a plurality of display panels disposed over the monolithic backlight module, and tiled such that each display panel abuts another display panel along at least one edge thereof to form a seam. Each display panel includes a light modulation layer disposed adjacent to the monolithic backlight module to modulate the lamp light received from a first side and to output a display image from a second side, and seam-concealing optics disposed over the second side of the light modulation layer. Other embodiments are disclosed and claimed.

Abstract translation: 一种模块化显示器，包括用于产生光的单片背光模块和布置在单片背光模块上的多个显示面板，并且被平铺，使得每个显示面板沿其至少一个边缘邻接另一个显示面板以形成接缝。 每个显示面板包括与单片背光模块相邻设置的光调制层，以调制从第一侧接收的灯光并从第二侧输出显示图像，以及设置在光调制的第二侧上的接缝隐蔽光学 层。 公开和要求保护其他实施例。

公开(公告)号：US09886742B2

公开(公告)日：2018-02-06

申请号：US15073199

申请日：2016-03-17

Applicant: Google Inc.

Inventor： John D. Perreault ,  Johnny Lee ,  Jerry Carollo

IPC: H04N5/222 ,  G06T3/40 ,  H04N5/232 ,  G02B27/01 ,  G02B26/10 ,  G02B27/30

CPC classification number: G06T3/4053 ,  G02B26/0808 ,  G02B26/106 ,  G02B27/0172 ,  G02B27/30 ,  G02B2027/0127 ,  G02B2027/0132 ,  G02B2027/0147 ,  H04N5/23232

Abstract: A near-eye display system includes a display panel, a beam steering assembly facing the display panel, a display controller, and a beam steering controller. The beam steering assembly imparts one of a plurality of net deflection angles to incident light. The display controller drives the display panel to display a sequence of images, and the beam steering controller controls the beam steering assembly to impart a different net deflection angle for each displayed image of the sequence. The sequence of images, when displayed within the visual perception interval, may be perceived as a single image having a resolution greater than the resolution of the display panel or having larger apparent pixel sizes that conceal the black space between pixels of the display, or the sequence of images may represent a lightfield with the angular information represented in the net deflection angles imparted into the images as they are projected.

公开(公告)号：US20170206830A1

公开(公告)日：2017-07-20

申请号：US13657667

申请日：2012-10-22

Applicant: Google Inc.

Inventor： Johnny Lee ,  Eric Teller ,  William G. Patrick ,  Eric Peeters

IPC: G09G3/22

CPC classification number: G09G3/22 ,  G02B3/0037 ,  G02B3/0043 ,  G02B3/0056 ,  G02B6/06 ,  G02B27/022 ,  G02B27/027 ,  G02B27/1066 ,  G06F3/1446 ,  G09F13/04 ,  G09G5/00 ,  G09G2356/00 ,  H05K13/00

Abstract: A display system includes a wedge optical element, a photoactive layer, light director, and light modulator. The wedge optical element has a clear substrate. The photoactive layer receives emitted light that generates an image. The light director is disposed between the photoactive layer and the wedge optical element. The light modulator generates emitted light and is optically coupled to the wedge optical element to direct the emitted light to an angled side of the wedge optical element. The angled side of the wedge optical element is configured to reflect the emitted light toward a backside of the photoactive layer to generate an image viewable by a user on a frontside of the photoactive layer. The light director is disposed to receive the emitted light from the angled side of the wedge optical element and direct the emitted light toward propagating substantially normal to the backside of the photoactive layer.

公开(公告)号：US20170018092A1

公开(公告)日：2017-01-19

申请号：US15236881

申请日：2016-08-15

Applicant: Google Inc.

Inventor： Johnny Lee ,  Joel Hesch

IPC: G06T7/20 ,  H04W4/02

CPC classification number: G06K9/00744 ,  G06T7/246 ,  G06T7/66 ,  G06T7/73 ,  G06T2207/10016 ,  G06T2207/10028 ,  G06T2207/30241 ,  G06T2207/30244 ,  H04W4/023 ,  H04W4/027 ,  H04W4/029

Abstract: Methods and systems for determining features of interest for following within various frames of data received from multiple sensors of a device are disclosed. An example method may include receiving data from a plurality of sensors of a device. The method may also include determining, based on the data, motion data that is indicative of a movement of the device in an environment. The method may also include as the device moves in the environment, receiving image data from a camera of the device. The method may additionally include selecting, based at least in part on the motion data, features in the image data for feature-following. The method may further include estimating one or more of a position of the device or a velocity of the device in the environment as supported by the data from the plurality of sensors and feature-following of the selected features in the images.

Abstract translation: 公开了用于确定在从设备的多个传感器接收的各种数据帧内追踪的特征的方法和系统。 示例性方法可以包括从设备的多个传感器接收数据。 该方法还可以包括基于数据确定指示设备在环境中的移动的运动数据。 该方法还可以包括当设备在环境中移动时，从设备的照相机接收图像数据。 该方法可以另外包括至少部分地基于运动数据来选择用于特征跟踪的图像数据中的特征。 该方法还可以包括估计设备的位置或环境中的设备的速度中的一个或多个，如来自多个传感器的数据所支持的，以及图像中所选特征的特征。

公开(公告)号：US09412053B1

公开(公告)日：2016-08-09

申请号：US13673828

申请日：2012-11-09

Applicant: Google Inc.

Inventor： William Graham Patrick ,  Eric Teller ,  Johnny Lee

IPC: G06K9/78 ,  G06F19/00 ,  G01C15/02 ,  H05B37/02

CPC classification number: G06K9/78 ,  H05B37/02 ,  H05B37/029

Abstract: Embodiments of an apparatus, system and method for creating light projection solutions for user guidance are described herein. A user may request that projected light be used to assist in a plurality of operations involving objects in the physical space around the user. A user can use voice commands and hand gestures to request that a projector project light or images on or near objects involved in one or more operations. Embodiments of the disclosure perform an image recognition process to scan the physical space around the user and to identify any user gesture performed (e.g., a user pointing at a plurality of objects, a user holding an object); a steerable projector may be actuated to project light or image data based on the user's request and a plurality of operations associated with the objects.

Abstract translation: 本文描述了用于创建用于用户引导的光投影解决方案的装置，系统和方法的实施例。 用户可以请求投射光用于辅助涉及用户周围的物理空间中的对象的多个操作。 用户可以使用语音命令和手势来请求投影仪投射在一个或多个操作中涉及的物体上或附近的光或图像。 本公开的实施例执行图像识别处理以扫描用户周围的物理空间并且识别执行的任何用户手势（例如，指向多个对象的用户，持有对象的用户）; 可以启动可操纵的投影仪以基于用户的请求投射光或图像数据以及与对象相关联的多个操作。