公开(公告)号：US08241122B2

公开(公告)日：2012-08-14

申请号：US12307390

申请日：2007-04-23

申请人： Akio Ohba ,  Hiroyuki Segawa ,  Akira Suzuki ,  Katsu Saito ,  Tomokazu Kake ,  Michinari Kohno

发明人： Akio Ohba ,  Hiroyuki Segawa ,  Akira Suzuki ,  Katsu Saito ,  Tomokazu Kake ,  Michinari Kohno

IPC分类号： A63F13/00

CPC分类号： G06F3/0304 ,  A63F13/00 ,  A63F13/02 ,  A63F2300/1093 ,  G06F3/012 ,  G06T7/254 ,  G06T2207/10016 ,  G06T2207/30196

摘要： For an input interface apparatus for recognizing the motion of an object, there may be cases where the brightness of the object to be captured is insufficient, and thus, a camera takes an image of the object operated by the object, a depth position detector detects the position of the object based on captured frames, an action identifying unit identifies an action of the player based on a result on the detection of the object, an input receiving unit receives the action as an instruction to an input-receiving image displayed on a display, and in response to the action, an illumination control unit raises the brightness of the image projected on the display higher than that before the action is detected.

摘要翻译： 对于用于识别对象的运动的输入接口装置，可能存在要拍摄的对象的亮度不足的情况，因此，相机拍摄由对象操作的对象的图像，深度位置检测器检测 基于拍摄的帧的对象的位置，动作识别单元基于对对象的检测结果来识别玩家的动作，输入接收单元接收作为对显示在对象上的输入接收图像的指示的动作 并且响应于该动作，照明控制单元将投影在显示器上的图像的亮度提高到高于检测到动作之前的图像的亮度。

公开(公告)号：US20090203440A1

公开(公告)日：2009-08-13

申请号：US12307390

申请日：2007-04-23

申请人： Akio Ohba ,  Hiroyuki Segawa ,  Akira Suzuki ,  Katsu Saito ,  Tomokazu Kake ,  Michinari Kohno

发明人： Akio Ohba ,  Hiroyuki Segawa ,  Akira Suzuki ,  Katsu Saito ,  Tomokazu Kake ,  Michinari Kohno

IPC分类号： A63F13/00

CPC分类号： G06F3/0304 ,  A63F13/00 ,  A63F13/02 ,  A63F2300/1093 ,  G06F3/012 ,  G06T7/254 ,  G06T2207/10016 ,  G06T2207/30196

摘要： For an input interface apparatus for recognizing the motion of an object, there may be cases where the brightness of the object to be captured is insufficient, and thus, a camera takes an image of the object operated by the object, a depth position detector detects the position of the object based on captured frames, an action identifying unit identifies an action of the player based on a result on the detection of the object, an input receiving unit receives the action as an instruction to an input-receiving image displayed on a display, and in response to the action, an illumination control unit raises the brightness of the image projected on the display higher than that before the action is detected.

摘要翻译： 对于用于识别对象的运动的输入接口装置，可能存在要拍摄的对象的亮度不足的情况，因此，相机拍摄由对象操作的对象的图像，深度位置检测器检测 基于拍摄的帧的对象的位置，动作识别单元基于对对象的检测结果来识别玩家的动作，输入接收单元接收作为对显示在对象上的输入接收图像的指示的动作 并且响应于该动作，照明控制单元将投影在显示器上的图像的亮度提高到高于检测到动作之前的图像的亮度。

公开(公告)号：US08113953B2

公开(公告)日：2012-02-14

申请号：US12294966

申请日：2007-04-23

申请人： Akio Ohba ,  Hiroyuki Segawa ,  Akira Suzuki ,  Katsu Saito ,  Tomokazu Kake ,  Shinichi Honda

发明人： Akio Ohba ,  Hiroyuki Segawa ,  Akira Suzuki ,  Katsu Saito ,  Tomokazu Kake ,  Shinichi Honda

IPC分类号： A63F13/00 ,  A63F13/06

CPC分类号： A63F13/54 ,  A63F13/06 ,  A63F13/213 ,  A63F2300/1087 ,  G06F3/16

摘要： A player can be notified both visually and aurally that his/her action is recognized. A velocity vector-calculating unit calculates a velocity vector of the movement of an object manipulated by a player moving toward an assumable contact surface W by using an image of the movement of the player captured by a camera. A travel time calculating unit calculates the travel time required for the object to reach the contact surface W by using the velocity vector and a distance between the object and the contact surface W. A lag time acquisition unit acquires a lag time that sound output from a speaker takes to reach the player. A sound control unit allows the player to hear the sound substantially at the same time the object contacts the contact surface by outputting a predetermined sound after the time passes which is obtained by subtracting the lag time from the travel time.

摘要翻译： 可以在视觉和听觉上通知玩家他/她的动作被认可。 速度矢量计算单元通过使用由摄像机拍摄的玩家的动作的图像来计算由玩家向可假定的接触面W移动而操纵的对象的移动的速度矢量。 行驶时间计算单元通过使用速度矢量和物体与接触面W之间的距离来计算物体到达接触面W所需的行驶时间。滞后时间获取单元获取从物体 扬声器到达播放器。 声音控制单元允许播放器在通过从行进时间减去滞后时间获得的时间之后输出预定声音，同时基本上听到声音对象接触接触表面。

公开(公告)号：US20100222144A1

公开(公告)日：2010-09-02

申请号：US12294966

申请日：2007-04-23

申请人： Akio Ohba ,  Hiroyuki Segawa ,  Akira Suzuki ,  Katsu Saito ,  Tomokazu Kake ,  Shinichi Honda

发明人： Akio Ohba ,  Hiroyuki Segawa ,  Akira Suzuki ,  Katsu Saito ,  Tomokazu Kake ,  Shinichi Honda

IPC分类号： A63F9/24

CPC分类号： A63F13/54 ,  A63F13/06 ,  A63F13/213 ,  A63F2300/1087 ,  G06F3/16

摘要： Intended is to inform a player of it through both the visual sense and the auditory sense that an action has been recognized. A velocity vector calculating unit calculates, by using the image of the action of the player taken with a camera (20), the velocity vector of the action, in which an object operated by a player (72) comes toward a contact plane (W). A moving time calculating unit calculates, by using the velocity vector and the distance between the object and the contact plane (W), the moving time period required for the object to reach the contact plane. A delay time acquiring unit acquires a delay time period till the voice uttered by a speaker (42) reaches the player (72). A voice control unit outputs a predetermined voice after lapse of the time period calculated by subtracting the delay time from the moving time period, so that the player (72) may listen to the voice, substantially simultaneously as the object contacts the contact plane.

摘要翻译： 旨在通过视觉和听觉来告知玩家它已经认识到一个动作。 速度矢量计算单元通过使用由摄像机（20）拍摄的演奏者的动作的图像来计算动作的速度矢量，其中由玩家（72）操作的对象朝向接触平面（W ）。 移动时间计算单元通过使用速度矢量和物体与接触面（W）之间的距离来计算物体到达接触平面所需的移动时间段。 延迟时间获取单元获取延迟时间，直到扬声器（42）发出的声音到达播放器（72）。 语音控制单元在通过从移动时间段减去延迟时间而计算的时间段经过之后输出预定语音，使得播放器（72）可以在对象接触接触平面的同时基本同时收听声音。

公开(公告)号：US08613665B2

公开(公告)日：2013-12-24

申请号：US11683543

申请日：2007-03-08

申请人： Teiyu Goto ,  Katsu Saito ,  Akio Ohba ,  Hiroyuki Segawa

发明人： Teiyu Goto ,  Katsu Saito ,  Akio Ohba ,  Hiroyuki Segawa

IPC分类号： A63F9/24

CPC分类号： A63F13/213 ,  A63F13/06 ,  A63F13/24 ,  A63F13/42 ,  A63F2300/1006 ,  A63F2300/1043 ,  A63F2300/1093 ,  A63F2300/301 ,  A63F2300/6045 ,  G06F3/033

摘要： A game controller includes a plurality of LEDs formed on the rear of a case. The plurality of LEDs are arranged two-dimensionally in its layout area. The game controller has a plurality of PWM control units which are provided inside the case and control the lighting of the plurality of LEDs, respectively. The PWM control units control the lighting of the LEDs based on a control signal from a game apparatus. The game apparatus acquires a captured image of the game controller, and acquires the position of the game controller in the captured image based on the positions of the LEDs in the captured image.

摘要翻译： 游戏控制器包括形成在壳体后部的多个LED。 多个LED在其布局区域中二维布置。 游戏控制器具有设置在壳体内的多个PWM控制单元，分别控制多个LED的点亮。 PWM控制单元基于来自游戏装置的控制信号来控制LED的点亮。 游戏装置获取游戏控制器的拍摄图像，并且基于拍摄图像中的LED的位置来获取拍摄图像中的游戏控制器的位置。

公开(公告)号：US08292737B2

公开(公告)日：2012-10-23

申请号：US12067468

申请日：2007-02-23

申请人： Teiyu Goto ,  Katsu Saito ,  Akio Ohba ,  Hiroyuki Segawa

发明人： Teiyu Goto ,  Katsu Saito ,  Akio Ohba ,  Hiroyuki Segawa

IPC分类号： A63F9/24

CPC分类号： A63F13/213 ,  A63F13/06 ,  A63F13/24 ,  A63F13/42 ,  A63F2300/1006 ,  A63F2300/1043 ,  A63F2300/1093 ,  A63F2300/301 ,  A63F2300/6045 ,  G06F3/033

摘要： The present invention provides a game system using LEDs in a controller 20. In a game system of the present invention, an image pickup apparatus captures the controller. The controller includes multiple input units for making an operation input to advance a game, and multiple LEDs for indicating a controller number set for the controller in a game application executed. A game apparatus accepts an operation input provided to the controller and reflects the operation input in the processing of a game application, acquires a captured image from the image pickup apparatus, acquires the position of the controller in the captured image based on the position of the LED in the captured image and reflects the acquired position information in the processing of the game application, and generates an image signal showing the result of application processing performed based on the operation input and acquired position information.

摘要翻译： 本发明提供一种在控制器20中使用LED的游戏系统。在本发明的游戏系统中，图像拾取装置捕获控制器。 控制器包括用于进行游戏进行操作输入的多个输入单元，以及用于指示在执行的游戏应用中为控制器设置的控制器号码的多个LED。 游戏装置接受提供给控制器的操作输入并反映在游戏应用的处理中的操作输入，从图像拾取装置获取拍摄图像，基于拍摄图像的位置获取拍摄图像中的控制器的位置 LED，并且在游戏应用的处理中反映获取的位置信息，并且生成表示基于操作输入和获取的位置信息执行的应用处理结果的图像信号。

公开(公告)号：US20100062854A1

公开(公告)日：2010-03-11

申请号：US12067468

申请日：2007-02-23

申请人： Teiyu Goto ,  Katsu Saito ,  Akio Ohba ,  Hiroyuki Segawa

发明人： Teiyu Goto ,  Katsu Saito ,  Akio Ohba ,  Hiroyuki Segawa

IPC分类号： A63F9/24

CPC分类号： A63F13/213 ,  A63F13/06 ,  A63F13/24 ,  A63F13/42 ,  A63F2300/1006 ,  A63F2300/1043 ,  A63F2300/1093 ,  A63F2300/301 ,  A63F2300/6045 ,  G06F3/033

摘要： Provided is a game system utilizing the LEDs of a controller (20). In a game system (1), an image pickup device (2) takes the image of the controller (20). The controller (20) includes a plurality of input units for performing an operation input to proceed a game, and a plurality of LEDs for expressing a controller number to be set in the controller (20), in a game application to be executed. A game device (10) accepts and reflects the operation input of the controller (20), upon the processing of the game application, acquires the taken image from the image pickup device (2), acquires a position in the taken image of the controller (20) from the positions of the LEDs in the taken image, reflects the acquired position information upon the processing of the game application, and generates an image signal indicating the application processing result based on the operation input and the acquired position information.

摘要翻译： 提供了利用控制器（20）的LED的游戏系统。 在游戏系统（1）中，摄像装置（2）拍摄控制器（20）的图像。 控制器（20）包括用于进行游戏的操作输入的多个输入单元和用于表达要在控制器（20）中设置的控制器编号的多个LED，以在要执行的游戏应用中。 游戏装置（10）接受并反映控制器（20）的操作输入，在游戏应用程序的处理中，从图像拾取装置（2）获取拍摄图像，获取控制器（20）的拍摄图像中的位置 （20）从拍摄图像中的LED的位置反映所获取的位置信息，并且基于操作输入和获取的位置信息生成指示应用处理结果的图像信号。

公开(公告)号：US20070218994A1

公开(公告)日：2007-09-20

申请号：US11683543

申请日：2007-03-08

申请人： Teiyu GOTO ,  Katsu Saito ,  Akio Ohba ,  Hiroyuki Segawa

发明人： Teiyu GOTO ,  Katsu Saito ,  Akio Ohba ,  Hiroyuki Segawa

IPC分类号： A63F9/24

CPC分类号： A63F13/213 ,  A63F13/06 ,  A63F13/24 ,  A63F13/42 ,  A63F2300/1006 ,  A63F2300/1043 ,  A63F2300/1093 ,  A63F2300/301 ,  A63F2300/6045 ,  G06F3/033

摘要： A game controller includes a plurality of LEDs formed on the rear of a case. The plurality of LEDs are arranged two-dimensionally in its layout area. The game controller has a plurality of PWM control units which are provided inside the case and control the lighting of the plurality of LEDs, respectively. The PWM control units control the lighting of the LEDs based on a control signal from a game apparatus. The game apparatus acquires a captured image of the game controller, and acquires the position of the game controller in the captured image based on the positions of the LEDs in the captured image.

摘要翻译： 游戏控制器包括形成在壳体后部的多个LED。 多个LED在其布局区域中二维布置。 游戏控制器具有设置在壳体内的多个PWM控制单元，分别控制多个LED的点亮。 PWM控制单元基于来自游戏装置的控制信号来控制LED的点亮。 游戏装置获取游戏控制器的拍摄图像，并且基于拍摄图像中的LED的位置来获取拍摄图像中的游戏控制器的位置。

公开(公告)号：US09699432B2

公开(公告)日：2017-07-04

申请号：US14005039

申请日：2012-01-16

申请人： Akio Ohba ,  Hiroyuki Segawa

发明人： Akio Ohba ,  Hiroyuki Segawa

IPC分类号： H04N13/00 ,  G06K9/46 ,  G06T7/20 ,  G06T5/00 ,  G06T7/593 ,  H04N13/02

CPC分类号： H04N13/122 ,  G06T7/593 ,  G06T2207/10021 ,  G06T2207/20016 ,  H04N13/106 ,  H04N13/239 ,  H04N13/271 ,  H04N2013/0074 ,  H04N2013/0081

摘要： An image pickup apparatus 12 includes a first camera 22 and a second camera 24. The cameras pick up an image of a target at the same timing and at the same frame rate from left and right positions spaced by a known distance from each other. Picked up frame images are converted into image data of a predetermined plurality of resolutions. An input information acquisition section 26 of an information processing apparatus 14 acquires an instruction input from a user. A position information production section 28 approximately estimates a region of the target or a region which involves some movement on an image of a low resolution and a wide range from within stereo image data as a target region and carries out stereo matching only in regard to the region on an image of a high resolution to specify a three-dimensional position of the target. An output information production section 32 carries out a necessary process based on the position of the target to produce output information. A communication section 30 carries out request for and acquisition of image data to and from the image pickup apparatus 12.

公开(公告)号：US09247132B2

公开(公告)日：2016-01-26

申请号：US14116630

申请日：2012-04-05

申请人： Akio Ohba ,  Hiroyuki Segawa

发明人： Akio Ohba ,  Hiroyuki Segawa

IPC分类号： G06F3/00 ,  H04N13/02 ,  G06F3/01 ,  H04N21/422 ,  H04N5/232 ,  H04N5/262 ,  H04N21/4223 ,  H04N21/4402 ,  H04N21/4788 ,  H04N21/442

CPC分类号： H04N5/23232 ,  G06F3/005 ,  G06F3/011 ,  H04N5/23219 ,  H04N5/2628 ,  H04N13/239 ,  H04N21/4223 ,  H04N21/440263 ,  H04N21/44218 ,  H04N21/4788

摘要： An image synthesis unit receives respective pixel values for a single horizontal row of a ¼ demosaiced image, a 1/16 demosaiced image, and a 1/64 demosaiced image from a pyramid filter for reducing, in a plurality of stages, a frame of a moving image that is captured. The image synthesis unit then connects the pixel values in a predetermined rule so as to generate a virtual synthesized image and outputs the synthesized image in the form of streams. A control unit of an image transmission unit notifies a data selection unit of a request from a host terminal. The data selection unit selects and extracts necessary data from respective streams of pieces of data of the synthesized image, a RAW image, and a 1/1 demosaiced image, and generates a stream of data to be transmitted. A packetizing unit packetizes the stream and transmits the packetized stream to the host terminal.

摘要翻译： 图像合成单元接收来自金字塔滤波器的1/4镶嵌图像，1/16去马赛克图像和1/64去马赛克图像的单个水平行的各个像素值，以便在多个阶段中将 捕获的动态图像。 然后，图像合成单元以预定规则连接像素值，以产生虚拟合成图像，并以流的形式输出合成图像。 图像发送单元的控制单元向主机终端通知数据选择单元的请求。 数据选择单元从合成图像，RAW图像和1/1去马赛克图像的数据片段的各个流中选择并提取必要的数据，并生成要发送的数据流。 分组单元将流打包并将分组化流发送到主机终端。