公开(公告)号：US06570588B1

公开(公告)日：2003-05-27

申请号：US09081635

申请日：1998-05-20

Applicant: Haru Ando ,  Nobuo Hataoka

Inventor： Haru Ando ,  Nobuo Hataoka

IPC: G06F1540

CPC classification number: G06F3/167 ,  G06F3/0481 ,  G06F9/453

Abstract: An editing system having a dialogue operation type interface directs a next operation by referring an operation history. User information is inputted by using speech input/output, pointing by a finger and 3-D CG. A human image representing the system is displayed as an agent on the image output device, and a user error, availability to a queue and a utilization environment are extracted by the system and informed to the user through the agent. The system responds to the user intent by the image display or the speech output by using the agent as a medium so that a user friendly interface for graphics edition and image edition is provided.

Abstract translation: 具有对话操作类型接口的编辑系统通过参考操作历史指导下一操作。 通过使用由手指和3-D CG指示的语音输入/输出来输入用户信息。 表示系统的人物图像作为代理显示在图像输出装置上，系统提取用户错误，队列的可用性和利用环境，并通过代理向用户通知。 系统通过使用代理作为介质，通过图像显示或语音输出来响应用户意图，从而提供用于图形编辑和图像版本的用户友好界面。

公开(公告)号：US06549887B1

公开(公告)日：2003-04-15

申请号：US09488076

申请日：2000-01-20

Applicant: Haru Ando ,  Hirohiko Sagawa ,  Masaru Takeuchi

Inventor： Haru Ando ,  Hirohiko Sagawa ,  Masaru Takeuchi

IPC: G10L2106

CPC classification number: G06T13/20 ,  G09B5/02 ,  G09B21/00

Abstract: Inputted sign language word labels and editing items such as speeds and positions of moving portions for specifying manual signs and/or sign gestures corresponding to the respective sign language word labels are displayed on an editing screen. These editing items are modified by the user to add non-language information such as emphasis/feeling information to the contents of communication, thereby generating modified sign language animation information data including the inputted sign language word label string having the added non-language information. For communication or interaction, the non-language information is extracted from the modified sign language animation information data and stored into a memory with the inputted sign language word label string. When a hearing impaired person communicates or interacts with another person through text, the user can emphasize the contents of communication or show the user's feeling for the contents of communication to the other person.

Abstract translation: 在编辑画面上显示输入的手语字标签和编辑项目，例如用于指定手动标志的移动部分的速度和位置和/或对应于各个手语字标签的手势。 这些编辑项目被用户修改以将非语言信息（例如强调/感觉信息）添加到通信内容，从而生成修改的手语动画信息数据，其包括具有添加的非语言信息的输入的手语单词标签串。 对于通信或交互，从修改的手语动画信息数据中提取非语言信息，并将其存储到具有输入的手语字标签串的存储器中。 当听力障碍者通过文本与另一个人进行通信或交互时，用户可以强调通信的内容，或向对方显示用户对通信内容的感觉。

公开(公告)号：US08014716B2

公开(公告)日：2011-09-06

申请号：US10728904

申请日：2003-12-08

Applicant: Haru Ando ,  Nobuhiro Sekimoto ,  Takashi Hasegawa

Inventor： Haru Ando ,  Nobuhiro Sekimoto ,  Takashi Hasegawa

IPC: G09B3/00

CPC classification number: H04L29/06 ,  G09B7/04 ,  H04L29/06027 ,  H04L67/306 ,  H04L69/329

Abstract: An information management server and information distribution system utilizes a video of the class for creating educational contents matching the learning conditions of the student, and also provides instruction using these same contents. This information server and information distribution system are composed of an accumulator section to store electronic data on the lecture contents, a holding section to hold lecture-related information, a send section to send lecture contents and lecture-related information to the terminal of the student, an analyzer section to analyze electronic data on the lecture contents, and a matcher section to link lecture-related information with lecture contents based on those analysis results, and a control section for selecting lecture contents linked to the lecture-related information based on a reply to the lecture-related information sent from the student terminal, wherein the send section and sends those selected lecture contents to the terminal of the student that sent the reply to the lecture-related information.

Abstract translation: 信息管理服务器和信息分配系统利用该类的视频来创建与学生的学习条件匹配的教育内容，并且还使用这些内容提供指令。 该信息服务器和信息分发系统由用于存储讲座内容的电子数据的存储器部分，用于保存讲座相关信息的保持部分，向学生的终端发送讲座内容和演讲相关信息的发送部分组成 分析部分，用于分析讲座内容的电子数据;以及匹配器部分，用于基于这些分析结果将演讲相关信息与演讲内容相关联;以及控制部分，用于基于与讲座相关的信息相关联地选择与讲座相关的信息相关的演讲内容 回复从学生终端发送的讲座相关信息，其中发送部分将所选择的讲座内容发送给发送答复的学生的终端到演讲相关信息。

公开(公告)号：US20090132637A1

公开(公告)日：2009-05-21

申请号：US12275559

申请日：2008-11-21

Applicant: Haru ANDO

Inventor： Haru ANDO

IPC: G06F15/16

CPC classification number: G06F17/242

Abstract: The invention, taking an electronic content utilization casing as the basis, extracts input activity to the same casing; estimates data input positions within the content by calculating similarity values and difference values among the same activity data, and similarity values and difference values between the activity data and model data; estimates the input state of the user from the estimated input positions; and presents the same estimation values as the content utilization state.

Abstract translation: 本发明以电子内容利用套管为基础，将输入活动提取给同一套管; 通过计算相同活动数据之间的相似度值和差值，以及活动数据和模型数据之间的相似度值和差值来估计内容内的数据输入位置; 从估计的输入位置估计用户的输入状态; 并呈现与内容利用状态相同的估计值。

公开(公告)号：US06477495B1

公开(公告)日：2002-11-05

申请号：US09259333

申请日：1999-03-01

Applicant: Nobuo Nukaga ,  Yoshinori Kitahara ,  Keiko Fujita ,  Haru Ando ,  Shunichi Yajima

Inventor： Nobuo Nukaga ,  Yoshinori Kitahara ,  Keiko Fujita ,  Haru Ando ,  Shunichi Yajima

IPC: G10L1308

CPC classification number: G10L13/10

Abstract: A prosodic parameter for an input text is computed by storing a sentence of vocalized speech in a speech corpus memory, searching for a stored text having a similar prosody to an input text as a key to the speech corpus and modifying the prosodic parameter based upon the search results. Because a plurality of prosodic parameters are handled as a linking data, a synthesized sound similar to natural speech having a natural intonation and prosody is produced.

Abstract translation: 通过将声音语音的句子存储在语音库存储器中来搜索输入文本的韵律参数，搜索具有与输入文本相似的韵律的存储文本作为语音语料库的关键字，并且基于该韵律参数修改韵律参数 搜索结果。 由于多个韵律参数被处理为连接数据，因此产生与具有自然语调和韵律的自然语音类似的合成声音。

公开(公告)号：US5777614A

公开(公告)日：1998-07-07

申请号：US542736

申请日：1995-10-13

Applicant: Haru Ando ,  Nobuo Hataoka

Inventor： Haru Ando ,  Nobuo Hataoka

IPC: G06F3/0481 ,  G06F3/16 ,  G06F9/44 ,  G06F3/00

CPC classification number: G06F9/4446 ,  G06F3/0481 ,  G06F3/167

Abstract: An editing system having a dialogue operation type interface directs a next operation by referring an operation history. User information is inputted by using speech input/output, pointing by a finger and 3-D CG. A human image representing the system is displayed as an agent on the image output device, and a user error, availability to a queue and a utilization environment are extracted by the system and informed to the user through the agent. The system responds to the user intent by the image display or the speech output by using the agent as a medium so that a user friendly interface for graphics edition and image edition is provided.

公开(公告)号：US5600765A

公开(公告)日：1997-02-04

申请号：US137788

申请日：1993-10-19

Applicant: Haru Ando ,  Yoshinori Kitahara

Inventor： Haru Ando ,  Yoshinori Kitahara

IPC: G06F3/041 ,  G06F3/033 ,  G06F3/038 ,  G06F3/048 ,  G06F3/16 ,  G06T11/80 ,  G09B5/00 ,  G06T11/00

CPC classification number: G06F3/038 ,  G06F3/0481 ,  G06F3/167 ,  G09B5/00 ,  G06F2203/0381

Abstract: A method of accepting multimedia operation commands wherein, while pointing to either of a display object or a display position on a display screen of a graphics display system through a pointing input device, a user commands the graphics display system to cause an event on a graphics display, through a voice input device; comprising a first step of allowing the user to perform the pointing gesture so as to enter a string of coordinate points which surround one area for either of the display object and any desired display position; a second step of allowing the user to give the voice command together with the pointing gesture; a third step of recognizing a command content of the voice command by a speech recognition process in response to the voice command; a fourth step of recognizing a command content of the pointing gesture in accordance with the recognized result of the third step; and a fifth step of executing the event on the graphics display in accordance with the command contents of the voice command and the pointing gesture. Thus, the method provides a man-machine interface which utilizes the plurality of media of the voice and the pointing gesture, which offers a high operability to the user, and with which an illustration etc. can be easily edited.

Abstract translation: 一种接受多媒体操作命令的方法，其中，通过指示输入设备指向图形显示系统的显示屏幕上的显示对象或显示位置中的任一个，用户命令图形显示系统在图形上引起事件 通过语音输入设备显示; 包括允许用户执行指示手势以便输入围绕显示对象和任何所需显示位置的一个区域的坐标点串的第一步骤; 允许用户与指示手势一起发出语音命令的第二步骤; 响应于语音命令通过语音识别处理识别语音命令的命令内容的第三步骤; 根据第三步骤的识别结果识别指示手势的命令内容的第四步骤; 以及第五步骤，根据语音命令和指示手势的命令内容在图形显示器上执行事件。 因此，该方法提供了一种人机接口，其利用语音和指向手势的多个媒体，其为用户提供高可操作性，并且可以容易地编辑图示等。

公开(公告)号：US07308479B2

公开(公告)日：2007-12-11

申请号：US10601954

申请日：2003-06-24

Applicant: Haru Ando ,  Junichi Matsuda

Inventor： Haru Ando ,  Junichi Matsuda

IPC: G06F15/16 ,  H04L12/58

CPC classification number: H04M1/72544 ,  G09B21/009 ,  H04M1/72552 ,  H04M3/5315 ,  H04M2207/18

Abstract: The mailing system of the invention converts the text information into movement information using animations, object information, and background information, and sends/receives the converted information as a mail. The system analyzes the information inputted or selected by a user, creates an animation movement by using the analyzed information, and selects an object and a background by using the analyzed information. The system sends/receives the created or selected animation movement information, object information, and background information as a mail, and displays the mail as if the sender and receiver were engaging in a dialogue.

Abstract translation: 本发明的邮件系统使用动画，对象信息和背景信息将文本信息转换为移动信息，并且作为邮件发送/接收转换的信息。 系统分析用户输入或选择的信息，通过使用分析的信息创建动画移动，并通过使用分析的信息来选择对象和背景。 该系统作为邮件发送/接收创建或选择的动画移动信息，对象信息和背景信息，并且像发送者和接收者正在进行对话一样显示该邮件。

公开(公告)号：US20050021665A1

公开(公告)日：2005-01-27

申请号：US10638399

申请日：2003-08-12

Applicant: Nobuhiro Sekimoto ,  Haru Ando

Inventor： Nobuhiro Sekimoto ,  Haru Ando

IPC: G06F13/00 ,  H04L29/06 ,  H04N7/173 ,  H04N17/00 ,  H04N21/239 ,  H04N21/258 ,  G06F15/16

CPC classification number: H04L29/06 ,  H04L67/42

Abstract: A content is delivered in consideration of a terminal used by a user, an ambient environment of the user and the terminal, and the characteristics and preferences of the user. A content delivery server has an input/output unit for transmitting and receiving information between itself and a terminal, a content management unit for managing contents composed of modalities, and a control unit for controlling the input/output unit and the content management unit. The control unit obtains attribute information composed of terminal attribute information on an output interface at the terminal, environmental attribute information on the current ambient environment of the terminal, and user attribute information on the characteristics of the user, generates, based on the obtained attribute information, modality construction information for specifying the modalities of a content to be delivered to the terminal, determines, by using the modality construction information, a modality construction for the content to be delivered which is under the management of the content management unit, and delivers the content composed of the determined modalitis to the terminal via the input/output unit.

Abstract translation: 考虑到用户使用的终端，用户的周边环境和终端以及用户的特征和偏好来传送内容。 内容传送服务器具有用于在其与终端之间发送和接收信息的输入/输出单元，用于管理由模态组成的内容的内容管理单元和用于控制输入/输出单元和内容管理单元的控制单元。 控制部获取终端的终端属性信息，终端的输出接口的属性信息，终端的当前环境的环境属性信息，用户的特性的用户属性信息，基于所获得的属性信息 用于指定要发送到终端的内容的模式的模态构造信息通过使用模态构造信息来确定在内容管理单元的管理下将被传送的内容的模态构造，并且传送 由经由输入/输出单元的终端确定的模态炎组成的内容。

公开(公告)号：US07190770B2

公开(公告)日：2007-03-13

申请号：US10206231

申请日：2002-07-29

Applicant: Haru Ando ,  Yoshito Nejime ,  Junichi Matsuda

Inventor： Haru Ando ,  Yoshito Nejime ,  Junichi Matsuda

IPC: H04M1/64 ,  G10L15/00

CPC classification number: H04M3/4938 ,  H04M1/271 ,  H04M2201/40

Abstract: A user-requested command with both visual and hearing information is indicated. Additionally, with a user friendly method, the user understands what content to input. The user-requested command is expressed in the form of a template sentence. Template part in the template sentence is vocalized, and a slot area in the template sentence is expressed using a sound or voice. The user inputs his or her voice to be input to the slot area.

Abstract translation: 指示了具有视觉和听觉信息的用户请求命令。 另外，用户友好的方法，用户了解要输入的内容。 用户请求的命令以模板句子的形式表示。 模板句中的模板部分发声，模板句中的插槽区域用声音或声音表示。 用户输入他或她的声音以输入到插槽区域。