Augmented reality writing system and method thereof

    公开(公告)号:US10067568B2

    公开(公告)日:2018-09-04

    申请号:US13407117

    申请日:2012-02-28

    摘要: Embodiments of the present invention disclose an augmented reality writing system and method thereof. According to one example embodiment, the system includes a handheld writing tool having an end portion and a display device for displaying digital content for viewing by an operating user. An optical sensor is coupled to the display device and includes a field of view facing away from the operating user. Furthermore, coupled to the optical sensor is a processing unit configured to detect and track the position of the end portion of the handwriting tool. In accordance therewith, handwritten content is digitally rendered on the display device to correspond with the handwriting motion of the writing tool within the field of view of the optical sensor.

    Dynamic text input using on and above surface sensing of hands and fingers
    2.
    发明授权
    Dynamic text input using on and above surface sensing of hands and fingers 有权
    使用手指和手指的表面感测进行动态文本输入

    公开(公告)号:US09430145B2

    公开(公告)日:2016-08-30

    申请号:US13081361

    申请日:2011-04-06

    摘要: A virtual keyboard is displayed on a touch screen display surface of a computing device. Partial images of the keyboard are displayed, where a partial image may be one key, referred to as the most probable key that the user will touch, or a group of keys, which may include some less probable or surrounding keys that may be touched. Sensors under or near the display surface detect an outline of the user hands and determines which finger is the fastest moving finger, which is presumed to be the finger used to touch a key. The most probable key is determined based on the fastest moving finger and may be displayed before the finger touches the surface. If the most probable key is not touched, a user profile containing user typing habits may be updated to reflect that a less probable key was touched.

    摘要翻译: 虚拟键盘显示在计算设备的触摸屏显示表面上。 显示键盘的部分图像,其中部分图像可以是一个键,被称为用户将触摸的最可能的键,或者一组键,其可以包括可能被触摸的一些较不可能或周围的键。 显示表面下或附近的传感器检测用户手的轮廓,并确定哪个手指是最快的移动手指,其被推定为用于触摸键的手指。 最可能的键是基于最快的移动手指确定的,并且可以在手指触摸表面之前显示。 如果最不可能的键不被触摸,则可能会更新包含用户打字习惯的用户配置文件,以反映较少可能的密钥被触动。

    USE OF A SENSOR TO ENABLE TOUCH AND TYPE MODES FOR HANDS OF A USER VIA A KEYBOARD
    4.
    发明申请
    USE OF A SENSOR TO ENABLE TOUCH AND TYPE MODES FOR HANDS OF A USER VIA A KEYBOARD 审中-公开
    传感器使用键盘的用户手柄和类型模式

    公开(公告)号:US20130257734A1

    公开(公告)日:2013-10-03

    申请号:US13435734

    申请日:2012-03-30

    IPC分类号: G06F3/02

    摘要: Example embodiments relate to a keyboard-based system that enables a user to provide touch input via the keyboard with one hand and typed input via the keyboard with the other hand. In example embodiments, a sensor detects the user's hands on the top surface of the keyboard. In response, a computing device identifies a first hand and a second hand by analyzing information provided by the sensor. The computing device then assigns the first hand to a touch mode and the second hand to a typing mode. The user may then provide touch input using a visualization of the first hand overlaid on a user interface, while providing typed input with the second hand via the keyboard.

    摘要翻译: 示例性实施例涉及一种基于键盘的系统,其使得用户能够通过键盘通过键盘提供一键式输入和另一方的键入输入。 在示例性实施例中,传感器在键盘的顶表面上检测用户的手。 作为响应,计算设备通过分析由传感器提供的信息来识别第一只手和第二只手。 计算设备然后将第一只手分配给触摸模式,而第二只手分配给打字模式。 然后,用户可以使用覆盖在用户界面上的第一只手的可视化来提供触摸输入,同时通过键盘向秒针提供打字输入。

    Egomotion speed estimation on a mobile device using a single imager
    5.
    发明授权
    Egomotion speed estimation on a mobile device using a single imager 有权
    使用单个成像器的移动设备上的运动速度估计

    公开(公告)号:US08456524B2

    公开(公告)日:2013-06-04

    申请号:US12699568

    申请日:2010-02-03

    IPC分类号: H04N7/00

    摘要: Linear and rotational speeds of a mobile device are calculated using distance estimates between imaging sensors in the device and objects or scenes in front of the sensors. The distance estimates are used to modify optical flow vectors from the sensors. Shifting and rotational speeds of the mobile device may then be calculated using the modified optical flow vector values. For example, given a configuration where the first imaging sensor and the second imaging sensor face opposite directions on a single axis, a shifting speed is calculated in the following way: multiplying a first optical flow vector and a first distance estimate, thereby deriving a first modified optical flow vector value; multiplying a second optical flow vector and a second distance estimate, thereby deriving a second modified optical flow vector value; the second modified optical flow vector value may then be subtracted from the first modified optical flow vector value, resulting in a measurement of the shifting speed.

    摘要翻译: 使用设备中的成像传感器和传感器前面的对象或场景之间的距离估计来计算移动设备的线性和旋转速度。 距离估计用于修改传感器的光流向量。 然后可以使用修改的光学流向量值来计算移动设备的移动和转速。 例如,给出第一成像传感器和第二成像传感器在单个轴上面对相反方向的配置,以下列方式计算移动速度:将第一光流矢量与第一距离估计相乘,从而得到第一 修改光流向量值; 乘以第二光流矢量和第二距离估计,从而导出第二修改光流矢量值; 然后可以从第一修改的光学流向量值中减去第二修改的光学流向量值,从而得到移位速度的测量值。

    MULTIPLE INPUT AREAS FOR PEN-BASED COMPUTING
    6.
    发明申请
    MULTIPLE INPUT AREAS FOR PEN-BASED COMPUTING 审中-公开
    用于笔式计算的多个输入区域

    公开(公告)号:US20130088427A1

    公开(公告)日:2013-04-11

    申请号:US13270403

    申请日:2011-10-11

    IPC分类号: G06F3/033 G06F3/041

    摘要: Embodiments of the present invention disclose a pen-based computing system and method using multiple input areas. According to one embodiment, the system includes a mobile computing device having a display, and a pen input device configured to transmit a signal for determining a position of the pen device relative to the mobile computing device. A plurality of input areas are designated around the entire outer periphery of the display and the mobile computing device such that the presence or movement of the pen input device within any one of the plurality of input areas corresponds to an input operation on the mobile computing device.

    摘要翻译: 本发明的实施例公开了一种使用多个输入区域的基于笔的计算系统和方法。 根据一个实施例,系统包括具有显示器的移动计算设备和被配置为发送用于确定笔设备相对于移动计算设备的位置的信号的笔输入设备。 在显示器和移动计算设备的整个外围周围指定多个输入区域,使得在多个输入区域中的任何一个输入区域内的笔输入设备的存在或移动对应于移动计算设备上的输入操作 。

    DYNAMIC TEXT INPUT USING ON AND ABOVE SURFACE SENSING OF HANDS AND FINGERS
    7.
    发明申请
    DYNAMIC TEXT INPUT USING ON AND ABOVE SURFACE SENSING OF HANDS AND FINGERS 有权
    使用手表和表面上的表面感应的动态文本输入

    公开(公告)号:US20120260207A1

    公开(公告)日:2012-10-11

    申请号:US13081361

    申请日:2011-04-06

    IPC分类号: G06F3/048

    摘要: A virtual keyboard is displayed on a touch screen display surface of a computing device. Partial images of the keyboard are displayed, where a partial image may be one key, referred to as the most probable key that the user will touch, or a group of keys, which may include some less probable or surrounding keys that may be touched. Sensors under or near the display surface detect an outline of the user hands and determines which finger is the fastest moving finger, which is presumed to be the finger used to touch a key. The most probable key is determined based on the fastest moving finger and may be displayed before the finger touches the surface. If the most probable key is not touched, a user profile containing user typing habits may be updated to reflect that a less probable key was touched.

    摘要翻译: 虚拟键盘显示在计算设备的触摸屏显示表面上。 显示键盘的部分图像,其中部分图像可以是一个键,被称为用户将触摸的最可能的键,或者一组键,其可以包括可能被触摸的一些较不可能或周围的键。 显示表面下或附近的传感器检测用户手的轮廓,并确定哪个手指是最快的移动手指,其被推定为用于触摸键的手指。 最可能的键是基于最快的移动手指确定的,并且可以在手指触摸表面之前显示。 如果最不可能的键不被触摸,则可能会更新包含用户打字习惯的用户配置文件,以反映较少可能的密钥被触动。

    ACTUATED ADAPTIVE DISPLAY SYSTEMS
    9.
    发明申请
    ACTUATED ADAPTIVE DISPLAY SYSTEMS 审中-公开
    启动自适应显示系统

    公开(公告)号:US20120075166A1

    公开(公告)日:2012-03-29

    申请号:US12893868

    申请日:2010-09-29

    IPC分类号: G09G5/00

    摘要: Adjustable, adaptive display system having individual display elements is able to change its configuration based on a user's movements, position, and activities. A method of adjusting a display system tracking a user is tracked using a camera or other tracking sensor, thereby creating user-tracking data. The user-tracking data is input to an actuator signal module which generates input signals for one or more actuators. The input signals are created, in part, from the user-tracking data. Two or more display elements are actuated using the one or more actuators based on the input signals. The display elements may be planar or curved. In this manner, a configuration of the display system adapts to user movements and adjusts systematically. This provides for a greater amount of a user's human visual field (or user FOV) to be filled by the display system.

    摘要翻译: 具有各个显示元件的可调整的自适应显示系统能够基于用户的移动,位置和活动来改变其配置。 使用相机或其他跟踪传感器跟踪用于调整跟踪用户的显示系统的方法,从而创建用户跟踪数据。 用户跟踪数据被输入到产生用于一个或多个致动器的输入信号的致动器信号模块。 输入信号部分地由用户跟踪数据创建。 使用基于输入信号的一个或多个致动器致动两个或更多个显示元件。 显示元件可以是平面的或弯曲的。 以这种方式,显示系统的配置适应用户移动并系统地调整。 这提供了更多量的由显示系统填充的用户的人类视野(​​或用户FOV)。