Systems and methods for interacting with mobile devices using external displays
    1.
    发明授权
    Systems and methods for interacting with mobile devices using external displays 有权
    使用外部显示器与移动设备交互的系统和方法

    公开(公告)号:US08866699B2

    公开(公告)日:2014-10-21

    申请号:US12326767

    申请日:2008-12-02

    IPC分类号: G09G5/00 G06F3/14

    摘要: A system and method for interacting with a mobile device using an external display is disclosed, where a mobile device provides representations of an object and action to an external display for a user to select and then input back to the mobile device. An application on a mobile device provides representation data of an object and an action to a host system driving an external display. The host system arranges the representation data into a representation on the external display and allows the user to interact with the representations. The user then selects a representation and inputs the selected representation into the mobile device, where the application processes the representation to carry out the appropriate actions on the appropriate objects. The representation may be inputted to the mobile device using a photo of the representation taken by a mobile device camera, or by inputting a code provided with each representation on the external display.

    摘要翻译: 公开了一种使用外部显示器与移动设备进行交互的系统和方法,其中移动设备向外部显示器提供对象和动作的表示,供用户选择然后输入到移动设备。 移动设备上的应用将对象和动作的表示数据提供给驱动外部显示器的主机系统。 主机系统将表示数据排列在外部显示器上的表示中,并允许用户与表示进行交互。 然后,用户选择表示并将所选择的表示输入到移动设备中,其中应用处理该表示以对适当的对象执行适当的动作。 该表示可以使用移动设备摄像机所采用的表示的照片或者通过在外部显示器上输入与每个表示一起提供的代码来将其输入到移动设备。

    Systems and methods of capturing and organizing annotated content on a mobile device
    2.
    发明授权
    Systems and methods of capturing and organizing annotated content on a mobile device 有权
    在移动设备上捕获和组织注释内容的系统和方法

    公开(公告)号:US08380040B2

    公开(公告)日:2013-02-19

    申请号:US13185396

    申请日:2011-07-18

    IPC分类号: H04N5/77 H04N5/93

    摘要: Systems and methods are provided for capturing, annotating, organizing and sharing content captured by a mobile device. The content may represent meeting notes on a whiteboard and may be captured by a camera on the mobile device, or by using specialized whiteboard capture software. Regions of the content where a user wishes to add annotations are then identified, after which the user adds annotations, such as written or audio annotations, to the identified regions. The annotated content is then organized into a specific sequence in which the content and the annotations will be presented, and a video is created from the sequence so that the annotated content can be easily shared with, and understood by, other users.

    摘要翻译: 提供了系统和方法来捕获,注释,组织和共享移动设备捕获的内容。 内容可以表示白板上的会议笔记,并且可以由移动设备上的相机捕获,或者通过使用专门的白板捕获软件。 然后识别用户希望添加注释的内容的区域,之后用户向所识别的区域添加诸如书面或音频注释的注释。 然后将注释的内容组织成其中将呈现内容和注释的特定序列,并且从序列创建视频,使得注释的内容可以容易地与其他用户共享并被其他用户理解。

    Image matching in support of mobile navigation

    公开(公告)号:US09683853B2

    公开(公告)日:2017-06-20

    申请号:US12359222

    申请日:2009-01-23

    摘要: Method, apparatus and system for improving navigation using mobile devices by adding previously captured media to navigation maps provided by mobile device. Added media include still images and video clips. Media captured at the same location using various camera orientations are available in an image database. Images in database include metadata indicating location, orientation and other parameters associated with each image. User location and pose are matched against metadata indicating location and camera orientation of captured images. User motion may also be matched to metadata indicating camera motion of stored video clips. Other parameters like lighting, seasonal factors, and tasks of walking, biking or driving may also be matched. User pose may be derived from an accelerometer embedded in the mobile device. Some or all of user parameters desired by user may be directly input to mobile device by user instead of being automatically detected by mobile device.

    Efficient, user-friendly system to stream screens inside video using a mobile device
    4.
    发明授权
    Efficient, user-friendly system to stream screens inside video using a mobile device 有权
    高效,用户友好的系统使用移动设备流式传输视频内的屏幕

    公开(公告)号:US08934024B2

    公开(公告)日:2015-01-13

    申请号:US12687831

    申请日:2010-01-14

    摘要: A system helps filter and correct video captured and streamed from a mobile device. In particular, the system detects and streams content shown on screens, allowing anyone to stream screen content immediately without needing to develop hooks into external software (i.e. without installing a screen recorder software in the computer). The system can use a variety of user-selectable techniques to detect the screen, and utilizes the mobile device's touchscreen to allow users to manually override detected corners. However, some of these approaches could potentially be applied to other types of content, such as identifying TV screens, appliance LCD screens, other mobile devices' screens, multifunction devices. (e.g. a remote technician could help troubleshoot a malfunctioning MFD by having the end-user point his cellphone to the LCD screen of the MFD).

    摘要翻译: 系统有助于过滤和纠正从移动设备捕获和流式传输的视频。 特别地,系统检测并流式传输显示在屏幕上的内容,允许任何人立即流式传输屏幕内容,而无需将钩子开发到外部软件(即不在计算机中安装屏幕录像机软件)。 该系统可以使用各种用户可选择的技术来检测屏幕,并利用移动设备的触摸屏来允许用户手动覆盖检测到的角落。 然而,这些方法中的一些可能可能应用于其他类型的内容,例如识别电视屏幕,设备LCD屏幕,其他移动设备屏幕,多功能设备。 (例如,远程技术人员可以通过使终端用户将其手机指向MFD的LCD屏幕来帮助排除故障MFD)。

    Systems and Methods for Instructional Video Navigation and Note Taking
    7.
    发明申请
    Systems and Methods for Instructional Video Navigation and Note Taking 有权
    教学视频导航系统与方法及注意事项

    公开(公告)号:US20140099071A1

    公开(公告)日:2014-04-10

    申请号:US13647248

    申请日:2012-10-08

    IPC分类号: H04N9/87

    摘要: A method for navigating instructional video presentations is disclosed. The method includes determining a pause mode of a video presentation, and playing the video presentation on a display device. The video presentation has one or more predetermined pause positions. The method also includes, while playing the video presentation, determining that the video presentation has reached one of the one or more pause positions. The method further includes, in accordance with a determination that the video presentation is in a first pause mode, pausing the video presentation at the one of the one or more pause positions and maintaining a display of a paused frame of the video presentation, and, in accordance with a determination that the video presentation is in a second pause mode distinct from the first pause mode, continuing to play the video presentation through the one of the one or more pause positions.

    摘要翻译: 公开了用于导航教学视频演示的方法。 该方法包括确定视频呈现的暂停模式,以及在显示装置上播放视频呈现。 视频呈现具有一个或多个预定的暂停位置。 该方法还包括在播放视频呈现时确定视频呈现已经达到一个或多个暂停位置中的一个。 所述方法还包括:根据所述视频呈现处于第一暂停模式的确定,暂停所述一个或多个暂停位置中的所述一个或多个暂停位置中的所述一个处的所述视频呈现,并且保持所述视频呈现的暂停帧的显示, 根据与第一暂停模式不同的第二暂停模式的确定,继续通过一个或多个暂停位置中的一个播放视频呈现。

    Systems and methods for document navigation with a text-to-speech engine
    8.
    发明授权
    Systems and methods for document navigation with a text-to-speech engine 有权
    使用文本到语音引擎的文档导航的系统和方法

    公开(公告)号:US08484028B2

    公开(公告)日:2013-07-09

    申请号:US12258303

    申请日:2008-10-24

    IPC分类号: G10L13/08

    CPC分类号: G06F17/2235 G10L13/00

    摘要: A system for visually navigating a document in conjunction with a text-to-speech (“TTS) engine presents a visual display of a region of interest that is related to the text of the document that is being audibly presented as speech to a user. When the TTS engine converts the text to speech and presents the speech to the user, the system presents the corresponding section of text on a display. During the presentation, if the system encounters a linked section of text, the visual display changes to display a linked region of interest that corresponds to the linked section of text.

    摘要翻译: 与文本到语音(“TTS”)引擎结合的用于视觉浏览文档的系统呈现与将被声音呈现为用户的文档的文本相关的感兴趣区域的视觉显示。 当TTS引擎将文本转换为语音并向用户呈现语音时,系统在显示屏上显示相应的文本部分,在演示过程中,如果系统遇到链接部分的文本,则视觉显示更改为显示 与文本的链接部分相对应的关联区域。

    IMAGE MATCHING IN SUPPORT OF MOBILE NAVIGATION
    9.
    发明申请
    IMAGE MATCHING IN SUPPORT OF MOBILE NAVIGATION 有权
    支持移动导航的图像匹配

    公开(公告)号:US20100191459A1

    公开(公告)日:2010-07-29

    申请号:US12359222

    申请日:2009-01-23

    摘要: Method, apparatus and system for improving navigation using mobile devices by adding previously captured media to navigation maps provided by mobile device. Added media include still images and video clips. Media captured at the same location using various camera orientations are available in an image database. Images in database include metadata indicating location, orientation and other parameters associated with each image. User location and pose are matched against metadata indicating location and camera orientation of captured images. User motion may also be matched to metadata indicating camera motion of stored video clips. Other parameters like lighting, seasonal factors, and tasks of walking, biking or driving may also be matched. User pose may be derived from an accelerometer embedded in the mobile device. Some or all of user parameters desired by user may be directly input to mobile device by user instead of being automatically detected by mobile device.

    摘要翻译: 用于通过将先前捕获的媒体添加到由移动设备提供的导航地图来改进使用移动设备的导航的方法,装置和系统。 添加的媒体包括静态图像和视频剪辑。 使用各种相机方向在相同位置拍摄的媒体在图像数据库中可用。 数据库中的图像包括指示与每个图像相关联的位置,方向和其他参数的元数据 用户位置和姿势与表示拍摄图像的位置和相机方向的元数据进行匹配。 用户运动也可以与指示存储的视频剪辑的相机运动的元数据相匹配。 其他参数,如照明,季节因素,步行,骑车或驾驶的任务也可能相匹配。 用户姿态可以从嵌入在移动设备中的加速度计导出。 用户期望的一些或全部用户参数可以由用户直接输入到移动设备,而不是由移动设备自动检测。

    Systems and methods for instructional video navigation and note taking
    10.
    发明授权
    Systems and methods for instructional video navigation and note taking 有权
    教学视频导航和笔记的系统和方法

    公开(公告)号:US09137509B2

    公开(公告)日:2015-09-15

    申请号:US13647248

    申请日:2012-10-08

    摘要: A method for navigating instructional video presentations is disclosed. The method includes determining a pause mode of a video presentation, and playing the video presentation on a display device. The video presentation has one or more predetermined pause positions. The method also includes, while playing the video presentation, determining that the video presentation has reached one of the one or more pause positions. The method further includes, in accordance with a determination that the video presentation is in a first pause mode, pausing the video presentation at the one of the one or more pause positions and maintaining a display of a paused frame of the video presentation, and, in accordance with a determination that the video presentation is in a second pause mode distinct from the first pause mode, continuing to play the video presentation through the one of the one or more pause positions.

    摘要翻译: 公开了用于导航教学视频演示的方法。 该方法包括确定视频呈现的暂停模式,以及在显示装置上播放视频呈现。 视频呈现具有一个或多个预定的暂停位置。 该方法还包括在播放视频呈现时确定视频呈现已经达到一个或多个暂停位置中的一个。 所述方法还包括:根据所述视频呈现处于第一暂停模式的确定,暂停所述一个或多个暂停位置中的所述一个或多个暂停位置中的所述一个处的所述视频呈现,并且保持所述视频呈现的暂停帧的显示, 根据与第一暂停模式不同的第二暂停模式的确定,继续通过一个或多个暂停位置中的一个播放视频呈现。