摘要:
A system and method for interacting with a mobile device using an external display is disclosed, where a mobile device provides representations of an object and action to an external display for a user to select and then input back to the mobile device. An application on a mobile device provides representation data of an object and an action to a host system driving an external display. The host system arranges the representation data into a representation on the external display and allows the user to interact with the representations. The user then selects a representation and inputs the selected representation into the mobile device, where the application processes the representation to carry out the appropriate actions on the appropriate objects. The representation may be inputted to the mobile device using a photo of the representation taken by a mobile device camera, or by inputting a code provided with each representation on the external display.
摘要:
Systems and methods are provided for capturing, annotating, organizing and sharing content captured by a mobile device. The content may represent meeting notes on a whiteboard and may be captured by a camera on the mobile device, or by using specialized whiteboard capture software. Regions of the content where a user wishes to add annotations are then identified, after which the user adds annotations, such as written or audio annotations, to the identified regions. The annotated content is then organized into a specific sequence in which the content and the annotations will be presented, and a video is created from the sequence so that the annotated content can be easily shared with, and understood by, other users.
摘要:
A system and method for identifying key frames of a presentation video that include stationary informational content. A sequence of frames is obtained from a presentation video and differences of pixel values between consecutive frames of the sequence of frames are computed. Sets of consecutive frames that are stationary are identified, wherein consecutive frames that are stationary have a proportion of changed pixel values below a first predetermined threshold, and wherein pixel values are deemed to be changed when the difference between the pixel values for corresponding pixels in consecutive frames exceeds a second predetermined threshold. Next, a set of key frames that include stationary informational content is retained. The set of key frames that include stationary informational content is then displayed for user interaction.
摘要:
Blogs (and other information sources) are recommended to a user based history of user's online activities. The system: (1) processes the user's web history, (2) identifies blog posts (and web pages) that link to pages read by the user, (3) generates multiple relevance scores for each identified post/page, and (4) produces multiple rankings of the corresponding source blogs (and web sites) by aggregating individual relevance scores (or combinations of relevance scores), according to users' preferences. The system allows the discovery of information sources that are likely to be interesting to the user and allows sources lost in the “long tail” to be seamlessly discovered.
摘要:
A system helps filter and correct video captured and streamed from a mobile device. In particular, the system detects and streams content shown on screens, allowing anyone to stream screen content immediately without needing to develop hooks into external software (i.e. without installing a screen recorder software in the computer). The system can use a variety of user-selectable techniques to detect the screen, and utilizes the mobile device's touchscreen to allow users to manually override detected corners. However, some of these approaches could potentially be applied to other types of content, such as identifying TV screens, appliance LCD screens, other mobile devices' screens, multifunction devices. (e.g. a remote technician could help troubleshoot a malfunctioning MFD by having the end-user point his cellphone to the LCD screen of the MFD).
摘要:
Techniques are provided for determining collaborative notes and automatically recognizing speech, handwriting and other type of information. Domain and optional actor/speaker information associated with the support information is determined. An initial automatic speech recognition model is determined based on the domain and/or actor information. The domain and/or actor/speaker language model is used to recognize text in the speech information associated with the support information. Presentation support information such as slides, speaker notes and the like are determined. The semantic overlap between the support information and the salient non-function words in the recognized text and collaborative user feedback information are used to determine relevancy scores for the recognized text. Grammaticality, well formedness, self referential integrity and other features are used to determine correctness scores. Suggested collaborative notes are displayed in the user interface based on the salient non-function words. User actions in the user interface determine feedback signals. Recognition models such as automatic speech recognition, handwriting recognition are determined based on the feedback signals and the correctness and relevance scores.
摘要:
A user-machine interface is disclosed that uses a line to connect and/or to intersect various objects displayed on a screen. A start of the line may identify a source, an end of the line may identify a sink, and line shapes and/or objects intersected by the line may identify commands.
摘要:
A method of classifying images as slide images or non-slide images can be done by capturing a video stream, analyzing an image of the video stream and determining whether the image is a slide image. The analyzing can be based on text height and/or edge region(s) of the image.
摘要:
A Graphical User Interface (“GUI”) that provides a user with the ability to manipulate display objects in a non-uniform manner on a display surface is provided. For example, a user can manipulate an object so that it appears, torn, bent, folded, angled, etc. Additionally, a method and system for digitally attaching display objects to a display surface is described. The attachments include digital staples, digital push-pins, digital tape, etc. In still another aspect of the present invention a technique for transmitting and updating the display of non-uniform objects is described.