摘要:
A method and system for generating a search request from a multimodal query that includes a query image and query text is provided. The multimodal query system identifies images of a collection that are textually related to the query image based on similarity between words associated with each image and the query text. The multimodal query system then selects those images of the identified images that are visually related to the query image. The multimodal query system may formulate a search request based on keywords of web pages that contain the selected images and submit that search request to a search engine service.
摘要:
A display system adapts a display page to a small display area using semantic information indicated by portions of the display page that are designated as cacheable. The display system adapts a display page by identifying leaf fragments, that is, fragments that contain no other fragments. The display system then determines whether each leaf fragment is a block that can be displayed as a unit in the display area or should be subdivided into blocks that each can be displayed as a unit in the display area. The display system then displays the display page on a block-by-block basis.
摘要:
A method and system for generating a search request from a multimodal query that includes a query image and query text is provided. The multimodal query system identifies images of a collection that are textually related to the query image based on similarity between words associated with each image and the query text. The multimodal query system then selects those images of the identified images that are visually related to the query image. The multimodal query system may formulate a search request based on keywords of web pages that contain the selected images and submit that search request to a search engine service.
摘要:
A system for learning an attention model for an image based on user navigation actions while viewing the image is provided. An attention model learning system generates an initial attention model based on static features derived from the image. The learning system logs the actions of users as they view the image. The learning system identifies from the actions of the users those areas of the image that may be of user interest: After the learning system identifies areas that may be of user interest, the learning system attempts to identify attention objects based on those identified areas. After identifying the user attention objects, the learning system updates the attention model for the image to reflect the additional information provided by the user attention objects.
摘要:
Methods and systems for selecting advertisements to present to a user of a computing device are provided. An advertisement system selects advertisements to display to a user based on the serving area of candidate advertisements. The advertisement system selects those candidate advertisements whose serving area encompasses the user's current location. The advertisement system may also select candidate advertisements to present to a user based on a map area currently being displayed to the user. The advertisement system may filter the candidate advertisements based on the provider location being within the map area that is currently being displayed to the user.
摘要:
A method and system for generating a hybrid index for indexing objects based on location and keyword attributes and performing location-based searching is provided. A search system performs a location-based search using a hybrid index that indexes both location and keyword attributes of objects. The search system generates the hybrid index either using the location attribute as the primary index or the keyword attribute as the primary index. When the location attribute is the primary index, the keyword attribute is the secondary index, and vice versa. To generate the hybrid index, the search system identifies the values for the keyword and location attributes of each object. The search system generates the primary index to map each value of a first attribute to a secondary index. The search system thus generates, for each value of the first attribute, a secondary index to map values of a second attribute to objects that have the associated values of the first and second attributes. The search system then uses the hybrid index to perform location-based searching.
摘要:
A method and system for searching for content relating to a target or query image by identifying duplicate images with associated content is provided. An image search system identifies visual parts of objects within the target image based on analysis of two or more versions of the target image. The image search system identifies visual parts based on analysis of the versions. The image search system then identifies images of an image database that have visual parts that are similar to the visual parts of the target image. The image search system may rank the identified images based on their likelihood of being duplicates of the target image and provide their associated content as the search result ordered according to the ranking of the images.
摘要:
Mining geographic knowledge using a location aware topic model is provided. A location system estimates topics and locations associated with documents based on a location aware topic (“LAT”) model. The location system generates the model from a collection of documents that are labeled with their associated locations. The location system generates collection level parameters based on an LDA-style model. To generate the collection level parameters, the location system estimates probabilities of latent topics, locations, and words of the collection. After the model is generated, the location system uses the collection level parameters to estimate probabilities of topics and locations being associated with target documents.
摘要:
A system for automatically classifying an object of a target image is provided. A classification system provides a collection of classified images along with a classification of the dominant object of the image. The classification system attempts to classify the object of a target image based on similarity of the target image to the classified images. To classify a target image, the classification system identifies the classified images of the collection that are most similar to the target image based on similarity between salient points of the target image and the classified images. The classification system selects a classification associated with the classified images that are most similar to the target image as a classification for the object of the target image.
摘要:
A blog-based city landmark discovery framework is described to discover and summarize popular scenes and their representative views from blog photos to provide online personalized tourist suggestions. First, a location extraction algorithm is implemented to infer geographical associations of blog photos from their contextual descriptors, thus providing the ability to harvest city scene photos from web blogs. Second, a visual-textual hierarchical clustering scheme is adopted to organize crawled photos into a scene-view structure, and present a PhotoRank algorithm to discover representative views within each scene by viewing the representative photo selection problem as a popularity ranking problem in a visual correlation environment. Third, author, context and content issues are evaluated in a unified Landmark-HITS model to discover representative scenes as well as build author correlations. The author correlations further facilitate a collaborative filtering process for online personalized tourist suggestions based on an author's previous travel logs.