公开(公告)号：US09852156B2

公开(公告)日：2017-12-26

申请号：US12855563

申请日：2010-08-12

申请人： David Petrou ,  John Flynn ,  Hartwig Adam ,  Hartmut Neven

发明人： David Petrou ,  John Flynn ,  Hartwig Adam ,  Hartmut Neven

IPC分类号： G06F17/30 ,  H04W4/02 ,  H04W64/00

CPC分类号： G06F17/30247 ,  G06F17/30241 ,  G06F17/30389 ,  G06F17/30528 ,  H04W4/02 ,  H04W64/00

摘要： A visual query is received from a client system, along with location information for the client system, and processed by a server system. The server system sends the visual query and the location information to a visual query search system, and receives from the visual query search system enhanced location information based on the visual query and the location information. The server system then sends a search query, including the enhanced location information, to a location-based search system. The search system receives and provides to the client one or more search results to the client system.

公开(公告)号：US09137308B1

公开(公告)日：2015-09-15

申请号：US13346529

申请日：2012-01-09

申请人： David Petrou ,  Laura Garcia-Barrio ,  Hartmut Neven ,  Hartwig Adam

发明人： David Petrou ,  Laura Garcia-Barrio ,  Hartmut Neven ,  Hartwig Adam

IPC分类号： G06F15/16 ,  H04L29/08 ,  G06F17/30

CPC分类号： H04L67/12 ,  G06F17/30 ,  H04W4/043 ,  H04W4/185

摘要： A method and apparatus for enabling media data capture based on a real-world user experience is described herein. According to embodiments of the invention, media data is captured by a mobile computing device and transmitted to a server computer system in response to identifying one or more events from sensor data. The server computer system adds the captured media data, along with data identifying the event that initiated the capture of the media data, to a history of real-world experiences of a user of the mobile computing device. The server computer system may further perform one or more recognition processes on the captured media data and, when the one or more recognition processes find a match, associate the recognized items to the captured media data.

摘要翻译： 本文描述了一种基于真实用户体验实现媒体数据捕获的方法和装置。 根据本发明的实施例，响应于识别来自传感器数据的一个或多个事件，媒体数据由移动计算设备捕获并被发送到服务器计算机系统。 服务器计算机系统将所捕获的媒体数据以及识别发起媒体数据捕获的事件的数据与移动计算设备的用户的真实体验的历史相加。 服务器计算机系统可以进一步对所捕获的媒体数据执行一个或多个识别过程，并且当一个或多个识别过程找到匹配时，将所识别的项目与所捕获的媒体数据相关联。

公开(公告)号：US08659433B2

公开(公告)日：2014-02-25

申请号：US13529959

申请日：2012-06-21

申请人： David Petrou

发明人： David Petrou

IPC分类号： G08B23/00

CPC分类号： G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G06F1/163 ,  G06F3/011 ,  G06F3/012 ,  G06F21/32 ,  G06F21/88 ,  H04W12/06

摘要： A wearable computer determines unnatural movements of a head-mounted display (HMD) and triggers a locking mechanism. In one embodiment, the wearable computer receives movement data from one or more sensors and determines that the movement of the HMD is unnatural. In one embodiment, the wearable computer receives movement data from one or more sensors and determines that the HMD is being worn by an unauthorized user. In response to determining an unnatural movement and/or an unauthorized user wearing the HMD, the wearable computer triggers a locking mechanism, which can beneficially provide security measures for the wearable computer.

摘要翻译： 可戴式计算机确定头戴式显示器（HMD）的不自然的移动并触发锁定机构。 在一个实施例中，可穿戴计算机从一个或多个传感器接收移动数据，并确定HMD的移动是不自然的。 在一个实施例中，可穿戴计算机从一个或多个传感器接收运动数据，并确定HMD正在被未经授权的用户佩戴。 响应于确定不自然的运动和/或穿戴HMD的未经授权的用户，可穿戴计算机触发锁定机构，其可以有益地为可穿戴式计算机提供安全措施。

公开(公告)号：US20130027572A1

公开(公告)日：2013-01-31

申请号：US13523832

申请日：2012-06-14

申请人： David Petrou

发明人： David Petrou

IPC分类号： G09G5/00 ,  G06F3/041 ,  H04N5/225

CPC分类号： G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/03547

摘要： A head-mounted display (HMD) displays a visual representation of a physical interaction with an input interface that is located outside of the field of view. In one embodiment, the visual representation includes symbols that indicate when close proximity or physical contact is made with the input interface. In another embodiment, the visual representation is a simulation of the physical interaction with the input interface. The visual representation displayed by the HMD can beneficially enable the wearer to interact with the input interface more efficiently.

摘要翻译： 头戴式显示器（HMD）显示与位于视野外的输入接口的物理交互的可视化表示。 在一个实施例中，视觉表示包括指示何时使用输入接口进行近距离或物理接触的符号。 在另一个实施例中，视觉表示是与输入接口的物理交互的模拟。 由HMD显示的视觉表示可以有利地使佩戴者更有效地与输入界面交互。

公开(公告)号：US08217856B1

公开(公告)日：2012-07-10

申请号：US13191873

申请日：2011-07-27

申请人： David Petrou

发明人： David Petrou

IPC分类号： G09G5/00

CPC分类号： G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/03547

摘要： A head-mounted display (HMD) displays a visual representation of a physical interaction with an input interface that is located outside of the field of view. In one embodiment, the visual representation includes symbols that indicate when close proximity or physical contact is made with the input interface. In another embodiment, the visual representation is a simulation of the physical interaction with the input interface. The visual representation displayed by the HMD can beneficially enable the wearer to interact with the input interface more efficiently.

摘要翻译： 头戴式显示器（HMD）显示与位于视野外的输入接口的物理交互的可视化表示。 在一个实施例中，视觉表示包括指示何时使用输入接口进行近距离或物理接触的符号。 在另一个实施例中，视觉表示是与输入接口的物理交互的模拟。 由HMD显示的视觉表示可以有利地使佩戴者更有效地与输入界面交互。

公开(公告)号：US20120134590A1

公开(公告)日：2012-05-31

申请号：US13309484

申请日：2011-12-01

申请人： David Petrou ,  Ashok C. Popat ,  Matthew R. Casey

发明人： David Petrou ,  Ashok C. Popat ,  Matthew R. Casey

IPC分类号： G06K9/18

CPC分类号： G06F17/3087 ,  G06F17/30253 ,  G06K9/00483 ,  G06K9/72 ,  G06K2209/01

摘要： A server system receives a visual query from a client system distinct from the server system. The server system performs optical character recognition (OCR) on the visual query to produce text recognition data representing textual characters, including a plurality of textual characters in a contiguous region of the visual query. The server system scores each textual character in the plurality of textual characters in accordance with the geographic location of the client system. The server system identifies, in accordance with the scoring, one or more high quality textual strings, each comprising a plurality of high quality textual characters from among the plurality of textual characters in the contiguous region of the visual query. Then the server system retrieves a canonical document having the one or more high quality textual strings and sends at least a portion of the canonical document to the client system.

摘要翻译： 服务器系统从与服务器系统不同的客户端系统接收可视化查询。 服务器系统在视觉查询上执行光学字符识别（OCR）以产生表示文本字符的文本识别数据，包括视觉查询的连续区域中的多个文本字符。 服务器系统根据客户端系统的地理位置对多个文本字符中的每个文本字符进行分数。 服务器系统根据评分识别一个或多个高质量的文本字符串，每个文本字符串包括来自视觉查询的连续区域中的多个文本字符中的多个高质量文本字符。 然后，服务器系统检索具有一个或多个高质量文本字符串的规范文档，并将规范文档的至少一部分发送给客户端系统。

公开(公告)号：US07958128B2

公开(公告)日：2011-06-07

申请号：US12837206

申请日：2010-07-15

申请人： David Petrou ,  Chiu-Ki Chan ,  Daniel Loreto ,  Jeffrey C. Reynar ,  Nikola Jevtic

发明人： David Petrou ,  Chiu-Ki Chan ,  Daniel Loreto ,  Jeffrey C. Reynar ,  Nikola Jevtic

IPC分类号： G06F17/30

CPC分类号： G06F17/30864 ,  G06F17/30657

摘要： A corpus contains information including text from books and metadata about the books. The book texts mention entities of various types, such as location, date, event, and person entities. An entity importance engine analyzes the information in the corpus to identify the entities mentioned therein, and ranks the entities using query-independent importance scores. The importance scores can be based in part on the contexts in which the entities are mentioned by the books. A presentation engine enables searching of the corpus to identify books satisfying a search query. The presentation engine presents information about a designated book. Entities mentioned in the book are presented in a style selected to enhance comprehension and utility. For example, location entities can be presented on a map with markers showing the locations of the entities. The number of entities presented are limited and ordered based on the query-independent importance scores.

摘要翻译： 语料库包含有书籍的文字和有关书籍的元数据的信息。 书本提到各种类型的实体，如位置，日期，事件和个人实体。 实体重要性引擎分析语料库中的信息以识别其中提到的实体，并且使用与查询无关的重要性得分对实体进行排序。 重要性分数可以部分地基于实体被书籍提及的背景。 演示文稿引擎可以搜索语料库来识别满足搜索查询的书籍。 演示文稿引擎提供有关指定书籍的信息。 本书中提到的实体以选择加强理解和实用性的风格呈现。 例如，位置实体可以在具有显示实体的位置的标记的地图上呈现。 所提出的实体数量是有限的，并且基于与查询无关的重要性分数进行排序。

公开(公告)号：US09262780B2

公开(公告)日：2016-02-16

申请号：US13346549

申请日：2012-01-09

申请人： David Petrou ,  Hartwig Adam ,  Laura Garcia-Barrio ,  Hartmut Neven

发明人： David Petrou ,  Hartwig Adam ,  Laura Garcia-Barrio ,  Hartmut Neven

IPC分类号： G06Q30/00 ,  G06F17/30 ,  G06Q30/06

CPC分类号： G06Q30/0623 ,  G06Q30/06

摘要： A method and apparatus for enabling dynamic product and vendor identification and the display of relevant purchase information are described herein. According to embodiments of the invention, a recognition process is executed on sensor data captured via a mobile computing device to identify one or more items, and to identify at least one product associated with the one or more items. Product and vendor information for the at least one product is retrieved and displayed via the mobile computing device. In the event a user gesture is detected in response to displaying the product and vendor information data, processing logic may submit a purchase order for the product (e.g., for an online vendor) or contact the vendor (e.g., for an in-store vendor).

摘要翻译： 本文描述了用于实现动态产品和供应商识别以及相关购买信息的显示的方法和装置。 根据本发明的实施例，对通过移动计算设备捕获的传感器数据执行识别过程以识别一个或多个项目，并且识别与一个或多个项目相关联的至少一个产品。 通过移动计算设备检索和显示至少一个产品的产品和供应商信息。 在响应于显示产品和供应商信息数据而检测到用户手势的情况下，处理逻辑可以提交产品的购买订单（例如，对于在线供应商）或联系供应商（例如，用于店内供应商 ）。

公开(公告)号：US09087059B2

公开(公告)日：2015-07-21

申请号：US12850513

申请日：2010-08-04

申请人： David Petrou ,  Theodore Power

发明人： David Petrou ,  Theodore Power

IPC分类号： G06F17/30

CPC分类号： G06F17/3005 ,  G06F17/30047

摘要： A visual query such as a photograph, screen shot, scanned image, or video frame is submitted to a visual query search system from a client system. The search system processes the visual query by sending it to a plurality of parallel search systems, each implementing a distinct visual query search process. A plurality of results is received from the parallel search systems. Utilizing the search results, an interactive results document is created and sent to the client system. The interactive results document has at least one visual identifier for a sub-portion of the visual query with a selectable link to at least one search result for that sub-portion. The visual identifier may be a bounding box around the respective sub-portion, or a semi-transparent label over the respective sub-portion. Optionally, the bounding box or label is color coded by type of result.

摘要翻译： 诸如照片，屏幕截图，扫描图像或视频帧的视觉查询从客户端系统提交到视觉查询搜索系统。 搜索系统通过将视觉查询发送到多个并行搜索系统来处理视觉查询，每个并行搜索系统实现不同的可视查询搜索过程。 从并行搜索系统接收到多个结果。 利用搜索结果，创建交互式结果文档并将其发送到客户端系统。 交互式结果文档具有至少一个视觉查询的子部分的视觉标识符，其具有至少一个该子部分的搜索结果的可选链接。 视觉标识符可以是围绕相应子部分的边界框，也可以是相应子部分上的半透明标签。 可选地，边界框或标签由结果类型进行颜色编码。

公开(公告)号：US08977639B2

公开(公告)日：2015-03-10

申请号：US12854793

申请日：2010-08-11

申请人： David Petrou ,  Avi Flamholz ,  Matthew R. Casey ,  Theodore Power

发明人： David Petrou ,  Avi Flamholz ,  Matthew R. Casey ,  Theodore Power

IPC分类号： G06F17/30

CPC分类号： G06F17/30861

摘要： A server system receives a visual query and identifies an entity in the visual query. The server system further identifies a client-side action corresponding to the identified entity and creates an actionable search result element configured to launch the client-side action. Examples of actionable search result elements are buttons to initiate a telephone call, to initiate email message, to map an address, to make a restaurant reservation, and to provide an option to purchase a product. The entity identified in the visual query may be indirectly associated with a client-side action whose contact address or appropriate link is found in a search result associated with the identified entity. The client system receives and displays the actionable search result element, and upon a user selection of the actionable search result element, launches the client-side action in an application distinct from the visual query client application.

摘要翻译： 服务器系统接收可视化查询并识别视觉查询中的实体。 服务器系统还识别与所识别的实体相对应的客户端动作，并创建配置成启动客户端动作的可操作的搜索结果元素。 可操作的搜索结果元素的示例是发起电话呼叫，发起电子邮件消息，映射地址，进行餐厅预约以及提供购买产品的选项的按钮。 在视觉查询中标识的实体可以间接地与客户端动作间接地相关联，其联系人地址或适当链接在与所识别的实体相关联的搜索结果中找到。 客户端系统接收并显示可操作的搜索结果元素，并且在用户选择可操作搜索结果元素时，在不同于视觉查询客户端应用的应用中启动客户端操作。