公开(公告)号：US20190379885A1

公开(公告)日：2019-12-12

申请号：US16379182

申请日：2019-04-09

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael Scavezze ,  Arthur Tomlin ,  Rui Cai ,  Zhiwei Li

IPC: H04N13/344 ,  H04N13/128 ,  G06T7/30 ,  G06T7/70 ,  G06T7/55 ,  H04N13/239 ,  G06T17/10

Abstract: Sensor fusion is utilized in an electronic device such as a head mounted display (HMD) device that has a sensor package equipped with different sensors so that information that is supplemental to captured 2D images of objects or scenes in a real world environment may be utilized to determine an optimized transform of image stereo-pairs and to discard erroneous data that would otherwise prevent successful scans used for construction of a 3D model in, for example, virtual world applications. Such supplemental information can include one or more of world location, world rotation, image data from an extended field of view (FOV), or depth map data.

公开(公告)号：US10674142B2

公开(公告)日：2020-06-02

申请号：US16379182

申请日：2019-04-09

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael Scavezze ,  Arthur Tomlin ,  Rui Cai ,  Zhiwei Li

IPC: G06T19/00 ,  H04N13/344 ,  H04N13/128 ,  G06T7/30 ,  G06T7/70 ,  G06T7/55 ,  H04N13/239 ,  G06T17/10

Abstract: Sensor fusion is utilized in an electronic device such as a head mounted display (HMD) device that has a sensor package equipped with different sensors so that information that is supplemental to captured 2D images of objects or scenes in a real world environment may be utilized to determine an optimized transform of image stereo-pairs and to discard erroneous data that would otherwise prevent successful scans used for construction of a 3D model in, for example, virtual world applications. Such supplemental information can include one or more of world location, world rotation, image data from an extended field of view (FOV), or depth map data.

公开(公告)号：US10257505B2

公开(公告)日：2019-04-09

申请号：US15017799

申请日：2016-02-08

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael Scavezze ,  Arthur Tomlin ,  Rui Cai ,  Zhiwei Li

IPC: G06T17/00 ,  H04N13/344 ,  H04N13/128 ,  G06T17/10 ,  G06T7/30 ,  G06T7/70 ,  G06T7/55 ,  H04N13/239

Abstract: Sensor fusion is utilized in an electronic device such as a head mounted display (HMD) device that has a sensor package equipped with different sensors so that information that is supplemental to captured 2D images of objects or scenes in a real world environment may be utilized to determine an optimized transform of image stereo-pairs and to discard erroneous data that would otherwise prevent successful scans used for construction of a 3D model in, for example, virtual world applications. Such supplemental information can include one or more of world location, world rotation, image data from an extended field of view (FOV), or depth map data.

公开(公告)号：US09460122B2

公开(公告)日：2016-10-04

申请号：US13692922

申请日：2012-12-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Zhiwei Li ,  Lei Zhang ,  Rui Cai ,  Wei-Ying Ma ,  Heung-Yeung Shum

IPC: G06F17/30

CPC classification number: G06F17/3028 ,  G06F17/30448

Abstract: Described herein is a technology that facilitates efficient large-scale similarity-based retrieval. In several embodiments documents, images, and/or other multimedia files are compactly represented and efficiently indexed to enable robust search using a long-query in a large-scale corpus. As described herein, these techniques include performing decomposition of a file, e.g., an image, a document containing an image, or a document-like representation of an image. The techniques use dimension reduction to obtain three parts, low-dimensional representations (major semantics), file specific terms (minor semantics), and background words, representing the major semantics in a feature vector and the minor semantics as keywords. Using the techniques described, file vectors are matched in a topic model and the results ranked based on the keywords.

Abstract translation: 这里描述了一种有助于有效的大规模相似性检索的技术。 在几个实施例中，文档，图像和/或其他多媒体文件被紧凑地表示并且被有效地索引，以使得能够使用大规模语料库中的长查询进行鲁棒搜索。 如本文所述，这些技术包括执行文件的分解，例如图像，包含图像的文档或图像的文档样表示。 这些技术使用维度缩减来获得三维部分，低维表示（主要语义），文件特定术语（次要语义）和背景词，表示特征向量中的主要语义，并将次要语义作为关键字。 使用所描述的技术，在主题模型中匹配文件向量，并根据关键字对结果进行排名。

公开(公告)号：US09430478B2

公开(公告)日：2016-08-30

申请号：US14147200

申请日：2014-01-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Xiao Kong ,  Wei Wang ,  Rui Cai ,  Haifeng Li ,  Yanfeng Sun

IPC: G06F17/30

CPC classification number: G06F17/30047 ,  G06F17/30864 ,  G06F17/30867

Abstract: Anchor images and information associated therewith are accumulated during a Web crawling operation. One or more rules are applied to the accumulated candidate anchor images to filter out candidate anchor images that are not appropriate for use as the anchor image for a particular target video. The remaining candidate anchor image is then selected as the anchor image for the particular video.

Abstract translation: 锚网图像和与之相关的信息在Web爬行操作期间被累积。 一个或多个规则被应用于累积的候选锚图像以过滤不适合用作特定目标视频的锚图像的候选锚图像。 然后选择剩余的候选锚图像作为特定视频的定位图像。

公开(公告)号：US09338440B2

公开(公告)日：2016-05-10

申请号：US13919933

申请日：2013-06-17

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Zhiwei Li ,  Rui Cai ,  Jiawei Gu ,  Lei Zhang ,  Yong Rui

IPC: G06T19/00 ,  H04N5/232 ,  H04N13/02 ,  G06F3/00

CPC classification number: H04N13/282 ,  G06F3/00 ,  G06T19/006 ,  H04N5/23216 ,  H04N5/23293 ,  H04N13/221 ,  H04N13/296

Abstract: A method of acquiring a set of images useable to 3D model a physical object includes imaging the physical object with a camera, and displaying with the camera a current view of the physical object as imaged by the camera from a current perspective. The method further includes displaying with the camera a visual cue overlaying the current view and indicating perspectives from which the physical object is to be imaged to acquire the set of images.

Abstract translation: 获取可用于对物理对象进行3D建模的一组图像的方法包括用相机对物理对象进行成像，并且从当前的角度通过相机显示物理对象的当前视图。 该方法还包括用相机显示覆盖当前视图的视觉提示，并且指示要从其中成像物理对象的视角以获取该组图像。