-
公开(公告)号:US20170126977A1
公开(公告)日:2017-05-04
申请号:US15012106
申请日:2016-02-01
Applicant: Apple Inc.
Inventor: Jason Klivington , Rudolph van der Merwe
CPC classification number: H04N5/23267 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/248 , G06T7/262 , G06T7/285 , H04N5/23254
Abstract: A method of removing unwanted camera motion from a video sequence is provided. The method matches a group of feature points between each pair of consecutive video frames in the video sequence. The method calculates the motion of each matched feature point between the corresponding pair of consecutive video frames. The method calculates a set of historical metrics for each feature point. The method, for each pair of consecutive video frames, identifies a homography that defines a dominant motion between the pair of consecutive frames. The homography is identified by performing a geometrically biased historically weighted RANSAC on the calculated motion of the feature points. The geometrically biased historically weighted RANSAC gives a weight to the calculated motion of each feature point based on the historical metrics calculated for the feature point. The method removes the unwanted camera motion from the video sequence using the identified homographies.
-
12.
公开(公告)号:US09542585B2
公开(公告)日:2017-01-10
申请号:US13911983
申请日:2013-06-06
Applicant: Apple Inc.
Inventor: George Williams , Benjamin Olson , Sebastien Beysserie , Ethan Tira-Thompson , Jianping Zhou , Claus Molgaard , Todd Sachs , Rudolph van der Merwe , Marco Zuliani
CPC classification number: G06K7/1443 , G06K7/10722 , G06K9/3233 , G06K9/6203 , G06K2009/3291 , G06K2209/21 , G06T7/20
Abstract: A method to improve the efficiency of the detection and tracking of machine-readable objects is disclosed. The properties of image frames may be pre-evaluated to determine whether a machine-readable object, even if present in the image frames, would be likely to be detected. After it is determined that one or more image frames have properties that may enable the detection of a machine-readable object, image data may be evaluated to detect the machine-readable object. When a machine-readable object is detected, the location of the machine-readable object in a subsequent frame may be determined based on a translation metric between the image frame in which the object was identified and the subsequent frame rather than a detection of the object in the subsequent frame. The translation metric may be identified based on an evaluation of image data and/or motion sensor data associated with the image frames.
Abstract translation: 公开了一种提高机器可读对象检测和跟踪效率的方法。 可以预先评估图像帧的属性,以确定即使存在于图像帧中的机器可读对象是否可能被检测到。 在确定一个或多个图像帧具有能够检测机器可读对象的属性之后,可以评估图像数据以检测机器可读对象。 当检测到机器可读对象时,可以基于在其中识别对象的图像帧与后续帧之间的转换度量而不是对象的检测来确定随后帧中的机器可读对象的位置 在后续的框架。 可以基于与图像帧相关联的图像数据和/或运动传感器数据的评估来识别翻译度量。
-
公开(公告)号:US09268985B2
公开(公告)日:2016-02-23
申请号:US14703165
申请日:2015-05-04
Applicant: Apple Inc.
Inventor: Rudolph van der Merwe , Samuel G. Noble
CPC classification number: G06K7/12 , G06K19/06037 , G06K19/06112 , G07F7/1008 , G09G3/2018 , G09G5/00 , G09G5/02 , G09G2358/00 , H04B10/116 , H04L67/141 , H04N1/00334 , H04N1/32149 , H04N2201/3267 , H04N2201/3269 , H04N2201/327 , H04N2201/3271
Abstract: Embodiments of the present disclosure provide a method and system for sharing information between a first computing device and a second computing device. In the described embodiments, an optical label, such as, for example a QR code, is generated on the first computing device. In embodiments, the optical label is color encoded and displayed in such a way that the optical label is not perceptible to a user. The second computing device may capture the encoded optical label and subject the captured images to a processing technique that decodes the encoded optical label.
-
14.
公开(公告)号:US20140363044A1
公开(公告)日:2014-12-11
申请号:US13911983
申请日:2013-06-06
Applicant: Apple Inc.
Inventor: George Williams , Benjamin Olson , Sebastien Beysserie , Ethan Tira-Thompson , Jianping Zhou , Claus Molgaard , Todd Sachs , Rudolph van der Merwe , Marco Zuliani
IPC: G06K9/00
CPC classification number: G06K7/1443 , G06K7/10722 , G06K9/3233 , G06K9/6203 , G06K2009/3291 , G06K2209/21 , G06T7/20
Abstract: A method to improve the efficiency of the detection and tracking of machine-readable objects is disclosed. The properties of image frames may be pre-evaluated to determine whether a machine-readable object, even if present in the image frames, would be likely to be detected. After it is determined that one or more image frames have properties that may enable the detection of a machine-readable object, image data may be evaluated to detect the machine-readable object. When a machine-readable object is detected, the location of the machine-readable object in a subsequent frame may be determined based on a translation metric between the image frame in which the object was identified and the subsequent frame rather than a detection of the object in the subsequent frame. The translation metric may be identified based on an evaluation of image data and/or motion sensor data associated with the image frames.
Abstract translation: 公开了一种提高机器可读对象检测和跟踪效率的方法。 可以预先评估图像帧的属性,以确定即使存在于图像帧中的机器可读对象是否可能被检测到。 在确定一个或多个图像帧具有能够检测机器可读对象的属性之后,可以评估图像数据以检测机器可读对象。 当检测到机器可读对象时,可以基于在其中识别对象的图像帧与后续帧之间的转换度量而不是对象的检测来确定随后帧中的机器可读对象的位置 在后续的框架。 可以基于与图像帧相关联的图像数据和/或运动传感器数据的评估来识别翻译度量。
-
公开(公告)号:US20140247280A1
公开(公告)日:2014-09-04
申请号:US13783082
申请日:2013-03-01
Applicant: APPLE INC.
Inventor: Christopher G. Nicholas , Lukas M. Marti , Rudolph van der Merwe , John Kassebaum
IPC: G06T19/00
CPC classification number: G06T19/006 , G06F3/011
Abstract: A user interface enables a user to calibrate the position of a three dimensional model with a real-world environment represented by that model. Using a device's sensor suite, the device's location and orientation is determined. A video image of the device's environment is displayed on the device's display. The device overlays a representation of an object from a virtual reality model on the video image. The position of the overlaid representation is determined based on the device's location and orientation. In response to user input, the device adjusts a position of the overlaid representation relative to the video image.
Abstract translation: 用户界面使得用户能够用由该模型表示的现实环境来校准三维模型的位置。 使用设备的传感器套件,确定设备的位置和方向。 设备的环境的视频图像显示在设备的显示屏上。 该设备在视频图像上覆盖来自虚拟现实模型的对象的表示。 重叠表示的位置是根据设备的位置和方向来确定的。 响应于用户输入,设备调整相对于视频图像的重叠表示的位置。
-
公开(公告)号:US11196943B2
公开(公告)日:2021-12-07
申请号:US16653704
申请日:2019-10-15
Applicant: Apple Inc.
Inventor: Shuang Gao , Vasilios E. Anton , Robert A. Bailey , Emilie Kim , Vignesh Jagadeesh , Paul Schneider , Piotr Stanczyk , Arwen Bradley , Jason Klivington , Jacques Gasselin De Richebourg , Joe Triscari , Sébastien Beysserie , Yang Yang , Afshin Dehghan , Rudolph van der Merwe
Abstract: Techniques are disclosed for editing captured media to overcome operational difficulties that may arise during capture operations. According to these techniques, content may be captured with a pair of cameras, a first camera having a wider field of view than a second camera. Object(s) may be detected from captured content from the wider field of view camera. The captured content may be processed from the wider field of view camera in a location of at least one detected object. Typically, operators may attempt to frame content using content from the narrower field of view camera. As a result, operators may be unaware that desired content is captured using a second, wider field of view camera. Results from the processed wider field of view data may be proposed to operators for review and, if desired, retention.
-
公开(公告)号:US10909763B2
公开(公告)日:2021-02-02
申请号:US16248677
申请日:2019-01-15
Applicant: Apple Inc.
Inventor: Christopher G. Nicholas , Lukas M. Marti , Rudolph van der Merwe , John Kassebaum
Abstract: A user interface enables a user to calibrate the position of a three dimensional model with a real-world environment represented by that model. Using a device's sensor, the device's location and orientation is determined. A video image of the device's environment is displayed on the device's display. The device overlays a representation of an object from a virtual reality model on the video image. The position of the overlaid representation is determined based on the device's location and orientation. In response to user input, the device adjusts a position of the overlaid representation relative to the video image.
-
公开(公告)号:US20190147662A1
公开(公告)日:2019-05-16
申请号:US16248677
申请日:2019-01-15
Applicant: Apple Inc.
Inventor: Christopher G. Nicholas , Lukas M. Marti , Rudolph van der Merwe , John Kassebaum
Abstract: A user interface enables a user to calibrate the position of a three dimensional model with a real-world environment represented by that model. Using a device's sensor, the device's location and orientation is determined. A video image of the device's environment is displayed on the device's display. The device overlays a representation of an object from a virtual reality model on the video image. The position of the overlaid representation is determined based on the device's location and orientation. In response to user input, the device adjusts a position of the overlaid representation relative to the video image.
-
公开(公告)号:US10062409B2
公开(公告)日:2018-08-28
申请号:US15275105
申请日:2016-09-23
Applicant: Apple Inc.
Inventor: Arwen V. Bradley , Samuel G. Noble , Rudolph van der Merwe , Jason Klivington , Douglas P. Mitchell
CPC classification number: G11B27/007 , G11B27/034 , G11B27/19 , G11B27/34 , H04N5/76
Abstract: Techniques and devices for creating an AutoLoop output video include identifying optimal loops within short videos or within a series of image. The AutoLoop output video may be automatically created using casually shot, handheld videos, and may include an AutoLoop pipeline that may comprise obtaining an input video, stabilizing the input video, detecting optimal loop parameters and baking out the AutoLoop output video with crossfade and playing back the AutoLoop output video. Video stabilization can include a cascade of video stabilization algorithms including a tripod-direct mode and a tripod-sequential mode. After stabilization, an AutoLoop operation may determine optimal loop parameters. Once optimal loop parameters are determined, a crossfade may be added to smooth out any temporal and spatial discontinuities in the AutoLoop output video.
-
公开(公告)号:US20180218542A1
公开(公告)日:2018-08-02
申请号:US15936286
申请日:2018-03-26
Applicant: Apple Inc.
Inventor: Christopher G. Nicholas , Lukas M. Marti , Rudolph van der Merwe , John Kassebaum
CPC classification number: G06T19/006 , G06F3/011
Abstract: A user interface enables a user to calibrate the position of a three dimensional model with a real-world environment represented by that model. Using a device's sensor, the device's location and orientation is determined. A video image of the device's environment is displayed on the device's display. The device overlays a representation of an object from a virtual reality model on the video image. The position of the overlaid representation is determined based on the device's location and orientation. In response to user input, the device adjusts a position of the overlaid representation relative to the video image.
-
-
-
-
-
-
-
-
-