公开(公告)号：US20130330055A1

公开(公告)日：2013-12-12

申请号：US14000846

申请日：2012-02-21

申请人： Roger Zimmermann ,  Seon Ho Kim ,  Sakire Arslan Ay ,  Beomjoo Seo ,  Zhijie Shen ,  Guanfeng Wang ,  Jia Hao ,  Ying Zhang

发明人： Roger Zimmermann ,  Seon Ho Kim ,  Sakire Arslan Ay ,  Beomjoo Seo ,  Zhijie Shen ,  Guanfeng Wang ,  Jia Hao ,  Ying Zhang

IPC分类号： H04N9/79

CPC分类号： H04N9/79 ,  G01S5/16 ,  G01S19/14 ,  G01S19/49 ,  G06F17/30817 ,  H04N1/00127 ,  H04N21/2743 ,  H04N21/41407 ,  H04N21/42202 ,  H04N21/4223 ,  H04N21/4728 ,  H04N21/4828 ,  H04N21/6131 ,  H04N21/6181 ,  H04N21/8193 ,  H04N21/84 ,  H04N21/8456 ,  H04N21/8547 ,  H04N2201/3253

摘要： Embodiments of methods for multimedia annotation with sensor data (referred to herein as Sensor-rich video) includes acquisition, management, storage, indexing, transmission, search, and display of video, images, or sound, that has been recorded in conjunction with additional sensor information (such as, but not limited to, global positioning system information (latitude, longitude, altitude), compass directions, WiFi fingerprints, ambient lighting conditions, etc.). The collection of sensor information is acquired on a continuous basis during recording. For example, the GPS information may be continuously acquired from a corresponding sensor at every second during the recording of a video. Therefore, the acquisition apparatus generates a continuous stream of video frames and a continuous stream of sensor meta-data values. The two streams are correlated in that every video frame is associated with a set of sensor values. Note that the sampling frequency (i.e., the frequency at which sensor values can be measured) is dependent on the type of sensor. For example, a GPS sensor may be sampled at 1-second intervals while a compass sensor may be sampled at 50 millisecond intervals. Video is also sampled at a specific rate, such as 25 or 30 frames per second. Sensor data are associated with each frame. If sensor data has not changed from the previous frame (due to a low sampling rate) then the previously measured data values are used. The resulting combination of a video and a sensor stream is called a sensor-rich video.

摘要翻译： 具有传感器数据的多媒体注释（本文中称为富含传感器的视频）的方法的实施例包括已经结合附加记录的视频，图像或声音的获取，管理，存储，索引，传输，搜索和显示 传感器信息（例如但不限于全球定位系统信息（纬度，经度，高度），罗盘方向，WiFi指纹，环境照明条件等）。 在记录期间，连续地获取传感器信息的收集。 例如，可以在记录视频期间每隔一秒从对应的传感器连续地获取GPS信息。 因此，采集装置产生视频帧的连续流和传感器元数据值的连续流。 这两个流是相关的，因为每个视频帧与一组传感器值相关联。 注意，采样频率（即可以测量传感器值的频率）取决于传感器的类型。 例如，GPS传感器可以以1秒的间隔进行采样，而罗盘传感器可以以50毫秒的间隔被采样。 视频也以特定速率采样，例如每秒25帧或30帧。 传感器数据与每个帧相关联。 如果传感器数据与前一帧没有变化（由于采样率低），则使用先前测量的数据值。 所得到的视频和传感器流的组合称为传感器丰富的视频。

公开(公告)号：US09509968B2

公开(公告)日：2016-11-29

申请号：US14000846

申请日：2012-02-21

申请人： Roger Zimmermann ,  Seon Ho Kim ,  Sakire Arslan Ay ,  Beomjoo Seo ,  Zhijie Shen ,  Guanfeng Wang ,  Jia Hao ,  Ying Zhang

发明人： Roger Zimmermann ,  Seon Ho Kim ,  Sakire Arslan Ay ,  Beomjoo Seo ,  Zhijie Shen ,  Guanfeng Wang ,  Jia Hao ,  Ying Zhang

IPC分类号： H04N9/79 ,  H04N1/00 ,  H04N21/2743 ,  H04N21/414 ,  H04N21/422 ,  H04N21/4223 ,  H04N21/4728 ,  H04N21/482 ,  H04N21/61 ,  H04N21/81 ,  H04N21/84 ,  H04N21/8547 ,  G06F17/30 ,  G01S5/16 ,  G01S19/14 ,  G01S19/49 ,  H04N21/845

CPC分类号： H04N9/79 ,  G01S5/16 ,  G01S19/14 ,  G01S19/49 ,  G06F17/30817 ,  H04N1/00127 ,  H04N21/2743 ,  H04N21/41407 ,  H04N21/42202 ,  H04N21/4223 ,  H04N21/4728 ,  H04N21/4828 ,  H04N21/6131 ,  H04N21/6181 ,  H04N21/8193 ,  H04N21/84 ,  H04N21/8456 ,  H04N21/8547 ,  H04N2201/3253

摘要： Embodiments of methods for multimedia annotation with sensor data (referred to herein as Sensor-rich video) includes acquisition, management, storage, indexing, transmission, search, and display of video, images, or sound, that has been recorded in conjunction with additional sensor information (such as, but not limited to, global positioning system information (latitude, longitude, altitude), compass directions, WiFi fingerprints, ambient lighting conditions, etc.). The collection of sensor information is acquired on a continuous basis during recording. For example, the GPS information may be continuously acquired from a corresponding sensor at every second during the recording of a video. Therefore, the acquisition apparatus generates a continuous stream of video frames and a continuous stream of sensor meta-data values. The two streams are correlated in that every video frame is associated with a set of sensor values. Note that the sampling frequency (i.e., the frequency at which sensor values can be measured) is dependent on the type of sensor. For example, a GPS sensor may be sampled at 1-second intervals while a compass sensor may be sampled at 50 millisecond intervals. Video is also sampled at a specific rate, such as 25 or 30 frames per second. Sensor data are associated with each frame. If sensor data has not changed from the previous frame (due to a low sampling rate) then the previously measured data values are used. The resulting combination of a video and a sensor stream is called a sensor-rich video.

摘要翻译： 具有传感器数据的多媒体注释（本文中称为富含传感器的视频）的方法的实施例包括已经结合附加记录的视频，图像或声音的获取，管理，存储，索引，传输，搜索和显示 传感器信息（例如但不限于全球定位系统信息（纬度，经度，高度），罗盘方向，WiFi指纹，环境照明条件等）。 在记录期间，连续地获取传感器信息的收集。 例如，可以在记录视频期间每隔一秒从对应的传感器连续地获取GPS信息。 因此，采集装置产生视频帧的连续流和传感器元数据值的连续流。 这两个流是相关的，因为每个视频帧与一组传感器值相关联。 注意，采样频率（即可以测量传感器值的频率）取决于传感器的类型。 例如，GPS传感器可以以1秒的间隔进行采样，而罗盘传感器可以以50毫秒的间隔被采样。 视频也以特定速率采样，例如每秒25帧或30帧。 传感器数据与每个帧相关联。 如果传感器数据与前一帧没有变化（由于采样率低），则使用先前测量的数据值。 所得到的视频和传感器流的组合称为传感器丰富的视频。