Methods and systems for content processing
    1.
    发明授权
    Methods and systems for content processing 有权
    内容处理方法和系统

    公开(公告)号:US08886206B2

    公开(公告)日:2014-11-11

    申请号:US12835527

    申请日:2010-07-13

    摘要: Many of the detailed technologies are useful in enabling a smart phone to respond to a user's environment, e.g., so it can serve as an intuitive hearing and seeing device. A few of the detailed arrangements involve using radio base station SDR equipment (e.g., at a cell tower) to perform image recognition operations for phones; forecasting service needs from remote processors, and reserving such capacity in advance of use; delegating a remote execution task to a service provider chosen in a competitive process, such as by a reverse auction; using nearby processors, e.g., in an automobile, another phone, or set-top box, for remote execution tasks; phones with separable camera and/or illumination components; phone camera illumination using different colors of light; using search tree methods with image frames captured at different focuses; using a phone's microprojector to aid in object identification; correcting lens aberrations by texture mapping captured imagery onto a corrective polygon surface using a phone GPU; etc. A great variety of other features and arrangements are also detailed.

    摘要翻译: 许多详细的技术在使智能手机能够响应用户的环境方面是有用的,例如,因此它可以用作直观的听觉和观看设备。 一些详细的布置涉及使用无线电基站SDR设备(例如,在小区塔)来执行电话的图像识别操作; 来自远程处理器的预测服务需求,并提前使用; 将远程执行任务委托给在竞争过程中选择的服务提供商,例如通过反向拍卖; 使用附近的处理器,例如在汽车,另一电话或机顶盒中,用于远程执行任务; 具有可分离相机和/或照明部件的手机; 手机相机照明使用不同颜色的光; 使用搜索树方法与不同焦点捕获的图像帧; 使用手机的微型喷射器来帮助对象识别; 通过使用电话GPU将捕获的图像纹理映射到校正多边形表面上来校正透镜像差; 还详细介绍了各种各样的其他功能和布置。

    Audio/video methods and systems
    2.
    发明授权
    Audio/video methods and systems 有权
    音频/视频方法和系统

    公开(公告)号:US08773589B2

    公开(公告)日:2014-07-08

    申请号:US12842900

    申请日:2010-07-23

    申请人: John D. Lord

    发明人: John D. Lord

    IPC分类号: H04N7/00

    摘要: Audio and or video data is structurally and persistently associated with auxiliary sensor data (e.g., relating to acceleration, orientation or tilt) through use of a unitary data object, such as a modified MPEG file or data stream. In this form, different rendering devices can employ co-conveyed sensor data to alter the audio or video content. Such use of the sensor data may be personalized to different users, e.g., through preference data. For example, accelerometer data can be associated with video data, allowing some users to view a shake-stabilized version of a video, and other users to view the video with such motion artifacts undisturbed. In like fashion, camera parameters, such as focal plane distance, can be co-conveyed with audio/video content—allowing the volume to be diminished (or not, again depending on user preference) when a camera captures audio/video from a distant subject. Some arrangements employ multiple image sensors and/or multiple audio sensors—each also collecting auxiliary data. A great number of other features and arrangements are also detailed.

    摘要翻译: 音频和/或视频数据通过使用诸如经修改的MPEG文件或数据流的统一数据对象在结构上和持久地与辅助传感器数据相关联(例如,涉及加速度,取向或倾斜)。 在这种形式中,不同的渲染设备可以使用共同传送的传感器数据来改变音频或视频内容。 传感器数据的这种使用可以例如通过偏好数据来个性化到不同的用户。 例如,加速度计数据可以与视频数据相关联,允许一些用户观看视频的抖动版本,并且其他用户不受干扰地观看具有这种运动伪像的视频。 以相似的方式,相机参数(如焦平面距离)可以与音频/视频内容共同传送,从而允许在相机从遥远的位置拍摄音频/视频时,音量减小(或不再依赖于用户偏好) 学科。 一些布置采用多个图像传感器和/或多个音频传感器,每个传感器还收集辅助数据。 还详细介绍了许多其他功能和安排。

    Methods and Systems for Content Processing
    3.
    发明申请
    Methods and Systems for Content Processing 有权
    内容处理方法与系统

    公开(公告)号:US20110034176A1

    公开(公告)日:2011-02-10

    申请号:US12835527

    申请日:2010-07-13

    摘要: Many of the detailed technologies are useful in enabling a smart phone to respond to a user's environment, e.g., so it can serve as an intuitive hearing and seeing device. A few of the detailed arrangements involve using radio base station SDR equipment (e.g., at a cell tower) to perform image recognition operations for phones; forecasting service needs from remote processors, and reserving such capacity in advance of use; delegating a remote execution task to a service provider chosen in a competitive process, such as by a reverse auction; using nearby processors, e.g., in an automobile, another phone, or set-top box, for remote execution tasks; phones with separable camera and/or illumination components; phone camera illumination using different colors of light; using search tree methods with image frames captured at different focuses; using a phone's microprojector to aid in object identification; correcting lens aberrations by texture mapping captured imagery onto a corrective polygon surface using a phone GPU; etc. A great variety of other features and arrangements are also detailed.

    摘要翻译: 许多详细的技术在使智能手机能够响应用户的环境方面是有用的,例如,因此它可以用作直观的听觉和观看设备。 一些详细的布置涉及使用无线电基站SDR设备(例如,在小区塔)来执行电话的图像识别操作; 来自远程处理器的预测服务需求,并提前使用; 将远程执行任务委托给在竞争过程中选择的服务提供商,例如通过反向拍卖; 使用附近的处理器,例如在汽车,另一电话或机顶盒中,用于远程执行任务; 具有可分离相机和/或照明部件的手机; 手机相机照明使用不同颜色的光; 使用搜索树方法与不同焦点捕获的图像帧; 使用手机的微型喷射器来帮助对象识别; 通过使用电话GPU将捕获的图像纹理映射到校正多边形表面上来校正透镜像差; 还详细介绍了各种各样的其他功能和布置。

    Methods and systems for content processing
    6.
    发明授权
    Methods and systems for content processing 有权
    内容处理方法和系统

    公开(公告)号:US08805110B2

    公开(公告)日:2014-08-12

    申请号:US13011618

    申请日:2011-01-21

    摘要: Mobile phones and other portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. Some aspects relate to visual search capabilities, and determining appropriate actions responsive to different image inputs. Others relate to processing of image data. Still others concern metadata generation, processing, and representation. Yet others concern user interface improvements. Other aspects relate to imaging architectures, in which a mobile phone's image sensor is one in a chain of stages that successively act on packetized instructions/data, to capture and later process imagery. Still other aspects relate to distribution of processing tasks between the mobile device and remote resources (“the cloud”). Elemental image processing (e.g., simple filtering and edge detection) can be performed on the mobile phone, while other operations can be referred out to remote service providers. The remote service providers can be selected using techniques such as reverse auctions, through which they compete for processing tasks. A great number of other features and arrangements are also detailed.

    摘要翻译: 移动电话和其他便携式设备配备有可以改进现有功能的各种技术,并且可以提供新的功能。 一些方面与视觉搜索能力相关,并确定响应于不同图像输入的适当动作。 其他涉及图像数据的处理。 还有一些涉及元数据生成,处理和表示。 还有一些则关注用户界面的改进。 其他方面涉及成像架构,其中移动电话的图像传感器是连续作用于分组化指令/数据的阶段链中的一个,以捕获和稍后处理图像。 另外其他方面涉及移动设备和远程资源(“云”)之间的处理任务分配。 可以在移动电话上执行元素图像处理(例如,简单滤波和边缘检测),而可以向远程服务提供商提供其他操作。 可以使用诸如反向拍卖的技术来选择远程服务提供商,通过它们竞争处理任务。 还详细介绍了许多其他功能和安排。

    Methods and systems for content processing
    10.
    发明授权
    Methods and systems for content processing 有权
    内容处理方法和系统

    公开(公告)号:US09008724B2

    公开(公告)日:2015-04-14

    申请号:US13444521

    申请日:2012-04-11

    申请人: John D. Lord

    发明人: John D. Lord

    摘要: Disclosed are technologies are useful in enabling a smart phone to respond to a user's environment, e.g., so it can serve as an intuitive hearing and seeing device. Some of the detailed arrangements involve using radio base station SDR equipment (e.g., at a cell tower) to perform image recognition operations for phones; forecasting service needs from remote processors delegating a remote execution task to a service provider chosen in a competitive process; using nearby processors, e.g., in an automobile, another phone, or set-top box, for remote execution tasks; phones with separable camera and/or illumination components; phone camera illumination using different colors of light; using search tree methods with image frames captured at different focuses; using a phone's microprojector to aid in object identification; correcting lens aberrations by texture mapping captured imagery onto a corrective polygon surface using a phone GPU; etc. A great variety of other features are also detailed.

    摘要翻译: 公开的技术在使智能电话能够响应用户环境中是有用的,例如,因此它可以用作直观的听觉和看见设备。 一些详细的布置涉及使用无线电基站SDR设备(例如,在小区塔)来执行电话的图像识别操作; 来自远程处理器的预测服务需求将远程执行任务委派给在竞争过程中选择的服务提供者; 使用附近的处理器,例如在汽车,另一电话或机顶盒中,用于远程执行任务; 具有可分离相机和/或照明部件的手机; 手机相机照明使用不同颜色的光; 使用搜索树方法与不同焦点捕获的图像帧; 使用手机的微型喷射器来帮助对象识别; 通过使用电话GPU将捕获的图像纹理映射到校正多边形表面上来校正透镜像差; 等等各种各样的其他功能也是详细的。