-
公开(公告)号:US08805110B2
公开(公告)日:2014-08-12
申请号:US13011618
申请日:2011-01-21
申请人: Geoffrey B. Rhoads , Tony F. Rodriguez , John D. Lord , Brian T. MacIntosh , Nicole Rhoads , William Y. Conwell
发明人: Geoffrey B. Rhoads , Tony F. Rodriguez , John D. Lord , Brian T. MacIntosh , Nicole Rhoads , William Y. Conwell
CPC分类号: G08C17/02 , G06F3/0482 , G06F17/30241 , G06F17/30256 , G06F17/30265 , G06F17/30867 , G06F17/3087 , G06F17/30879 , G06K9/00 , G06K9/00664 , G06K9/22 , G06K9/32 , G06K9/6253 , G06T1/20 , G08C2201/93 , H04L67/34 , H04N1/00307 , H04N5/23219 , H04N2013/0074 , H04N2101/00 , H04N2201/3278 , H04W88/02
摘要: Mobile phones and other portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. Some aspects relate to visual search capabilities, and determining appropriate actions responsive to different image inputs. Others relate to processing of image data. Still others concern metadata generation, processing, and representation. Yet others concern user interface improvements. Other aspects relate to imaging architectures, in which a mobile phone's image sensor is one in a chain of stages that successively act on packetized instructions/data, to capture and later process imagery. Still other aspects relate to distribution of processing tasks between the mobile device and remote resources (“the cloud”). Elemental image processing (e.g., simple filtering and edge detection) can be performed on the mobile phone, while other operations can be referred out to remote service providers. The remote service providers can be selected using techniques such as reverse auctions, through which they compete for processing tasks. A great number of other features and arrangements are also detailed.
摘要翻译: 移动电话和其他便携式设备配备有可以改进现有功能的各种技术,并且可以提供新的功能。 一些方面与视觉搜索能力相关,并确定响应于不同图像输入的适当动作。 其他涉及图像数据的处理。 还有一些涉及元数据生成,处理和表示。 还有一些则关注用户界面的改进。 其他方面涉及成像架构,其中移动电话的图像传感器是连续作用于分组化指令/数据的阶段链中的一个,以捕获和稍后处理图像。 另外其他方面涉及移动设备和远程资源(“云”)之间的处理任务分配。 可以在移动电话上执行元素图像处理(例如,简单滤波和边缘检测),而可以向远程服务提供商提供其他操作。 可以使用诸如反向拍卖的技术来选择远程服务提供商,通过它们竞争处理任务。 还详细介绍了许多其他功能和安排。
-
公开(公告)号:US20110212717A1
公开(公告)日:2011-09-01
申请号:US13011618
申请日:2011-01-21
申请人: Geoffrey B. Rhoads , Tony F. Rodriguez , John D. Lord , Brian T. Maclntosh , Nicole Rhoads , William Y. Conwell
发明人: Geoffrey B. Rhoads , Tony F. Rodriguez , John D. Lord , Brian T. Maclntosh , Nicole Rhoads , William Y. Conwell
CPC分类号: G08C17/02 , G06F3/0482 , G06F17/30241 , G06F17/30256 , G06F17/30265 , G06F17/30867 , G06F17/3087 , G06F17/30879 , G06K9/00 , G06K9/00664 , G06K9/22 , G06K9/32 , G06K9/6253 , G06T1/20 , G08C2201/93 , H04L67/34 , H04N1/00307 , H04N5/23219 , H04N2013/0074 , H04N2101/00 , H04N2201/3278 , H04W88/02
摘要: Mobile phones and other portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. Some aspects relate to visual search capabilities, and determining appropriate actions responsive to different image inputs. Others relate to processing of image data. Still others concern metadata generation, processing, and representation. Yet others concern user interface improvements. Other aspects relate to imaging architectures, in which a mobile phone's image sensor is one in a chain of stages that successively act on packetized instructions/data, to capture and later process imagery. Still other aspects relate to distribution of processing tasks between the mobile device and remote resources (“the cloud”). Elemental image processing (e.g., simple filtering and edge detection) can be performed on the mobile phone, while other operations can be referred out to remote service providers. The remote service providers can be selected using techniques such as reverse auctions, through which they compete for processing tasks. A great number of other features and arrangements are also detailed.
摘要翻译: 移动电话和其他便携式设备配备有可以改进现有功能的各种技术,并且可以提供新的功能。 一些方面与视觉搜索能力相关,并确定响应于不同图像输入的适当动作。 其他涉及图像数据的处理。 还有一些涉及元数据生成,处理和表示。 还有一些则关注用户界面的改进。 其他方面涉及成像架构,其中移动电话的图像传感器是连续作用于分组化指令/数据的阶段链中的一个,以捕获和稍后处理图像。 另外其他方面涉及移动设备和远程资源(“云”)之间的处理任务分配。 可以在移动电话上执行元素图像处理(例如,简单滤波和边缘检测),而可以向远程服务提供商提供其他操作。 可以使用诸如反向拍卖的技术来选择远程服务提供商,通过它们竞争处理任务。 还详细介绍了许多其他功能和安排。
-
公开(公告)号:US20130011062A1
公开(公告)日:2013-01-10
申请号:US13275126
申请日:2011-10-17
IPC分类号: G06K9/80
CPC分类号: G06K9/0063 , G06F17/30247 , G06F17/30265 , G06F17/30867 , G06K9/228 , G06K9/32 , G06K9/6201 , G06K9/6253 , G06K9/6267 , G06T3/00 , G06T2207/10016 , G06T2215/00 , H04N1/00307 , H04N5/23219 , H04N2101/00 , H04N2201/3278
摘要: Cell phones and other portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. Some relate to visual search capabilities, and determining appropriate actions responsive to different image inputs. Others relate to processing of image data. Still others concern metadata generation, processing, and representation. Yet others relate to coping with fixed focus limitations of cell phone cameras, e.g., in reading digital watermark data. Still others concern user interface improvements. A great number of other features and arrangements are also detailed.
摘要翻译: 手机和其他便携式设备配备有可以改进现有功能的各种技术,并且可以提供新的功能。 一些涉及到视觉搜索功能,并根据不同的图像输入确定适当的动作。 其他涉及图像数据的处理。 还有一些涉及元数据生成,处理和表示。 还有一些涉及应对手机摄像机的固定焦距限制,例如在读取数字水印数据时。 还有人关注用户界面改进。 还详细介绍了许多其他功能和安排。
-
公开(公告)号:US20100048242A1
公开(公告)日:2010-02-25
申请号:US12484115
申请日:2009-06-12
申请人: Geoffrey B. Rhoads , John D. Lord , Tony F. Rodriguez , William Y. Conwell , Brian T. Maclntosh
发明人: Geoffrey B. Rhoads , John D. Lord , Tony F. Rodriguez , William Y. Conwell , Brian T. Maclntosh
IPC分类号: H04M1/00
CPC分类号: H04N5/23222 , G06F17/30244 , G06F19/00 , G06K9/00288 , G06K9/00577 , G06K9/228 , G06K9/4604 , G06K9/4647 , G06K9/4652 , G06K9/4671 , G06K9/6253 , H04M1/0202 , H04M1/0264 , H04N1/00307 , H04N1/2133 , H04N1/32101 , H04N5/23219 , H04N2101/00 , H04N2201/3225 , H04N2201/3274 , H04N2201/3278 , H04W4/50
摘要: Cell phones and other portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. Some aspects relate to data driven imaging architectures, in which a cell phone's image sensor is one in a chain of stages that successively act on packetized instructions/data, to capture and later process imagery. Other aspects relate to distribution of processing tasks between the device and remote resources (“the cloud”). Elemental image processing, such as filtering and edge detection—and even some simpler template matching operations—may be performed on the cell phone. Other operations are referred out to remote service providers. The remote service providers can be identified using techniques such as a reverse auction, though which they compete for processing tasks. Other aspects of the disclosed technologies relate to visual search capabilities, and determining appropriate actions responsive to different image inputs. Still others concern metadata generation, processing, and representation. Yet others relate to coping with fixed focus limitations of cell phone cameras, e.g., in reading digital watermark data. Still others concern user interface improvements. A great number of other features and arrangements are also detailed.
摘要翻译: 手机和其他便携式设备配备有可以改进现有功能的各种技术,并且可以提供新的功能。 一些方面涉及数据驱动的成像架构,其中手机的图像传感器是连续作用于分组化指令/数据的阶段链中的一个,以捕获和稍后处理图像。 其他方面涉及设备和远程资源(“云”)之间的处理任务分配。 可以在蜂窝电话上执行元素图像处理,例如滤波和边缘检测,甚至一些更简单的模板匹配操作。 其他操作被转交给远程服务提供商。 可以使用诸如反向拍卖的技术来识别远程服务提供商,尽管它们竞争处理任务。 所公开技术的其他方面涉及视觉搜索能力,并且响应于不同的图像输入来确定适当的动作。 还有一些涉及元数据生成,处理和表示。 还有一些涉及应对手机摄像机的固定焦距限制,例如在读取数字水印数据时。 还有人关注用户界面改进。 还详细介绍了许多其他功能和安排。
-
公开(公告)号:US08886206B2
公开(公告)日:2014-11-11
申请号:US12835527
申请日:2010-07-13
IPC分类号: H04B1/38 , G06F17/30 , G06K9/22 , G06K9/00 , G06K9/62 , H04W28/26 , H04N1/32 , H04N1/00 , H04N101/00
CPC分类号: H04N5/2354 , G06F17/30244 , G06K9/00993 , G06K9/228 , G06K9/6253 , H04M1/0264 , H04M1/72572 , H04N1/00307 , H04N1/32101 , H04N5/2256 , H04N9/04 , H04N2101/00 , H04N2201/3225 , H04N2201/3274 , H04N2201/3278 , H04W28/26
摘要: Many of the detailed technologies are useful in enabling a smart phone to respond to a user's environment, e.g., so it can serve as an intuitive hearing and seeing device. A few of the detailed arrangements involve using radio base station SDR equipment (e.g., at a cell tower) to perform image recognition operations for phones; forecasting service needs from remote processors, and reserving such capacity in advance of use; delegating a remote execution task to a service provider chosen in a competitive process, such as by a reverse auction; using nearby processors, e.g., in an automobile, another phone, or set-top box, for remote execution tasks; phones with separable camera and/or illumination components; phone camera illumination using different colors of light; using search tree methods with image frames captured at different focuses; using a phone's microprojector to aid in object identification; correcting lens aberrations by texture mapping captured imagery onto a corrective polygon surface using a phone GPU; etc. A great variety of other features and arrangements are also detailed.
摘要翻译: 许多详细的技术在使智能手机能够响应用户的环境方面是有用的,例如,因此它可以用作直观的听觉和观看设备。 一些详细的布置涉及使用无线电基站SDR设备(例如,在小区塔)来执行电话的图像识别操作; 来自远程处理器的预测服务需求,并提前使用; 将远程执行任务委托给在竞争过程中选择的服务提供商,例如通过反向拍卖; 使用附近的处理器,例如在汽车,另一电话或机顶盒中,用于远程执行任务; 具有可分离相机和/或照明部件的手机; 手机相机照明使用不同颜色的光; 使用搜索树方法与不同焦点捕获的图像帧; 使用手机的微型喷射器来帮助对象识别; 通过使用电话GPU将捕获的图像纹理映射到校正多边形表面上来校正透镜像差; 还详细介绍了各种各样的其他功能和布置。
-
公开(公告)号:US09197736B2
公开(公告)日:2015-11-24
申请号:US12797503
申请日:2010-06-09
IPC分类号: G10L15/00 , H04M1/725 , G06F9/50 , G06K9/00 , G10L15/22 , H04W72/02 , G06F3/0484 , G06F3/0488 , G06K9/62 , G10L17/00 , G10L15/26 , G10L21/00 , G10L13/00 , G06F17/27 , G06F17/28 , G06F7/04 , G08B21/00 , G08B13/00 , G08B23/00 , G09G5/00 , G06T15/00 , H04N5/225 , H04N7/14 , H04N5/232 , H04N5/76
CPC分类号: H04M1/72563 , G06F3/04842 , G06F3/04847 , G06F3/0488 , G06F9/50 , G06K9/00335 , G06K9/6202 , G10L15/22 , G10L15/26 , G10L17/005 , H04M1/72583 , H04W72/02
摘要: A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.
-
公开(公告)号:US20110161076A1
公开(公告)日:2011-06-30
申请号:US12797503
申请日:2010-06-09
IPC分类号: G10L15/00
CPC分类号: H04M1/72563 , G06F3/04842 , G06F3/04847 , G06F3/0488 , G06F9/50 , G06K9/00335 , G06K9/6202 , G10L15/22 , G10L15/26 , G10L17/005 , H04M1/72583 , H04W72/02
摘要: A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.
摘要翻译: 智能手机感测来自用户环境的音频,图像和/或其他刺激,并自动地执行以推断或预期的用户期望。 一方面,详细的技术涉及电话摄像机观看的场景的基于手机的认知。 应用于场景的图像处理任务可以通过参考资源成本,资源约束,其他刺激信息(例如,音频),任务可替换性等从各种替代方案中选择。电话可以将更多或更少的资源应用于图像处理 任务取决于任务正在进行的成功,或者基于用户对任务的明显兴趣。 在一些安排中,数据可能被称为云进行分析,或用于清除。 识别和识别适当的设备响应可以通过附带信息(如上下文)来辅助。 还详细介绍了许多其他功能和安排。
-
公开(公告)号:US09143603B2
公开(公告)日:2015-09-22
申请号:US12982470
申请日:2010-12-30
CPC分类号: H04M1/72569 , G06F3/167 , G06F17/30244 , G06F2200/1636 , G06K9/00671 , G06Q10/109 , G10L15/22 , G10L2015/223 , H04M19/047 , H04M2250/02 , H04M2250/10 , H04M2250/12 , H04M2250/52 , H04M2250/74 , H04N5/23203 , H04N5/23293 , H04W4/029
摘要: The present technology concerns improvements to smart phones and related sensor-equipped systems. Some embodiments relate to smart phone-assisted commuting, e.g., by bicycle. Some involve novel human-computer interactions, e.g., using tactile grammars—some of which may be customized by users. Others involve spoken clues, e.g., by which a user can assist a smart phone in identifying what portion of imagery captured by a smart phone camera should be processed, or identifying what type of image processing should be conducted. Some arrangements include the degradation of captured content information in accordance with privacy rules, which may be location-dependent, or based on the unusualness of the captured content, or responsive to later consultation of the stored content information by the user. A great variety of other features and arrangements are also detailed.
摘要翻译: 目前的技术涉及智能手机和相关传感器装备系统的改进。 一些实施例涉及智能电话辅助通勤,例如通过自行车。 一些涉及新颖的人机交互,例如使用触觉语法,其中一些可以由用户定制。 其他涉及口语线索,例如,用户可以通过该线索帮助智能电话识别应该处理由智能电话摄像机捕获的图像的哪一部分,或者识别应该进行什么类型的图像处理。 一些布置包括根据可能取决于位置的隐私规则或者基于所捕获的内容的不寻常性,或者响应于用户对所存储的内容信息的后续咨询,所捕获的内容信息的恶化。 还详细介绍了各种各样的其他功能和安排。
-
公开(公告)号:US20120218436A1
公开(公告)日:2012-08-30
申请号:US13465620
申请日:2012-05-07
IPC分类号: H04N5/228
CPC分类号: G01B11/14 , G01C21/3629 , G06F3/011 , G06F3/016 , G06K9/00523 , G06K9/00993 , G06K9/626 , G06Q30/02 , H04M2250/12 , H04M2250/52 , H04N5/225 , H04W4/02
摘要: A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.
摘要翻译: 智能手机感测来自用户环境的音频,图像和/或其他刺激,并自动地执行以推断或预期的用户期望。 一方面,详细的技术涉及电话摄像机观看的场景的基于手机的认知。 应用于场景的图像处理任务可以通过参考资源成本,资源约束,其他刺激信息(例如,音频),任务可替换性等从各种替代方案中选择。电话可以将更多或更少的资源应用于图像处理 任务取决于任务正在进行的成功,或者基于用户对任务的明显兴趣。 在一些安排中,数据可能被称为云进行分析,或用于清除。 识别和识别适当的设备响应可以通过附带信息(如上下文)来辅助。 还详细介绍了许多其他功能和安排。
-
公开(公告)号:US09183580B2
公开(公告)日:2015-11-10
申请号:US13278949
申请日:2011-10-21
IPC分类号: G06K9/00 , G06Q30/06 , G06F9/38 , G10L25/84 , G10L15/28 , G10L25/81 , G10L25/78 , G06F9/50 , H04M1/725 , G06F9/445
CPC分类号: G06Q30/06 , G06F8/61 , G06F9/3885 , G06F9/445 , G06F9/5027 , G10L15/285 , G10L25/78 , G10L25/81 , G10L25/84 , H04L2463/101 , H04M1/72522 , H04M2250/52
摘要: Methods and arrangements involving portable devices are disclosed. One arrangement enables a content creator to select software with which that content should be rendered—assuring continuity between artistic intention and delivery. Another arrangement utilizes the camera of a smartphone to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some of the detailed technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.
摘要翻译: 公开了涉及便携式设备的方法和布置。 一种安排使得内容创作者能够选择应该呈现该内容的软件 - 确保艺术意图和传递之间的连续性。 另一种安排利用智能手机的照相机识别附近的主体,并基于此采取行动。 其他人依靠近场芯片(RFID)识别对象,或者识别音频流(例如,音乐,语音)。 一些详细的技术涉及与这样的设备相关联的用户界面的改进。 其他涉及使用这些设备与购物,文本输入,手语解释和基于视觉的发现相关联。 还有其他改进是建筑性质的,例如涉及基于证据的状态机和黑板系统。 其他技术还涉及在便携式设备中使用链接数据,其中一些利用了GPU功能。 其他技术还涉及计算机摄影。 还详细介绍了各种各样的其他功能和安排。
-
-
-
-
-
-
-
-
-