公开(公告)号：US20140369550A1

公开(公告)日：2014-12-18

申请号：US14312421

申请日：2014-06-23

Applicant: Digimarc Corporation

Inventor： Bruce L. Davis ,  Tony F. Rodriguez

IPC: G06T1/00

CPC classification number: G06T1/0021 ,  G06F3/162 ,  G06F3/165 ,  G06F9/44505 ,  G06F16/433 ,  G06F16/632 ,  G06F16/683 ,  G06Q30/0201 ,  G06Q30/0631 ,  G06T2201/005 ,  G10L15/00 ,  G10L15/20 ,  G10L19/018 ,  H04N21/47

Abstract: Methods and arrangements involving portable devices, such as smartphones and tablet computers, are disclosed. One arrangement enables a creator of content to select software with which that creator's content should be rendered—assuring continuity between artistic intention and delivery. Another arrangement utilizes the camera of a smartphone to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some of the detailed technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.

Abstract translation: 公开了涉及便携式设备（诸如智能电话和平板计算机）的方法和布置。 一种安排使内容创作者可以选择应该创作者内容的软件，从而确保艺术意图和传递之间的连续性。 另一种安排利用智能手机的照相机识别附近的主体，并基于此采取行动。 其他人依靠近场芯片（RFID）识别对象，或者识别音频流（例如，音乐，语音）。 一些详细的技术涉及与这样的设备相关联的用户界面的改进。 其他涉及使用这些设备与购物，文本输入，手语解释和基于视觉的发现相关联。 还有其他改进是建筑性质的，例如涉及基于证据的状态机和黑板系统。 其他技术还涉及在便携式设备中使用链接数据，其中一些利用了GPU功能。 其他技术还涉及计算机摄影。 还详细介绍了各种各样的其他功能和安排。

公开(公告)号：US20140351765A1

公开(公告)日：2014-11-27

申请号：US14452282

申请日：2014-08-05

Applicant: Digimarc Corporation

Inventor： Tony F. Rodriguez ,  Geoffrey B. Rhoads

IPC: G06F3/0484 ,  G06F3/023 ,  G06F3/0488 ,  G06F3/0481

CPC classification number: H04M1/72519 ,  G01C21/00 ,  G01C21/20 ,  G01C21/36 ,  G06F3/005 ,  G06F3/011 ,  G06F3/017 ,  G06F3/023 ,  G06F3/04817 ,  G06F3/0482 ,  G06F3/04842 ,  G06F3/04847 ,  G06F3/04886 ,  G06K9/00671 ,  G06K9/4671 ,  G06K9/62 ,  G06K9/6267 ,  G06Q10/10 ,  G06T19/006 ,  G06T2200/24 ,  G09G5/00 ,  H04M1/72522 ,  H04N5/225 ,  H04N5/23229 ,  H04N5/23245 ,  H04W4/02 ,  H04W4/027

Abstract: A smart phone senses audio and/or imagery from a user's environment, and acts to fulfill inferred or requested user desires. In one arrangement, a smart phone comprises: a touch screen display; a camera for capturing imagery; a microphone for capturing audio; a physical discovery button for receiving a user's indication to initiate a discovery mode; one or more processors; and memory storing software instructions for configuring said one or more processors. The software configures the processors for: responsive to a user's request via the physical discovery button, initiating a discovery mode including processing imagery captured with said camera; causing two different areas to be displayed on the touch screen display, in which a first of the two areas comprises a sensor pane in which visual information associated with captured imagery is displayed along with augmented reality graphics, and in which a second of the two areas comprises user-selectable graphic icons; and causing a user-selectable graphic icon to be displayed in the first of the two areas to allow a user to switch modes from image to audio. A great number of other features and arrangements are also detailed.

Abstract translation: 智能手机从用户的环境中感知音频和/或图像，并且用于满足推测或请求的用户需求。 在一种布置中，智能手机包括：触摸屏显示器; 用于捕获图像的相机; 用于捕获音频的麦克风; 用于接收用户指示以发起发现模式的物理发现按钮; 一个或多个处理器; 以及存储器存储用于配置所述一个或多个处理器的软件指令。 该软件配置处理器：响应用户通过物理发现按钮的请求，启动发现模式，包括处理使用所述相机拍摄的图像; 导致在触摸屏显示器上显示两个不同的区域，其中两个区域中的第一区域包括传感器窗格，其中显示与捕获的图像相关联的视觉信息以及增强的现实图形，并且其中两个区域中的第二区域 包括用户可选图形图标; 并且使用户可选择的图形图标显示在两个区域的第一区域中，以允许用户将模式从图像切换到音频。 还详细介绍了许多其他功能和安排。

公开(公告)号：US20140333794A1

公开(公告)日：2014-11-13

申请号：US14287933

申请日：2014-05-27

Applicant: Digimarc Corporation

Inventor： Geoffrey B. Rhoads ,  Tony F. Rodriguez ,  Gilbert B. Shaw

IPC: G01B11/14

CPC classification number: G01B11/14 ,  G01C21/3629 ,  G06F3/011 ,  G06F3/016 ,  G06K9/00523 ,  G06K9/00993 ,  G06K9/626 ,  G06Q30/02 ,  H04M2250/12 ,  H04M2250/52 ,  H04N5/225 ,  H04W4/02

Abstract: A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.

公开(公告)号：US20140323142A1

公开(公告)日：2014-10-30

申请号：US14242417

申请日：2014-04-01

Applicant: Digimarc Corporation

Inventor： Tony F. Rodriguez ,  Geoffrey B. Rhoads

IPC: H04M1/725 ,  H04W72/02 ,  G06F9/50 ,  G10L15/22 ,  G06K9/00

CPC classification number: H04M1/72563 ,  G06F3/04842 ,  G06F3/04847 ,  G06F3/0488 ,  G06F9/50 ,  G06K9/00335 ,  G06K9/6202 ,  G10L15/22 ,  G10L15/26 ,  G10L17/005 ,  H04M1/72583 ,  H04W72/02

Abstract: A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.

Abstract translation: 智能手机感测来自用户环境的音频，图像和/或其他刺激，并自动地执行以推断或预期的用户期望。 一方面，详细的技术涉及电话摄像机观看的场景的基于手机的认知。 应用于场景的图像处理任务可以通过参考资源成本，资源约束，其他刺激信息（例如，音频），任务可替换性等从各种替代方案中选择。电话可以将更多或更少的资源应用于图像处理 任务取决于任务正在进行的成功，或者基于用户对任务的明显兴趣。 在一些安排中，数据可能被称为云进行分析，或用于清除。 识别和识别适当的设备响应可以通过附带信息（如上下文）来辅助。 还详细介绍了许多其他功能和安排。

公开(公告)号：US20140313303A1

公开(公告)日：2014-10-23

申请号：US14288890

申请日：2014-05-28

Applicant: Digimarc Corporation

Inventor： Bruce L. Davis ,  Tony F. Rodriguez ,  Geoffrey B. Rhoads

IPC: G06T3/00 ,  A61B5/00 ,  H04N5/232

CPC classification number: A61B5/68 ,  A61B5/0002 ,  A61B5/0077 ,  A61B5/444 ,  A61B5/7425 ,  G06K9/00885 ,  G06T7/0016 ,  G06T7/33 ,  G06T2207/30088 ,  G06T2210/41

Abstract: The evolution of a skin condition over time can be useful in its assessment. In an illustrative arrangement, a user captures skin images at different times, using a smartphone. The images are co-registered, color-corrected, and presented to the user (or a clinician) for review, e.g., in a temporal sequence, or as one image presented as a ghosted overlay atop another. Image registration can employ nevi, hair follicles, wrinkles, pores, and pigmented regions as keypoints. With some imaging spectra, keypoints from below the outermost layer of skin can be used. Hair may be removed for image registration, and restored for image review. Transformations in addition to rotation and affine transforms can be employed. Diagnostic correlations with reference image sequences can be made, employing machine learning in some instances. A great variety of other features and arrangements are also detailed.

Abstract translation: 随着时间的推移，皮肤状况的演变在其评估中是有用的。 在说明性的布置中，用户使用智能手机在不同时间拍摄皮肤图像。 图像被共同登记，颜色校正，并呈现给用户（或临床医生）以进行审查，例如以时间顺序，或作为在另一个上方呈现为重影覆盖物的一个图像。 图像配准可以使用痣，毛囊，皱纹，毛孔和色素区域作为关键点。 使用一些成像光谱，可以使用从皮肤最外层下面的关键点。 头发可能被删除以进行图像注册，并恢复为图像审查。 可以使用旋转和仿射变换之外的变换。 可以在某些情况下使用机器学习来进行与参考图像序列的诊断相关性。 还详细介绍了各种各样的其他功能和安排。

公开(公告)号：US08868039B2

公开(公告)日：2014-10-21

申请号：US13651182

申请日：2012-10-12

Applicant: Digimarc Corporation

Inventor： Tony F. Rodriguez

IPC: H04W12/06 ,  H04W4/00

CPC classification number: H04W12/06 ,  H04M1/05 ,  H04M1/7253 ,  H04M1/72569 ,  H04M2250/52 ,  H04W4/12 ,  H04W4/80 ,  H04W12/04 ,  H04W84/14

Abstract: In one arrangement, a first device presents a display that is based on context data, derived from one or more of its sensors. This display is imaged by a camera in a second device. The second device uses context data from its own sensors to assess the information in the captured imagery, and makes a determination about the first device. In another arrangement, social network friend requests are automatically issued, or accepted, based on contextual similarity. In yet another arrangement, delivery of a message is triggered by a contextual circumstance other than (or in addition to) location. In still another arrangement, two or more devices automatically establish an ad hoc network (e.g., Bluetooth pairing) based on contextual parallels. In still another arrangement, historical context information is archived and used in transactions with other devices, e.g., in challenge-response authentication. A great number of other features and arrangements—many involving head-mounted displays—are also detailed.

Abstract translation: 在一种布置中，第一设备呈现基于从其一个或多个传感器导出的上下文数据的显示器。 该显示器通过相机在第二设备中成像。 第二个设备使用自己的传感器的上下文数据来评估捕获的图像中的信息，并确定第一个设备。 在另一种安排中，基于上下文相似性，自动地发布或接受社交网络朋友请求。 在另一种布置中，消息的传递由位置之外的（或除了）位置之外的上下文环境触发。 在另一种布置中，两个或多个设备基于上下文平行自动地建立自组织网络（例如，蓝牙配对）。 在另一种布置中，历史上下文信息被归档并用于与其他设备的交易中，例如在质询 - 响应认证中。 许多涉及头戴式显示器的其他功能和布置也很详细。

公开(公告)号：US08855372B2

公开(公告)日：2014-10-07

申请号：US14084962

申请日：2013-11-20

Applicant: Digimarc Corporation

Inventor： Tony F. Rodriguez ,  Geoffrey B. Rhoads

IPC: G06K9/00 ,  G06F17/30 ,  G06T3/00 ,  G06K9/62 ,  G06K9/32 ,  H04N5/232 ,  H04N1/00 ,  G06K9/22 ,  H04N101/00

CPC classification number: G06K9/0063 ,  G06F17/30247 ,  G06F17/30265 ,  G06F17/30867 ,  G06K9/228 ,  G06K9/32 ,  G06K9/6201 ,  G06K9/6253 ,  G06K9/6267 ,  G06T3/00 ,  G06T2207/10016 ,  G06T2215/00 ,  H04N1/00307 ,  H04N5/23219 ,  H04N2101/00 ,  H04N2201/3278

Abstract: Cell phones and other portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. Some relate to visual search capabilities, and responding to different image inputs and different contexts. Others relate to processing of image data. Still others concern metadata generation, processing, and representation. Yet others relate to coping with fixed focus limitations of cell phone cameras, e.g., in reading digital watermark data. Still others concern user interface improvements. Yet others concern adapting behavior of a camera-equipped system based on previously-captured imagery. A great number of other features and arrangements are also detailed.

Abstract translation: 手机和其他便携式设备配备有可以改进现有功能的各种技术，并且可以提供新的功能。 一些涉及到视觉搜索功能，以及响应不同的图像输入和不同的上下文。 其他涉及图像数据的处理。 还有一些涉及元数据生成，处理和表示。 还有一些涉及应对手机摄像机的固定焦距限制，例如在读取数字水印数据时。 还有人关注用户界面改进。 而另一些则涉及到基于以前捕获的图像来适应配备摄像头的系统的行为。 还详细介绍了许多其他功能和安排。

公开(公告)号：US20140244494A1

公开(公告)日：2014-08-28

申请号：US13792764

申请日：2013-03-11

Applicant: DIGIMARC CORPORATION

Inventor： Bruce L. Davis ,  Tony F. Rodriguez

IPC: G06Q20/22

CPC classification number: G06Q20/227 ,  G06Q20/105 ,  G06Q20/3274 ,  G06Q20/36 ,  G06Q20/363 ,  G06T2201/005 ,  G06T2201/0051 ,  G07F17/42

Abstract: To make a payment, a smartphone presents artwork for a payment card (e.g., a Visa card) that has been selected by a user from a virtual wallet of such cards. Encoded in the displayed artwork is payment information that has been encrypted with a context-dependent session key. A cooperating system (e.g., a retailer's point of sale system) uses a camera to capture an image of the artwork, and independently creates the session key from its own context sensor(s), enabling decryption of the payment information. Such technology provides a superior transaction security model at a fraction of the cost of competing chip card payment systems (which require, e.g., expensive physical cards, and single-purpose reader hardware). A great variety of other features and arrangements are also detailed.

Abstract translation: 为了进行支付，智能手机向用户从这种卡的虚拟钱包中选择的支付卡（例如，Visa卡）呈现艺术品。 在所显示的图形中编码的是用上下文相关的会话密钥加密的支付信息。 合作系统（例如，零售商的销售点系统）使用相机来捕获艺术品的图像，并且从其自己的上下文传感器独立地创建会话密钥，从而能够解密支付信息。 这种技术提供了优异的交易安全模型，其成本仅为竞争芯片卡支付系统（需要例如昂贵的物理卡和单用途读卡器硬件）的成本的一小部分。 还详细介绍了各种各样的其他功能和安排。

公开(公告)号：US08755837B2

公开(公告)日：2014-06-17

申请号：US13774056

申请日：2013-02-22

Applicant: Digimarc Corporation

Inventor： Geoffrey B. Rhoads ,  Tony F. Rodriguez

IPC: H04M1/00 ,  G06K9/46 ,  G06K9/00 ,  G06F17/30 ,  H04M1/02 ,  G06K9/62 ,  H04W4/00 ,  H04N1/32 ,  H04N101/00 ,  H04N1/00

CPC classification number: H04N5/23222 ,  G06F17/30244 ,  G06F19/00 ,  G06K9/00288 ,  G06K9/00577 ,  G06K9/228 ,  G06K9/4604 ,  G06K9/4647 ,  G06K9/4652 ,  G06K9/4671 ,  G06K9/6253 ,  H04M1/0202 ,  H04M1/0264 ,  H04N1/00307 ,  H04N1/2133 ,  H04N1/32101 ,  H04N5/23219 ,  H04N2101/00 ,  H04N2201/3225 ,  H04N2201/3274 ,  H04N2201/3278 ,  H04W4/50

Abstract: Cell phones and other portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. Some aspects relate to data driven imaging architectures, in which a cell phone's image sensor is one in a chain of stages that successively act on packetized instructions/data, to capture and later process imagery. Other aspects relate to distribution of processing tasks between the device and remote resources (“the cloud”). Elemental image processing, such as filtering and edge detection—and even some simpler template matching operations—may be performed on the cell phone. Other operations are referred out to remote service providers. The remote service providers can be identified using techniques such as a reverse auction, though which they compete for processing tasks. Other aspects of the disclosed technologies relate to visual search capabilities, and determining appropriate actions responsive to different image inputs. Still others concern metadata generation, processing, and representation. Yet others relate to coping with fixed focus limitations of cell phone cameras, e.g., in reading digital watermark data. Still others concern user interface improvements. A great number of other features and arrangements are also detailed.

Abstract translation: 手机和其他便携式设备配备有可以改进现有功能的各种技术，并且可以提供新的功能。 一些方面涉及数据驱动的成像架构，其中手机的图像传感器是连续作用于分组化指令/数据的阶段链中的一个，以捕获和稍后处理图像。 其他方面涉及设备和远程资源（“云”）之间的处理任务分配。 可以在蜂窝电话上执行元素图像处理，例如滤波和边缘检测，甚至一些更简单的模板匹配操作。 其他操作被转交给远程服务提供商。 可以使用诸如反向拍卖的技术来识别远程服务提供商，尽管它们竞争处理任务。 所公开技术的其他方面涉及视觉搜索能力，并且响应于不同的图像输入来确定适当的动作。 还有一些涉及元数据生成，处理和表示。 还有一些涉及应对手机摄像机的固定焦距限制，例如在读取数字水印数据时。 还有人关注用户界面改进。 还详细介绍了许多其他功能和安排。

公开(公告)号：US20130344916A1

公开(公告)日：2013-12-26

申请号：US14010180

申请日：2013-08-26

Applicant: Digimarc Corporation

Inventor： Tony F. Rodriguez

IPC: H04W4/16

CPC classification number: H04W4/16 ,  H04M1/0272 ,  H04M1/72522 ,  H04M1/72544 ,  H04M2250/52

Abstract: A first device (such as a cell phone) is equipped with a micro-projector, and used to present imagery on a display surface. A second device (such as a second cell phone) is equipped with a digital camera, and used to capture some of the projected imagery. The captured imagery allows a user of the second device to access digital content of interest from a user of the first device, or from elsewhere. The content may be visual, or of other form (content examples include audio, games, maps, text documents, video, spreadsheets, etc.). In one particular arrangement, the projected imagery is encoded with digital watermark data. Through such arrangements, one user can readily share content, and also engage in collaborative activities—such as cooperative game play, with one or more other users. A great variety of other features and arrangements are also detailed.

Abstract translation: 第一设备（例如手机）配备有微型投影仪，并用于在显示器表面上呈现图像。 第二设备（例如第二手机）配备有数码相机，并用于捕获一些投影图像。 所捕获的图像允许第二设备的用户从第一设备的用户或其他地方访问感兴趣的数字内容。 内容可以是视觉的，也可以是其他形式（内容示例包括音频，游戏，地图，文本文档，视频，电子表格等）。 在一个特定的布置中，投影图像用数字水印数据编码。 通过这样的布置，一个用户可以容易地共享内容，并且还与一个或多个其他用户进行协作活动，例如合作游戏。 还详细介绍了各种各样的其他功能和安排。