SYSTEMS AND METHODS FOR MONITORING CONSUMPTION

    公开(公告)号:WO2019159006A1

    公开(公告)日:2019-08-22

    申请号:PCT/IB2019/000165

    申请日:2019-02-14

    Abstract: A wearable apparatus may automatically monitor consumption by a user of the wearable apparatus by analyzing images captured from an environment of the user. The wearable apparatus may include at least one image capture device configured to capture a plurality of images from an environment of the user of the wearable apparatus. The wearable apparatus may also include at least one processing device configured to: analyze the plurality of images to detect a consumable product represented in at least one of the plurality of images; based on the detection of the consumable product represented in at least one of the plurality of images, analyze one or more of the plurality of images to determine a type indicator associated with the detected consumable product; analyze the one or more of the plurality of images to estimate an amount of the consumable product consumed by the user; determine a feedback based on the type indicator of the detected consumable product and the estimated amount of the consumable product consumed by the user; and cause the feedback to be outputted to the user.

    APPARATUS AND METHOD FOR PERFORMING ACTIONS BASED ON CAPTURED IMAGE DATA

    公开(公告)号:WO2014140816A3

    公开(公告)日:2014-09-18

    申请号:PCT/IB2014/000850

    申请日:2014-03-06

    Abstract: An apparatus and method are provided for performing one or more actions based on triggers detecting within captured image data. In one implementation, a method is provided for audibly reading text retrieved from a captured image. According to the method, real-time image data is captured from an environment of a user, and an existence of a trigger is determined within the captured image data. In one aspect, the trigger may be associated with a desire of the user to hear text read aloud, and the trigger identifies an intermediate portion of the text a distance from a level break in the text. The method includes performing a layout analysis on the text to identify the level break associated with the trigger, and reading aloud text beginning from the level break associated with the trigger.

    WEARABLE APPARATUS AND METHODS
    4.
    发明申请

    公开(公告)号:WO2020121056A3

    公开(公告)日:2020-06-18

    申请号:PCT/IB2019/001304

    申请日:2019-12-12

    Abstract: Systems and methods are disclosed for using a wearable apparatus in social events. In one implementation, a system may comprise an image sensor, an audio sensor, and a processor. The processor may be configured to receive images captured by the image sensor and receive an audio signal representative of sound captured by the audio sensor. The processor may determine, based on the images or the audio signal, whether an individual is a recognized individual of the user. When the individual is not recognized, the processor may identify the individual based on an external resource. The processor may further identify a content source associated with the individual, identify a content item associated with the individual, and provide the content item to a computing device associated with the user.

    SYSTEMS AND METHODS FOR PROVIDING FEEDBACK BASED ON THE STATE OF AN OBJECT

    公开(公告)号:WO2014140906A3

    公开(公告)日:2014-09-18

    申请号:PCT/IB2014/001168

    申请日:2014-03-11

    Abstract: A device and method are provided for providing feedback based on the state of an object. In one implementation, an apparatus for processing images is provided. The apparatus may include an image sensor configured to capture real time images from an environment of a user and at least one processor device configured to initially process at least one image to determine whether an object is likely to change its state. If a determination is made that the object is unlikely to change its state, the at least one processor device may additionally process the at least one image and provide a first feedback. If a determination is made that the object is likely to change its state, the at least one processor device may continue to capture images of the object and alert the user with a second feedback after a change in the state of the object occurs.

    APPARATUS AND METHOD FOR EXECUTING SYSTEM COMMANDS BASED OH CAPTURED IMAGE DATA
    7.
    发明申请
    APPARATUS AND METHOD FOR EXECUTING SYSTEM COMMANDS BASED OH CAPTURED IMAGE DATA 审中-公开
    用于执行基于系统命令的OH捕获图像数据的装置和方法

    公开(公告)号:WO2014140800A1

    公开(公告)日:2014-09-18

    申请号:PCT/IB2014/000758

    申请日:2014-02-26

    Abstract: An apparatus and method are provided for identifying and executing system commands based on captured image data. In one implementation, a method is provided for executing at least one command retrieved from a captured image. According to the method, image data is received from an image sensor, and the image data may include printed information associated with a specific system commands. The method further includes accessing a database including a plurality of predefined system commands associated with printed information, and identifying in the image data an existence of the printed information associated with the specific system command stored in the database. The specific system command is executed after the printed information associated with the specific system command is identified.

    Abstract translation: 提供了一种基于捕获的图像数据来识别和执行系统命令的装置和方法。 在一个实现中,提供了一种用于执行从捕获的图像检索的至少一个命令的方法。 根据该方法,从图像传感器接收图像数据,并且图像数据可以包括与特定系统命令相关联的打印信息。 该方法还包括访问包括与打印信息相关联的多个预定义系统命令的数据库,以及在图像数据中识别与存储在数据库中的特定系统命令相关联的打印信息的存在。 在与特定系统命令相关联的打印信息被识别之后执行特定系统命令。

    WEARABLE SYSTEMS AND METHODS FOR SELECTIVELY READING TEXT

    公开(公告)号:WO2021116760A1

    公开(公告)日:2021-06-17

    申请号:PCT/IB2020/001029

    申请日:2020-12-10

    Abstract: Systems and methods are disclosed for selectively reading text. A system may comprise an image capture device, an audio capture device, and a processor. The processor may be configured to receive images captured by the image capture device and audio signals captured by the audio capture device. The processor may analyze the image to identify text represented in the image; identify, based on the image, a structural element of the text; identify a request to read a first portion of the text associated with the structural element, the request being identified by at least one of analyzing the audio signals to detect a spoken request or detecting a gesture in the plurality of images; and present the first portion of text to the user of the wearable device.

    WEARABLE SYSTEMS AND METHODS FOR LOCATING AN OBJECT

    公开(公告)号:WO2021099833A1

    公开(公告)日:2021-05-27

    申请号:PCT/IB2020/000951

    申请日:2020-11-16

    Abstract: Systems and methods are disclosed for locating an object for a user. A system may comprise an image capture device, an audio capture device, and a processor. The processor may be configured to receive images captured by the image capture device and audio signals received by the audio capture device. The processor may analyze the audio signals to identify a descriptor word describing the object and retrieve a visual characteristic of the object based on the descriptor word. The processor may then determine a location of the object in the images based on the visual characteristic, determine a location of a hand of the user in the images, and determine a direction between the hand and the object. The processor may then determine feedback indicative of the direction and provide the feedback to the user.

    HEARING AID SYSTEM WITH DIFFERENTIAL GAIN
    10.
    发明申请

    公开(公告)号:WO2021038295A1

    公开(公告)日:2021-03-04

    申请号:PCT/IB2020/000698

    申请日:2020-08-26

    Abstract: A hearing aid and related systems and methods are disclosed. In one implementation, a hearing aid system (2300) may include a wearable camera (2301); a microphone (2302); and a processor (2303). The processor (2303) may be programmed to receive images captured by the camera (2301); receive audio signals representative of sounds received by the at least one microphone (2302); determine a look direction (2030) of the user based on analysis of the images; determine an amplitude of a first audio signal associated with an individual or object in a region associated with the look direction of the user; determine an amplitude of a second audio signal from a region other than the look direction of the user; adjust the second amplitude in accordance with the first amplitude; and cause transmission of the second audio signal at the adjusted amplitude to a hearing interface device configured to provide sound to an ear of the user (100).

Patent Agency Ranking