Real-time video overlaying display

    公开(公告)号:US12069322B2

    公开(公告)日:2024-08-20

    申请号:US17979056

    申请日:2022-11-02

    摘要: Technologies relating to system and method of real-time video overlaying or superimposing display from multiple mutually synchronous cameras are disclosed. An example method of real-time video overlaying includes the steps of: synchronizing frame rates of a depth data, a face metadata, and a video data of a first camera video output captured by a first camera; determining a first depth between a user face and the first camera; using a cutoff depth to determine a user body contour; generating a binary mask of the user body contour based on the first depth and the cutoff depth; smoothing an edge of the binary mask; merging the binary mask with the first camera video output and generating a merged first camera video output; and overlaying the merged first camera video output onto a second camera video output.

    Convolutional computing using multilayered analysis engine

    公开(公告)号:US11657288B2

    公开(公告)日:2023-05-23

    申请号:US16895071

    申请日:2020-06-08

    申请人: Affectiva, Inc.

    摘要: Disclosed embodiments provide for deep convolutional neural network computing. The convolutional computing is accomplished using a multilayered analysis engine. The multilayered analysis engine includes a deep learning network using a convolutional neural network (CNN). The multilayered analysis engine is used to analyze multiple images in a supervised or unsupervised learning process. Multiple images are provided to the multilayered analysis engine, and the multilayered analysis engine is trained with those images. A subject image is then evaluated by the multilayered analysis engine. The evaluation is accomplished by analyzing pixels within the subject image to identify a facial portion and identifying a facial expression based on the facial portion. The results of the evaluation are output. The multilayered analysis engine is retrained using a second plurality of images.

    Audio and video stream rendering modification based on device rotation metric

    公开(公告)号:US11381805B2

    公开(公告)日:2022-07-05

    申请号:US17086333

    申请日:2020-10-31

    摘要: Disclosed techniques include audio and visual stream rendering modification based on device rotation metric. One or more media streams are received from a server. The one or more media streams are targeted for display on a handheld media stream playback device. An orientation of the handheld device is determined during playback of at least one of the one or more media streams on the handheld device. A change in orientation of the handheld device is detected. The change occurs during playback of the at least one of the one or more media streams. Based on detecting the change in orientation, a rotation angle of the handheld device is calculated. Based on the rotation angle, the playback of at least one of the one or more media streams is changed on the handheld device.

    Data flow graph computation using exceptions

    公开(公告)号:US10949328B2

    公开(公告)日:2021-03-16

    申请号:US16502110

    申请日:2019-07-03

    摘要: Techniques are disclosed for data manipulation within a reconfigurable computing environment for data flow graph computation using exceptions. Processing elements are configured within a reconfigurable fabric to implement a data flow graph. The processing elements are loaded with process agents. Valid data is executed by a first process agent on a first processing element, where the first process agent corresponds to a starting node of the data flow graph. A second processing element detects that an error exception has occurred, where a second process agent is running on the second processing element. A done signal to a third process agent is withheld by the second process agent, where the third process agent is running on a third processing element. The second process agent raises an interrupt request, where the interrupt request is based on the detecting that an error exception has occurred.

    Artificial neural network functionality using dynamic random-access memory

    公开(公告)号:US10818344B1

    公开(公告)日:2020-10-27

    申请号:US16517807

    申请日:2019-07-22

    摘要: Techniques are disclosed for artificial neural network functionality within dynamic random-access memory. A plurality of dynamic random-access cells is accessed within a memory block. Data within the plurality of dynamic random-access cells is sensed using a plurality of sense amplifiers associated with the plurality of dynamic random-access cells. A plurality of select lines coupled to the plurality of sense amplifiers is activated to facilitate the sensing of the data within the plurality of dynamic random-access cells, wherein the activating is a function of inputs to a layer within a neural network, and wherein a bit within the plurality of dynamic random-access cells is sensed by a first sense amplifier and a second sense amplifier within the plurality of sense amplifiers. Resulting data is provided based on the activating wherein the resulting data is a function of weights within the neural network.

    Processor supporting arithmetic instructions with branch on overflow and methods

    公开(公告)号:US10768930B2

    公开(公告)日:2020-09-08

    申请号:US14612104

    申请日:2015-02-02

    申请人: MIPS Tech, LLC

    摘要: A method provides for decoding, in a microprocessor, an instruction into data identifying a first register, a second register, an immediate value, and an opcode identifier. The opcode identifier is interpreted as indicating that an arithmetic operation is to be performed on the first register and the second register, and that the microprocessor is to perform a change of control operation in response to the addition of the first register and the second register causing overflow or underflow. The change of control operation is to a location in a program determined based on the immediate value. A processor can be provided with a decoder and other supporting circuitry to implement such method. Overflow/underflow can be checked on word boundaries of a double-word operation.

    Energy management with multiple pressurized storage elements

    公开(公告)号:US10725441B2

    公开(公告)日:2020-07-28

    申请号:US16118886

    申请日:2018-08-31

    摘要: Disclosed techniques include energy management with multiple pressurized storage elements. Energy is obtained from one or more energy sources. Energy requirements are modeled over a first time period and a second time period. A first subset of the energy that was obtained is allocated for storage in a first energy store based on the modeling. A second subset of the energy that was obtained is allocated for storage in a second energy store based on the modeling, where the second energy store comprises a pressurized storage element. Energy is routed to the first energy store from the second energy store based on the modeling. Recovering energy further includes using the energy routed to the first energy store or the second energy store, based on the modeling.

    Joining data within a reconfigurable fabric

    公开(公告)号:US10659396B2

    公开(公告)日:2020-05-19

    申请号:US16021840

    申请日:2018-06-28

    摘要: Techniques are disclosed for managing data within a reconfigurable computing environment. In a multiple processing element environment, such as a mesh network or other suitable topology, there is an inherent need to pass data between processing elements. Subtasks are divided among multiple processing elements. The output resulting from the subtasks is then merged by a downstream processing element. In such cases, a join operation can be used to combine data from multiple upstream processing elements. A control agent executes on each processing element. A memory buffer is disposed between upstream processing elements and the downstream processing element. The downstream processing element is configured to automatically perform an operation based on the availability of valid data from the upstream processing elements.