公开(公告)号：US20240193866A1

公开(公告)日：2024-06-13

申请号：US18078832

申请日：2022-12-09

申请人： Yannick VERDIE ,  Zihao YANG ,  Deepak SRIDHAR ,  Steven George MCDONAGH ,  Juwei LU

发明人： Yannick VERDIE ,  Zihao YANG ,  Deepak SRIDHAR ,  Steven George MCDONAGH ,  Juwei LU

IPC分类号： G06T17/20 ,  G06F3/01 ,  G06V40/20

CPC分类号： G06T17/20 ,  G06F3/017 ,  G06V40/28

摘要： Methods and systems for estimation of a 3D hand pose are disclosed. A 2D image containing a detected hand is processed using a U-net network to obtain a global feature vector and a heatmap for the keypoints of the hand. Information from the global feature vector and the heatmap are concatenated to obtain a set of input tokens that are processed using a transformer encoder to obtain a first set of 2D keypoints representing estimated 2D locations of the keypoints in a first view. The first set of 2D keypoints are inputted as a query to a transformer decoder, to obtain a second set of 2D keypoints representing estimated 2D locations of the keypoints in a second view. The first and second sets of 2D keypoints are aggregated to output the set of estimated 3D keypoints.

公开(公告)号：US20240054757A1

公开(公告)日：2024-02-15

申请号：US18327384

申请日：2023-06-01

申请人： Yanhui GUO ,  Deepak SRIDHAR ,  Peng DAI ,  Juwei LU

发明人： Yanhui GUO ,  Deepak SRIDHAR ,  Peng DAI ,  Juwei LU

IPC分类号： G06V10/62 ,  G06V10/24 ,  G06V10/44 ,  G06V10/764 ,  G06V10/80 ,  G06V10/82

CPC分类号： G06V10/62 ,  G06V10/24 ,  G06V10/44 ,  G06V10/764 ,  G06V10/806 ,  G06V10/82

摘要： Systems and methods for temporal action localization of video data are described. A feature representation extracted from video data has a temporal dimension and a spatial dimension. The feature representation is self-aligned in the spatial dimension. Spatial multi-sampling is performed to obtain a plurality of sparse samples of the self-aligned representation along the spatial dimension, and the multi-sampled representation is fused with the self-aligned representation. Attention-based context information aggregation is applied on the fused representation to obtain a spatially refined representation. Local temporal information aggregation is applied on the self-aligned representation to obtain a temporally refined representation. Action localization is performed on a concatenation of the spatially refined representation and the temporally refined representation.

公开(公告)号：US11698926B2

公开(公告)日：2023-07-11

申请号：US17524862

申请日：2021-11-12

申请人： Arnab Kumar Mondal ,  Deepak Sridhar ,  Niamul Quader ,  Juwei Lu ,  Peng Dai ,  Chao Xing

发明人： Arnab Kumar Mondal ,  Deepak Sridhar ,  Niamul Quader ,  Juwei Lu ,  Peng Dai ,  Chao Xing

IPC分类号： G06F16/30 ,  G06F16/732 ,  G06N3/04 ,  G06F16/783 ,  G06V20/40

CPC分类号： G06F16/7343 ,  G06F16/783 ,  G06N3/04 ,  G06V20/40

摘要： Methods and systems are described for performing video retrieval together with video grounding. A word-based query for a video is and encoded into a query representation using a trained query encoder. One or more similar video representations are identified, from a plurality of video representations that are similar to the query representation. Each similar video representation represents a respective relevant video. A grounding is generated for each relevant video by forward propagating each respective similar video representation together with the query representation through a trained grounding module. The relevant videos or identifiers of the relevant videos are outputted together with the grounding generated for each relevant video.

公开(公告)号：US20230153352A1

公开(公告)日：2023-05-18

申请号：US17524862

申请日：2021-11-12

申请人： Arnab Kumar MONDAL ,  Deepak SRIDHAR ,  Niamul QUADER ,  Juwei LU ,  Pen DAI ,  Chao XING

发明人： Arnab Kumar MONDAL ,  Deepak SRIDHAR ,  Niamul QUADER ,  Juwei LU ,  Pen DAI ,  Chao XING

IPC分类号： G06F16/732 ,  G06F16/783 ,  G06K9/00 ,  G06N3/04

CPC分类号： G06F16/7343 ,  G06F16/783 ,  G06K9/00711 ,  G06N3/04

摘要： Methods and systems are described for performing video retrieval together with video grounding. A word-based query for a video is and encoded into a query representation using a trained query encoder. One or more similar video representations are identified, from a plurality of video representations that are similar to the query representation. Each similar video representation represents a respective relevant video. A grounding is generated for each relevant video by forward propagating each respective similar video representation together with the query representation through a trained grounding module. The relevant videos or identifiers of the relevant videos are outputted together with the grounding generated for each relevant video.

公开(公告)号：US20220303560A1

公开(公告)日：2022-09-22

申请号：US17203613

申请日：2021-03-16

申请人： Deepak SRIDHAR ,  Niamul QUADER ,  Srikanth MURALIDHARAN ,  Yaoxin LI ,  Juwei LU ,  Peng DAI

发明人： Deepak SRIDHAR ,  Niamul QUADER ,  Srikanth MURALIDHARAN ,  Yaoxin LI ,  Juwei LU ,  Peng DAI

IPC分类号： H04N19/20 ,  G06N3/04 ,  G06N3/08

摘要： Systems, methods, and computer media of processing a video are disclosed. An example method may include: receiving a plurality of video frames of a video; generating a plurality of first input features based on the plurality of video frames; generating a plurality of second input features based on reversing a temporal order of the plurality of first input features; generating a first set of joint attention features based on the plurality of first input features; generating a second set of joint attention features based on the plurality of second input features; and concatenating the first set of joint attention features and the second set of joint attention features to generate a final set of joint attention features.

公开(公告)号：US09777920B2

公开(公告)日：2017-10-03

申请号：US14116627

申请日：2012-05-11

申请人： Liang-Shih Fan ,  Deepak Sridhar ,  Fanxing Li

发明人： Liang-Shih Fan ,  Deepak Sridhar ,  Fanxing Li

IPC分类号： F23C10/04 ,  F23C13/08 ,  F23C99/00

CPC分类号： F23C13/08 ,  F23C10/04 ,  F23C99/00 ,  F23C2900/99008 ,  Y02E20/346

摘要： In accordance with one embodiment of the present disclosure, an oxygen carrying material may include a primary active mass, a primary support material, and a secondary support material. The oxygen carrying material may include about 20% to about 70% by weight of the primary active mass, the primary active mass including a composition having a metal or metal oxide selected from the group consisting of Fe, Co, Ni, Cu, Mo, Mn, Sn, Ru, Rh, and combinations thereof. The oxygen carrying material may include about 5% to about 70% by weight of a primary support material. The oxygen carrying material may include about 1% to about 35% by mass of a secondary support material.

公开(公告)号：US20230419733A1

公开(公告)日：2023-12-28

申请号：US17846770

申请日：2022-06-22

申请人： Yannick VERDIE ,  Zi Hao YANG ,  Deepak SRIDHAR ,  Juwei LU

发明人： Yannick VERDIE ,  Zi Hao YANG ,  Deepak SRIDHAR ,  Juwei LU

IPC分类号： G06V40/20 ,  G06V20/64 ,  G06V30/14 ,  G06T7/246 ,  G06T7/73

CPC分类号： G06V40/28 ,  G06V20/64 ,  G06V30/1456 ,  G06T7/246 ,  G06T7/73 ,  G06T2207/30196

摘要： Methods and devices are described for computer vision-based gesture detection. From a frame of image data, extracted locations of keypoints of a detected hand are obtained. The extracted locations are normalized to obtain normalized features. The normalized features are processed using a trained decision tree ensemble to generate a probability of a valid gesture for the detected hand. The generated probability is compared with a defined decision threshold to generate a binary classification to classify the detected hand as a valid gesture or invalid gesture.

公开(公告)号：US20210279595A1

公开(公告)日：2021-09-09

申请号：US16810524

申请日：2020-03-05

申请人： Deepak SRIDHAR ,  Juwei LU

发明人： Deepak SRIDHAR ,  Juwei LU

IPC分类号： G06N3/08 ,  G06N3/04

摘要： Methods, devices and processor-readable media for an integrated teacher-student machine learning system. One or more teacher-student modules are trained as part of the teacher neural network training. Each student sub-network uses a portion of the teacher neural network to generate an intermediate feature map, then provides the intermediate feature map to a student sub-network to generate inferences. The student sub-network may use a feature enhancement block to map the intermediate feature map to a subsequent feature map. A compression block may be used to compress intermediate feature map data for transmission in some embodiments.

公开(公告)号：US20140295361A1

公开(公告)日：2014-10-02

申请号：US14116627

申请日：2012-05-11

申请人： Liang-Shih Fan ,  Deepak Sridhar ,  Fanxing Li

发明人： Liang-Shih Fan ,  Deepak Sridhar ,  Fanxing Li

IPC分类号： F23C13/08 ,  F23C10/04

CPC分类号： F23C13/08 ,  F23C10/04 ,  F23C99/00 ,  F23C2900/99008 ,  Y02E20/346

摘要： In accordance with one embodiment of the present disclosure, an oxygen carrying material may include a primary active mass, a primary support material, and a secondary support material. The oxygen carrying material may include about 20% to about 70% by weight of the primary active mass, the primary active mass including a composition having a metal or metal oxide selected from the group consisting of Fe, Co, Ni, Cu, Mo, Mn, Sn, Ru, Rh, and combinations thereof. The oxygen carrying material may include about 5% to about 70% by weight of a primary support material. The oxygen carrying material may include about 1% to about 35% by mass of a secondary support material.

摘要翻译： 根据本公开的一个实施例，氧气携带材料可以包括主要活性物质，主要载体材料和辅助载体材料。 含氧材料可以包括主要活性物质的约20重量％至约70重量％，主要活性物质包括具有选自Fe，Co，Ni，Cu，Mo的金属或金属氧化物的组合物， Mn，Sn，Ru，Rh及其组合。 携氧材料可以包括约5％至约70％重量的主要载体材料。 携氧材料可以包括约1％至约35质量％的第二载体材料。

公开(公告)号：US20120171588A1

公开(公告)日：2012-07-05

申请号：US13394572

申请日：2010-09-08

申请人： Liang-Shih Fan ,  Fanxing Li ,  Liang Zeng ,  Deepak Sridhar

发明人： Liang-Shih Fan ,  Fanxing Li ,  Liang Zeng ,  Deepak Sridhar

IPC分类号： H01M8/06 ,  H01M8/18

CPC分类号： H01M8/0618 ,  B01J7/00 ,  C01B3/063 ,  C01B3/34 ,  C01B3/344 ,  C01B2203/0216 ,  C01B2203/0222 ,  C01B2203/0233 ,  C01B2203/0238 ,  C01B2203/066 ,  C01B2203/0827 ,  C01B2203/148 ,  C10J3/46 ,  C10J3/725 ,  C10J2300/0916 ,  C10J2300/093 ,  C10J2300/0959 ,  C10J2300/0993 ,  C10J2300/1612 ,  C10J2300/1646 ,  C10J2300/1678 ,  C10J2300/1807 ,  C10K1/003 ,  C10K1/024 ,  C10K3/026 ,  C25B1/04 ,  C25B3/00 ,  H01M8/0643 ,  H01M8/1007 ,  H01M8/1016 ,  H01M8/145 ,  H01M2008/1293 ,  H01M2008/147 ,  H01M2300/0051 ,  H01M2300/0071 ,  Y02E20/18 ,  Y02E20/185 ,  Y02E60/36 ,  Y02E60/366 ,  Y02E60/50 ,  Y02E60/525 ,  Y02E60/526 ,  Y02P20/134 ,  Y02P20/146 ,  Y02P70/56

摘要： High efficiency electricity generation processes and systems with substantially zero CO2 emissions are provided. A closed looping between the unit that generates gaseous fuel (H2, CO, etc) and the fuel cell anode side is formed. In certain embodiments, the heat and exhaust oxygen containing gas from the fuel cell cathode side are also utilized for the gaseous fuel generation. The systems for converting fuel may comprise reactors configured to conduct oxidation-reduction reactions. The resulting power generation efficiencies are improved due to the minimized steam consumption for the gaseous fuel production in the fuel cell anode loop as well as the strategic mass and energy integration schemes.

摘要翻译： 提供了高效发电过程和基本上零二氧化碳排放的系统。 形成产生气体燃料（H2，CO等）的单元与燃料电池阳极侧之间的闭环。 在某些实施例中，来自燃料电池阴极侧的含有热和废气的含氧气体也用于产生气体燃料。 用于转化燃料的系统可以包括被配置为进行氧化还原反应的反应器。 由于燃料电池阳极回路中的气体燃料生产的最小蒸汽消耗以及战略质量和能量集成方案，所得到的发电效率得到改善。