-
公开(公告)号:US11157554B2
公开(公告)日:2021-10-26
申请号:US16674402
申请日:2019-11-05
Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
Inventor: Chuang Gan , Abhishek Bhandwaldar , Yang Zhang , Xiaoxiao Guo
IPC: G06F16/30 , G06F16/73 , G06N20/00 , G06F16/783 , G06F16/901 , G06F16/242
Abstract: A method, system, and program product for generating and modifying a video response is provided. The method includes receiving an audio/video file. Parsed video features of the audio/video file are generated with respect to a first graph. Parsed audio features of the audio/video file are generated with respect to a second graph. The first graph is placed overlaying the second graph and at least one intersection point between the first graph and the second graph is determined. A natural language query is executed with respect to the audio/video file and a parsed query entity is generated from the natural language query. The parsed query entity is analyzed with respect to the intersection point and a node of the intersection point comprising similar features is determined with respect to the parsed query entity. A resulting natural language response with respect to the natural language query is generated.
-
公开(公告)号:US20210383497A1
公开(公告)日:2021-12-09
申请号:US16894343
申请日:2020-06-05
Inventor: Ao Liu , Sijia Liu , Abhishek Bhandwaldar , Chuang Gan , Lirong Xia , Qi Cheng Li
Abstract: Interpretation maps of deep neural networks are provided that use Renyi differential privacy to guarantee the robustness of the interpretation. In one aspect, a method for generating interpretation maps with guaranteed robustness includes: perturbing an original digital image by adding Gaussian noise to the original digital image to obtain m noisy images; providing the m noisy images as input to a deep neural network; interpreting output from the deep neural network to obtain m noisy interpretations corresponding to the m noisy images; thresholding the m noisy interpretations to obtain a top-k of the m noisy interpretations; and averaging the top-k of the m noisy interpretations to produce an interpretation map with certifiable robustness.
-
公开(公告)号:US11663851B2
公开(公告)日:2023-05-30
申请号:US16790672
申请日:2020-02-13
Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
Inventor: Justin David Weisz , Abhishek Bhandwaldar , Maryam Ashoori , Arunima Chaudhary , Benjamin Hoover
CPC classification number: G06V40/168 , G06N5/02 , G06V10/761 , G06V20/46 , G06V40/20 , G08B21/24 , G10L25/51
Abstract: An implicit bias monitoring system is provided. The system receives sensor data including video and audio that are captured during an interaction between a first individual and a second individual. The system determines a set of attributes associated with the interaction based on the received sensor data, the set of attributes comprising at least one of race and gender of the second individual. The system detects an implicit bias based on a combination of the determined set of attributes and a bias profile. The system generates an alert based on the detected implicit bias.
-
公开(公告)号:US20210256832A1
公开(公告)日:2021-08-19
申请号:US16790672
申请日:2020-02-13
Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
Inventor: Justin David Weisz , Abhishek Bhandwaldar , Maryam Ashoori , Arunima Chaudhary , Benjamin Hoover
Abstract: An implicit bias monitoring system is provided. The system receives sensor data including video and audio that are captured during an interaction between a first individual and a second individual. The system determines a set of attributes associated with the interaction based on the received sensor data, the set of attributes comprising at least one of race and gender of the second individual. The system detects an implicit bias based on a combination of the determined set of attributes and a bias profile. The system generates an alert based on the detected implicit bias.
-
公开(公告)号:US11341598B2
公开(公告)日:2022-05-24
申请号:US16894343
申请日:2020-06-05
Inventor: Ao Liu , Sijia Liu , Abhishek Bhandwaldar , Chuang Gan , Lirong Xia , Qi Cheng Li
Abstract: Interpretation maps of deep neural networks are provided that use Renyi differential privacy to guarantee the robustness of the interpretation. In one aspect, a method for generating interpretation maps with guaranteed robustness includes: perturbing an original digital image by adding Gaussian noise to the original digital image to obtain m noisy images; providing the m noisy images as input to a deep neural network; interpreting output from the deep neural network to obtain m noisy interpretations corresponding to the m noisy images; thresholding the m noisy interpretations to obtain a top-k of the m noisy interpretations; and averaging the top-k of the m noisy interpretations to produce an interpretation map with certifiable robustness.
-
公开(公告)号:US20220083881A1
公开(公告)日:2022-03-17
申请号:US17020299
申请日:2020-09-14
Applicant: International Business Machines Corporation
Inventor: Arunima Chaudhary , Dakuo Wang , David John Piorkowski , Daniel M. Gruen , Chuang Gan , Peter Daniel Kirchner , Gregory Bramble , Bei Chen , Abel Valente , Carolina Maria Spina , John Thomas Richards , Abhishek Bhandwaldar
Abstract: An automated analytic tool (AAT) apparatus analyzes a machine learning system (MLS). The tool comprises a processor configured to receive experiment parameters associated with an experiment performed on the MLS, and captures information from a plurality of stages of the experiment. The information comprises information regarding MLS results and choices made during the experiment. The tool automatically revise the captured information into revised information utilizing a knowledge base comprising information from prior experiments. The tool then presents the revised information to a user.
-
公开(公告)号:US20210133236A1
公开(公告)日:2021-05-06
申请号:US16674402
申请日:2019-11-05
Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
Inventor: Chuang Gan , Abhishek Bhandwaldar , Yang Zhang , Xiaoxiao Guo
IPC: G06F16/73 , G06F16/901 , G06F16/783 , G06N20/00
Abstract: A method, system, and program product for generating and modifying a video response is provided. The method includes receiving an audio/video file. Parsed video features of the audio/video file are generated with respect to a first graph. Parsed audio features of the audio/video file are generated with respect to a second graph. The first graph is placed overlaying the second graph and at least one intersection point between the first graph and the second graph is determined. A natural language query is executed with respect to the audio/video file and a parsed query entity is generated from the natural language query. The parsed query entity is analyzed with respect to the intersection point and a node of the intersection point comprising similar features is determined with respect to the parsed query entity. A resulting natural language response with respect to the natural language query is generated.
-
-
-
-
-
-