公开(公告)号：US20240111964A1

公开(公告)日：2024-04-04

申请号：US18454136

申请日：2023-08-23

申请人： Tata Consultancy Services Limited

发明人： Arpita KUNDU ,  Subhasish Ghosh ,  Pratik Saini ,  Indrajit Bhattacharya ,  Tapas Nayak

IPC分类号： G06F40/40 ,  G06F16/35 ,  G06F40/137 ,  G06F40/186

CPC分类号： G06F40/40 ,  G06F16/35 ,  G06F40/137 ,  G06F40/186

摘要： Technical interviewing is important for organizations for assessing a candidate to make hiring decision. For effective technical interviewing, predicting difficulty of long form technical questions is crucial. The present disclosure provides systems and methods for predicting difficulty of long form technical questions using weak supervision from textbooks. Further, zero shot pre-trained large language models and unsupervised template-based technique are used for generating questions. Furthermore, a difficulty score is assigned to the generated questions based on context difficulty and task difficulty. The context difficulty for the generated questions is computed using hierarchical structure of the textbooks, and the task difficulty is computed by determining a similarity between the generated questions and Bloom's taxonomy levels. In the present disclosure, few supervised question difficulty prediction models are trained by means of weak supervision using the generated questions and corresponding difficulty scores and further evaluated for prediction performance using a gold-standard question difficulty dataset.