What is the Challenge

Develop an Artificial Intelligence computational framework to quantify human behavior from recorded videos in the context of job interviews

In effect, build a computational framework that can automatically predict the overall rating of a job interview given the audio-visual recordings and score them on behavioral competencies.

Challenge Description

Real world hiring decisions are based on assessments of knowledge and skills as well as holistic judgments of person-job fit. Empirical studies show that non-verbal behavior is as important as the verbal response in job interviews.

The success or failure of the interviewee's effort is traditionally assessed subjectively by the interviewer, either through a holistic impression or quantitative ratings. The validity and reliability of these assessments is subject to much debate.

The new emerging alternative to the traditional human-only interview assessment model is to augment human judgment with automated assessment of interview performance. This is being done by conducting robot video-based interviews bringing many benefits to both interviewers and interviewees, including the convenience of offline reviewing and decision making by human resources enables 4X faster hiring.

The challenge is to build an automated scoring model to predict behavioral traits of candidates who take their robot interviews using their recorded videos.

What is EvueMe

EvueMe Selection Robot has developed a Robot Interview platform where a human looking Robot interviews the candidates.

Questions to judge the required competencies for a particular job are programmed in our robot. Candidates get an interview invite and call our Robot interviewer "On-Demand" all 24 hours of the day as per their availability.

Once the Robot appears on the screen, she makes the candidate comfortable speaking to her with practice questions and then asks the actual interview questions. The answers to each question by the candidates are recorded as separate videos.

Robot Interview

Challenge Steps

The challenge would involve 3 key steps:

01

Development of a standardized protocol for collecting structured interview (SI) videos and a set of rubrics for the human rating of the recorded performance.

EvueMe

02

Development of a model to automatically extract features from the interview videos. These extracted features will come in 3 buckets

  • Video features - Facial expressions mapping, micro expression analysis and eyeball movements
  • Prosadic Features - Extract Voice prosadic features from speech patterns like intonation, pace, emphasis, vocal pitch, voice intensity, pauses etc
  • Lexical features - Analytics of word choice, intent of words etc.

03

With improved human scores and automated multimodal features, build automated scoring systems to predict several behavioral traits like temperament, ambition, communication, cooperative, systematic, integrity, creativity etc. in the job interview

EvueMe

What is the desired output?

A computational framework that can automatically predict the overall rating of a job interview given the audio-visual recordings and score them on behavioral competencies built by analyzing at least 300 recorded interviews.

Eligibility Criteria

  • This challenge is only open to teams
  • Teams can be of 2-4 members
  • Team members can be B.Tech/ M. Tech students, Research/PHD scholars, I-O psychologists, and /or professors from academic institutions

Process of Applications

  • Please click here to apply
  • Teams can call us at +919341555666 for any clarifications on the challenge while writing their approach note.
  • Applications for this round close at 23:59 Hrs of 29th Feb, 2020.
  • Shortlisted teams move to the next round

Stage 2 of Shortlisting

  • Shortlisted teams get 1-1 communication from the EvueMe- WAIN office
  • Shortlisted teams prepare a presentation not lasting more than 30 min
  • Individual team presentations to the jury between 9th to 13th of March 2020

Final Jury Round

  • The finalists will be invited to New Delhi
  • Presentations to the Jury by End March/Early April, 2020
  • The winners get announced within a week of final presentations.
  • All finalists get a certificate of excellence and to/fro travel to New Delhi.

Expectation from the Winning team

  • The winning team works closely with the EvueMe-WAIN mentors
  • They complete the desired output from the challenge by 30th July, 2020

What does the winning team get?

  • Cash award of Rs 1 Lac
  • Publicity through WAIN Connect platform
  • Certificate on completion of challenge objectives
  • Opportunity to get absorbed in the company.

General Instructions

  • To & fro travel to Delhi for the finalists will be reimbursed by 2nd AC train travel
  • The winning team will get a cash award of Rs 1 lac. 25% of this award money will be given on being declared winner, 25% on completion of 300 Structured interviews, 50% on development of training the model to predict behavioral competencies.

Jury Panel

Vinod Sood
Vinod Sood
Sujit Bhattacharyya
Sujit Bhattacharyya
Rupak Agarwal
Rupak Agarwal
Dr. Prasenjit Banerjee
Dr. Prasenjit Banerjee