Please note: AI Interview is currently a beta feature. Functionality, settings, and availability may change before general release.
AI Interview helps hiring teams automate first-round interviews using a conversational AI interviewer. Candidates complete interviews on their own time by phone or computer, while hiring teams receive structured evaluations, transcripts, and AI-generated summaries to help review candidates faster and more consistently.
Unlike traditional interview scheduling, AI Interview allows candidates to complete interviews as soon as they are invited. This helps reduce scheduling delays while giving recruiters more information before deciding which candidates should move forward.
In this article, we will cover:
- Configuring AI Interview
- Adding an AI Interview to a Job
- Candidate Experience
- Reviewing Results
- Permissions
- Frequently Asked Questions
Configuring AI Interview
AI Interview Agents, Interview Guides, and Branding are configured under AI Features in the left navigation. These settings provide the foundation needed before adding AI Interview as a hiring step.
Creating Agents
An Agent is the AI persona that conducts your interviews. Each Agent has a name, voice, and personality. For multi-location organizations, inheritance settings allow you to control which locations can access and use each Agent.
Accessing the Agents tab
Agents can be created and managed from AI Features.
From the left navigation, select AI Features, then open the Agents tab. If no Agents have been created, you will see an empty state with a Create Agent button.
Creating a new Agent
Select Create Agent to open the Agent setup panel.
Configure the following settings:
Agent Name
Choose a name for your Agent, such as Alex or Hireology Interviewer. The Agent name is visible internally and may appear to candidates during the interview experience.
Voice
Select from the available voice options. Each option includes a personality descriptor, such as Warm & Friendly, Professional, or Energetic. Select the play icon to preview a voice before choosing one.
Inheritance settings (multi-location organizations only)
Organizations with multiple locations can choose how Agents are shared across their organization.
- Available at this account: Enabled by default. When disabled, the Agent will not be available for use at that organization.
-
Pass down to all children: Allows child organizations to access the Agent.
- Can Disable: Child organizations can turn off the Agent.
- Cannot Disable: Child organizations cannot turn off the Agent.
Select Save to create the Agent.
Editing or deleting an agent
To update an existing Agent, select the edit (pencil) icon on the Agent card to reopen the setup panel.
To remove an Agent, select the options menu (⋮) and choose Delete. If the Agent has been shared with child organizations, you will be prompted to confirm before removing it.
Inherited Agents
Agents shared by a parent organization appear in a separate Inherited Agents section.
Child organizations can view inherited Agent settings in read-only mode and disable Agents when the parent organization has selected Can Disable.
Inherited Agents cannot be edited, including the Agent name, voice, or other settings.
Creating Interview Guides
An Interview Guide defines the questions your AI Agent will ask during an interview. Guides include different question types, scoring options, and built-in EEO compliance review to help teams create consistent interview experiences.
Creating a new guide
Interview Guides can be created and managed from AI Features → Interview Guides.
Select Create Interview Guide to begin building a guide.
Configure the following settings:
- Guide Name - Enter a descriptive name for your guide, such as RN Behavioral Interview.
- Opening and Closing Statements (optional) - Add welcome and closing messages that the AI Agent will read aloud during the interview.
- Interview Questions - Add up to 10 questions by selecting + Create Question.
AI Interview supports three question types:
- Information Questions - Used to collect factual information, such as availability, certifications, or work authorization. Information questions are not scored and do not include follow-up questions.
-
Assessment Questions - Used to evaluate role-specific knowledge, skills, or qualifications. Assessment questions receive a score from 1–5 and can include up to two configurable follow-up questions. For Assessment questions, you can define scoring criteria using three rubric anchors:
- Score 1: Does not meet expectations
- Score 3: Meets expectations
- Score 5: Exceeds expectations
- Behavioral Questions - Used to gather experience-based examples from candidates. Behavioral questions receive a score from 1–5 and include up to two follow-up questions using the STAR method. Behavioral questions use a standardized STAR rubric that is automatically applied and cannot be customized.
Question scoring and ordering
For scored questions, weights must total 100% across all questions. Questions can be reordered within the guide using drag-and-drop.
EEO question validation
Each interview question and rubric anchor is automatically reviewed when saved.
Potential issues are flagged with one of the following indicators:
- Red: The question cannot be saved as written and must be updated.
- Yellow: The question can still be saved, but the warning is recorded and a warning badge appears on the question card.
The EEO review is intended to provide guidance and is not a legal certification. We recommend consulting your HR or legal team for guidance specific to your roles, industry, and location.
Interview duration estimates
The Interview Guide builder provides an estimated interview duration that updates as questions are added or removed.
AI Interviews have a 25-minute maximum session length.
Guides with seven or fewer questions save without a warning. Guides with eight or more questions display a warning that candidates may not have enough time to complete all questions, but the guide can still be saved.
Inherited Interview Guides
For organizations with multiple locations, Interview Guides follow the same inheritance settings as Agents.
Parent organizations can choose whether guides are available to child organizations and whether child organizations can disable them.
Child organizations can view inherited guides, including questions and rubrics, in read-only mode but cannot edit them.
Branding
The Branding tab under AI Features → Branding allows you to customize the candidate-facing AI Interview experience to match your organization’s identity.
Branding includes the following settings: Logo, Color Palette, AI Interview Support Contact, and a Welcome Video
Logo
Upload your organization’s logo from the Logo card. Supported file formats include:
- JPG
- JPEG
- PNG
- GIF
- SVG
- WEBP
Logos must be at least 200 × 200 pixels and no larger than 10 MB. The logo appears on the candidate-facing AI Interview landing page.
Color Palette
Use the Color Palette settings to customize the look and feel of the interview experience. Both the Brand Primary color and Background Theme are required.
Brand Primary - Enter your brand’s color code using a hex value or select a color using the built-in color picker.
Background Theme - Choose from the available themes: Light, Dark, Brand, or Soft
Background, text, container, and call-to-action button colors are automatically generated based on these settings and cannot be configured individually.
The Start Interview button automatically adjusts between filled and outlined styles to maintain a minimum 4.5:1 contrast ratio against the Brand Primary color.
Accessibility checks based on WCAG guidelines are displayed as a reference. These checks do not prevent saving, even if a warning appears.
Select Reset defaults to restore the inherited parent organization settings or Hireology’s default branding.
AI Interview Support Contact
The AI Interview Support Contact setting allows you to provide candidates with a contact email address for interview-related questions or assistance.
Enter a support email address in the designated field. If no local or inherited support email is configured, AI Interview will default to the job’s hiring manager email address.
Welcome Video
The Welcome Video setting allows you to add a video introduction for candidates before they begin their AI Interview.
Add a video URL from:
- Vimeo (recommended, ad-free)
- Loom
- YouTube
When a YouTube URL is added, a warning will appear during save to notify you that YouTube may display ads to applicants.
You are responsible for maintaining the video link. Hireology cannot detect or recover removed videos or inactive links. If the video is unavailable, candidates will see a broken video player. Candidates see the embedded video on the interview setup page before the AI Interview begins.
Live Preview
The branding preview allows you to see how your AI Interview experience will appear to candidates.
The preview includes:
- Landing page
- Interview questions
- Success page
The preview updates automatically as you make changes to your logo and colors. You do not need to save changes first. On mobile devices, the preview is available through the floating eye icon, which opens the preview as a bottom sheet.
Branding Inheritance
For organizations with multiple locations, each branding setting includes its own inheritance controls. Parent organizations can choose whether branding settings are:
Shared with sub-organizations
- Allows child organizations to use the configured branding.
- Child organizations may either disable or inherit the setting depending on the selected option.
Can Disable
- Child organizations can turn off the inherited setting and create their own configuration.
Cannot Disable
- Child organizations can view the setting but cannot make changes.
Depending on the inheritance configuration, branding cards may appear as:
- Editable: No inherited setting exists. The organization can configure the setting.
- Locked: The setting is inherited and cannot be changed.
- Overridable: The setting is inherited but can be customized locally.
- Overridden: A local customization exists and can be reverted back to the inherited setting.
Availability
If AI Interview Branding is not included in your subscription, the Branding tab will display a Learn More page instead of the available configuration settings.
Adding an AI Interview to a Job
Once an Agent and Interview Guide are configured, AI Interview can be added as a hiring step on any job.
You can also configure automated invitations to send AI Interviews at a specific point in the hiring process.
Adding the AI Interview hiring step
Open the job and navigate to Hiring Steps.
Select + Add another hiring step, then choose AI Interview from the available step options.
Choose an AI Agent and an Interview Guide to associate with the hiring step. Both are required.
If an Agent or Interview Guide has not been created yet, select + New next to the corresponding field to create one without leaving job setup.
After adding the hiring step, AI Interview will appear in the hiring step list with the selected guide name and Agent.
The hiring step can be reordered or removed at any time. If AI Interview is not included in your subscription, the option will appear locked with an explanatory message.
Setting up automated AI Interview invitations
AI Interview invitations can be automatically sent from the Applicants stage. Select the lightning bolt icon to configure automation, then choose Send AI Interview Invitation.
Note: Automated AI Interview invitations and Automated Interview Scheduling cannot both be enabled at the same time.
Choose when invitations should be sent:
-
After passing prescreen score threshold - Automatically sends an AI Interview invitation when a candidate reaches the required prescreen score. Configure:
- Minimum score threshold (50–85%)
- Delivery method (Email or SMS)
- Maximum number of interviews to send (up to 100)
Once the maximum number of interviews is reached, the automation will automatically deactivate and notify the hiring team.
- To all applicants upon application - Automatically sends an AI Interview invitation to every applicant regardless of prescreen score. The score threshold setting is not required when using this option.
Sending an AI Interview invitation manually
AI Interview invitations can also be sent directly from a candidate profile. Open the candidate’s AI Interview hiring step and select Send AI Interview.
Choose the delivery method:
- SMS
- Both
You can also edit the invitation template or message before sending. Invitation links expire seven days after they are sent. Resending an invitation creates a new expiration window.
Candidate Experience
Candidates receive an email or SMS invitation with a link to complete their AI Interview. The invitation includes the expiration date and a disclosure explaining that AI is used as part of the hiring process.
Candidates do not need to create an account and can access the interview from any mobile or desktop browser.
Starting the interview
The AI Interview landing page displays your configured branding, including:
- Organization logo
- Brand colors
- Welcome video (if configured)
- AI Agent name
- Estimated interview duration
- Language selection
Candidates can select from more than 50 supported languages, including English, Spanish, French, German, Portuguese, Mandarin, Arabic, Hindi, Japanese, and more.
Before beginning the interview, candidates complete:
- Microphone Test - Confirms that the candidate’s audio is working. A successful test displays as Complete ✓.
- Practice Question - Provides an unscored sample question so candidates can become familiar with the interview format.
During the Interview
During the interview, the AI Agent asks questions conversationally and evaluates candidate responses based on the configured Interview Guide. Assessment and Behavioral questions may include up to two targeted follow-up questions. The AI Agent does not reveal scoring criteria or rubric details during the interview. Candidates will see captions throughout the interview. A countdown timer appears when five minutes remain in the 25-minute session limit.
Candidate Accommodations
Candidates can access accommodations at any point during the interview. The accommodations menu allows candidates to:
- Ask the AI Agent to repeat a question
- Request additional time to respond
- Ask the AI Agent to speak more slowly
Candidates can also select Request Human Alternative if they would prefer a non-AI interview option. When selected:
- The interview session pauses immediately.
- The hiring team receives an email notification.
- The candidate’s status updates to Assistance Requested.
Interview Disconnections
If a candidate loses connection during an interview, AI Interview will automatically attempt to reconnect once. If the reconnect is successful, the interview will restart from the beginning.
If the reconnect fails or has already been used, the candidate will receive instructions to close the interview window. A recruiter can then send a new invitation.
Reviewing Results
Once a candidate completes an AI Interview, hiring teams can review interview results directly from the candidate profile. The pipeline swimlane provides a quick view of candidate progress, while the candidate results panel includes detailed scores, summaries, and transcripts
Reviewing Results from the Candidate Profile
Open the candidate profile and select the AI Interview hiring step to view results. Results include:
- Overall Score - Displays the candidate’s overall interview score. The score is calculated using only Assessment and Behavioral questions. Information questions do not contribute to the overall score. If a candidate does not answer all required questions, the overall score will display as —.
- AI Disclosure Confirmation - Confirms that the candidate acknowledged AI usage during the interview process.
- Question Breakdown - Displays each interview question with the candidate’s response details.
Question results vary by question type:
-
Information Questions
- Display the candidate’s response only.
- Do not include a score or AI evaluation.
-
Assessment Questions
- Include a 1–5 AI score.
- Include a rationale based on the configured scoring rubric.
- Include an expandable rubric section showing the scoring guidance used.
-
Behavioral Questions
- Include an AI evaluation label.
- Include a written rationale.
- Include the STAR method rubric used for evaluation.
AI Interview Summary and Transcript
The Overview tab provides an AI-generated summary of the candidate’s overall interview performance. The Transcript tab displays the full conversation between the candidate and AI Agent, including:
- Speaker labels
- Candidate responses
- AI follow-up questions
- Interview flow in chronological order
A Translate option is available on question cards to generate an English translation. Select View original to return to the original response.
Overriding AI Scores
Recruiters can adjust scores for Assessment and Behavioral questions when needed. To override a score, open the question result and adjust the 1–5 score selector.A note explaining the reason for the change is required before saving.
When a score is overridden:
- The updated score replaces the AI-generated score.
- The overall score recalculates automatically.
- A visual indicator shows that the score was manually updated.
- The change is recorded in the candidate’s activity history.
Activity history includes:
- User who made the change
- Previous score
- Updated score
- Timestamp
Scores can be overridden multiple times if needed.
Incomplete Interviews
If a candidate skips a question, disconnects, or reaches the session time limit before answering all questions, the overall score will display as —. Individual answered questions will still display available scores and results.
If a candidate reaches the 25-minute session limit, the interview is marked as Completed and scored based on the responses provided. Unanswered questions are excluded from scoring.
Reviewing Results in the Pipeline Swim-lane
The AI Interview swim-lane appears on the In Progress pipeline board for jobs that include an AI Interview hiring step. The swim-lane provides a high-level view of candidate progress but does not display interview scores. Candidate cards display one of the following statuses:
- Not Sent - No AI Interview invitation has been sent.
- Invite Sent - The invitation has been delivered, but the candidate has not started the interview.
- In Progress - The candidate has started the interview but has not submitted it.
- Completed - The candidate has submitted the interview.
- Assistance Requested - The candidate requested a human alternative accommodation.
Select a candidate marked Completed to view their full results, including scores, summaries, and transcripts. Candidates can be manually moved into or out of the AI Interview swim-lane like any other hiring stage.
Permissions
Access to AI Interview is controlled through existing ATS permissions. Different permissions apply depending on whether a user is configuring AI Interview, adding it to a job, or reviewing candidate results.
Configuring AI Interview
Users must have Can access account settings to create, edit, or delete Agents, Interview Guides, or Branding settings within AI Features.
Users with Can edit hiring steps can view the AI Features navigation and its tabs, but they have read-only access. Users without Can access account settings will see a Learn More page instead of editable settings.
The AI Features navigation is only visible to users with either permission.
Adding AI Interview to a Job
Users must have Can Open Jobs or Can Edit Jobs to add an AI Interview hiring step to a job.
Creating a new Agent or Interview Guide directly from job setup requires either:
- Can Edit Hiring Steps, or
- Can access account settings
Without one of these permissions, the + New buttons will be disabled. Users can still select existing Agents and Interview Guides but must contact their account administrator to create new ones.
Reviewing Results
Viewing AI Interview results follows the same permissions used to access candidate profiles within the ATS. Users with access to the candidate profile can view interview scores, summaries, transcripts, and submit score overrides.
Note: AI Interview does not currently include a separate permission specifically for viewing interview results.
Frequently Asked Questions
Q: What AI model powers AI Interviews?
A: AI Interviews use Azure's gpt-realtime-1.5 model.
Q: How long is an AI Interview?
A: Approximately 10–15 minutes depending on the number of questions and candidate responses. A 25-minute hard cap applies to all sessions.
Q: What languages are supported?
A: 50+ languages including English, Spanish, French, German, Portuguese, Mandarin, Arabic, Hindi, Japanese, and more. Candidates can select their preferred language from the interview landing page.
Q: Can recruiters override AI scores?
A: Yes. Recruiters can adjust any Assessment or Behavioral question score on the results panel. A required note must be entered before the override is saved.
Q: What happens if a guide or agent is deleted while a job is active?
A: Both are soft-deleted. Any candidate currently in progress continues their interview unaffected using the deleted item. New candidates will need a replacement guide or agent configured on the job.
Q: What happens if a candidate doesn't answer a question?
A: Unanswered or declined questions appear as blank rows in the results table with a "—" score. If any questions go unanswered, the aggregate score displays as "—" rather than a numeric value.
Q: Can candidates retake an AI Interview?
A: Not by default. If a candidate needs another chance, a recruiter can manually resend the invitation link.
Q: Is AI Interviewing compliant with EEO laws?
A: Hireology's Interview Guide builder includes an automated EEO compliance check that flags potentially non-compliant or irrelevant questions before they are used. This check is a best-effort tool — not a legal certification. We strongly recommend consulting your HR or legal team for guidance specific to your roles, industry, and state. Hireology conducts regular bias audits through Warden AI.
Q: What is an Automated Employment Decision Tool (AEDT) and does AI Interviewing qualify?
A: AI Interviews score candidates but do not make automatic advancement or rejection decisions — a recruiter reviews all results and makes the final call. This distinction is important for compliance with laws like NYC Local Law 144. Hireology does not support automating hiring decisions based solely on AI Interview scores at this time.
Comments
0 comments
Article is closed for comments.