How to Hire an AI Engineer: Skills, Pay and Assessment

Published Updated 13 min read
When a company decides to put AI into its products or operations, someone has to build it, and the title it reaches for is "AI engineer". It is also a hard hire to get right, because the same title covers people who train new models, people who build products on existing ones and people who keep the data flowing underneath.
A clear definition comes first: what problem the engineer will solve, what data they will work with and who will run the system after launch. With that written down, you can decide what kind of engineer you need, what to pay and how to tell a strong candidate from a confident one.
This guide explains the main kinds of AI engineer, how to define the role, when to hire, grow or contract, where to find candidates, what government pay data shows, and how to assess candidates with a scorecard, a work sample and interview questions. It ends with the mistakes that most often lead to a wrong hire.
DisclosureJake Jorgovan co-founded Alpha Apex Group, which is mentioned in this article.
What an AI engineer does and where they come from
LinkedIn describes the role as engineers who "develop and implement AI models that perform complex tasks" such as problem-solving and prediction, and notes that the title is also used for machine learning engineers. AI engineers topped LinkedIn's 2026 Jobs on the Rise list (opens in a new tab) of the fastest-growing roles in the US, measured on jobs its members started from January 2023 to July 2025. It also topped the 2025 list (opens in a new tab), which covered January 2022 to July 2024.
The listed skills changed between the two years. In 2025 the most common skills LinkedIn recorded were large language models, natural language processing and PyTorch. In 2026 they included retrieval-augmented generation, a way of connecting a model to a company's own documents and data, alongside PyTorch.
LinkedIn's data also says where these engineers come from. In the 2026 list the roles AI engineers most often moved from were software engineer, data scientist and full stack engineer, and their median prior experience was 3.7 years. That gives you a place to look: software engineers with evidence of relevant AI work.
The main kinds of AI engineer
Job titles vary from company to company, so define the role by the work. LinkedIn counts machine learning engineers under the same title; this guide separates them because the work and the hire differ. Use these four groupings to describe the work you need.
| Kind | What they build | Usual background | When you need one |
|---|---|---|---|
| AI application engineer | Products and internal tools on existing models: search over your documents, assistants, automated workflows, with testing and monitoring | Software engineering, then AI work | You want to use AI in a product or process, and existing models can do the core task |
| Machine learning engineer | Models trained on your own data, such as recommendations, fraud detection or forecasting, and the systems that run them | Data science or software engineering with machine learning | The value depends on predictions from your own data |
| AI or machine learning researcher | New models and methods | Graduate research, often a doctorate | You compete on the model itself |
| Data or platform engineer | The pipelines, storage and deployment tooling that the other roles depend on | Data engineering, infrastructure | Your data is scattered or unreliable, or models never make it into production |
If existing models can do the core task, consider an application engineer, and check whether data or platform work needs to come first. The role calls for real software engineering: the engineer has to integrate a model with your systems, test whether its answers are good enough, control cost and keep it working as the models underneath change. It needs less of the advanced mathematics that research roles demand. LinkedIn treats researchers as a separate role: AI and machine learning researchers ranked fifth on its 2026 list.
Define the role before you write the job description
An AI engineer job description can easily ask for everything: a research background, data pipelines, cloud deployment, product sense and the ability to explain it all to the board. Few people do all of that well, and the search stalls.
One role that took me a while to recruit for was scheduling guests for our podcasts, which I talked through on my podcast in 2021. The work had several parts, from writing the scripts and email campaigns to handling replies and scheduling the guests. My first job description asked one person to manage all of it, and I ended up splitting it into three separate roles. Some parts needed highly skilled people and others did not. If a role looks too hard to hand to one person, it may be several roles.
The same test applies here. If your description asks for a researcher, a data engineer and a product engineer at once, decide which part creates the value now, hire for that and cover the rest another way. Before you open the search, fill in a one-page brief.
A one-page AI engineer role brief
Fill it in before you open the search
- The problem
- the business outcome this role exists to deliver, in one sentence
- Build or use
- whether existing models can do the core task, or you need models trained on your own data
- The data
- what exists, where it lives, who owns it and what condition it is in
- The kind of engineer
- application, machine learning, research or data and platform (from the table above)
- Success at 90 days
- one shipped or tested result you could show a leadership team
- After launch
- who monitors the system, fixes it and pays for running it
- Reporting line and partners
- who sets priorities and which teams the engineer works with
- Constraints
- privacy, security and regulatory limits on the data and the use
Hire, grow or contract
You have three ways to get the work done, and the brief usually points to one.
- Grow an engineer you already have. LinkedIn lists software engineer first among the roles AI engineers moved from. For application work, consider training an engineer who already knows your systems and data. Check that they have time to learn and access to technical support.
- Contract for a defined project. A prototype, an evaluation of whether AI can do a task, or a one-off integration has an end date. A contractor or a specialist firm can do it, provided someone on your team will own the result afterwards.
- Hire. Consider a permanent hire when the workload is ongoing and you need engineering capacity inside the company. Whatever you choose, name who owns monitoring, maintenance and improvements.
The approach described in this article, shown as a visual guide.
Figure details
AI Engineering Sourcing: Grow, Contract, or Hire Upskill Internal SE: Existing models fit core task and engineer knows system Contract / Agency: Defined scope, feasibility POC, or one-off integration Permanent Hire: Ongoing workload needing sustained internal capacity Ownership Prerequisite: Must identify long-term owner for production maintenance
The choices combine. One option is a single experienced hire who sets the technical direction, with existing engineers trained alongside them. When the gap is leadership rather than engineering, the role you need may be a Chief AI Officer.
Where to find candidates
For a hire, look beyond people who already hold the title. AI engineers most often come from software engineering, data science and full stack engineering roles, so look for candidates with relevant AI work; referrals from your own engineers are a good place to start. In LinkedIn's 2026 list, San Francisco, New York City and Dallas were the regions with the largest shares of AI engineers employed from January to October 2025. A specialist recruiter can run the search for you; the AI recruiters and search firms guide compares them. For a defined contract, compare independent engineers or specialist firms on relevant past work, using the same assessment criteria you would use for a hire.
What to pay an AI engineer
The Bureau of Labor Statistics' Occupational Outlook Handbook has no AI engineer occupation; its A to Z index of job titles (opens in a new tab) lists none. The government's figures for two related occupations give a reference point. BLS notes that research scientists' expertise will be needed to create new technologies related to artificial intelligence.
| Occupation | Median annual wage | Top 10 percent earned more than | Typical entry-level education |
|---|---|---|---|
| Software developers (opens in a new tab) | $135,980 | $214,670 | Bachelor's degree |
| Computer and information research scientists (opens in a new tab) | $140,300 | $230,630 | Master's degree |
Application work is closer to software development, and research roles to the research scientists. Skills matter to pay as well as titles: a study of about eleven million UK job postings (opens in a new tab) from 2018 to mid-2024 found that AI skills carried a wage premium of 23%, more than any degree below a doctorate.
The study’s UK job-posting data show different relationships between degree requirements and advertised pay in AI, green, and other roles. Figure 2 combines salary trends, education requirements, and estimated degree premiums. It does not show that dropping a degree requirement causes a pay increase.
Full citation and reuse terms
Matthew Bone, Eugenia González Ehlinger and Fabian Stephany, “Skills or Degree? The Rise of Skill-Based Hiring for AI and Green Jobs,” November 2024 manuscript, Figure 2, PDF page 20. arXiv:2312.11942. Based on roughly 11 million UK job postings, 2018 to mid-2024. (opens in a new tab) Original publication image reproduced unchanged. CC BY 4.0. (opens in a new tab)
Treat the government figures as a reference point, not an offer. Before you set a range, check current offers for the specific role, seniority and city, through a compensation survey or a recruiter working on similar searches, and decide how much of the package is base salary. Location is part of the offer too: in LinkedIn's 2026 data, 26.2% of AI engineer jobs posted from November 2024 to November 2025 were flagged as remote and 27.1% as hybrid.
Degrees or skills
A degree tells you someone learned the foundations. It does not tell you whether they can ship a working system. The same UK study found that from 2018 to 2023, demand for AI roles grew by 21% as a share of all postings, while mentions of university degree requirements for AI roles fell by 15%. The authors describe this as employers turning to skill-based hiring to widen the pool.
For research roles, specify the research capability you need and whether an advanced degree is necessary to show it. For application and machine learning engineering, put evidence of relevant work first: systems they built, what happened when those systems met real users, and code or write-ups you can review.
How to assess AI engineer candidates
Fluent answers about models do not establish production experience, so ask candidates for evidence of systems they have deployed. Have an experienced engineer, from your team or an outside adviser, judge the technical evidence, and use three tools in order: a scorecard agreed in advance, structured questions and a work sample.
1. Agree the scorecard before the first interview
Weight the scorecard to the kind of engineer you need. The example below is for an application engineer. For a machine learning engineer, add modeling and statistics as a competency and reset the weights to match your brief.
| Competency | What a strong candidate shows | Example weight |
|---|---|---|
| Software engineering | Clean, tested code; integrates with existing systems and APIs | 20% |
| Building on models | Retrieval over company data, prompt design, choosing between existing models | 15% |
| Evaluation and quality | Defines what a good answer is, measures it and catches regressions | 15% |
| Data handling | Cleans, structures and secures messy or incomplete data | 15% |
| Production and cost | Deployment, monitoring, failure handling and running costs | 15% |
| Judgment on risk | Privacy, bias and when not to use AI | 10% |
| Communication | Explains trade-offs to people who are not engineers | 10% |
Define what each rating means before you meet anyone. For evaluation and quality, for example, a 1 could be a demo with no measured evaluation, a 3 a relevant test set and a clear account of its limits, and a 5 a test set plus evidence of catching regressions and handling failures. Record the evidence behind each rating, multiply each rating by its weight and add them up for a total out of 5. Agree in advance which competencies are essential, so a high total cannot hide a missing one.
A rating sheet for each candidate
One per interviewer, filled in before the panel discusses
- Software engineering (20%)
- rating 1 to 5, and the evidence you saw
- Building on models (15%)
- rating 1 to 5, and the evidence you saw
- Evaluation and quality (15%)
- rating 1 to 5, and the evidence you saw
- Data handling (15%)
- rating 1 to 5, and the evidence you saw
- Production and cost (15%)
- rating 1 to 5, and the evidence you saw
- Judgment on risk (10%)
- rating 1 to 5, and the evidence you saw
- Communication (10%)
- rating 1 to 5, and the evidence you saw
- Essential competencies met
- yes or no, for each one agreed in advance
- Weighted total out of 5
2. Ask every candidate the same structured questions
The US Office of Personnel Management, the federal government's HR agency, describes a structured interview (opens in a new tab) as one where all candidates are asked the same predetermined questions in the same order and all answers are judged against the same rating scale. Write the questions and what a strong answer looks like before the first interview, and have each interviewer rate independently before the panel talks.
3. Set a work sample from your own work
A work sample asks candidates to do a task that mirrors the job. OPM's guidance on work samples (opens in a new tab) says they closely reflect real work and that performance on them relates highly to performance on the job. It also says they can be costly to develop and run, and give the best return when critical skills are needed on entry, the number of applicants to test is limited and only a few are expected to have the skills. Give the task to your shortlist, and if you plan to teach a skill after hiring, do not make mastery of it a selection requirement.
Base the task on a real problem, simplified and stripped of confidential data: improve the answers of a simple document assistant, find why a model's results fell after a data change, or structure a messy dataset so a model can use it. Keep it short, tell candidates how it will be judged, and ask them to walk you through their choices afterwards.
The approach described in this article, shown as a visual guide.
Figure details
Three-Stage AI Candidate Technical Assessment Weighted Scorecard: Lock 7 core competencies and rating rubrics in advance Structured Interview: Identical questions and independent rating before discussion Simplified Sample: Real task on sanitized data with post-exercise walkthrough Selection Threshold: Verify mandatory competencies regardless of total score
Generic online tests have a narrower use. TestGorilla's test library (opens in a new tab), for example, lists multiple-choice tests of core AI and machine learning concepts. They can screen a large applicant pool, but they cannot show whether someone can build on your systems.
If you use automated tools to screen applicants, check the rules where you hire. New York City's Local Law 144 (opens in a new tab) bars employers and employment agencies from using an automated employment decision tool unless it has had a bias audit within one year of its use, information about the audit is public and the required notices have gone to candidates. The guide to reducing bias in AI hiring tools covers the wider question.
Once you have chosen, turn the role brief into an onboarding plan: access to systems and data, the person who reviews the engineer's technical work, the first deliverable and who accepts it.
AI engineer interview questions
Choose questions that fit the kind of engineer in your brief, ask every candidate the same ones and score the answers against the scorecard.
Building and shipping
- Walk me through an AI system you built that real users relied on. What did it do, and what did you build yourself?
- How did you decide whether to use an existing model or train one on your own data?
- What broke after launch, and how did you find out?
- How did you keep the running cost of that system under control?
- Describe how you would connect a model to our internal documents so it answers accurately.
Data, quality and evaluation
- How do you decide whether a model's answers are good enough to put in front of customers?
- Tell me about a time a model's performance fell. How did you diagnose it?
- What do you do when the data you need is incomplete, inconsistent or unstructured?
- How do you test a change before it reaches users?
Judgment and communication
- When have you recommended not using AI for a problem? What did you suggest instead?
- How have you handled privacy, security or bias in a system you built?
- Explain to me, as you would to our CFO, the main trade-off in a project you led.
- How do you work with product managers and the people who will use what you build?
- What have you learned from an AI project that failed?
For a machine learning engineer
- How did you choose the evaluation metric for a model trained on your own data, and why that one?
- Tell me about a model that did well in testing and worse in production. What was different?
- How do you handle overfitting, and how do you know you have?
- How did you decide when a model needed retraining?
Mistakes that lead to the wrong AI hire
- One job description for several roles. A list that asks for research, data engineering and product work in one person invites a long search or a compromise hire. Split it into roles you can fill.
- Hiring for theory when you need delivery. Questions about how algorithms work favor candidates from research. If the job is building products on existing models, test building.
- Weighting degrees over evidence. A degree requirement narrows the pool without telling you whether someone can ship. Require a degree only when you can explain why the work needs it.
- Ignoring the data. Models need reliable data. If yours is scattered, the first hire may need to be a data engineer, or the AI engineer needs time and authority to fix it.
- No owner after launch. AI systems need monitoring and maintenance. Decide before you hire who will run what gets built.
- Not testing communication. The engineer will explain limits and risks to people who are not technical. Score that skill as deliberately as coding.
If you wrote the role brief today, could you say in one sentence what your AI engineer will deliver in the first 90 days?
Sources and method
How this list was made
Built from LinkedIn's 2025 and 2026 Jobs on the Rise lists, the Bureau of Labor Statistics' Occupational Outlook Handbook, a study of UK AI job postings, the US Office of Personnel Management's assessment guidance and New York City's rules on automated hiring tools, all read October 7, 2026. The role types, scorecard and questions are this guide's own.
Jake's record
- Working Without Pants: Episode 209, How to think about systems, December 2021, 09:58 to 12:47
Research, government and company pages read October 7, 2026

Jake Jorgovan
Jake works with enterprise leaders on marketing strategy and executive talent. He co-founded Alpha Apex Group, founded Content Allies, owns Listen Network and is a partner in Fieldtrip, a group of marketing agencies. He founded Lead Cookie and later sold it.
Related guides
AI and Machine Learning Recruiters: 22 Firms Compared
Recruitment & workforce
Chief AI Officer: what the role owns and how to hire
Executive search
Data Analytics Recruiters and Staffing Firms Compared
Recruitment & workforce