Don't Buy the AI Buzzword: The 3 Questions Every HR Leader Must Ask Vendors
We are in the middle of an HR technology gold rush. As the pressure to "figure out AI" mounts, HR leaders are being bombarded by vendors promising to magically automate recruitment, employee relations, and performance management.
But buying an AI tool is not an AI strategy. If you buy the wrong platform without understanding what is under the hood, you aren't buying efficiency—you are buying a massive compliance and privacy liability.
The Context: The Wedge and The Harness
If you have been following our work, you know that we are witnessing the freight training that is the AI Wedge. Agentic AI is driving a permanent wedge between humans and legacy "dumb tech," automating the tactical middle of the business so that HR professionals can get back to highly strategic, empathetic work.
But raw AI is dangerous. To make the Wedge safe for HR, you have to build an AI Harness around it. The Harness is the strategic wrapper—defined by the Trigger and the 4Cs (Context, Constraints, Connections, and Control)—that ensures the AI obeys your policies, protects your data, and always keeps a human in the loop.
Here is the reality for most organizations: You will not build your own AI from scratch; you will buy the AI Wedge from a vendor.
But outsourcing the technology does not mean outsourcing the liability. True AI fluency means having "Procurement Fluency." If a vendor cannot answer these three questions with absolute, technical clarity, they are treating AI as a buzzword rather than a secure infrastructure. Here is exactly what you want to hear—and the red flags you must avoid.
Question 1: How is your model trained?
The Red Flag (What you DON’T want to hear):
"Our algorithm is completely proprietary," or "We just plug into ChatGPT to make it smart."
If they claim it's a black box, they likely don't understand it themselves. If they just plug raw into ChatGPT without an architectural wrapper, they are exposing your business to massive
The Green Light (What you WANT to hear):
"We use a leading foundational model as our reasoning engine, but we do not train the base model on your data. Instead, we use a Retrieval-Augmented Generation (RAG) architecture. This means the AI is strictly tethered to a closed database of your approved HR policies and historical data. It can only generate answers based on the context we allow it to retrieve."
The Harness Connection: This proves the vendor understands the Context and Constraints of your Harness. A RAG architecture ensures the AI isn't pulling advice from the open internet; it is restricted to your specific corporate reality.
Question 2: Does our proprietary employee data become part of your public training data?
The Red Flag (What you DON’T want to hear):
"We anonymize your data first to protect privacy," or "Yes, but only to improve the product experience for everyone."
Anonymized data can easily be reverse-engineered by modern LLMs. If your company's compensation bands, performance review notes, or strategic workforce plans are used to train their global model, your proprietary data will eventually leak to your competitors.
The Green Light (What you WANT to hear):
"Absolutely not. We have a strict Zero-Data Retention agreement with our LLM providers. Your data is completely sandboxed in a single-tenant environment. When you run a prompt or process a resume, the data is computed and immediately purged."
The Harness Connection: This secures your Connections. It ensures that when your HR team connects the AI to sensitive HRIS or behavioral data, you aren't inadvertently violating employee trust or corporate security policies.
Question 3: How do you test for bias in your screening algorithms?
The Red Flag (What you DON’T want to hear):
"AI is just math, so it's inherently objective and unbiased," or "We just remove names and genders from the resumes before the AI reads them."
AI is trained on historical human data, which means it is trained on historical human bias. Stripping names does not work; AI can infer demographics from graduation dates, zip codes, and extracurricular activities.
The Green Light (What you WANT to hear):
"We assume bias exists, so we proactively hunt for it. We conduct routine Disparate Impact Analyses to ensure our algorithm isn't disproportionately filtering out protected classes. Furthermore, we contract independent, third-party algorithmic auditors to rigorously test our models for fairness. Ultimately, our system is designed for decision-support, not decision-making."
The Harness Connection: This validates your Control gate. A vendor that understands the legal and ethical realities of HR technology will never try to sell you an AI that operates without human oversight. They will provide the explainability logs necessary for your HR leaders to safely review and approve the AI's recommendations.
The Takeaway
The next time an HR Tech vendor pitches you an "AI-powered revolution," do not ask them what the AI can do. Ask them how it is contained. Ask them about the Harness. If they don't have the answers, walk away.
And if you want a partner to help you on this journey, call on Lever Talent to be your Orchestrator of Record for all things talent management in a tech-led world. Reach out today.
Drew Fortin
Drew is a people-first, values-driven leader with nearly 20 years of growth strategy and team-building experience across retail, marketing technology, local media, and HR tech. He spent 7 years at The Predictive Index, where he was Chief Growth Officer responsible for the company's strategy to build the world's first...
More from the blog
View All PostsStop Obsessing Over the AI Models. You Need an AI Harness.
Read MoreThe Death of Dumb Tech and the Rise of Co-Intelligent Teams
Read MoreSupporting Your Employees During the Israel-Hamas Conflict: A Guide for Business Leaders
Read MoreSubscribe to email updates
Stay up-to-date on what's happening at this blog and get additional content about the benefits of subscribing.
