Skepticism is the correct starting point for hiring AI. Here is everything we'd want to see too.
Suited's assessments are grounded in industrial-organizational psychology and validated across more than 200,000 professionals in law and finance. Every model is tested for accuracy, reliability, fairness, and explainability before deployment.
What we measure.
Suited’s assessments measure cognitive ability and behavioral traits. Our industrial-organizational psychology team developed and validated the assessments around the demands of the roles being evaluated.
Cognitive ability
How candidates process information, evaluate evidence, and solve problems. The competencies measured reflect the cognitive demands of the role.
Behavioral traits
How candidates typically approach their work, what motivates and drives them, and how they interact with others. Structured questions measure values and tendencies, providing information that resumes and interviews alone may not reveal.
The assessment takes about 30 minutes. Firms use the results to better understand candidates and evaluate their potential for success against the demands of the role and the firm’s own performance data.
The credentials available can tell you who got into law school. They cannot tell you who will thrive at your firm.
Two T14 law students.
With first-semester grades still pending, nothing further is coming. Their resumes give you little reason to choose between them.
Indistinguishable on paper.
What hiring partners can't see.
They approach their work, and respond to different working environments, in fundamentally different ways.
Candidate A
T14 Law School · J.D. Candidate 2029
Highly ambitious and unconventional
- First-semester grades pending
- Ivy League undergraduate institution
- B.A., Public and International Affairs · 3.8 GPA
- Regulatory paralegal at a global pharmaceutical company for 2 years prior to law school
Candidate B
T14 Law School · J.D. Candidate 2029
Measured and structured
- First-semester grades pending
- Top-15 undergraduate university
- B.A., Political Economy & Legal Studies · 3.9 GPA
- Paralegal at an AmLaw 100 firm for 2 years prior to law school
Without Suited, placed by resume alone.
With Suited, placed by fit.
Firm Theta
Structured development · regular feedback
Firm Gamma
Sink-or-swim · deep-end culture
Miserable
Candidate A, 1st-year associate
“Run through walls” type
r/biglaw · 2 days ago · u/half_caff_
three rounds of redline on a two-page memo, is this just first year
Every draft I turn in goes to a senior, then counsel, then the partner before it leaves the building. By the time it goes out I can't find a sentence of mine in it. Five months and I still haven't been on a client call. I've been on the mute end of two. I don't think I'm being punished. This is just how they run it, and two other people in my class have said the same thing. But I'm getting slower instead of faster and I can't tell if that's the training working or the opposite. Nobody mentioned any of this during the summer. Is this a normal year 1 or did I pick wrong?
↑ 847 · 213 comments
Thriving
Candidate A, 1st-year associate
“Run through walls” type
r/biglaw · 2 days ago · u/half_caff_
three weeks in and they gave me a real piece of the deal
Staffed on a $400M acquisition my first week and given the reps in the disclosure schedules to own. Senior associate showed me what good looked like once and then let me get there myself.
Every time I've been stuck, help has been there inside the hour. It's not that nobody's watching, it's that nobody's hovering. Steep, mildly terrifying, exactly what I wanted.
Fully expect the replies telling me to check back at month nine. Friends at more structured shops describe a very different first year and I don't envy it.
↑ 1.2k · 340 comments
Miserable
Candidate B, 1st-year associate
“Step-by-step” type
r/biglaw · 4 days ago · u/notesinthemargin3
is it normal to just... not hear back on anything
Staffed my second week, told to take first pass on the SPA. No precedent, no markup to work from, nobody to walk me through what the sections were for. Asked my assigned mentor a question eight days ago, still nothing.
Turned the draft in and heard back nothing at all, which I'm told means it was fine. I don't know if it was fine. I don't know if anything I've done in three months has been fine.
I summered here and it was structured and supervised and bore no resemblance to this. People call it autonomy. I'm on pace for 2400 and I've learned almost nothing.
↑ 612 · 189 comments
Thriving
Candidate B, 1st-year associate
“Step-by-step” type
r/biglaw · 4 days ago · u/notesinthemargin3
six months in and I actually know what I'm doing
Obligatory: yes, I know it's six months and this sub will tell me it's the honeymoon.
Weekly check-in with my senior, and she marks up my drafts with reasons instead of just fixing them. I summered somewhere you got thrown in and figured it out, and I spent ten weeks panicking.
Slower start here, probably. But I can feel the craft accumulating, which I could not say in August. Culture is most of the job and nobody tells you that going in.
↑ 612 · 189 comments
The associates and their posts are composites, for illustration.
Two T14 law students.
With first-semester grades still pending, nothing further is coming. Their resumes give you little reason to choose between them.
Indistinguishable on paper.
Candidate A
T14 Law School · J.D. Candidate 2029
Highly ambitious and unconventional
- First-semester grades pending
- Ivy League undergraduate institution
- B.A., Public and International Affairs · 3.8 GPA
- Regulatory paralegal at a global pharmaceutical company for 2 years prior to law school
Candidate B
T14 Law School · J.D. Candidate 2029
Measured and structured
- First-semester grades pending
- Top-15 undergraduate university
- B.A., Political Economy & Legal Studies · 3.9 GPA
- Paralegal at an AmLaw 100 firm for 2 years prior to law school
What hiring partners can't see.
They approach their work, and respond to different working environments, in fundamentally different ways.
Without Suited, placed by resume alone.
With Suited, placed by fit.
Firm Theta
Structured development · regular feedback
Miserable
Candidate A, 1st-year associate
“Run through walls” type
three rounds of redline on a two-page memo, is this just first year
Thriving
Candidate B, 1st-year associate
“Step-by-step” type
six months in and I actually know what I'm doing
Firm Gamma
Sink-or-swim · deep-end culture
Miserable
Candidate B, 1st-year associate
“Step-by-step” type
is it normal to just... not hear back on anything
Thriving
Candidate A, 1st-year associate
“Run through walls” type
three weeks in and they gave me a real piece of the deal
The associates and their posts are composites, for illustration.
Without Suited, placed by resume alone.
Firm Theta
Structured development · regular feedback
Miserable
Candidate A, 1st-year associate
“Run through walls” type
r/biglaw · 2 days ago · u/half_caff_
three rounds of redline on a two-page memo, is this just first year
Every draft I turn in goes to a senior, then counsel, then the partner before it leaves the building. By the time it goes out I can't find a sentence of mine in it. Five months and I still haven't been on a client call. I've been on the mute end of two. I don't think I'm being punished. This is just how they run it, and two other people in my class have said the same thing. But I'm getting slower instead of faster and I can't tell if that's the training working or the opposite. Nobody mentioned any of this during the summer. Is this a normal year 1 or did I pick wrong?
↑ 847 · 213 comments
Firm Gamma
Sink-or-swim · deep-end culture
Miserable
Candidate B, 1st-year associate
“Step-by-step” type
r/biglaw · 4 days ago · u/notesinthemargin3
is it normal to just... not hear back on anything
Staffed my second week, told to take first pass on the SPA. No precedent, no markup to work from, nobody to walk me through what the sections were for. Asked my assigned mentor a question eight days ago, still nothing.
Turned the draft in and heard back nothing at all, which I'm told means it was fine. I don't know if it was fine. I don't know if anything I've done in three months has been fine.
I summered here and it was structured and supervised and bore no resemblance to this. People call it autonomy. I'm on pace for 2400 and I've learned almost nothing.
↑ 612 · 189 comments
The associates and their posts are composites, for illustration.
With Suited, placed by fit.
Firm Theta
Structured development · regular feedback
Firm Gamma
Sink-or-swim · deep-end culture
Candidate A, 1st-year associate
“Run through walls” type
MiserableThriving
Candidate B, 1st-year associate
“Step-by-step” type
MiserableThriving
Firm Theta
Structured development · regular feedback
Thriving
Candidate B, 1st-year associate
“Step-by-step” type
r/biglaw · 4 days ago · u/notesinthemargin3
six months in and I actually know what I'm doing
Obligatory: yes, I know it's six months and this sub will tell me it's the honeymoon.
Weekly check-in with my senior, and she marks up my drafts with reasons instead of just fixing them. I summered somewhere you got thrown in and figured it out, and I spent ten weeks panicking.
Slower start here, probably. But I can feel the craft accumulating, which I could not say in August. Culture is most of the job and nobody tells you that going in.
↑ 612 · 189 comments
Firm Gamma
Sink-or-swim · deep-end culture
Thriving
Candidate A, 1st-year associate
“Run through walls” type
r/biglaw · 2 days ago · u/half_caff_
three weeks in and they gave me a real piece of the deal
Staffed on a $400M acquisition my first week and given the reps in the disclosure schedules to own. Senior associate showed me what good looked like once and then let me get there myself.
Every time I've been stuck, help has been there inside the hour. It's not that nobody's watching, it's that nobody's hovering. Steep, mildly terrifying, exactly what I wanted.
Fully expect the replies telling me to check back at month nine. Friends at more structured shops describe a very different first year and I don't envy it.
↑ 1.2k · 340 comments
The associates and their posts are composites, for illustration.
Resumes and transcripts told hiring partners these candidates were identical. They weren't.
Every firm gets its own model.
A generic benchmark would have hired both. A firm-specific model only hires one.
We study your high performers
Suited assesses the attorneys or analysts already working at your firm and pairs their cognitive and behavioral profiles with your firm's own performance data: reviews, ratings, retention. That pairing, assessment data plus real outcomes, is the training set. Nothing is inferred from resumes.
We build your firm's model
A supervised machine-learning model learns which trait combinations distinguish your high performers from the broader candidate population. We choose model classes that are decomposable by design, because a score we can't explain is a score we won't ship. This model is unique to your firm. No two are the same.
Every candidate is scored against your model
When a candidate completes the assessment, their profile runs through your firm's specific model. The result is a score grounded in who actually thrives at your firm, not an industry average. Same inputs, same score, every time: the scoring function is deterministic.
The model improves every cycle
Each recruiting cycle adds assessment and outcome data. The model is retrained and revalidated as new cohorts mature, so the benchmark gets sharper as Suited learns what performance looks like at your firm specifically. It takes one cohort to calibrate. After that, the model compounds.
Does it work.
The test that matters is whether Suited’s scores predict on-the-job performance. Across our clients, as candidates become employees, we compare those who scored above Suited’s behavioral target with those who scored below it, using each firm’s own performance measures.
Firm A
Firm B
Firm C
Firm D
Average
Each firm’s own performance measure: partner ratings, annual reviews, or end-of-summer evaluations, compared for attorneys above and below Suited’s behavioral target. Firms anonymized.
The pattern holds at every firm we have measured. Attorneys above Suited’s target are rated high performers about twice as often as those below it, and the smallest gap observed was a 70% increase.
A hiring model should demonstrate that its scores predict on-the-job outcomes for the people and roles it is designed to evaluate. That requires testing against actual performance data: a standard we hold ourselves to at Suited.
Aaron Myers, Ph.D., Chief Technology Officer, Suited
The cognitive side carries large-scale evidence of its own. We tracked 8,623 associates at 519 law firms from the day they were hired. Those who missed all three of Suited’s cognitive minimums had left at 31.5% after two years, against 17.8% for those who met all three. The lines separate within the first year and keep widening through the second.
Suited tenure study: 8,623 Suited-assessed associates at 519 law firms, law school class of 2015 or later. Kaplan-Meier estimates; associates who left for a judicial clerkship are excluded. Missed all three: 485 associates, 95% CI 26.9% to 36.7% at two years.
Suited uses machine learning, validated against outcomes.
Two technologies share the AI label and do different things. Generative models produce text and images by sampling from probability distributions over training data. They were built to write, summarize, and converse. Some hiring tools use generative models to score candidates from resumes and video interviews. Most have never been validated against on-the-job performance. Most cannot produce the same score for the same candidate twice.
Suited uses machine learning of a different kind: supervised models trained on structured assessment data and real employment outcomes. The assessment measures stable behavioral traits and cognitive ability through a structured, psychometrically validated instrument. A firm-specific model learns which trait combinations predict performance and retention inside that firm's own population. The score is deterministic. The model is retrained and revalidated against the firm's own outcome data as new cohorts mature. The traits driving the score are visible to the firm.
How we validate.
Hiring decisions should be informed by evidence that is accurate, consistent, and relevant to the job. Before deployment, Suited’s models are tested to evaluate how well they predict performance, how reliably they produce results, and whether the factors they measure are relevant to the role.
Criterion validity
Do the model's outputs predict job performance? Suited validates every model out-of-sample, using k-fold cross-validation against actual on-the-job outcomes at the client firm. If the scores don't predict performance, the model doesn't deploy.
Reliability
Reliability lives in two places. The scoring models are deterministic: the same assessment responses produce the same score for a particular firm, every time. The assessments themselves are reliable psychometric instruments because they measure stable traits, not transient states.
Construct validity
Does the assessment measure what it claims to measure? Every dimension is a validated psychological construct from I/O psychology, selected through formal job analysis with subject-matter experts. "Culture fit" is not a construct. Cognitive ability is.
Explainability
Can you trace why a candidate received a specific score? Yes. Suited deliberately uses model classes whose scores decompose into per-trait contributions. Firms see which traits drove the score, not a black-box number.
How we evaluate fairness.
Fairness is a core part of how we evaluate our assessments and models. We examine whether the factors being measured are relevant to the work and whether results differ across demographic groups.
Testing for adverse impact
Before deployment, we evaluate differences in selection rates and assessment results across race and gender. These analyses help us assess whether a model could disproportionately exclude candidates from a particular group. We review the findings alongside evidence of job relevance and predictive validity when evaluating a model for use.
Grounded in the work
The assessment focuses on cognitive abilities and behavioral traits selected through research into the demands of the role. We evaluate these measures against actual performance data to understand their relationship to success on the job.
Demographic information is excluded from scoring
A candidate’s race, gender, age, and other demographic characteristics are not inputs to their score. Demographic data is used separately to evaluate fairness.
Independent review
Suited’s models undergo independent third-party bias audits in accordance with applicable requirements, including New York City Local Law 144.
Scientific leadership.
Aaron Myers, Ph.D., Suited’s Chief Technology Officer, leads the development and validation of our predictive models. His work brings together machine learning, explainable AI, and the study of human bias in decision-making.
Suited’s assessments were developed with industrial-organizational psychologists, whose expertise continues to inform our methodology through an ongoing consulting relationship.
FAQs
Why doesn’t every high scorer become a high performer?
Because what happens after hire depends on more than the person: market cycles, partner moves, family decisions, the team they land on. No assessment can explain that variance in advance. What Suited’s scores do is shift the odds, measured against each firm’s own reviews and whether attorneys stayed: twice the rate of high-performance ratings above the target, and 77% more departures among associates who missed all three cognitive minimums.
Why doesn't a generic benchmark work?
Two firms with similar credentials and similar billable rates have different cultures, different staffing models, and different definitions of thriving. A generic benchmark predicts the average firm. The firm making the hiring decision is not the average firm.
How do you prevent gaming?
The assessment is built to evaluate a candidate who answers as themselves. Forced-choice items, internal consistency checks, and response-time analysis flag responses that do not pass internal validity.
The structure of the system also works against gaming. It isn't apparent what any individual behavioral item is measuring, so there is no obvious "right" answer to aim for. And because every firm's model is different, there is no single profile to fake: the same response pattern that would raise a score at one firm can lower it at another. The only strategy that works everywhere is answering as yourself.
Who runs the bias audit?
An independent third party, qualified to the standards required under NYC Local Law 144.
Does Suited use generative AI?
The scoring models are deterministic and non-generative. Generative AI is used inside the lateral research product to synthesize public data sources into a briefing draft. A human editor reviews every briefing before it reaches a candidate.