top of page


How Do We Know If Our Model Is Actually Doing What We Think It's Doing?
It's a question that sounds simple but turns out to be surprisingly hard to answer, especially in the early months after a model goes live. Part of what makes it hard is timing. In a credit business, the outcomes you care most about take time to materialize. A model trained to predict severe delinquency at 12 months on book can't tell you much about whether it's working after two weeks in production. You have to build toward that answer gradually, using a sequence of leading

Leland Burns & Jim McGuire
Aug 3


What Should I Actually Expect from a Model Build?
We've written a lot about specific aspects of credit modeling — how to choose features, what AUC actually measures, when to retrain. But we haven't spent much time on the bigger picture: if you've never done a custom model build before and you're considering one, what does the process actually look like? How long does it take? And where does it tend to go sideways? This post is for companies that have relied on off-the-shelf scores or externally developed policies and are now

Leland Burns & Jim McGuire
Jun 22


The Hidden Economics of Credit Cards: Why Utilization Matters More Than You Think
When credit card portfolios underperform, most teams look in the same places. They examine approval rates. They scrutinize loss curves. They debate underwriting cutoffs and pricing. And if those metrics look reasonable, they often conclude the portfolio is fundamentally sound. In many cases, that conclusion is wrong. The real driver of credit card economics isn’t approval rates or even headline loss percentages. It’s utilization — how much of the approved line customers actua

Brandon Homuth
Jun 15


What Does a Credit Model Score Actually Mean — and How Should We Use It?
Ask a lender how they plan to use their new model, and you'll often get an answer about approval rates, cutoffs, or pricing tiers. What you hear less often — but should — is a clear explanation of what the model's raw output actually represents and what it doesn't. That gap matters. How you interpret a score shapes everything downstream: how you set cutoffs, how you price, and how you know when something has gone wrong. And these are questions worth working through before a m

Leland Burns & Jim McGuire
Jun 1


Lead Reactivation: Small Channel, Outsized ROI
Every lender has a database full of “maybe later” customers — applicants who didn’t qualify, didn’t finish the process, or simply weren’t ready to borrow. That database can look like a graveyard of lost leads. But with the right approach, it can become one of your most efficient acquisition channels. At Ensemblex, we’ve seen lead reactivation play a small but consistently profitable role in scaled credit businesses. It rarely drives more than 3–5% of originations — but the ec

Brandon Homuth
May 18


Are You Overfitting to a Weird Economic Period?
It’s a question we hear often during model builds: “Are we overfitting to a weird period in the data?” Sometimes the concern is macro — COVID, stimulus, rate shocks. Other times it’s more internal — a change in product, channel, or geography. Either way, the underlying issue is the same: Does the data we trained on actually reflect the environment we’re about to operate in? That’s not always an easy question to answer. But it’s one you have to ask. What “Overfitting” Means in

Leland Burns & Jim McGuire
Apr 27


How Do You Transition from Human Credit Analysts to Empirical Models When Some Judgment Can’t Be Automated?
When lenders move from judgmental credit decisions to empirical models, the biggest challenge isn’t the math. It’s the messy middle. A client recently told us: “Our analysts don’t just apply policy — they fix data. They interpret incomplete bank statements, fractional credit card statements, and half-finished proofs of income. How can a model handle that?” It’s a fair question — and one we hear often. In manual underwriting shops, analysts wear many hats: decision-maker, data

Brandon Homuth
Apr 20


Why Two Good Credit Models Can Disagree — and Why That’s Not a Problem
In many of our projects, we’ll build two candidate models that both look strong on paper. Similar AUC. Similar stability. Both clearly predictive. And yet — when we start comparing scores more closely — they don’t line up. The disagreement isn’t always dramatic. It doesn’t show up as one model approving and the other declining across the board. It’s subtler than that. Borrowers shift between deciles. Score correlations aren’t as high as expected. ROC curves have similar AUCs

Leland Burns & Jim McGuire
Apr 6


How to Write a Credit Policy: A Fintech's Guide to Getting It Right
The Document Nobody Wants to Write, Until They Have to You've got the product vision. You've mapped the user journey. You've had the early conversations with a sponsor bank. And then someone on the other side of the table asks: "Can you send us your credit policy?" Cue the internal scramble. For most fintech founders, the credit policy feels like a formality — a thick document full of banking jargon that exists to check a compliance box. But here's the truth: the credit polic

Scott Bass
Mar 30


The Hidden Bias in Your Organic Channel
Every fintech dreams of “free” leads. Organic traffic sounds like the holy grail — low cost, self-sustaining, and scalable. But in lending, organic often hides a paradox: Your most expensive customers can come from your cheapest channel. At Ensemblex, we’ve seen this across markets and products — from payday alternatives to SMB working-capital loans. The pattern is consistent: organic traffic often converts poorly and performs worse than paid or referral channels. The reason

Brandon Homuth
Mar 23
bottom of page