← All articles
Our StoryBy David Sturtz4 min read

What Expert Review of AI-Drafted Training Content Looks Like

Our curriculum engine drafts course material, and a credit expert approves every case, module and quiz question before a learner sees it. What that review checks, why it matters more in credit than in most subjects, and what it costs.

In brief

Shockproof uses a curriculum engine to draft course material, and a credit expert reviews and approves every case, module and quiz question before a learner sees it. The review checks that the numbers tie, the practice is conventional, the decision is defensible and every wrong answer teaches something. Nothing ships without that sign-off.

Why We Draft With AI at All

Shockproof has 26 years of credit training behind it and a catalog that lists 76 learning paths in 13 categories, with new paths rolling out through 2027. Writing that much material by hand, with full case files and a large pool of quiz questions for every course, would take far longer than anyone would wait.

“Expert-reviewed” is easy to put on a website. This post is about what it means in practice, and why I think it matters more in credit than in most subjects.

So we built a curriculum engine. Adam Galper, our CTO, leads that work. The engine drafts course material from an outline: module scripts, cases with full financials, learning checks and quiz questions.

A draft is a starting point. I’ve never worked in a commercial bank, and I’m not the right person to judge whether a case is realistic. The credit experts are.

Who Reviews the Material

Patti Alexander, our Head Banking Expert, has more than 40 years in banking, two decades of it in loan review consulting, and she reviews every case and quiz question. Tom Halupnik brings more than 40 years of bank lending, equipment leasing and credit instruction. Liz Pham brings more than 30 years of banking experience, including EVP roles and many years of loan review consulting.

They are the people who sign. If one of them doesn’t approve something, it doesn’t go out.

The Review Process, Step by Step

Each path starts from what the learner has to be able to do on the job, and the outline is built from that. The engine drafts from the outline. A credit expert reads the draft as a credit professional would, edits it, and either approves it or sends it back. Only approved material is published.

The order matters. The expert is not checking a finished product for typos at the end. The expert decides whether it is right.

From outline to learner
StepWhat happens
OutlineThe path starts from what the learner has to be able to do on the job
DraftThe engine drafts the module, case or question set from the outline
Expert reviewA credit expert reads the draft as a credit professional would, edits it, and approves it or sends it back
Sign-offOnly approved material is published to learners

What the Reviewers Look For

The credit experts’ review comes back to five questions. Do the numbers tie? Is it how banks actually do it? Is the decision defensible? Do the wrong answers teach something? Is it one idea, said plainly? A draft that fails any of them goes back before it can be approved.

Do the numbers tie? A case with full financials has to be internally consistent. The balance sheet has to balance, the cash flow has to reconcile to the changes on the balance sheet, and the ratios in the analysis have to match the spread. A case that doesn’t tie teaches the learner that close enough is fine.

Is it how banks actually do it? Terms have to be used the way lenders use them. Practices have to be conventional, and anything that varies by institution or by state has to be described that way rather than as a single rule.

Is the decision defensible? Our cases cover every kind of loan decision: approved, approved with conditions, declined and workout. Whatever the outcome, an experienced credit officer has to be able to look at the file and agree that it is a reasonable call.

Do the wrong answers teach something? In a good quiz question, the wrong answers reflect mistakes real analysts make, and there is exactly one answer a careful analyst would defend. A question that can be argued two ways isn’t ready.

Is it one idea, said plainly? A module should teach one thing. Material that is accurate but belongs somewhere else should go there.

Why Expert Review Matters More in Credit

AI drafting tools are good at producing text that reads well. Reading well and being right are different things, and the gap is hard to spot if you aren’t an expert. A fluent paragraph with a wrong rule in it looks just as authoritative as a correct one, and in credit, wrong habits reach real loan files.

In most subjects a small error in training is an annoyance. In credit, an analyst who learns a wrong habit carries it into real loan files. If they learn to count a distribution twice in global cash flow, or to accept an add-back without support, the cost shows up later in a loan that was riskier than the memo said.

That is why a person signs. Accountability for what an analyst is taught should sit with someone who has spent a career being accountable for loans.

What Expert Review Costs

It’s slower. I underestimated how long one expert-reviewed path takes to build, and I’d rather say so than pretend the engine made it fast. The question pools add to the cost: retakes draw fresh questions, so the experts write and review several times as many questions as any single quiz uses.

Each of those questions gets the same review as everything else.

I think the trade is right. The engine does the drafting, which is the part a machine can do. The credit experts do the judging, which is the part that has to come from people who have done the job.

For more on why we rebuilt the way credit training is delivered in the first place, see Why We Rebuilt How Credit Training Is Taught. For how the outlines start from the job, see Why Credit Training Should Be Built Backwards From the Job.

Learning Paths

See Expert-Reviewed Cases at Work

C&I Business Underwriting takes a learner from screening a request through building a UCA cash flow to writing the credit memo, on complete borrower case files. Every path is designed and approved by credit experts.

Explore C&I Business Underwriting

Frequently Asked Questions

Does AI write Shockproof’s courses?

Our curriculum engine drafts module scripts, cases with full financials, learning checks and quiz questions from an outline. A credit expert then reads, edits and approves each one, or sends it back. Nothing reaches a learner without a credit expert’s sign-off.

Who reviews Shockproof’s training content?

Patti Alexander, our Head Banking Expert, reviews every case and quiz question. Tom Halupnik, with more than 40 years of bank lending, equipment leasing and credit instruction, and Liz Pham, former EVP of Credit Risk and Operations at a major California bank, review alongside her.

Why does a quiz retake need more expert-reviewed questions?

Each retake draws fresh questions from a pool, so a learner can’t pass by remembering the last set of answers. That means writing and reviewing several times as many questions as any single quiz uses, and every one gets the same expert review.

More From the Blog

Last updated November 12, 2026.