And What Professional Organizations Can Do About It
There is a certain kind of problem that arises only when the organization is already successful. You have a training program that works. Content is copyrighted. Students trust you. Your pass rates are strong, your doctors are confident, and somewhere behind all of that is an expert—a clinical manager, a lead instructor, a media specialist—whose knowledge, voice, and judgment are woven into every module.
Then someone asks: can we measure this? The honest answer is: yes, but not the way you think.
The Expert Is Not The Bottle. They are the Product.
When L&D teams start talking about metrics, the conversation often quickly turns to success. More content. Better templates. Faster production cycles. The underlying assumption is that the expert is a bottleneck—someone who needs to be removed from the system in order for the process to move faster. This thinking is not very good for professional training.
In typical business studies, the content is highly interactive. A data protection compliance slide deck or a video about workplace safety doesn’t need to feature a distinct expert voice. It needs to be accurate, clear, and memorable.
But the psychiatry certificate program is different. A regulated health care training course is different. The certification process for any high-level field is unique. In these cases, an expert’s opinion is not a decoration—it is a certificate. Students don’t just get information. They are initiated into a certain way of understanding their particular field of authority, knowledge, and a certain way of shaping the concepts that make up the content of your loyalty.
Take that away, and you’re not maximizing training. You replaced something cheaper and less important. Your students may not be able to tell the difference right away, but they will feel it.
The Real Problem of Measurement
The psychotherapy training organization I worked with ran right into this. Their lead clinical supervisor—someone whose approach underpins the entire philosophy of the certification—helped six cohorts a year across the two pathways. Adding a seventh team meant asking him to do more. Adding an eighth meant that the show started to feel a bit small. His presence had already been extended; his availability was at a ceiling.
The natural reaction was to bring in more promoters. Talented people. Clinically qualified. But the students noticed the difference immediately. Not because the new promoters were so bad, but because they didn’t exist his. The frame was different. The examples were different. The manner in which complex clinical situations were presented in supervision was different. What they had come for was the students and they quietly left the room.
This is a real scale training problem—and not a productivity problem. It’s a credibility issue.
A Framework for Measuring Training Without Loss of Reliability
After working on this with several professional organizations, I’ve come to think that the solution lies in three different things that most L&D teams combine.
1. Distinguish Presence from Availability
Your technician cannot be in six places at once. But their presence—their voice, their frame, their particular clinical or professional perspective—can be made stronger. This means investing deeply in learning not just what they teach, but How they think. Long recordings of news interviews. Examples are explained in action. Guidance sessions are written in sufficient detail that reasoning is preserved, not just conclusion. A goal is a body of material that serves as a static record of professional judgment—something a new assistant can be introduced to, rather than just briefed on.
2. Separate Content That Can Be Matched from Content That Can’t
Not everything in your system depends on a different expert’s voice. Regulatory frameworks, evaluation criteria, process guidance—these can be standardized and standardized without loss. But clinical reasoning, ethical decision making, complex case formulation: these cannot. A mistake that many organizations make is to treat these two categories in the same way. They measure everything, and in doing so underestimate the important parts. Map your curriculum clearly against these differences. Be honest about where grading helps students and where it silently undermines them.
3. Build Version Control into Your Content Management
Professional knowledge is developing. Clinical standards are changing. A doctor with twenty years’ experience thinks differently in his twentieth year than he did in his tenth year. If your training program is built around a certain interpretation of their thinking, and that thinking has grown since then, you have a silent accuracy problem that grows invisibly with the rest of the group.
Professional training organizations rarely have formal procedures for this. Many operate under the assumption that their content is current because it was true when it was created. Organizations that measure well treat their experts’ opinion as a living resource, not static—and build review cycles into their governance accordingly.
What Good Measurement Really Looks Like
The psychotherapy organization I spoke of finally found a model that works. The lead manager remained the authoritative voice on clinical content. But a huge investment was made in documenting his thinking—not in summary form, but in full: the way he approached complex presentations, the frameworks he reached, the times he pushed the trainee’s thinking. This was the induction notice for every new assistant who joined the program.
The promoters who came after him were not trying to imitate him. They were given the opportunity to understand the clinical philosophy that underpinned the program in depth enough to teach in the same setting. They are not the same words. Similar roots. That distinction is more important than anything else when building training that needs to be both scalable and reliable.
Important Question
Before your organization commits to a measurement process, there’s one question you should sit with deeply: What about our training really works—and will it survive what we’re going to do about it?
Not all training programs are built on professional credibility in the way I have described. For others, the measurement is straightforward. But in organizations where the answer to that question is “you’re an expert, and I’m not sure”—the honest job is to fully understand that before you start doing it right.
