Define how the program will be measured before the results exist.
Use a balanced evidence framework to evaluate member understanding, service quality, workflow performance, employee readiness, provider execution, governance, and sustainable institutional value, without inventing benchmarks or promising outcomes.
Start with the decision the credit union needs to make, define the measure and source, establish a verified baseline, and preserve the limitations. A number without a definition, owner, timeframe, source, and decision use is not reliable evidence.
Balanced program value
Member value and institutional sustainability belong on the same dashboard.
Financial contribution can help sustain a program, but it should never erase evidence about member understanding, service failures, refunds, complaints, workflow quality, employee readiness, or provider performance.
Never review alone
Participation rate
Product income
Average products per loan
Always pair with
Member, service, process, training, provider, and risk evidence
Definitions, sources, segmentation, limitations, and owners
Corrective action and documented decision authority
Eight outcome domains
A whole-program evidence model.
Select only the measures that support a real decision and can be defined, sourced, reviewed, and acted upon.
01
Member understanding and choice
Did the member receive enough clear information to make a voluntary decision?
Measures and evidence +
Possible measures
Understanding-check results
Optional-status and cost explanation
Acceptance and decline documentation
Agreement and contact delivery
Possible evidence
Observation records
Knowledge or member-feedback questions
Completed loan and product records
Document-delivery logs
02
Claims, total-loss, and repair support
Can members obtain timely, understandable help when the product is needed?
Measures and evidence +
Possible measures
Intake-to-acknowledgment time
Required-document completion
Decision and payment cycle time
Unresolved and escalated cases
Possible evidence
Provider case reports
Credit-union service records
Escalation logs
Member complaints and follow-up
03
Cancellations and refunds
Are requests, calculations, funds, loan application, notices, and records accurate and timely?
Measures and evidence +
Possible measures
Request-to-cancellation time
Refund calculation accuracy
Refund aging and application
Reconciliation exceptions
Possible evidence
Cancellation files
Provider refund reports
Loan and accounting records
Exception and aging reports
04
Workflow and documentation quality
Does the operating path reliably produce the approved result?
Measures and evidence +
Possible measures
Eligibility and rating exceptions
Contract and disclosure accuracy
Missing or late documents
Corrections, rework, and manual overrides
Possible evidence
System exception reports
Quality-review samples
Contracting records
Operations and reconciliation logs
05
Employee and manager readiness
Can each role educate, document, support, and escalate within approved boundaries?
Measures and evidence +
Possible measures
Knowledge and scenario results
Observed conversation quality
Workflow completion
Manager coaching and follow-up
Possible evidence
Learning records
Observation scorecards
Coaching plans
Role authorization and refresher logs
06
Provider and administrator performance
Is the provider meeting measurable product, service, operational, reporting, and change obligations?
Measures and evidence +
Possible measures
Service-level performance
Reporting completeness and accuracy
Recurring issue and corrective action
Material change and incident response
Possible evidence
Service reports
Issue and corrective-action logs
Audit and review records
Contract and governance records
07
Governance, complaints, and risk signals
Can leaders identify concerns early and take documented action?
Measures and evidence +
Possible measures
Complaints and themes
Policy or control exceptions
Open audit or review findings
Escalation, remediation, and stop decisions
Possible evidence
Complaint system
Risk and compliance reporting
Committee records
Corrective-action and decision logs
08
Participation and sustainable program value
Is the program creating responsible institutional value without outranking member and service outcomes?
Measures and evidence +
Possible measures
Eligible opportunities and participation
Product mix and channel patterns
Program income and direct costs
Cancellations, refunds, and chargebacks
Possible evidence
Lending and product reports
Finance and accounting records
Provider statements
Balanced outcome dashboard
For every measure
Define the evidence before interpreting the number.
01Purpose and decision supported
02Exact definition and calculation
03Population, timeframe, and segmentation
04Source system and responsible owner
05Baseline and approved threshold
06Data-quality and comparison limitations
07Review cadence and escalation path
08Corrective action and decision record
Measurement cadence
Baseline. Observe. Investigate. Decide. Adapt.
The first 90 days should validate execution and evidence quality, not rush to declare success.
Before launch
Review 01
Define the baseline and owners
Select measures tied to the program’s purpose, define each calculation and source, assign ownership, document limitations, and establish escalation thresholds before results exist.
First 30 days
Review 02
Verify execution and visibility
Confirm data arrives, agreements and documents are correct, roles follow the workflow, support paths work, and early exceptions reach accountable owners.
Days 31 to 60
Review 03
Study patterns and coach
Segment results by product, channel, location, role, dealer, or provider where appropriate; investigate recurring friction; reinforce training and correct process gaps.
Days 61 to 90
Review 04
Evaluate and decide
Compare the verified baseline with current evidence, document what improved or worsened, resolve open risks, and approve continuation, change, restriction, or stop decisions.
Ongoing
Review 05
Monitor and adapt
Maintain a consistent cadence, revalidate definitions after changes, examine member and financial measures together, and preserve evidence behind important decisions.
Case-study readiness
Turn outcomes into public proof only when the evidence is ready.
Verify the source data, definition, timeframe, methodology, comparison, and limitations.
Separate correlation, observation, and causation.
Avoid cherry-picking only favorable measures.
Obtain the credit union’s written approval for its name, quote, figures, and description.
Never imply that another institution will produce the same result.
Measurement questions
How to begin without manufactured proof.
Should a credit union set industry benchmarks before launch?+
Not unless the benchmark is current, comparable, sourced, and meaningful to the institution. Begin with the credit union’s own verified baseline, program purpose, member standard, risk appetite, and approved decision thresholds.
Should participation or income be the primary measure?+
No single metric should control the review. Participation and financial contribution can be considered alongside member understanding, service quality, cancellations, refunds, complaints, workflow accuracy, readiness, provider performance, and governance evidence.
What if the credit union cannot measure everything immediately?+
Prioritize a small set connected to the highest-risk or highest-value decisions. Document missing data, temporary methods, owners, and a plan to improve measurement rather than treating unavailable evidence as a positive result.
Can early results become a case study?+
Only after the measures, source data, timeframe, methodology, limitations, and claims are verified and the credit union has approved publication. Early directional observations should not be presented as proven outcomes.
Put the framework to work
Capture the baseline and 90-day review plan.
The printable scorecard organizes measures, definitions, sources, owners, baselines, thresholds, limitations, and review decisions across all eight domains.
Evidence notice: This framework does not establish a benchmark, certify performance, prove causation, determine compliance, or promise member, operational, financial, or program outcomes. The credit union determines its measures, sources, thresholds, review, and decisions.
A next step centered on members
Build measurement into the program before launch.
A program review can organize the institution’s purpose, baseline, member and service measures, data sources, owners, reporting, thresholds, and review cadence.