March 2026 · Assessment
Why multiple-choice tests fail investment training
A multiple-choice item can tell you whether a person recognises a phrase they saw last Tuesday. It is a weak guide to whether that person will notice a missing constraint in a live paper. Investment work inside an organisation is mostly the second problem. The first problem is what vendors of “knowledge checks” still sell, because it is cheap to mark.
Recognition and application part company as soon as the answer is not on the page. A participant can select the correct definition of tracking error and still sign a report that treats a changed benchmark as a performance event. The item did not ask them to do the work they will actually be asked to do. It asked them to point at a sentence.
A case task looks different. You give a short file: a mandate page, a one-line risk appetite, a table with two missing footnotes. You ask the participant to mark the sentence that would not survive a later audit, or to write the question they would put to the manager before the meeting starts. There is still a right-enough answer. It just is not hiding among four options that were written to look similar.
Building that kind of assessment is slower. You have to decide in advance which mistake would actually matter in the role. You have to accept that two competent answers can differ in wording. You have to brief the people who will mark the practicum so that they are scoring the decision path, not elegance. The cost is the point. If the organisation wanted a certificate of attendance, it did not need an assessment at all.
The useful output for the commissioning organisation is not a league table of staff. It is a map of the themes that attracted the same error. If a cohort consistently misses liquidity in a report that looks “fine” on return, the next cycle should spend time there. A ninety-percent score on definitions would have hidden that. The score would have been comforting. Comfort is not the purpose of the file.
We still use a short multiple-choice gate at the start of some modules, as a check that the reading brief was opened. We do not file that gate as evidence of competence. The evidence is the marked case and the practicum memorandum. If a vendor cannot show you those artefacts, they are selling recognition and calling it training.
Educational content. Not a recommendation.