Distinguish Type I from Type II errors when deciding whether to hire or keep a manager
The idea
Take as the null hypothesis that the manager has no skill. A Type I error rejects a true null: hiring a manager who lacks skill, or keeping one on. A Type II error fails to reject a false null: passing over a skilled manager, or firing one after a run of poor results. Because the return distributions of skilled and unskilled managers overlap heavily over short periods, reducing one error tends to increase the other; only longer records or better qualitative evidence reduce both. Type I errors are visible, whereas Type II errors are an unseen opportunity cost, so committees tend to fear the former more. Firing managers after brief underperformance also incurs transition costs and often locks in Type II errors.
In the app: 1 practice questions on this outcome, a narrated walkthrough with diagrams, spaced review that brings it back before you forget it.
Take the free diagnostic →More in Investment Manager Selection
- Set out the stages of the manager selection process, with due diligence among them
- Explain how style analysis, both holdings-based and returns-based, supports the choice of investment managers
- Explain how maximum drawdown, drawdown duration, capture ratios on the upside and downside, and up/down capture help in assessing managers
- Assess the investment philosophy of a manager and the process by which it reaches investment decisions
- Discuss how behavioural factors shape the decisions of an investment team and propose ways to limit their influence
- Weigh the benefits and costs of separate accounts against those of pooled investment vehicles
- Contrast the main forms of investment manager contract, covering their key provisions and their advantages and drawbacks
- Set out the three standard ways a performance-based fee can be structured
- Analyse an illustrative performance-based fee schedule and interpret its outcomes