Rory Gravatt says the later life lending market has been growing at a rapid rate of knots, but recent events have thrown it in very choppy waters.