If it is required for retirement or the kids' college, it may make extra sense to invest—a payoff is far more certain down the road, even if it doesn't amount to a attractive six-figure check.