Pay Off Your Mortgage or Retire Early? A Real $1.4M Case Study
“Joe, if you had to choose between retiring as soon as possible or paying off a mortgage, what would you go for?”
I ask Joe that right at the top of this episode, and his answer ends up being more prophetic than either of us realized.
Joe and I help Carol figure out whether paying off a low-rate mortgage early actually makes sense once she’s already hit her retirement number — three years ahead of schedule.
We also walk a listener through how to hire her first accountant now that her tax situation has suddenly gotten complicated, and Joe finally explains, at length, why he’s not a fan of risk parity investing, even though he agrees with its biggest advocate on almost everything else.
Listen Here
Listener Questions
Susanna asks: I’ve been a DIY tax filer for years, but my situation just got a lot more complicated. My husband quit his W-2 job to start his own business, we moved to a new state with income tax, and we became landlords on a rental property that isn’t quite cash-flowing yet. I don’t know if I need a CPA, an EA, or something else, or how to even find and interview one. Where do I start?
Carol asks: Since I called in a few years ago with $750,000 saved, I’ve grown that to $1.4 million and I’m now on track to hit my retirement goal three years early, at age 57. Most of my retirement money is in pre-tax accounts, and my plan has been to bridge the gap to age 59 and a half using my brokerage account, plus a rental condo I still owe about $124,000 on at a 4.125% rate. Now I’m wondering if I should redirect my extra savings toward paying off that mortgage instead of building a bigger cash bridge. Does that make sense, or should I just focus on retiring as soon as possible?
Mark asks: You’ve talked before about building a portfolio along the efficient frontier, and I know Joe isn’t a fan of risk parity investing. But if you take the efficient frontier concept to its logical extreme, doesn’t it lead you toward a risk parity portfolio anyway? I’ve learned a lot from Frank Vasquez’s Risk Parity Radio podcast, especially about how these portfolios can perform well in different economic environments. So why is Joe against risk parity, even though he’s for the efficient frontier?
Key Takeaways
- Specialize Around Complexity, Not Account Count: One rental property doesn’t require a specialist CPA. Running your own business does. Match the level of expertise you look for to the most complex part of your financial life, not the part that feels the scariest.
- Once You’ve Hit Your Number, the Math Becomes Secondary: If your retirement date and finances already work, a decision like paying off a low-interest mortgage early comes down to how you want to manage cash flow and taxes, not whether it mathematically “beats” a savings account.
- “One More Year” Isn’t Automatically a Red Flag: Staying in a job past the point where you could retire isn’t a problem if you genuinely like the work. Pay attention to how you feel about the job, not just how long you’ve been putting off leaving it.
- Liking Your Job Changes Every Other Financial Decision: Whether to retire early, pay off debt, or take on more investment risk all hinge on the same question: does work feel like a choice, or an obligation?
- Agreeing on the Math Doesn’t Mean Agreeing on the Portfolio: Two people can agree on the theory behind a strategy and still land on completely different real-world portfolios, depending on how each of them defines “optimal.”
Not sure which investments belong in your Roth vs. your taxable account? Grab our free one-page guide to where each type of investment should sit: https://affordanything.com/assetlocation
Karsten Jeske (“Big ERN”):
“How to Lie with Personal Finance – Part 4: Risk Parity”: https://earlyretirementnow.com/2026/07/29/risk-parity-lies/
“Can We Increase the Safe Withdrawal Rate with Risk Parity? – SWR Series Part 64”: https://earlyretirementnow.com/2026/07/27/risk-parity-swr-series-part-64/
#548: Is Your Retirement Safe in Today’s Economy?: https://affordanything.com/548-is-your-retirement-safe-in-todays-economy-with-dr-karsten-jeske-big-ern/
#643: LIVESTREAM: A Former Fed Economist Reveals What’s Really Happening: https://affordanything.com/643-livestream-a-former-fed-economist-reveals-whats-really-happening-with-karsten-jeske-big-ern/
Nick Maggiulli:
#375: The 2X Rule (and Other Wealth-Accelerating Advice): https://affordanything.com/375-the-2x-rule-and-other-wealth-accelerating-advice-with-nick-maggiulli/
#629: The Wealth Ladder Has Six Rungs (and Most People Never Climb Past Four): https://affordanything.com/629-nick-maggiulli-the-wealth-ladder-has-six-rungs-and-most-people-never-climb-past-four/
Frank Vasquez:
#618: How to Retire at 50 While Supporting Aging Parents: https://affordanything.com/618-how-to-retire-at-50-while-supporting-aging-parents-with-frank-vasquez/
His podcast, Risk Parity Radio: https://www.riskparityradio.com
JL Collins:
#624: JL Collins Part 1 – The Simple Path vs. The “Optimal” Path: https://affordanything.com/624-jl-collins-part-1-the-simple-path-vs-the-optimal-path/
#625: JL Collins Part 2 – What Happens When You Don’t Need to Work Anymore?: https://affordanything.com/625-jl-collins-part-2-what-happens-when-you-dont-need-to-work-anymore/
Paul Merriman:
#550: Paul Merriman – The 4-Fund Strategy That Beats the S&P 500: https://affordanything.com/550-paul-merriman-the-4-fund-strategy-that-beats-the-sp-500/
#590: Small Cap Showdown! Paul Merriman vs. Dr. Karsten Jeske: https://affordanything.com/affordanything-com-small-cap-value-debate/
————————
Submit your own question for a future episode: https://affordanything.com/voicemail
————————
Stay in the loop – https://affordanything.com/newsletter
————————-
Join our community – https://affordanything.com/community
Chapters
Note: Timestamps are approximate and may vary across listening platforms due to dynamically inserted ads.
(4:02) Why software can’t handle a messy tax situation
(8:02) The three types of tax pros — and who you actually need
(12:46) How to interview and choose the right accountant
(24:42) She hit her $1.4M goal three years early
(32:22) The hidden fear behind “one more year” at work
(38:29) Why loving your job changes the retirement math
(49:39) Why a former advisor won’t touch risk parity
(53:46) Four investing legends who all disagree with each other
(59:35) The historian’s warning: history doesn’t repeat itself
(1:07:57) The cooking analogy that explains your portfolio
Thanks to our sponsors!
Secure your family’s future with Policygenius. Head to Policygenius.com to compare life insurance quotes from top companies and see how much you could save.
If you like your money, Mint Mobile is for you. Shop plans at Mintmobile.com/paula
Use code AFFORD at Monarch.com to get your first year of Monarch Core half off at just $50.
Ready for a flexible side hustle? Create a free account at EarnHaus.com/PAULA and see which paid surveys are available to you.
Get 20% off at cozyearth.com with code AFFORDANYTHING
Upgrade your everyday. Get free shipping and 365-day returns at Quince.com/paula.
