Remember: If the IRS suspects you haven't reported income, it can challenge returns from the past six years. So if you are self-employed or have multiple income sources, hold on to six years of files to be absolutely safe.