The Department Of The Treasury's Financial Management Service, who processes refund payments for the IRS, will notify you if they are turning over an overpayment to whoever holds the paper on your loan. It is this agency, and not the IRS, that would have this information. They notify the IRS that the amount was taken, but not by whom.. . Note that this withholding would only happen if you are indebted to the federal or other government due to their guarantee of your loan.