Pastor Employed with HA & recieving retirement with designated HA ???

Can a minister who is 69 and presently an employee of his church and receiving a housing allowance also use a housing allowance designated by his retirement plan as long its use stays within the "lessor of " (actual expenses, FMV rental value, combined designated...) ?