For this type of situation, a bank or lender should regularly do "in house" loans; a large down payment would be required, and one could not get a government-backed loan.
So, look for a lender, probably local to where you want to buy.
Hope this helps, and forgive me for not seeing your question sooner.
Melody Beaudro, Principal broker
TR Hunter RE
1749 Hwy 101
Florence, OR 97439