Yes, $25,000 can buy you a decent house. I just bought one yesterday in Pennsylvania, and its great.
Its 4 bedrooms, 1 den, 1 kitchen, and 1 bathroom, and 2 living rooms and a basement. Yes you can buy a decent house for $25,000. I did.
The inspection passed as Above Average condition. So if the house was given a letter grade, it would be a (B-.). That's not took bad for that price. It was inexpensive because its a small community, low cost of living (but no jobs) which means you'd have to travel further to work, but it only takes me 36 minutes anyway.
Its not perfect, but it certainly isn't bad. The house is 86 years old too. It needed a leak repaired here and there, but that's taken care of now.
So yes you can my friend, but you'll have to search around. The House I bought was originally put up for $50,000, but nobody wanted it because it was too quiet and remote.
So I talked the seller into selling ir for half that price. I hope this answers your question.