I think safety is all a matter of perspective, so it is hard to say. 15 years ago, before the Verizon Center, it was not a good area, but there has been a lot of development in the Chinatown area that is starting to push towards Mt. Vernon Square. Several new condos have gone up and they are selling very well.
You can always quantify crime by looking at the DC crime map.