I live on Washington St. (lower numbers) and crime definitely exists here.
I have personally witnessed fights almost nightly outside my building during the summer after the bars close, I have had a chained up Vespa scooter stolen from me about a year ago, and there was a homicide on River St (not too far away from here) about 4 years ago when I first moved to Haverhill which was a drug deal gone wrong. Helicopters in the air, and emergency vehicles everywhere.
If you're looking to stay away from criminal behavior, try Bradford or Georgetown. It's still close, but safer and quieter.
If you're anywhere near downtown Haverhill, there WILL be disturbances, and it may involve you.