Condos and two-family homes can pull down the values of nearby single family homes. You can easily judge this by looking at what a similar home might go for in an area without nearby condos and two-families. A home not located by these types of buildings will most likely list and sell for a higher price.
An exception to this would be if the area is kind of a planned community, with multi-families and aparements on the outskirts, condos just inside and the single families holding the prime inner positions. These can be somewhat neutral in price due to the appeal of "community".
In the end, if you are buying this as a family home and not as an investment property you need to first look at what works for you and your family and its resale value second. If everything about the home "works" for you then go for it and enjoy your new home!