Yes you are. If it was built to code, go to code enforcement and ask them to issue a permit. If not, you will have to remove and update. Of course if the city does not know about it, nothing will happen.
The problem is that you want to keep your tax basis, if the city finds out about it say in 2 years and you retrofit it then, your property taxes will probably go up.