Permits and zoning are two separate things. While a residential accessory building under 200 sq ft might not require a permit, it will still be subject to zoning setbacks in most jurisdictions unless it's specifically called out in the details of the particular residential zone regulations that apply to the property.