Over the 41 years we have lived in this home, I have done several upgrades to it including adding a 30' x 24' standalone shop, always doing it by code and call for inspections as soon as necessary or after the project is finished. In every case, the inspectors do the inspection, and I don't know that an accessor has come by to inspect the changes until they decided they need to reaccess all homes in the city. IIIRC, we have only seen the accessor 2 or 3 times in that 41 year period.

Let the responsible legal authority worry about it. I don't know how they could hold you responsible for their failure to act in a timely fashion. Just my opinion and worth absolutely nothing!