I used to race battery powered electric cars. While I was running them we went through a big technological shift from NiCads to NiMH so I only speak for those batteries. Our chargers were pretty darn advanced and even those did not appreciate us unplugging their power source.
If was fairly common that breakers would be popped in the pits and our chargers had alarms in them to tell us when they lost power because it would reverse drain our batteries. This would certainly shorten the life of our very expensive batteries. Mind you, we were charging our packs at very high rates and draining them at very high rates.
I can't speak to what will happen to your batteries, but I would not do that given my experience.