Hi Lovish,
The only reason it should create new entities is when you've changed the module's name, and/or when you've cloned the module instead of publishing it as the original one.
What you could try to do is open the last known good version of the module, merge it with the recovered one, and publish that.