How do we handle or track messages that get dropped from the message queue before the connection is re-established?

Answer:

If Persistent Messages are enabled, the dropped messages will end up in the dead letters queue in the local storage. And those messages can be managed via the Node API. With these APIs, you can either put those messages back into a queue (for a module) by using restore call or you can delete those messages from a queue by using delete calls.