Temporarily stores packets that are not supposed to be handled by
listeners. When wanting to send a packet silently, it is added to this queue.
When the packet is later encountered again handling a packet send event,
the event can be properly ignored, and the packet is removed from the queue.
If the event never occurs, a timeout will make sure the packet is eventually
cleaned up again.
This class is thread-safe.