COM Query

How COM Object gets removed from the memory?
Suppose there are 4 clients using our COM Component, One by One they goes out of scope ..At which point the component knows that it has to unload from memory.? Once the COM Object's reference count reached to zero then at this point which mechanism works to remove it from the memory.

Thanks