To listen to someone who is backbiting is not Haram in it self, however the listener must act in accordance to enjoining the good (Amr bil Marouf) and forbidding the evil (Nahy anil Munkar).
Hawzah News Agency- The Commander of the Faithful Imam Ali (peace be upon him) says: