Do not break the thread of love by a jerk. Either it will be broken forever or will have a knot when tied.
If one has a healthy mindset then he need not worry about the persons with whom he is associated. A sandalwood tree does not become poisonous inspite of being a residing place for snakes.