To give up or not

Sometimes, we have to give up on certain people. It's not because we don't care about those people anymore but rather because they don't care about us.

So why do we have to waste time on those people?