The few people that do care about who you are and what you do are really the ones to hold onto. Sometimes people are just wrapped up in their own thoughts and desires. Nothing wrong with that. It's just when they lose sight of you and who you are or don't want to know you or even forget you time after time, That's when you have to question if it's worth it.
Have a Lovely Day :)