What's the point of giving some one "a hard time"?

The phrase itself suggests that you're deliberately causing them discomfort. You might say that it's just a joke, but it's not even somehow ironic or silly, it doesn't subtly suggest that you're actually on the other person's side. It's just making people unhappy and then making them feel foolish for becoming unhappy.