That's what you're supposed to do. Means you have time to decide if the player is interfering with play of not. The alternative is that you'll have players flagged for offside when they're on the far side of the pitch and clearly not getting the ball.
I like the way people will criticise referees and yet show that they have absolutely no knowledge of what they're actually talking about.