Milk is not effective at removing garlic smell from your fingers, but - as I was very surprised to learn - rubbing a spoon really works!
The sulfurous smell compounds in garlic are attracted to metal, so rubbing on a stainless steel implement under running water will pull the smell off. Follow with a soap-and-water wash and that may be all you need!