No matter what your home decorating budget is, it can be fun to use items that are "free" to add interest to your home.
The best way I have found to remove labels is to use hot water. I fill the bottles with hot tap water, which softens the label adhesive from the inside. I then lay them on their side and score the wet label with a plastic knife to allow more water to make its way behind the protective cover most labels have. Turn on the hot tap. Using the same plastic knife, scrape until the label is completely removed.
There’s usually some adhesive left at this point, so I change to a stiff plastic bristle brush and lightly scrub while hot water is still running over the bottle.