How can I get rid of Love Handles?

I have tried for years to rid of these Love Handles (exercise, weight lifting, diet) and it’s still there. I went from 34 to a 30 waist and it’s still there. I’ve done everything by the book. What’s the problem…do I need to go to a 28-29 waist?
I’m 5’7, 165