The Bulleit website describes the taste as spicy and complex with hints of vanilla and honey. I get the complexity and honey, but I'm not picking up on the vanilla. Either way though- it's really good and something I will definitely be drinking again.
For more reading and information from Bulleit themselves, check the website here: http://www.bulleit.com/whiskey/bulleit-rye/