I read a quote from Stravinsky that implied that, for him, it didn't have a thing to do with emotion. That he was focused on extreme care with craft. . . only.
And yet, his music resonated, emotionally, with me. At another tact, I've left concerts with two people, having heard the same music, were at opposite ends about what they had heard. And both equally qualified to have a well-informed opinion. Which implies to me a lot of it has to do with background, personal preferences and even how you are feeling that day.