A little quote from an article by Archbishop Fulton J. Sheen:
When we hear music for the first time, we either like or dislike it. We judge it by the music we already have heard in our own hearts. Jittery minds, which cannot long repose in one object of thought or in continuity of an ideal, love music that is distracting, excited, and jittery. Calm minds like calm music: the heart has its own secret melody, and one day, when the score is played, the heart answers: "This is it." So it is with love.
So, what do you think about it? Perhaps he has oversimplified the argument, but I think there is something to it.