Image2song: Song Retrieval via Bridging Image Content and Lyric Words Xuelong Li∗, DiHu†, XiaoqiangLu∗ ∗Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, P. R. China †School of Computer Science and Center for OPTical IMagery Analysis and Learning (OPTIMAL), Northwestern Polytechnical University, Xi’an 710072, P. R. China xuelong
[email protected],
[email protected],
[email protected] Abstract All I Want For Christmas Is You -- Mariah Carey … Image is usually taken for expressing some kinds of emo- I don't want a lot for Christmas There is just one thing I need tions or purposes, such as love, celebrating Christmas. And I don't care about the presents There is another better way that combines the image and Underneath the Christmas tree relevant song to amplify the expression, which has drawn I don't need to hang my stocking much attention in the social network recently. Hence, the There upon the fireplace Santa Claus won't make me happy automatic selection of songs should be expected. In this pa- With a toy on Christmas Day per, we propose to retrieve semantic relevant songs just by object: tree , flower, ball , dress, stock… … an image query, which is named as the image2song prob- attribute: smiling, green , happy, red… lem. Motivated by the requirements of establishing corre- Figure 1. A Christmas-relevant image and coupled song (lyric). There are several words (in different color) appearing in both im- lation in semantic/content, we build a semantic-based song age tags and lyric words.