A music service tested a personalized recommender and a list of generally popular songs. New users listened longer with the popular list, whereas long-time users listened longer with personalized recommendations. Personalized lists introduced more unfamiliar artists to both groups, but unfamiliarity caused new users to skip more often.