The Sleepy Jackson relocated to Sydney where they recorded another EP, Let Your Love Be Love, in late 2002. Songs from this EP and Caffeine in the Morning Sun were compiled together to form a self-titled mini-album for release in the UK market in February 2003. A period of extensive touring quickly followed, which saw the band playing in Australia, the United States, and Europe. The latter brought the band some very enthusiastic attention from UK music magazine NME.