Tiny Ruins began as a name for New Zealand based singer-songwriter Hollie Fullbrook, who had recorded as a solo artist prior to 2009. Fullbrook recorded a collaborative EP with A Singer of Songs in 2010 under the name Tiny Ruins, then recorded a full-length, Some Were Meant for Sea, in 2011.
After adding Cass Basil and Alexander Freer to the lineup, Tiny Ruins recorded a second album, Brightly Painted One, which was released in 2014. Guitarist Tom Healy and violinist Siobhanne Thompson performed on the album and appeared with the group on subsequent tours.