I don't know about a FOSS version of iTunes but Fiio M21
Haven't bought one yet but I searched far and wide earlier this year, to find something with metal+glass exterior and no cameras or microphones or speakers, like the original first gen iPod touch
