Olimje was first mentioned in 1208 as a castle owned by Otto Rufus as a feudal estate of the church in Krka (Gurk, Carinthia, Austria).