While we say complete we mean proper end or the work is over. while finish means about to get over at times. So, we can say that complete can be used in place of finish but vice-versa is not possible.