I just used my clip for the first time today and this afternoon it started the same place I stopped this morning. But I think I read somewhere that whenever you connect to the computer that feature does not work and it goes back to the start. Have you tried it without going connecting to the computer?

If you "pause" it before you turn it off, it should start back where you left off- at least it does in audiobooks.