I always assumed that it means that if you talk to them and don’t mention the thing that you might rely on later then it could harm your defence but if you just say that you need to speak to a lawyer and say nothing else then that can’t harm your defence.

I’m not a lawyer though.