It refers to situations where one is cautious, but in the wrong way, and therefore ends up in a dangerous situation.
When walking on thin ice, if you stand on tiptoes in order to walk carefully and gingerly to avoid breaking the ice, your weight will be focused on your toes and the ice will end up breaking.
Reference
“Radeel Anthology of Proverbs” (Shizay Kaizary)