1 Answer. Assuming you have metal fascia as well, gently remove the nails securing a section of it where you need to work. Flex it out, then remove the hidden nails holding the soffit. Lower the soffit panels slightly by tilting them downward, and slide them past the fascia individually.