When doing :l, abandon all breakpoints before we unload everything