As the title implies, when we erupt the surface tile a lava wall is created underground, but to get rid of the lava we must freeze both the surface and the lava wall separately. On that note we can freeze undeground lava walls but we cannot erupt cave walls/veins from undeground.