The Jewish people faced the mountain when they received the Torah. That you knew.
What you might not have considered was that their backs were turned to the rest of the world. To RECEIVE the Torah you have to turn your back to the rest of the world. Afterwards we face the world again and try to rectify it and fill it with the Light of Torah [אורייתא].
[Based on Maran HaRav Hutner]