Ancient Greeks saw Olympus as a divine realm of Zeus and the gods, not a mountain. Its link to Mount Olympus emerged in later traditions.
While there is a ton of information to digest here, clearly the most important bit here is the existence of multiple Gods ...