Much of this is discussed in our classic thread on the topic: What are good basic statistics to use for ordinal data?
The classical thinking on the topic is that data can instantiate one of a set of levels of measurement (nominal, ordinal, interval, and ratio). While I think this theory is generally overblown, the standard recommendation is to use means to represent the central tendency of continuous (interval or ratio) data, medians to represent ordinal data, and the mode (potentially) to represent nominal data. The reason to choose the median is that it carries more information about the distribution than the mode and it is unambiguously acceptable for ordinal data (e.g., using the mean could be controversial, see: Calculate mean of ordinal variable). In truth, the mode is rarely ever used in my experience.