What are over and under markets?

Over and under markets uses greater or less than logic. 

See below examples -

Over 2.5 goals in football means there will be 3 or more goals in a match, full time results only.

Under 2.5 goals in football means there will be 2 goals or less goals in a match, full time results only.