The police typically stay within city limits, whereas the sheriff cover the more rural areas. However, it should be known that the exact definition varies rather widely from state to state, especially if the state has troopers as well, like New York does.