Ulysses S. Grant was stopped and fined multiple times for riding his horse too fast through the streets of Washington.