Definition: To greatly annoy someone. This phrase is from American horse racing. They would put a goat and let the racehorse to calm it. Goats are certainly used to calm horse, so if someone get goat away, then the racehorse may lose. Examples: Having too many exams and much homework gets our goat.