State Machines

Here’s a video outlining the utility of state machines in video game development.

What is a finite state machine?
What is a benefit of using a state machine?
In programming, what is an enumerator?