How does government borrowing work?

How does government borrowing work, and how and when is the money paid back?