Can someone who's not an MP become prime minister?

A number of potential candidates to replace Prime Minister Justin Trudeau do not currently have a seat in the House of Commons — but that would not prevent them from being sworn in if they win the Liberal leadership race.