Is a mirrorless camera worth the cost?

Mirrorless cameras are rapidly rising in popularity, but are they actually worth the hefty price tag?