32-bit vs. 64-bit: Understanding what these options really mean

You've seen these options when you download an app or install a game. Which one is better? Does it matter?