A vocabulary of 20,000 tokens is stored as one-hot rows. A sparse representation uses only the 8 nonzero positions per row. Which is smaller, and by roughly how much?

prerequisite: MATH-001