Can Transformers work on real-valued sequences?

Hua-mei Chen asked 3 days ago

Since the output of Transformers are probabilities of output tokens, and the size of the set of output tokens is finite, I guess I can not use Transformers directly for sequences composing real numbers. Is this correct? Of course, I am not talking about language translation, but general sequence to sequence translation. Thank you.

Your Answer

3 + 12 =