asc("≤") -> {32,8804,32} ?

[ijabbott]

(07-23-2020 07:08 PM)Claudio L. Wrote:  To make it even more complex, in some cases the same symbol may be represented as a unique code or as a sequence of codes, so 2 strings may look exactly the same but produce 2 different lists of codes.
Ideally you would have Unicode-aware routines that let you do string(2) and guarantee to return the second character (which may in itself be a string of several codes).
Then you also need a Unicode-aware comparison that can do NFC normalization so it can detect the case when characters are the same expressed differently.
Converting to a list to use generic list functions will never give you a perfect answer, hence there's not a lot of effort put into that conversion.
ASCII was easy, Unicode is no easy subject.

It seems that the Prime doesn't support combining character sequences anyway, so normalisation shouldn't be an issue.