utf-8 for RPL source code

[Claudio L.]

(04-07-2015 03:14 AM)MarkHaysHarris777 Wrote:  Support the spec, the whole spec, and everything in the spec; just bite the bullet and do it, you'll be glad you did, even though its gonna be a royal pain in the butt.

Well, we have 2 MB of flash in the 50g, of which 1.3 MB is used already. The only "complete" implementation is the reference ICU library. The x86 version binary for Linux is 12.6 MB GZipped, who knows how big it is when expanded.
You see my point now?
Even if I could use the full library, it makes indiscriminate use of malloc/free (since Unicode strings like to expand...), which means it would have to be heavily modified to run on a system where you alloc from TempOb and all routines need to be GC-aware. It would be a nightmare. I could spend the next two years trying to figure out how to implement Unicode, there has to be a reasonable compromise somewhere.