Reading a Unicode text file?

[netninja]

You can add the UTF-8 BOM mark by prepending 3 bytes with values 0xEF 0xBB 0xBF to the start of the file. In decimal terms, that's 3 bytes, 239 187 191. You can add it with the Binary object. Or a CT dude could add that functionality to an extension

Prepending it if it doesn't exist is a good idea! It's just annoying to have to do all these 'workarounds' for something that seems so simple.

In the messages I've exchanged with Yves it seems MMF Unicode can't read UTF-8 encoded files, it can only read "Unicode" or "UCS-2 Little Endian".

[Phi]

Oops, yeah, you want UTF-16 for MMF Unicode. My bad.
Just prepend 0xFF 0xFE then (aka 255 254).
UCS-2 was deprecated by UTF-16 in July 1996, but it holds 96.9% similarity to UTF-16.

[netninja]

Thanks Phi, that's a really good fix! I'll give it a go

[Phi]

*1 hour later, Phi notices the finger-shape holes in his desk

[Phi]

* 2 weeks later, Phi is still waiting for netninja to tell if it worked and is now very hungry

[netninja]

I haven't had a chance to try it yet! I went on holiday for 3 weeks overseas while you've been waiting haha. I'll get back to you

[Phi]

* Phi is now dead from starvation

[netninja]

If it's killing you, why don't you try and make an example of it to test? :P

[Phi]

I just assumed that you'd keep your word and get back to me...