Thanks to everyone who responded with ideas on this.

John's suggestion of the TEC* functions was promising, but I ended up not using 
them when I discovered that they're not available on the iPhone.  Ditto for 
Martin's suggestion of using getxattr.

I eventually ended up using Rainer's method (which was also suggested by Nick 
Z).  I understand that it's not perfect, but it was good enough for what I was 
doing.

And what was I doing....

I've just posted an open source CSV parser to github.  I've had occasion in the 
past for a parser that's more intelligent than -[NSString 
componentsSeparatedByString:@","], and have developed this one.  However, I've 
also had need to use this parser on UTF16 files, hence my desire to be able to 
auto-discover file encodings.  (There is, of course, an option to provide a 
known encoding when initializing the parser)

Please check it out, fork it, and help me make improvements to it:    
http://github.com/davedelong/CHCSVParser

Thanks for your help, everyone!

Dave DeLong

On Jul 30, 2010, at 9:50 PM, Michael Ash wrote:
> 
> A nitpick: starting with those two bytes is a *strong suggestion* that
> it's UTF-16, but it could just be, say, a Latin-1 file that starts
> with "þÿ", or a random binary file that happens to start with that
> byte sequence.
> 
> One fact that's can be extremely useful for this sort of thing but
> which seems to be little-known: due to the structure of UTF-8 it's
> rare for a file to be valid UTF-8 by accident. Random data, or data
> that isn't intended to be structured like UTF-8, is extremely unlikely
> to happen to match the structure required by UTF-8 by coincidence.
> Thus, if a file parses as UTF-8, you can be pretty confident that it
> was supposed to be interpreted in that encoding.
> 
> The same is, alas, not true of UTF-16.
> 
> Mike

Attachment: smime.p7s
Description: S/MIME cryptographic signature

_______________________________________________

Cocoa-dev mailing list (Cocoa-dev@lists.apple.com)

Please do not post admin requests or moderator comments to the list.
Contact the moderators at cocoa-dev-admins(at)lists.apple.com

Help/Unsubscribe/Update your Subscription:
http://lists.apple.com/mailman/options/cocoa-dev/archive%40mail-archive.com

This email sent to arch...@mail-archive.com

Reply via email to