~alcinnz/hurl

ref: e9e75cebf9d684a1552bcbe11e8de3f274424433 hurl/ISSUES/charset-sniffing.md -rw-r--r-- 298 bytes
e9e75ceb — Adrian Cochrane Release HURL v2.3.0.1 1 year, 7 months ago

#Optimize Charset Sniffing

Almost all charsets are supersets of ASCII, so when sniffing the charset for files which don't specify the encoding in their MIMEtype I can treat all the preceding text as ASCII. Though I suppose for this trick to work on UTF16 or UTF32 I'd need to remove any 0 bytes.