~alcinnz/hurl

7d31eda45dc9d615cbfa084a2149b17c5e313a85 — Adrian Cochrane 2 years ago 3cb0d7d
Note charset optimization.
1 files changed, 3 insertions(+), 0 deletions(-)

A ISSUES/charset-sniffing.md
A ISSUES/charset-sniffing.md => ISSUES/charset-sniffing.md +3 -0
@@ 0,0 1,3 @@
# Optimize Charset Sniffing

Almost all charsets are supersets of ASCII, so when sniffing the charset for files which don't specify the encoding in their MIMEtype I can treat all the preceding text as ASCII. Though I suppose for this trick to work on UTF16 or UTF32 I'd need to remove any 0 bytes.