sl@0: /* sl@0: ******************************************************************************* sl@0: * sl@0: * Copyright (C) 2002-2005, International Business Machines sl@0: * Corporation and others. All Rights Reserved. sl@0: * sl@0: ******************************************************************************* sl@0: * file name: utf.h sl@0: * encoding: US-ASCII sl@0: * tab size: 8 (not used) sl@0: * indentation:4 sl@0: * sl@0: * created on: 2002sep21 sl@0: * created by: Markus W. Scherer sl@0: */ sl@0: sl@0: /** sl@0: * \file sl@0: * \brief C API: Deprecated macros for Unicode string handling sl@0: */ sl@0: sl@0: /** sl@0: * sl@0: * The macros in utf_old.h are all deprecated and their use discouraged. sl@0: * Some of the design principles behind the set of UTF macros sl@0: * have changed or proved impractical. sl@0: * Almost all of the old "UTF macros" are at least renamed. sl@0: * If you are looking for a new equivalent to an old macro, please see the sl@0: * comment at the old one. sl@0: * sl@0: * utf_old.h is included by utf.h after unicode/umachine.h sl@0: * and some common definitions, to not break old code. sl@0: * sl@0: * Brief summary of reasons for deprecation: sl@0: * - Switch on UTF_SIZE (selection of UTF-8/16/32 default string processing) sl@0: * was impractical. sl@0: * - Switch on UTF_SAFE etc. (selection of unsafe/safe/strict default string processing) sl@0: * was of little use and impractical. sl@0: * - Whole classes of macros became obsolete outside of the UTF_SIZE/UTF_SAFE sl@0: * selection framework: UTF32_ macros (all trivial) sl@0: * and UTF_ default and intermediate macros (all aliases). sl@0: * - The selection framework also caused many macro aliases. sl@0: * - Change in Unicode standard: "irregular" sequences (3.0) became illegal (3.2). sl@0: * - Change of language in Unicode standard: sl@0: * Growing distinction between internal x-bit Unicode strings and external UTF-x sl@0: * forms, with the former more lenient. sl@0: * Suggests renaming of UTF16_ macros to U16_. sl@0: * - The prefix "UTF_" without a width number confused some users. sl@0: * - "Safe" append macros needed the addition of an error indicator output. sl@0: * - "Safe" UTF-8 macros used legitimate (if rarely used) code point values sl@0: * to indicate error conditions. sl@0: * - The use of the "_CHAR" infix for code point operations confused some users. sl@0: * sl@0: * More details: sl@0: * sl@0: * Until ICU 2.2, utf.h theoretically allowed to choose among UTF-8/16/32 sl@0: * for string processing, and among unsafe/safe/strict default macros for that. sl@0: * sl@0: * It proved nearly impossible to write non-trivial, high-performance code sl@0: * that is UTF-generic. sl@0: * Unsafe default macros would be dangerous for default string processing, sl@0: * and the main reason for the "strict" versions disappeared: sl@0: * Between Unicode 3.0 and 3.2 all "irregular" UTF-8 sequences became illegal. sl@0: * The only other conditions that "strict" checked for were non-characters, sl@0: * which are valid during processing. Only during text input/output should they sl@0: * be checked, and at that time other well-formedness checks may be sl@0: * necessary or useful as well. sl@0: * This can still be done by using U16_NEXT and U_IS_UNICODE_NONCHAR sl@0: * or U_IS_UNICODE_CHAR. sl@0: * sl@0: * The old UTF8_..._SAFE macros also used some normal Unicode code points sl@0: * to indicate malformed sequences. sl@0: * The new UTF8_ macros without suffix use negative values instead. sl@0: * sl@0: * The entire contents of utf32.h was moved here without replacement sl@0: * because all those macros were trivial and sl@0: * were meaningful only in the framework of choosing the UTF size. sl@0: * sl@0: * See Jitterbug 2150 and its discussion on the ICU mailing list sl@0: * in September 2002. sl@0: * sl@0: *
The original concept for these files was for ICU to allow sl@0: * in principle to set which UTF (UTF-8/16/32) is used internally sl@0: * by defining UTF_SIZE to either 8, 16, or 32. utf.h would then define the UChar type sl@0: * accordingly. UTF-16 was the default.
sl@0: * sl@0: *This concept has been abandoned. sl@0: * A lot of the ICU source code assumes UChar srings are in UTF-16. sl@0: * This is especially true for low-level code like sl@0: * conversion, normalization, and collation. sl@0: * The utf.h header enforces the default of UTF-16. sl@0: * The UTF-8 and UTF-32 macros remain for now for completeness and backward compatibility.
sl@0: * sl@0: *Accordingly, utf.h defines UChar to be an unsigned 16-bit integer. If this matches wchar_t, then sl@0: * UChar is defined to be exactly wchar_t, otherwise uint16_t.
sl@0: * sl@0: *UChar32 is defined to be a signed 32-bit integer (int32_t), large enough for a 21-bit sl@0: * Unicode code point (Unicode scalar value, 0..0x10ffff). sl@0: * Before ICU 2.4, the definition of UChar32 was similarly platform-dependent as sl@0: * the definition of UChar. For details see the documentation for UChar32 itself.
sl@0: * sl@0: *utf.h also defines a number of C macros for handling single Unicode code points and sl@0: * for using UTF Unicode strings. It includes utf8.h, utf16.h, and utf32.h for the actual sl@0: * implementations of those macros and then aliases one set of them (for UTF-16) for general use. sl@0: * The UTF-specific macros have the UTF size in the macro name prefixes (UTF16_...), while sl@0: * the general alias macros always begin with UTF_...
sl@0: * sl@0: *Many string operations can be done with or without error checking.
sl@0: * Where such a distinction is useful, there are two versions of the macros, "unsafe" and "safe"
sl@0: * ones with ..._UNSAFE and ..._SAFE suffixes. The unsafe macros are fast but may cause
sl@0: * program failures if the strings are not well-formed. The safe macros have an additional, boolean
sl@0: * parameter "strict". If strict is FALSE, then only illegal sequences are detected.
sl@0: * Otherwise, irregular sequences and non-characters are detected as well (like single surrogates).
sl@0: * Safe macros return special error code points for illegal/irregular sequences:
sl@0: * Typically, U+ffff, or values that would result in a code unit sequence of the same length
sl@0: * as the erroneous input sequence.
sl@0: * Note that _UNSAFE macros have fewer parameters: They do not have the strictness parameter, and
sl@0: * they do not have start/length parameters for boundary checking.
Here, the macros are aliased in two steps: sl@0: * In the first step, the UTF-specific macros with UTF16_ prefix and _UNSAFE and _SAFE suffixes are sl@0: * aliased according to the UTF_SIZE to macros with UTF_ prefix and the same suffixes and signatures. sl@0: * Then, in a second step, the default, general alias macros are set to use either the unsafe or sl@0: * the safe/not strict (default) or the safe/strict macro; sl@0: * these general macros do not have a strictness parameter.
sl@0: * sl@0: *It is possible to change the default choice for the general alias macros to be unsafe, safe/not strict or safe/strict. sl@0: * The default is safe/not strict. It is not recommended to select the unsafe macros as the basis for sl@0: * Unicode string handling in ICU! To select this, define UTF_SAFE, UTF_STRICT, or UTF_UNSAFE.
sl@0: * sl@0: *For general use, one should use the default, general macros with UTF_ prefix and no _SAFE/_UNSAFE suffix. sl@0: * Only in some cases it may be necessary to control the choice of macro directly and use a less generic alias. sl@0: * For example, if it can be assumed that a string is well-formed and the index will stay within the bounds, sl@0: * then the _UNSAFE version may be used. sl@0: * If a UTF-8 string is to be processed, then the macros with UTF8_ prefixes need to be used.
sl@0: * sl@0: *UTF8_ERROR_VALUE_1 and UTF8_ERROR_VALUE_2 are special error values for UTF-8,
sl@0: * which need 1 or 2 bytes in UTF-8:
sl@0: * U+0015 = NAK = Negative Acknowledge, C0 control character
sl@0: * U+009f = highest C1 control character
These are used by UTF8_..._SAFE macros so that they can return an error value sl@0: * that needs the same number of code units (bytes) as were seen by sl@0: * a macro. They should be tested with UTF_IS_ERROR() or UTF_IS_VALID().
sl@0: * sl@0: * @deprecated ICU 2.4. Obsolete, see utf_old.h. sl@0: */ sl@0: #define UTF8_ERROR_VALUE_1 0x15 sl@0: sl@0: /** sl@0: * See documentation on UTF8_ERROR_VALUE_1 for details. sl@0: * sl@0: * @deprecated ICU 2.4. Obsolete, see utf_old.h. sl@0: */ sl@0: #define UTF8_ERROR_VALUE_2 0x9f sl@0: sl@0: /** sl@0: * Error value for all UTFs. This code point value will be set by macros with error sl@0: * checking if an error is detected. sl@0: * sl@0: * @deprecated ICU 2.4. Obsolete, see utf_old.h. sl@0: */ sl@0: #define UTF_ERROR_VALUE 0xffff sl@0: sl@0: /** sl@0: * Is a given 32-bit code an error value sl@0: * as returned by one of the macros for any UTF? sl@0: * sl@0: * @deprecated ICU 2.4. Obsolete, see utf_old.h. sl@0: */ sl@0: #define UTF_IS_ERROR(c) \ sl@0: (((c)&0xfffe)==0xfffe || (c)==UTF8_ERROR_VALUE_1 || (c)==UTF8_ERROR_VALUE_2) sl@0: sl@0: /** sl@0: * This is a combined macro: Is c a valid Unicode value _and_ not an error code? sl@0: * sl@0: * @deprecated ICU 2.4. Obsolete, see utf_old.h. sl@0: */ sl@0: #define UTF_IS_VALID(c) \ sl@0: (UTF_IS_UNICODE_CHAR(c) && \ sl@0: (c)!=UTF8_ERROR_VALUE_1 && (c)!=UTF8_ERROR_VALUE_2) sl@0: sl@0: /** sl@0: * Is this code unit or code point a surrogate (U+d800..U+dfff)? sl@0: * @deprecated ICU 2.4. Renamed to U_IS_SURROGATE and U16_IS_SURROGATE, see utf_old.h. sl@0: */ sl@0: #define UTF_IS_SURROGATE(uchar) (((uchar)&0xfffff800)==0xd800) sl@0: sl@0: /** sl@0: * Is a given 32-bit code point a Unicode noncharacter? sl@0: * sl@0: * @deprecated ICU 2.4. Renamed to U_IS_UNICODE_NONCHAR, see utf_old.h. sl@0: */ sl@0: #define UTF_IS_UNICODE_NONCHAR(c) \ sl@0: ((c)>=0xfdd0 && \ sl@0: ((uint32_t)(c)<=0xfdef || ((c)&0xfffe)==0xfffe) && \ sl@0: (uint32_t)(c)<=0x10ffff) sl@0: sl@0: /** sl@0: * Is a given 32-bit value a Unicode code point value (0..U+10ffff) sl@0: * that can be assigned a character? sl@0: * sl@0: * Code points that are not characters include: sl@0: * - single surrogate code points (U+d800..U+dfff, 2048 code points) sl@0: * - the last two code points on each plane (U+__fffe and U+__ffff, 34 code points) sl@0: * - U+fdd0..U+fdef (new with Unicode 3.1, 32 code points) sl@0: * - the highest Unicode code point value is U+10ffff sl@0: * sl@0: * This means that all code points below U+d800 are character code points, sl@0: * and that boundary is tested first for performance. sl@0: * sl@0: * @deprecated ICU 2.4. Renamed to U_IS_UNICODE_CHAR, see utf_old.h. sl@0: */ sl@0: #define UTF_IS_UNICODE_CHAR(c) \ sl@0: ((uint32_t)(c)<0xd800 || \ sl@0: ((uint32_t)(c)>0xdfff && \ sl@0: (uint32_t)(c)<=0x10ffff && \ sl@0: !UTF_IS_UNICODE_NONCHAR(c))) sl@0: sl@0: /* Formerly utf8.h ---------------------------------------------------------- */ sl@0: sl@0: /** sl@0: * Count the trail bytes for a UTF-8 lead byte. sl@0: * @deprecated ICU 2.4. Renamed to U8_COUNT_TRAIL_BYTES, see utf_old.h. sl@0: */ sl@0: #define UTF8_COUNT_TRAIL_BYTES(leadByte) (utf8_countTrailBytes[(uint8_t)leadByte]) sl@0: sl@0: /** sl@0: * Mask a UTF-8 lead byte, leave only the lower bits that form part of the code point value. sl@0: * @deprecated ICU 2.4. Renamed to U8_MASK_LEAD_BYTE, see utf_old.h. sl@0: */ sl@0: #define UTF8_MASK_LEAD_BYTE(leadByte, countTrailBytes) ((leadByte)&=(1<<(6-(countTrailBytes)))-1) sl@0: sl@0: /** Is this this code point a single code unit (byte)? @deprecated ICU 2.4. Renamed to U8_IS_SINGLE, see utf_old.h. */ sl@0: #define UTF8_IS_SINGLE(uchar) (((uchar)&0x80)==0) sl@0: /** Is this this code unit the lead code unit (byte) of a code point? @deprecated ICU 2.4. Renamed to U8_IS_LEAD, see utf_old.h. */ sl@0: #define UTF8_IS_LEAD(uchar) ((uint8_t)((uchar)-0xc0)<0x3e) sl@0: /** Is this this code unit a trailing code unit (byte) of a code point? @deprecated ICU 2.4. Renamed to U8_IS_TRAIL, see utf_old.h. */ sl@0: #define UTF8_IS_TRAIL(uchar) (((uchar)&0xc0)==0x80) sl@0: sl@0: /** Does this scalar Unicode value need multiple code units for storage? @deprecated ICU 2.4. Use U8_LENGTH or test ((uint32_t)(c)>0x7f) instead, see utf_old.h. */ sl@0: #define UTF8_NEED_MULTIPLE_UCHAR(c) ((uint32_t)(c)>0x7f) sl@0: sl@0: /** sl@0: * Given the lead character, how many bytes are taken by this code point. sl@0: * ICU does not deal with code points >0x10ffff sl@0: * unless necessary for advancing in the byte stream. sl@0: * sl@0: * These length macros take into account that for values >0x10ffff sl@0: * the UTF8_APPEND_CHAR_SAFE macros would write the error code point 0xffff sl@0: * with 3 bytes. sl@0: * Code point comparisons need to be in uint32_t because UChar32 sl@0: * may be a signed type, and negative values must be recognized. sl@0: * sl@0: * @deprecated ICU 2.4. Use U8_LENGTH instead, see utf_old.h. sl@0: */ sl@0: #if 1 sl@0: # define UTF8_CHAR_LENGTH(c) \ sl@0: ((uint32_t)(c)<=0x7f ? 1 : \ sl@0: ((uint32_t)(c)<=0x7ff ? 2 : \ sl@0: ((uint32_t)((c)-0x10000)>0xfffff ? 3 : 4) \ sl@0: ) \ sl@0: ) sl@0: #else sl@0: # define UTF8_CHAR_LENGTH(c) \ sl@0: ((uint32_t)(c)<=0x7f ? 1 : \ sl@0: ((uint32_t)(c)<=0x7ff ? 2 : \ sl@0: ((uint32_t)(c)<=0xffff ? 3 : \ sl@0: ((uint32_t)(c)<=0x10ffff ? 4 : \ sl@0: ((uint32_t)(c)<=0x3ffffff ? 5 : \ sl@0: ((uint32_t)(c)<=0x7fffffff ? 6 : 3) \ sl@0: ) \ sl@0: ) \ sl@0: ) \ sl@0: ) \ sl@0: ) sl@0: #endif sl@0: sl@0: /** The maximum number of bytes per code point. @deprecated ICU 2.4. Renamed to U8_MAX_LENGTH, see utf_old.h. */ sl@0: #define UTF8_MAX_CHAR_LENGTH 4 sl@0: sl@0: /** Average number of code units compared to UTF-16. @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF8_ARRAY_SIZE(size) ((5*(size))/2) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_GET_UNSAFE, see utf_old.h. */ sl@0: #define UTF8_GET_CHAR_UNSAFE(s, i, c) { \ sl@0: int32_t _utf8_get_char_unsafe_index=(int32_t)(i); \ sl@0: UTF8_SET_CHAR_START_UNSAFE(s, _utf8_get_char_unsafe_index); \ sl@0: UTF8_NEXT_CHAR_UNSAFE(s, _utf8_get_char_unsafe_index, c); \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Use U8_GET instead, see utf_old.h. */ sl@0: #define UTF8_GET_CHAR_SAFE(s, start, i, length, c, strict) { \ sl@0: int32_t _utf8_get_char_safe_index=(int32_t)(i); \ sl@0: UTF8_SET_CHAR_START_SAFE(s, start, _utf8_get_char_safe_index); \ sl@0: UTF8_NEXT_CHAR_SAFE(s, _utf8_get_char_safe_index, length, c, strict); \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_NEXT_UNSAFE, see utf_old.h. */ sl@0: #define UTF8_NEXT_CHAR_UNSAFE(s, i, c) { \ sl@0: (c)=(s)[(i)++]; \ sl@0: if((uint8_t)((c)-0xc0)<0x35) { \ sl@0: uint8_t __count=UTF8_COUNT_TRAIL_BYTES(c); \ sl@0: UTF8_MASK_LEAD_BYTE(c, __count); \ sl@0: switch(__count) { \ sl@0: /* each following branch falls through to the next one */ \ sl@0: case 3: \ sl@0: (c)=((c)<<6)|((s)[(i)++]&0x3f); \ sl@0: case 2: \ sl@0: (c)=((c)<<6)|((s)[(i)++]&0x3f); \ sl@0: case 1: \ sl@0: (c)=((c)<<6)|((s)[(i)++]&0x3f); \ sl@0: /* no other branches to optimize switch() */ \ sl@0: break; \ sl@0: } \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_APPEND_UNSAFE, see utf_old.h. */ sl@0: #define UTF8_APPEND_CHAR_UNSAFE(s, i, c) { \ sl@0: if((uint32_t)(c)<=0x7f) { \ sl@0: (s)[(i)++]=(uint8_t)(c); \ sl@0: } else { \ sl@0: if((uint32_t)(c)<=0x7ff) { \ sl@0: (s)[(i)++]=(uint8_t)(((c)>>6)|0xc0); \ sl@0: } else { \ sl@0: if((uint32_t)(c)<=0xffff) { \ sl@0: (s)[(i)++]=(uint8_t)(((c)>>12)|0xe0); \ sl@0: } else { \ sl@0: (s)[(i)++]=(uint8_t)(((c)>>18)|0xf0); \ sl@0: (s)[(i)++]=(uint8_t)((((c)>>12)&0x3f)|0x80); \ sl@0: } \ sl@0: (s)[(i)++]=(uint8_t)((((c)>>6)&0x3f)|0x80); \ sl@0: } \ sl@0: (s)[(i)++]=(uint8_t)(((c)&0x3f)|0x80); \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_FWD_1_UNSAFE, see utf_old.h. */ sl@0: #define UTF8_FWD_1_UNSAFE(s, i) { \ sl@0: (i)+=1+UTF8_COUNT_TRAIL_BYTES((s)[i]); \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_FWD_N_UNSAFE, see utf_old.h. */ sl@0: #define UTF8_FWD_N_UNSAFE(s, i, n) { \ sl@0: int32_t __N=(n); \ sl@0: while(__N>0) { \ sl@0: UTF8_FWD_1_UNSAFE(s, i); \ sl@0: --__N; \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_SET_CP_START_UNSAFE, see utf_old.h. */ sl@0: #define UTF8_SET_CHAR_START_UNSAFE(s, i) { \ sl@0: while(UTF8_IS_TRAIL((s)[i])) { --(i); } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Use U8_NEXT instead, see utf_old.h. */ sl@0: #define UTF8_NEXT_CHAR_SAFE(s, i, length, c, strict) { \ sl@0: (c)=(s)[(i)++]; \ sl@0: if((c)>=0x80) { \ sl@0: if(UTF8_IS_LEAD(c)) { \ sl@0: (c)=utf8_nextCharSafeBody(s, &(i), (int32_t)(length), c, strict); \ sl@0: } else { \ sl@0: (c)=UTF8_ERROR_VALUE_1; \ sl@0: } \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Use U8_APPEND instead, see utf_old.h. */ sl@0: #define UTF8_APPEND_CHAR_SAFE(s, i, length, c) { \ sl@0: if((uint32_t)(c)<=0x7f) { \ sl@0: (s)[(i)++]=(uint8_t)(c); \ sl@0: } else { \ sl@0: (i)=utf8_appendCharSafeBody(s, (int32_t)(i), (int32_t)(length), c, NULL); \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_FWD_1, see utf_old.h. */ sl@0: #define UTF8_FWD_1_SAFE(s, i, length) U8_FWD_1(s, i, length) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_FWD_N, see utf_old.h. */ sl@0: #define UTF8_FWD_N_SAFE(s, i, length, n) U8_FWD_N(s, i, length, n) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_SET_CP_START, see utf_old.h. */ sl@0: #define UTF8_SET_CHAR_START_SAFE(s, start, i) U8_SET_CP_START(s, start, i) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_PREV_UNSAFE, see utf_old.h. */ sl@0: #define UTF8_PREV_CHAR_UNSAFE(s, i, c) { \ sl@0: (c)=(s)[--(i)]; \ sl@0: if(UTF8_IS_TRAIL(c)) { \ sl@0: uint8_t __b, __count=1, __shift=6; \ sl@0: \ sl@0: /* c is a trail byte */ \ sl@0: (c)&=0x3f; \ sl@0: for(;;) { \ sl@0: __b=(s)[--(i)]; \ sl@0: if(__b>=0xc0) { \ sl@0: UTF8_MASK_LEAD_BYTE(__b, __count); \ sl@0: (c)|=(UChar32)__b<<__shift; \ sl@0: break; \ sl@0: } else { \ sl@0: (c)|=(UChar32)(__b&0x3f)<<__shift; \ sl@0: ++__count; \ sl@0: __shift+=6; \ sl@0: } \ sl@0: } \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_BACK_1_UNSAFE, see utf_old.h. */ sl@0: #define UTF8_BACK_1_UNSAFE(s, i) { \ sl@0: while(UTF8_IS_TRAIL((s)[--(i)])) {} \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_BACK_N_UNSAFE, see utf_old.h. */ sl@0: #define UTF8_BACK_N_UNSAFE(s, i, n) { \ sl@0: int32_t __N=(n); \ sl@0: while(__N>0) { \ sl@0: UTF8_BACK_1_UNSAFE(s, i); \ sl@0: --__N; \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_SET_CP_LIMIT_UNSAFE, see utf_old.h. */ sl@0: #define UTF8_SET_CHAR_LIMIT_UNSAFE(s, i) { \ sl@0: UTF8_BACK_1_UNSAFE(s, i); \ sl@0: UTF8_FWD_1_UNSAFE(s, i); \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Use U8_PREV instead, see utf_old.h. */ sl@0: #define UTF8_PREV_CHAR_SAFE(s, start, i, c, strict) { \ sl@0: (c)=(s)[--(i)]; \ sl@0: if((c)>=0x80) { \ sl@0: if((c)<=0xbf) { \ sl@0: (c)=utf8_prevCharSafeBody(s, start, &(i), c, strict); \ sl@0: } else { \ sl@0: (c)=UTF8_ERROR_VALUE_1; \ sl@0: } \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_BACK_1, see utf_old.h. */ sl@0: #define UTF8_BACK_1_SAFE(s, start, i) U8_BACK_1(s, start, i) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_BACK_N, see utf_old.h. */ sl@0: #define UTF8_BACK_N_SAFE(s, start, i, n) U8_BACK_N(s, start, i, n) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U8_SET_CP_LIMIT, see utf_old.h. */ sl@0: #define UTF8_SET_CHAR_LIMIT_SAFE(s, start, i, length) U8_SET_CP_LIMIT(s, start, i, length) sl@0: sl@0: /* Formerly utf16.h --------------------------------------------------------- */ sl@0: sl@0: /** Is uchar a first/lead surrogate? @deprecated ICU 2.4. Renamed to U_IS_LEAD and U16_IS_LEAD, see utf_old.h. */ sl@0: #define UTF_IS_FIRST_SURROGATE(uchar) (((uchar)&0xfffffc00)==0xd800) sl@0: sl@0: /** Is uchar a second/trail surrogate? @deprecated ICU 2.4. Renamed to U_IS_TRAIL and U16_IS_TRAIL, see utf_old.h. */ sl@0: #define UTF_IS_SECOND_SURROGATE(uchar) (((uchar)&0xfffffc00)==0xdc00) sl@0: sl@0: /** Assuming c is a surrogate, is it a first/lead surrogate? @deprecated ICU 2.4. Renamed to U_IS_SURROGATE_LEAD and U16_IS_SURROGATE_LEAD, see utf_old.h. */ sl@0: #define UTF_IS_SURROGATE_FIRST(c) (((c)&0x400)==0) sl@0: sl@0: /** Helper constant for UTF16_GET_PAIR_VALUE. @deprecated ICU 2.4. Renamed to U16_SURROGATE_OFFSET, see utf_old.h. */ sl@0: #define UTF_SURROGATE_OFFSET ((0xd800<<10UL)+0xdc00-0x10000) sl@0: sl@0: /** Get the UTF-32 value from the surrogate code units. @deprecated ICU 2.4. Renamed to U16_GET_SUPPLEMENTARY, see utf_old.h. */ sl@0: #define UTF16_GET_PAIR_VALUE(first, second) \ sl@0: (((first)<<10UL)+(second)-UTF_SURROGATE_OFFSET) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_LEAD, see utf_old.h. */ sl@0: #define UTF_FIRST_SURROGATE(supplementary) (UChar)(((supplementary)>>10)+0xd7c0) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_TRAIL, see utf_old.h. */ sl@0: #define UTF_SECOND_SURROGATE(supplementary) (UChar)(((supplementary)&0x3ff)|0xdc00) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_LEAD, see utf_old.h. */ sl@0: #define UTF16_LEAD(supplementary) UTF_FIRST_SURROGATE(supplementary) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_TRAIL, see utf_old.h. */ sl@0: #define UTF16_TRAIL(supplementary) UTF_SECOND_SURROGATE(supplementary) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_IS_SINGLE, see utf_old.h. */ sl@0: #define UTF16_IS_SINGLE(uchar) !UTF_IS_SURROGATE(uchar) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_IS_LEAD, see utf_old.h. */ sl@0: #define UTF16_IS_LEAD(uchar) UTF_IS_FIRST_SURROGATE(uchar) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_IS_TRAIL, see utf_old.h. */ sl@0: #define UTF16_IS_TRAIL(uchar) UTF_IS_SECOND_SURROGATE(uchar) sl@0: sl@0: /** Does this scalar Unicode value need multiple code units for storage? @deprecated ICU 2.4. Use U16_LENGTH or test ((uint32_t)(c)>0xffff) instead, see utf_old.h. */ sl@0: #define UTF16_NEED_MULTIPLE_UCHAR(c) ((uint32_t)(c)>0xffff) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_LENGTH, see utf_old.h. */ sl@0: #define UTF16_CHAR_LENGTH(c) ((uint32_t)(c)<=0xffff ? 1 : 2) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_MAX_LENGTH, see utf_old.h. */ sl@0: #define UTF16_MAX_CHAR_LENGTH 2 sl@0: sl@0: /** Average number of code units compared to UTF-16. @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF16_ARRAY_SIZE(size) (size) sl@0: sl@0: /** sl@0: * Get a single code point from an offset that points to any sl@0: * of the code units that belong to that code point. sl@0: * Assume 0<=iUsage: ICU coding guidelines for if() statements should be followed when using these macros. sl@0: * Compound statements (curly braces {}) must be used for if-else-while... sl@0: * bodies and all macro statements should be terminated with semicolon.
sl@0: */ sl@0: sl@0: /* internal definitions ----------------------------------------------------- */ sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_IS_SAFE(c, strict) \ sl@0: (!(strict) ? \ sl@0: (uint32_t)(c)<=0x10ffff : \ sl@0: UTF_IS_UNICODE_CHAR(c)) sl@0: sl@0: /* sl@0: * For the semantics of all of these macros, see utf16.h. sl@0: * The UTF-32 versions are trivial because any code point is sl@0: * encoded using exactly one code unit. sl@0: */ sl@0: sl@0: /* single-code point definitions -------------------------------------------- */ sl@0: sl@0: /* classes of code unit values */ sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_IS_SINGLE(uchar) 1 sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_IS_LEAD(uchar) 0 sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_IS_TRAIL(uchar) 0 sl@0: sl@0: /* number of code units per code point */ sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_NEED_MULTIPLE_UCHAR(c) 0 sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_CHAR_LENGTH(c) 1 sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_MAX_CHAR_LENGTH 1 sl@0: sl@0: /* average number of code units compared to UTF-16 */ sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_ARRAY_SIZE(size) (size) sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_GET_CHAR_UNSAFE(s, i, c) { \ sl@0: (c)=(s)[i]; \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_GET_CHAR_SAFE(s, start, i, length, c, strict) { \ sl@0: (c)=(s)[i]; \ sl@0: if(!UTF32_IS_SAFE(c, strict)) { \ sl@0: (c)=UTF_ERROR_VALUE; \ sl@0: } \ sl@0: } sl@0: sl@0: /* definitions with forward iteration --------------------------------------- */ sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_NEXT_CHAR_UNSAFE(s, i, c) { \ sl@0: (c)=(s)[(i)++]; \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_APPEND_CHAR_UNSAFE(s, i, c) { \ sl@0: (s)[(i)++]=(c); \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_FWD_1_UNSAFE(s, i) { \ sl@0: ++(i); \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_FWD_N_UNSAFE(s, i, n) { \ sl@0: (i)+=(n); \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_SET_CHAR_START_UNSAFE(s, i) { \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_NEXT_CHAR_SAFE(s, i, length, c, strict) { \ sl@0: (c)=(s)[(i)++]; \ sl@0: if(!UTF32_IS_SAFE(c, strict)) { \ sl@0: (c)=UTF_ERROR_VALUE; \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_APPEND_CHAR_SAFE(s, i, length, c) { \ sl@0: if((uint32_t)(c)<=0x10ffff) { \ sl@0: (s)[(i)++]=(c); \ sl@0: } else /* c>0x10ffff, write 0xfffd */ { \ sl@0: (s)[(i)++]=0xfffd; \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_FWD_1_SAFE(s, i, length) { \ sl@0: ++(i); \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_FWD_N_SAFE(s, i, length, n) { \ sl@0: if(((i)+=(n))>(length)) { \ sl@0: (i)=(length); \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_SET_CHAR_START_SAFE(s, start, i) { \ sl@0: } sl@0: sl@0: /* definitions with backward iteration -------------------------------------- */ sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_PREV_CHAR_UNSAFE(s, i, c) { \ sl@0: (c)=(s)[--(i)]; \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_BACK_1_UNSAFE(s, i) { \ sl@0: --(i); \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_BACK_N_UNSAFE(s, i, n) { \ sl@0: (i)-=(n); \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_SET_CHAR_LIMIT_UNSAFE(s, i) { \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_PREV_CHAR_SAFE(s, start, i, c, strict) { \ sl@0: (c)=(s)[--(i)]; \ sl@0: if(!UTF32_IS_SAFE(c, strict)) { \ sl@0: (c)=UTF_ERROR_VALUE; \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_BACK_1_SAFE(s, start, i) { \ sl@0: --(i); \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_BACK_N_SAFE(s, start, i, n) { \ sl@0: (i)-=(n); \ sl@0: if((i)<(start)) { \ sl@0: (i)=(start); \ sl@0: } \ sl@0: } sl@0: sl@0: /** @deprecated ICU 2.4. Obsolete, see utf_old.h. */ sl@0: #define UTF32_SET_CHAR_LIMIT_SAFE(s, i, length) { \ sl@0: } sl@0: sl@0: /* Formerly utf.h, part 2 --------------------------------------------------- */ sl@0: sl@0: /** sl@0: * Estimate the number of code units for a string based on the number of UTF-16 code units. sl@0: * sl@0: * @deprecated ICU 2.4. Obsolete, see utf_old.h. sl@0: */ sl@0: #define UTF_ARRAY_SIZE(size) UTF16_ARRAY_SIZE(size) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_GET_UNSAFE, see utf_old.h. */ sl@0: #define UTF_GET_CHAR_UNSAFE(s, i, c) UTF16_GET_CHAR_UNSAFE(s, i, c) sl@0: sl@0: /** @deprecated ICU 2.4. Use U16_GET instead, see utf_old.h. */ sl@0: #define UTF_GET_CHAR_SAFE(s, start, i, length, c, strict) UTF16_GET_CHAR_SAFE(s, start, i, length, c, strict) sl@0: sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_NEXT_UNSAFE, see utf_old.h. */ sl@0: #define UTF_NEXT_CHAR_UNSAFE(s, i, c) UTF16_NEXT_CHAR_UNSAFE(s, i, c) sl@0: sl@0: /** @deprecated ICU 2.4. Use U16_NEXT instead, see utf_old.h. */ sl@0: #define UTF_NEXT_CHAR_SAFE(s, i, length, c, strict) UTF16_NEXT_CHAR_SAFE(s, i, length, c, strict) sl@0: sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_APPEND_UNSAFE, see utf_old.h. */ sl@0: #define UTF_APPEND_CHAR_UNSAFE(s, i, c) UTF16_APPEND_CHAR_UNSAFE(s, i, c) sl@0: sl@0: /** @deprecated ICU 2.4. Use U16_APPEND instead, see utf_old.h. */ sl@0: #define UTF_APPEND_CHAR_SAFE(s, i, length, c) UTF16_APPEND_CHAR_SAFE(s, i, length, c) sl@0: sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_FWD_1_UNSAFE, see utf_old.h. */ sl@0: #define UTF_FWD_1_UNSAFE(s, i) UTF16_FWD_1_UNSAFE(s, i) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_FWD_1, see utf_old.h. */ sl@0: #define UTF_FWD_1_SAFE(s, i, length) UTF16_FWD_1_SAFE(s, i, length) sl@0: sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_FWD_N_UNSAFE, see utf_old.h. */ sl@0: #define UTF_FWD_N_UNSAFE(s, i, n) UTF16_FWD_N_UNSAFE(s, i, n) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_FWD_N, see utf_old.h. */ sl@0: #define UTF_FWD_N_SAFE(s, i, length, n) UTF16_FWD_N_SAFE(s, i, length, n) sl@0: sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_SET_CP_START_UNSAFE, see utf_old.h. */ sl@0: #define UTF_SET_CHAR_START_UNSAFE(s, i) UTF16_SET_CHAR_START_UNSAFE(s, i) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_SET_CP_START, see utf_old.h. */ sl@0: #define UTF_SET_CHAR_START_SAFE(s, start, i) UTF16_SET_CHAR_START_SAFE(s, start, i) sl@0: sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_PREV_UNSAFE, see utf_old.h. */ sl@0: #define UTF_PREV_CHAR_UNSAFE(s, i, c) UTF16_PREV_CHAR_UNSAFE(s, i, c) sl@0: sl@0: /** @deprecated ICU 2.4. Use U16_PREV instead, see utf_old.h. */ sl@0: #define UTF_PREV_CHAR_SAFE(s, start, i, c, strict) UTF16_PREV_CHAR_SAFE(s, start, i, c, strict) sl@0: sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_BACK_1_UNSAFE, see utf_old.h. */ sl@0: #define UTF_BACK_1_UNSAFE(s, i) UTF16_BACK_1_UNSAFE(s, i) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_BACK_1, see utf_old.h. */ sl@0: #define UTF_BACK_1_SAFE(s, start, i) UTF16_BACK_1_SAFE(s, start, i) sl@0: sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_BACK_N_UNSAFE, see utf_old.h. */ sl@0: #define UTF_BACK_N_UNSAFE(s, i, n) UTF16_BACK_N_UNSAFE(s, i, n) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_BACK_N, see utf_old.h. */ sl@0: #define UTF_BACK_N_SAFE(s, start, i, n) UTF16_BACK_N_SAFE(s, start, i, n) sl@0: sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_SET_CP_LIMIT_UNSAFE, see utf_old.h. */ sl@0: #define UTF_SET_CHAR_LIMIT_UNSAFE(s, i) UTF16_SET_CHAR_LIMIT_UNSAFE(s, i) sl@0: sl@0: /** @deprecated ICU 2.4. Renamed to U16_SET_CP_LIMIT, see utf_old.h. */ sl@0: #define UTF_SET_CHAR_LIMIT_SAFE(s, start, i, length) UTF16_SET_CHAR_LIMIT_SAFE(s, start, i, length) sl@0: sl@0: /* Define default macros (UTF-16 "safe") ------------------------------------ */ sl@0: sl@0: /** sl@0: * Does this code unit alone encode a code point (BMP, not a surrogate)? sl@0: * Same as UTF16_IS_SINGLE. sl@0: * @deprecated ICU 2.4. Renamed to U_IS_SINGLE and U16_IS_SINGLE, see utf_old.h. sl@0: */ sl@0: #define UTF_IS_SINGLE(uchar) U16_IS_SINGLE(uchar) sl@0: sl@0: /** sl@0: * Is this code unit the first one of several (a lead surrogate)? sl@0: * Same as UTF16_IS_LEAD. sl@0: * @deprecated ICU 2.4. Renamed to U_IS_LEAD and U16_IS_LEAD, see utf_old.h. sl@0: */ sl@0: #define UTF_IS_LEAD(uchar) U16_IS_LEAD(uchar) sl@0: sl@0: /** sl@0: * Is this code unit one of several but not the first one (a trail surrogate)? sl@0: * Same as UTF16_IS_TRAIL. sl@0: * @deprecated ICU 2.4. Renamed to U_IS_TRAIL and U16_IS_TRAIL, see utf_old.h. sl@0: */ sl@0: #define UTF_IS_TRAIL(uchar) U16_IS_TRAIL(uchar) sl@0: sl@0: /** sl@0: * Does this code point require multiple code units (is it a supplementary code point)? sl@0: * Same as UTF16_NEED_MULTIPLE_UCHAR. sl@0: * @deprecated ICU 2.4. Use U16_LENGTH or test ((uint32_t)(c)>0xffff) instead. sl@0: */ sl@0: #define UTF_NEED_MULTIPLE_UCHAR(c) UTF16_NEED_MULTIPLE_UCHAR(c) sl@0: sl@0: /** sl@0: * How many code units are used to encode this code point (1 or 2)? sl@0: * Same as UTF16_CHAR_LENGTH. sl@0: * @deprecated ICU 2.4. Renamed to U16_LENGTH, see utf_old.h. sl@0: */ sl@0: #define UTF_CHAR_LENGTH(c) U16_LENGTH(c) sl@0: sl@0: /** sl@0: * How many code units are used at most for any Unicode code point (2)? sl@0: * Same as UTF16_MAX_CHAR_LENGTH. sl@0: * @deprecated ICU 2.4. Renamed to U16_MAX_LENGTH, see utf_old.h. sl@0: */ sl@0: #define UTF_MAX_CHAR_LENGTH U16_MAX_LENGTH sl@0: sl@0: /** sl@0: * Set c to the code point that contains the code unit i. sl@0: * i could point to the lead or the trail surrogate for the code point. sl@0: * i is not modified. sl@0: * Same as UTF16_GET_CHAR. sl@0: * \pre 0<=i