Character-sets.html 5.6 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128
  1. <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
  2. <html>
  3. <!-- Copyright (C) 1987-2023 Free Software Foundation, Inc.
  4. Permission is granted to copy, distribute and/or modify this document
  5. under the terms of the GNU Free Documentation License, Version 1.3 or
  6. any later version published by the Free Software Foundation. A copy of
  7. the license is included in the
  8. section entitled "GNU Free Documentation License".
  9. This manual contains no Invariant Sections. The Front-Cover Texts are
  10. (a) (see below), and the Back-Cover Texts are (b) (see below).
  11. (a) The FSF's Front-Cover Text is:
  12. A GNU Manual
  13. (b) The FSF's Back-Cover Text is:
  14. You have freedom to copy and modify this GNU Manual, like GNU
  15. software. Copies published by the Free Software Foundation raise
  16. funds for GNU development. -->
  17. <!-- Created by GNU Texinfo 6.7, http://www.gnu.org/software/texinfo/ -->
  18. <head>
  19. <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  20. <title>Character sets (The C Preprocessor)</title>
  21. <meta name="description" content="Character sets (The C Preprocessor)">
  22. <meta name="keywords" content="Character sets (The C Preprocessor)">
  23. <meta name="resource-type" content="document">
  24. <meta name="distribution" content="global">
  25. <meta name="Generator" content="makeinfo">
  26. <link href="index.html" rel="start" title="Top">
  27. <link href="Index-of-Directives.html" rel="index" title="Index of Directives">
  28. <link href="index.html#SEC_Contents" rel="contents" title="Table of Contents">
  29. <link href="Overview.html" rel="up" title="Overview">
  30. <link href="Initial-processing.html" rel="next" title="Initial processing">
  31. <link href="Overview.html" rel="prev" title="Overview">
  32. <style type="text/css">
  33. <!--
  34. a.summary-letter {text-decoration: none}
  35. blockquote.indentedblock {margin-right: 0em}
  36. div.display {margin-left: 3.2em}
  37. div.example {margin-left: 3.2em}
  38. div.lisp {margin-left: 3.2em}
  39. kbd {font-style: oblique}
  40. pre.display {font-family: inherit}
  41. pre.format {font-family: inherit}
  42. pre.menu-comment {font-family: serif}
  43. pre.menu-preformatted {font-family: serif}
  44. span.nolinebreak {white-space: nowrap}
  45. span.roman {font-family: initial; font-weight: normal}
  46. span.sansserif {font-family: sans-serif; font-weight: normal}
  47. ul.no-bullet {list-style: none}
  48. -->
  49. </style>
  50. </head>
  51. <body lang="en">
  52. <span id="Character-sets"></span><div class="header">
  53. <p>
  54. Next: <a href="Initial-processing.html" accesskey="n" rel="next">Initial processing</a>, Up: <a href="Overview.html" accesskey="u" rel="up">Overview</a> &nbsp; [<a href="index.html#SEC_Contents" title="Table of contents" rel="contents">Contents</a>][<a href="Index-of-Directives.html" title="Index" rel="index">Index</a>]</p>
  55. </div>
  56. <hr>
  57. <span id="Character-sets-1"></span><h3 class="section">1.1 Character sets</h3>
  58. <p>Source code character set processing in C and related languages is
  59. rather complicated. The C standard discusses two character sets, but
  60. there are really at least four.
  61. </p>
  62. <p>The files input to CPP might be in any character set at all. CPP&rsquo;s
  63. very first action, before it even looks for line boundaries, is to
  64. convert the file into the character set it uses for internal
  65. processing. That set is what the C standard calls the <em>source</em>
  66. character set. It must be isomorphic with ISO 10646, also known as
  67. Unicode. CPP uses the UTF-8 encoding of Unicode.
  68. </p>
  69. <p>The character sets of the input files are specified using the
  70. <samp>-finput-charset=</samp> option.
  71. </p>
  72. <p>All preprocessing work (the subject of the rest of this manual) is
  73. carried out in the source character set. If you request textual
  74. output from the preprocessor with the <samp>-E</samp> option, it will be
  75. in UTF-8.
  76. </p>
  77. <p>After preprocessing is complete, string and character constants are
  78. converted again, into the <em>execution</em> character set. This
  79. character set is under control of the user; the default is UTF-8,
  80. matching the source character set. Wide string and character
  81. constants have their own character set, which is not called out
  82. specifically in the standard. Again, it is under control of the user.
  83. The default is UTF-16 or UTF-32, whichever fits in the target&rsquo;s
  84. <code>wchar_t</code> type, in the target machine&rsquo;s byte
  85. order.<a id="DOCF1" href="#FOOT1"><sup>1</sup></a> Octal and hexadecimal escape sequences do not undergo
  86. conversion; <tt>'\x12'</tt> has the value 0x12 regardless of the currently
  87. selected execution character set. All other escapes are replaced by
  88. the character in the source character set that they represent, then
  89. converted to the execution character set, just like unescaped
  90. characters.
  91. </p>
  92. <p>In identifiers, characters outside the ASCII range can be specified
  93. with the &lsquo;<samp>\u</samp>&rsquo; and &lsquo;<samp>\U</samp>&rsquo; escapes or used directly in the input
  94. encoding. If strict ISO C90 conformance is specified with an option
  95. such as <samp>-std=c90</samp>, or <samp>-fno-extended-identifiers</samp> is
  96. used, then those constructs are not permitted in identifiers.
  97. </p>
  98. <div class="footnote">
  99. <hr>
  100. <h4 class="footnotes-heading">Footnotes</h4>
  101. <h5><a id="FOOT1" href="#DOCF1">(1)</a></h3>
  102. <p>UTF-16 does not meet the requirements of the C
  103. standard for a wide character set, but the choice of 16-bit
  104. <code>wchar_t</code> is enshrined in some system ABIs so we cannot fix
  105. this.</p>
  106. </div>
  107. <hr>
  108. <div class="header">
  109. <p>
  110. Next: <a href="Initial-processing.html" accesskey="n" rel="next">Initial processing</a>, Up: <a href="Overview.html" accesskey="u" rel="up">Overview</a> &nbsp; [<a href="index.html#SEC_Contents" title="Table of contents" rel="contents">Contents</a>][<a href="Index-of-Directives.html" title="Index" rel="index">Index</a>]</p>
  111. </div>
  112. </body>
  113. </html>