1 @c This is part of the Emacs manual.
2 @c Copyright (C) 1997, 1999 Free Software Foundation, Inc.
3 @c See file emacs.texi for copying conditions.
4 @node International, Major Modes, Frames, Top
5 @chapter International Character Set Support
7 @cindex international scripts
8 @cindex multibyte characters
9 @cindex encoding of characters
26 Emacs supports a wide variety of international character sets,
27 including European variants of the Latin alphabet, as well as Chinese,
28 Cyrillic, Devanagari (Hindi and Marathi), Ethiopic, Greek, Hebrew, IPA,
29 Japanese, Korean, Lao, Thai, Tibetan, and Vietnamese scripts. These features
30 have been merged from the modified version of Emacs known as MULE (for
31 ``MULti-lingual Enhancement to GNU Emacs'')
34 * International Intro:: Basic concepts of multibyte characters.
35 * Enabling Multibyte:: Controlling whether to use multibyte characters.
36 * Language Environments:: Setting things up for the language you use.
37 * Input Methods:: Entering text characters not on your keyboard.
38 * Select Input Method:: Specifying your choice of input methods.
39 * Multibyte Conversion:: How single-byte characters convert to multibyte.
40 * Coding Systems:: Character set conversion when you read and
41 write files, and so on.
42 * Recognize Coding:: How Emacs figures out which conversion to use.
43 * Specify Coding:: Various ways to choose which conversion to use.
44 * Fontsets:: Fontsets are collections of fonts
45 that cover the whole spectrum of characters.
46 * Defining Fontsets:: Defining a new fontset.
47 * Single-Byte European Support::
48 You can pick one European character set
49 to use without multibyte characters.
52 @node International Intro
53 @section Introduction to International Character Sets
55 The users of these scripts have established many more-or-less standard
56 coding systems for storing files. Emacs internally uses a single
57 multibyte character encoding, so that it can intermix characters from
58 all these scripts in a single buffer or string. This encoding
59 represents each non-ASCII character as a sequence of bytes in the range
60 0200 through 0377. Emacs translates between the multibyte character
61 encoding and various other coding systems when reading and writing
62 files, when exchanging data with subprocesses, and (in some cases) in
63 the @kbd{C-q} command (@pxref{Multibyte Conversion}).
66 @findex view-hello-file
67 The command @kbd{C-h h} (@code{view-hello-file}) displays the file
68 @file{etc/HELLO}, which shows how to say ``hello'' in many languages.
69 This illustrates various scripts.
71 Keyboards, even in the countries where these character sets are used,
72 generally don't have keys for all the characters in them. So Emacs
73 supports various @dfn{input methods}, typically one for each script or
74 language, to make it convenient to type them.
77 The prefix key @kbd{C-x @key{RET}} is used for commands that pertain
78 to multibyte characters, coding systems, and input methods.
80 @node Enabling Multibyte
81 @section Enabling Multibyte Characters
83 You can enable or disable multibyte character support, either for
84 Emacs as a whole, or for a single buffer. When multibyte characters are
85 disabled in a buffer, then each byte in that buffer represents a
86 character, even codes 0200 through 0377. The old features for
87 supporting the European character sets, ISO Latin-1 and ISO Latin-2,
88 work as they did in Emacs 19 and also work for the other ISO 8859
91 However, there is no need to turn off multibyte character support to
92 use ISO Latin; the Emacs multibyte character set includes all the
93 characters in these character sets, and Emacs can translate
94 automatically to and from the ISO codes.
96 To edit a particular file in unibyte representation, visit it using
97 @code{find-file-literally}. @xref{Visiting}. To convert a buffer in
98 multibyte representation into a single-byte representation of the same
99 characters, the easiest way is to save the contents in a file, kill the
100 buffer, and find the file again with @code{find-file-literally}. You
101 can also use @kbd{C-x @key{RET} c}
102 (@code{universal-coding-system-argument}) and specify @samp{raw-text} as
103 the coding system with which to find or save a file. @xref{Specify
104 Coding}. Finding a file as @samp{raw-text} doesn't disable format
105 conversion, uncompression and auto mode selection as
106 @code{find-file-literally} does.
108 @vindex enable-multibyte-characters
109 @vindex default-enable-multibyte-characters
110 To turn off multibyte character support by default, start Emacs with
111 the @samp{--unibyte} option (@pxref{Initial Options}), or set the
112 environment variable @samp{EMACS_UNIBYTE}. You can also customize
113 @code{enable-multibyte-characters} or, equivalently, directly set the
114 variable @code{default-enable-multibyte-characters} in your init file to
115 have basically the same effect as @samp{--unibyte}.
117 Multibyte strings are not created during initialization from the
118 values of environment variables, @file{/etc/passwd} entries etc.@: that
119 contain non-ASCII 8-bit characters. However, the initialization file is
120 normally read as multibyte---like Lisp files in general---even with
121 @samp{--unibyte}. To avoid multibyte strings being generated by
122 non-ASCII characters in it, put @samp{-*-unibyte: t;-*-} in a comment on
123 the first line. Do the same for initialization files for packages like
126 The mode line indicates whether multibyte character support is enabled
127 in the current buffer. If it is, there are two or more characters (most
128 often two dashes) before the colon near the beginning of the mode line.
129 When multibyte characters are not enabled, just one dash precedes the
132 @node Language Environments
133 @section Language Environments
134 @cindex language environments
136 All supported character sets are supported in Emacs buffers whenever
137 multibyte characters are enabled; there is no need to select a
138 particular language in order to display its characters in an Emacs
139 buffer. However, it is important to select a @dfn{language environment}
140 in order to set various defaults. The language environment really
141 represents a choice of preferred script (more or less) rather than a
144 The language environment controls which coding systems to recognize
145 when reading text (@pxref{Recognize Coding}). This applies to files,
146 incoming mail, netnews, and any other text you read into Emacs. It may
147 also specify the default coding system to use when you create a file.
148 Each language environment also specifies a default input method.
150 @findex set-language-environment
151 @vindex current-language-environment
152 To select a language environment, customize the option
153 @code{current-language-environment} or use the command @kbd{M-x
154 set-language-environment}. It makes no difference which buffer is
155 current when you use this command, because the effects apply globally to
156 the Emacs session. The supported language environments include:
159 Chinese-BIG5, Chinese-CNS, Chinese-GB, Cyrillic-ALT, Cyrillic-ISO,
160 Cyrillic-KOI8, Czech, Devanagari, English, Ethiopic, German, Greek,
161 Hebrew, IPA, Japanese, Korean, Lao, Latin-1, Latin-2, Latin-3,
162 Latin-4, Latin-5, Latin-8, Latin-9, Romanian, Slovak, Slovenian, Thai,
163 Tibetan, Turkish, and Vietnamese.
166 @findex set-locale-environment
167 @vindex locale-language-names
168 @vindex locale-charset-language-names
169 Some operating systems let you specify the language you are using by
170 setting the locale environment variables @env{LC_ALL}, @env{LC_CTYPE},
171 and @env{LANG}; the first of these which is nonempty specifies your
172 locale. Emacs handles this during startup by invoking the
173 @code{set-locale-environment} function, which matches your locale
174 against entries in the value of the variable
175 @code{locale-language-names} and selects the corresponding language
176 environment if a match is found. But if your locale also matches an
177 entry in the variable @code{locale-charset-language-names}, this entry
178 is preferred if its character set disagrees. For example, suppose the
179 locale @samp{en_GB.ISO8859-15} matches @code{"Latin-1"} in
180 @code{locale-language-names} and @code{"Latin-9"} in
181 @code{locale-charset-language-names}; since these two language
182 environments' character sets disagree, Emacs uses @code{"Latin-9"}.
184 If all goes well, the @code{set-locale-environment} function selects
185 the language environment, since language is part of locale. It also
186 adjusts the display table and terminal coding system, the locale coding
187 system, and the preferred coding system as needed for the locale.
189 Since the @code{set-locale-environment} function is automatically
190 invoked during startup, you normally do not need to invoke it yourself.
191 However, if you modify the @env{LC_ALL}, @env{LC_CTYPE}, or @env{LANG}
192 environment variables, you may want to invoke the
193 @code{set-locale-environment} function afterwards.
195 @findex set-locale-environment
196 @vindex locale-preferred-coding-systems
197 The @code{set-locale-environment} function normally uses the preferred
198 coding system established by the language environment to decode system
199 messages. But if your locale matches an entry in the variable
200 @code{locale-preferred-coding-systems}, Emacs uses the corresponding
201 coding system instead. For example, if the locale @samp{ja_JP.PCK}
202 matches @code{japanese-shift-jis} in
203 @code{locale-preferred-coding-systems}, Emacs uses that encoding even
204 though it might normally use @code{japanese-iso-8bit}.
206 The environment chosen from the locale when Emacs starts is
207 overidden by any explicit use of the command
208 @code{set-language-environment} or customization of
209 @code{current-language-environment} in your init file.
212 @findex describe-language-environment
213 To display information about the effects of a certain language
214 environment @var{lang-env}, use the command @kbd{C-h L @var{lang-env}
215 @key{RET}} (@code{describe-language-environment}). This tells you which
216 languages this language environment is useful for, and lists the
217 character sets, coding systems, and input methods that go with it. It
218 also shows some sample text to illustrate scripts used in this language
219 environment. By default, this command describes the chosen language
222 @vindex set-language-environment-hook
223 You can customize any language environment with the normal hook
224 @code{set-language-environment-hook}. The command
225 @code{set-language-environment} runs that hook after setting up the new
226 language environment. The hook functions can test for a specific
227 language environment by checking the variable
228 @code{current-language-environment}.
230 @vindex exit-language-environment-hook
231 Before it starts to set up the new language environment,
232 @code{set-language-environment} first runs the hook
233 @code{exit-language-environment-hook}. This hook is useful for undoing
234 customizations that were made with @code{set-language-environment-hook}.
235 For instance, if you set up a special key binding in a specific language
236 environment using @code{set-language-environment-hook}, you should set
237 up @code{exit-language-environment-hook} to restore the normal binding
241 @section Input Methods
243 @cindex input methods
244 An @dfn{input method} is a kind of character conversion designed
245 specifically for interactive input. In Emacs, typically each language
246 has its own input method; sometimes several languages which use the same
247 characters can share one input method. A few languages support several
250 The simplest kind of input method works by mapping ASCII letters into
251 another alphabet. This is how the Greek and Russian input methods work.
253 A more powerful technique is composition: converting sequences of
254 characters into one letter. Many European input methods use composition
255 to produce a single non-ASCII letter from a sequence that consists of a
256 letter followed by accent characters (or vice versa). For example, some
257 methods convert the sequence @kbd{a'} into a single accented letter.
258 These input methods have no special commands of their own; all they do
259 is compose sequences of printing characters.
261 The input methods for syllabic scripts typically use mapping followed
262 by composition. The input methods for Thai and Korean work this way.
263 First, letters are mapped into symbols for particular sounds or tone
264 marks; then, sequences of these which make up a whole syllable are
265 mapped into one syllable sign.
267 Chinese and Japanese require more complex methods. In Chinese input
268 methods, first you enter the phonetic spelling of a Chinese word (in
269 input method @code{chinese-py}, among others), or a sequence of portions
270 of the character (input methods @code{chinese-4corner} and
271 @code{chinese-sw}, and others). Since one phonetic spelling typically
272 corresponds to many different Chinese characters, you must select one of
273 the alternatives using special Emacs commands. Keys such as @kbd{C-f},
274 @kbd{C-b}, @kbd{C-n}, @kbd{C-p}, and digits have special definitions in
275 this situation, used for selecting among the alternatives. @key{TAB}
276 displays a buffer showing all the possibilities.
278 In Japanese input methods, first you input a whole word using
279 phonetic spelling; then, after the word is in the buffer, Emacs converts
280 it into one or more characters using a large dictionary. One phonetic
281 spelling corresponds to many differently written Japanese words, so you
282 must select one of them; use @kbd{C-n} and @kbd{C-p} to cycle through
285 Sometimes it is useful to cut off input method processing so that the
286 characters you have just entered will not combine with subsequent
287 characters. For example, in input method @code{latin-1-postfix}, the
288 sequence @kbd{e '} combines to form an @samp{e} with an accent. What if
289 you want to enter them as separate characters?
291 One way is to type the accent twice; that is a special feature for
292 entering the separate letter and accent. For example, @kbd{e ' '} gives
293 you the two characters @samp{e'}. Another way is to type another letter
294 after the @kbd{e}---something that won't combine with that---and
295 immediately delete it. For example, you could type @kbd{e e @key{DEL}
296 '} to get separate @samp{e} and @samp{'}.
298 Another method, more general but not quite as easy to type, is to use
299 @kbd{C-\ C-\} between two characters to stop them from combining. This
300 is the command @kbd{C-\} (@code{toggle-input-method}) used twice.
302 @xref{Select Input Method}.
305 @kbd{C-\ C-\} is especially useful inside an incremental search,
306 because it stops waiting for more characters to combine, and starts
307 searching for what you have already entered.
309 @vindex input-method-verbose-flag
310 @vindex input-method-highlight-flag
311 The variables @code{input-method-highlight-flag} and
312 @code{input-method-verbose-flag} control how input methods explain what
313 is happening. If @code{input-method-highlight-flag} is non-@code{nil},
314 the partial sequence is highlighted in the buffer. If
315 @code{input-method-verbose-flag} is non-@code{nil}, the list of possible
316 characters to type next is displayed in the echo area (but not when you
317 are in the minibuffer).
319 @node Select Input Method
320 @section Selecting an Input Method
324 Enable or disable use of the selected input method.
326 @item C-x @key{RET} C-\ @var{method} @key{RET}
327 Select a new input method for the current buffer.
329 @item C-h I @var{method} @key{RET}
330 @itemx C-h C-\ @var{method} @key{RET}
331 @findex describe-input-method
334 Describe the input method @var{method} (@code{describe-input-method}).
335 By default, it describes the current input method (if any).
336 This description should give you the full details of how to
337 use any particular input method.
339 @item M-x list-input-methods
340 Display a list of all the supported input methods.
343 @findex set-input-method
344 @vindex current-input-method
346 To choose an input method for the current buffer, use @kbd{C-x
347 @key{RET} C-\} (@code{set-input-method}). This command reads the
348 input method name with the minibuffer; the name normally starts with the
349 language environment that it is meant to be used with. The variable
350 @code{current-input-method} records which input method is selected.
352 @findex toggle-input-method
354 Input methods use various sequences of ASCII characters to stand for
355 non-ASCII characters. Sometimes it is useful to turn off the input
356 method temporarily. To do this, type @kbd{C-\}
357 (@code{toggle-input-method}). To reenable the input method, type
360 If you type @kbd{C-\} and you have not yet selected an input method,
361 it prompts for you to specify one. This has the same effect as using
362 @kbd{C-x @key{RET} C-\} to specify an input method.
364 @vindex default-input-method
365 Selecting a language environment specifies a default input method for
366 use in various buffers. When you have a default input method, you can
367 select it in the current buffer by typing @kbd{C-\}. The variable
368 @code{default-input-method} specifies the default input method
369 (@code{nil} means there is none).
371 @findex quail-set-keyboard-layout
372 Some input methods for alphabetic scripts work by (in effect)
373 remapping the keyboard to emulate various keyboard layouts commonly used
374 for those scripts. How to do this remapping properly depends on your
375 actual keyboard layout. To specify which layout your keyboard has, use
376 the command @kbd{M-x quail-set-keyboard-layout}.
378 @findex list-input-methods
379 To display a list of all the supported input methods, type @kbd{M-x
380 list-input-methods}. The list gives information about each input
381 method, including the string that stands for it in the mode line.
383 @node Multibyte Conversion
384 @section Unibyte and Multibyte Non-ASCII characters
386 When multibyte characters are enabled, character codes 0240 (octal)
387 through 0377 (octal) are not really legitimate in the buffer. The valid
388 non-ASCII printing characters have codes that start from 0400.
390 If you type a self-inserting character in the invalid range 0240
391 through 0377, Emacs assumes you intended to use one of the ISO
392 Latin-@var{n} character sets, and converts it to the Emacs code
393 representing that Latin-@var{n} character. You select @emph{which} ISO
394 Latin character set to use through your choice of language environment
399 (@pxref{Language Environments}).
401 If you do not specify a choice, the default is Latin-1.
403 The same thing happens when you use @kbd{C-q} to enter an octal code
407 @section Coding Systems
408 @cindex coding systems
410 Users of various languages have established many more-or-less standard
411 coding systems for representing them. Emacs does not use these coding
412 systems internally; instead, it converts from various coding systems to
413 its own system when reading data, and converts the internal coding
414 system to other coding systems when writing data. Conversion is
415 possible in reading or writing files, in sending or receiving from the
416 terminal, and in exchanging data with subprocesses.
418 Emacs assigns a name to each coding system. Most coding systems are
419 used for one language, and the name of the coding system starts with the
420 language name. Some coding systems are used for several languages;
421 their names usually start with @samp{iso}. There are also special
422 coding systems @code{no-conversion}, @code{raw-text} and
423 @code{emacs-mule} which do not convert printing characters at all.
425 @cindex end-of-line conversion
426 In addition to converting various representations of non-ASCII
427 characters, a coding system can perform end-of-line conversion. Emacs
428 handles three different conventions for how to separate lines in a file:
429 newline, carriage-return linefeed, and just carriage-return.
432 @item C-h C @var{coding} @key{RET}
433 Describe coding system @var{coding}.
435 @item C-h C @key{RET}
436 Describe the coding systems currently in use.
438 @item M-x list-coding-systems
439 Display a list of all the supported coding systems.
443 @findex describe-coding-system
444 The command @kbd{C-h C} (@code{describe-coding-system}) displays
445 information about particular coding systems. You can specify a coding
446 system name as argument; alternatively, with an empty argument, it
447 describes the coding systems currently selected for various purposes,
448 both in the current buffer and as the defaults, and the priority list
449 for recognizing coding systems (@pxref{Recognize Coding}).
451 @findex list-coding-systems
452 To display a list of all the supported coding systems, type @kbd{M-x
453 list-coding-systems}. The list gives information about each coding
454 system, including the letter that stands for it in the mode line
457 @cindex end-of-line conversion
458 @cindex MS-DOS end-of-line conversion
459 @cindex Macintosh end-of-line conversion
460 Each of the coding systems that appear in this list---except for
461 @code{no-conversion}, which means no conversion of any kind---specifies
462 how and whether to convert printing characters, but leaves the choice of
463 end-of-line conversion to be decided based on the contents of each file.
464 For example, if the file appears to use the sequence carriage-return
465 linefeed to separate lines, DOS end-of-line conversion will be used.
467 Each of the listed coding systems has three variants which specify
468 exactly what to do for end-of-line conversion:
472 Don't do any end-of-line conversion; assume the file uses
473 newline to separate lines. (This is the convention normally used
474 on Unix and GNU systems.)
477 Assume the file uses carriage-return linefeed to separate lines, and do
478 the appropriate conversion. (This is the convention normally used on
479 Microsoft systems.@footnote{It is also specified for MIME `text/*'
480 bodies and in other network transport contexts. It is different
481 from the SGML reference syntax record-start/record-end format which
482 Emacs doesn't support directly.})
485 Assume the file uses carriage-return to separate lines, and do the
486 appropriate conversion. (This is the convention normally used on the
490 These variant coding systems are omitted from the
491 @code{list-coding-systems} display for brevity, since they are entirely
492 predictable. For example, the coding system @code{iso-latin-1} has
493 variants @code{iso-latin-1-unix}, @code{iso-latin-1-dos} and
494 @code{iso-latin-1-mac}.
496 The coding system @code{raw-text} is good for a file which is mainly
497 ASCII text, but may contain byte values above 127 which are not meant to
498 encode non-ASCII characters. With @code{raw-text}, Emacs copies those
499 byte values unchanged, and sets @code{enable-multibyte-characters} to
500 @code{nil} in the current buffer so that they will be interpreted
501 properly. @code{raw-text} handles end-of-line conversion in the usual
502 way, based on the data encountered, and has the usual three variants to
503 specify the kind of end-of-line conversion to use.
505 In contrast, the coding system @code{no-conversion} specifies no
506 character code conversion at all---none for non-ASCII byte values and
507 none for end of line. This is useful for reading or writing binary
508 files, tar files, and other files that must be examined verbatim. It,
509 too, sets @code{enable-multibyte-characters} to @code{nil}.
511 The easiest way to edit a file with no conversion of any kind is with
512 the @kbd{M-x find-file-literally} command. This uses
513 @code{no-conversion}, and also suppresses other Emacs features that
514 might convert the file contents before you see them. @xref{Visiting}.
516 The coding system @code{emacs-mule} means that the file contains
517 non-ASCII characters stored with the internal Emacs encoding. It
518 handles end-of-line conversion based on the data encountered, and has
519 the usual three variants to specify the kind of end-of-line conversion.
521 @node Recognize Coding
522 @section Recognizing Coding Systems
524 Most of the time, Emacs can recognize which coding system to use for
525 any given file---once you have specified your preferences.
527 Some coding systems can be recognized or distinguished by which byte
528 sequences appear in the data. However, there are coding systems that
529 cannot be distinguished, not even potentially. For example, there is no
530 way to distinguish between Latin-1 and Latin-2; they use the same byte
531 values with different meanings.
533 Emacs handles this situation by means of a priority list of coding
534 systems. Whenever Emacs reads a file, if you do not specify the coding
535 system to use, Emacs checks the data against each coding system,
536 starting with the first in priority and working down the list, until it
537 finds a coding system that fits the data. Then it converts the file
538 contents assuming that they are represented in this coding system.
540 The priority list of coding systems depends on the selected language
541 environment (@pxref{Language Environments}). For example, if you use
542 French, you probably want Emacs to prefer Latin-1 to Latin-2; if you use
543 Czech, you probably want Latin-2 to be preferred. This is one of the
544 reasons to specify a language environment.
546 @findex prefer-coding-system
547 However, you can alter the priority list in detail with the command
548 @kbd{M-x prefer-coding-system}. This command reads the name of a coding
549 system from the minibuffer, and adds it to the front of the priority
550 list, so that it is preferred to all others. If you use this command
551 several times, each use adds one element to the front of the priority
554 If you use a coding system that specifies the end-of-line conversion
555 type, such as @code{iso-8859-1-dos}, what that means is that Emacs
556 should attempt to recognize @code{iso-8859-1} with priority, and should
557 use DOS end-of-line conversion in case it recognizes @code{iso-8859-1}.
559 @vindex file-coding-system-alist
560 Sometimes a file name indicates which coding system to use for the
561 file. The variable @code{file-coding-system-alist} specifies this
562 correspondence. There is a special function
563 @code{modify-coding-system-alist} for adding elements to this list. For
564 example, to read and write all @samp{.txt} files using the coding system
565 @code{china-iso-8bit}, you can execute this Lisp expression:
568 (modify-coding-system-alist 'file "\\.txt\\'" 'china-iso-8bit)
572 The first argument should be @code{file}, the second argument should be
573 a regular expression that determines which files this applies to, and
574 the third argument says which coding system to use for these files.
576 @vindex inhibit-eol-conversion
577 Emacs recognizes which kind of end-of-line conversion to use based on
578 the contents of the file: if it sees only carriage-returns, or only
579 carriage-return linefeed sequences, then it chooses the end-of-line
580 conversion accordingly. You can inhibit the automatic use of
581 end-of-line conversion by setting the variable @code{inhibit-eol-conversion}
585 You can specify the coding system for a particular file using the
586 @samp{-*-@dots{}-*-} construct at the beginning of a file, or a local
587 variables list at the end (@pxref{File Variables}). You do this by
588 defining a value for the ``variable'' named @code{coding}. Emacs does
589 not really have a variable @code{coding}; instead of setting a variable,
590 it uses the specified coding system for the file. For example,
591 @samp{-*-mode: C; coding: latin-1;-*-} specifies use of the Latin-1
592 coding system, as well as C mode. If you specify the coding explicitly
593 in the file, that overrides @code{file-coding-system-alist}.
595 @vindex auto-coding-alist
596 The variable @code{auto-coding-alist} is the strongest way to specify
597 the coding system for certain patterns of file names; this variable even
598 overrides @samp{-*-coding:-*-} tags in the file itself. Emacs uses this
599 feature for tar and archive files, to prevent Emacs from being confused
600 by a @samp{-*-coding:-*-} tag in a member of the archive and thinking it
601 applies to the archive file as a whole.
603 @vindex buffer-file-coding-system
604 Once Emacs has chosen a coding system for a buffer, it stores that
605 coding system in @code{buffer-file-coding-system} and uses that coding
606 system, by default, for operations that write from this buffer into a
607 file. This includes the commands @code{save-buffer} and
608 @code{write-region}. If you want to write files from this buffer using
609 a different coding system, you can specify a different coding system for
610 the buffer using @code{set-buffer-file-coding-system} (@pxref{Specify
613 @vindex sendmail-coding-system
614 When you send a message with Mail mode (@pxref{Sending Mail}), Emacs has
615 four different ways to determine the coding system to use for encoding
616 the message text. It tries the buffer's own value of
617 @code{buffer-file-coding-system}, if that is non-@code{nil}. Otherwise,
618 it uses the value of @code{sendmail-coding-system}, if that is
619 non-@code{nil}. The third way is to use the default coding system for
620 new files, which is controlled by your choice of language environment,
621 if that is non-@code{nil}. If all of these three values are @code{nil},
622 Emacs encodes outgoing mail using the Latin-1 coding system.
624 @vindex rmail-decode-mime-charset
625 When you get new mail in Rmail, each message is translated
626 automatically from the coding system it is written in---as if it were a
627 separate file. This uses the priority list of coding systems that you
628 have specified. If a MIME message specifies a character set, Rmail
629 obeys that specification, unless @code{rmail-decode-mime-charset} is
632 @vindex rmail-file-coding-system
633 For reading and saving Rmail files themselves, Emacs uses the coding
634 system specified by the variable @code{rmail-file-coding-system}. The
635 default value is @code{nil}, which means that Rmail files are not
636 translated (they are read and written in the Emacs internal character
640 @section Specifying a Coding System
642 In cases where Emacs does not automatically choose the right coding
643 system, you can use these commands to specify one:
646 @item C-x @key{RET} f @var{coding} @key{RET}
647 Use coding system @var{coding} for the visited file
648 in the current buffer.
650 @item C-x @key{RET} c @var{coding} @key{RET}
651 Specify coding system @var{coding} for the immediately following
654 @item C-x @key{RET} k @var{coding} @key{RET}
655 Use coding system @var{coding} for keyboard input.
657 @item C-x @key{RET} t @var{coding} @key{RET}
658 Use coding system @var{coding} for terminal output.
660 @item C-x @key{RET} p @var{input-coding} @key{RET} @var{output-coding} @key{RET}
661 Use coding systems @var{input-coding} and @var{output-coding} for
662 subprocess input and output in the current buffer.
664 @item C-x @key{RET} x @var{coding} @key{RET}
665 Use coding system @var{coding} for transferring selections to and from
666 other programs through the window system.
668 @item C-x @key{RET} X @var{coding} @key{RET}
669 Use coding system @var{coding} for transferring @emph{one}
670 selection---the next one---to or from the window system.
674 @findex set-buffer-file-coding-system
675 The command @kbd{C-x @key{RET} f} (@code{set-buffer-file-coding-system})
676 specifies the file coding system for the current buffer---in other
677 words, which coding system to use when saving or rereading the visited
678 file. You specify which coding system using the minibuffer. Since this
679 command applies to a file you have already visited, it affects only the
680 way the file is saved.
683 @findex universal-coding-system-argument
684 Another way to specify the coding system for a file is when you visit
685 the file. First use the command @kbd{C-x @key{RET} c}
686 (@code{universal-coding-system-argument}); this command uses the
687 minibuffer to read a coding system name. After you exit the minibuffer,
688 the specified coding system is used for @emph{the immediately following
691 So if the immediately following command is @kbd{C-x C-f}, for example,
692 it reads the file using that coding system (and records the coding
693 system for when the file is saved). Or if the immediately following
694 command is @kbd{C-x C-w}, it writes the file using that coding system.
695 Other file commands affected by a specified coding system include
696 @kbd{C-x C-i} and @kbd{C-x C-v}, as well as the other-window variants of
699 @kbd{C-x @key{RET} c} also affects commands that start subprocesses,
700 including @kbd{M-x shell} (@pxref{Shell}).
702 However, if the immediately following command does not use the coding
703 system, then @kbd{C-x @key{RET} c} ultimately has no effect.
705 An easy way to visit a file with no conversion is with the @kbd{M-x
706 find-file-literally} command. @xref{Visiting}.
708 @vindex default-buffer-file-coding-system
709 The variable @code{default-buffer-file-coding-system} specifies the
710 choice of coding system to use when you create a new file. It applies
711 when you find a new file, and when you create a buffer and then save it
712 in a file. Selecting a language environment typically sets this
713 variable to a good choice of default coding system for that language
717 @findex set-terminal-coding-system
718 The command @kbd{C-x @key{RET} t} (@code{set-terminal-coding-system})
719 specifies the coding system for terminal output. If you specify a
720 character code for terminal output, all characters output to the
721 terminal are translated into that coding system.
723 This feature is useful for certain character-only terminals built to
724 support specific languages or character sets---for example, European
725 terminals that support one of the ISO Latin character sets. You need to
726 specify the terminal coding system when using multibyte text, so that
727 Emacs knows which characters the terminal can actually handle.
729 By default, output to the terminal is not translated at all, unless
730 Emacs can deduce the proper coding system from your terminal type.
733 @findex set-keyboard-coding-system
734 The command @kbd{C-x @key{RET} k} (@code{set-keyboard-coding-system})
735 specifies the coding system for keyboard input. Character-code
736 translation of keyboard input is useful for terminals with keys that
737 send non-ASCII graphic characters---for example, some terminals designed
738 for ISO Latin-1 or subsets of it.
740 By default, keyboard input is not translated at all.
742 There is a similarity between using a coding system translation for
743 keyboard input, and using an input method: both define sequences of
744 keyboard input that translate into single characters. However, input
745 methods are designed to be convenient for interactive use by humans, and
746 the sequences that are translated are typically sequences of ASCII
747 printing characters. Coding systems typically translate sequences of
748 non-graphic characters.
752 @findex set-selection-coding-system
753 @findex set-next-selection-coding-system
754 The command @kbd{C-x @key{RET} x} (@code{set-selection-coding-system})
755 specifies the coding system for sending selected text to the window
756 system, and for receiving the text of selections made in other
757 applications. This command applies to all subsequent selections, until
758 you override it by using the command again. The command @kbd{C-x
759 @key{RET} X} (@code{set-next-selection-coding-system}) specifies the
760 coding system for the next selection made in Emacs or read by Emacs.
763 @findex set-buffer-process-coding-system
764 The command @kbd{C-x @key{RET} p} (@code{set-buffer-process-coding-system})
765 specifies the coding system for input and output to a subprocess. This
766 command applies to the current buffer; normally, each subprocess has its
767 own buffer, and thus you can use this command to specify translation to
768 and from a particular subprocess by giving the command in the
769 corresponding buffer.
771 By default, process input and output are not translated at all.
773 @vindex file-name-coding-system
774 The variable @code{file-name-coding-system} specifies a coding system
775 to use for encoding file names. If you set the variable to a coding
776 system name (as a Lisp symbol or a string), Emacs encodes file names
777 using that coding system for all file operations. This makes it
778 possible to use non-ASCII characters in file names---or, at least, those
779 non-ASCII characters which the specified coding system can encode.
781 If @code{file-name-coding-system} is @code{nil}, Emacs uses a default
782 coding system determined by the selected language environment. In the
783 default language environment, any non-ASCII characters in file names are
784 not encoded specially; they appear in the file system using the internal
785 Emacs representation.
787 @strong{Warning:} if you change @code{file-name-coding-system} (or the
788 language environment) in the middle of an Emacs session, problems can
789 result if you have already visited files whose names were encoded using
790 the earlier coding system and cannot be encoded (or are encoded
791 differently) under the new coding system. If you try to save one of
792 these buffers under the visited file name, saving may use the wrong file
793 name, or it may get an error. If such a problem happens, use @kbd{C-x
794 C-w} to specify a new file name for that buffer.
796 @vindex locale-coding-system
797 The variable @code{locale-coding-system} specifies a coding system to
798 use when encoding and decoding system strings such as system error
799 messages and @code{format-time-string} formats and time stamps. This
800 coding system should be compatible with the underlying system's coding
801 system, which is normally specified by the first environment variable in
802 the list @env{LC_ALL}, @env{LC_CTYPE}, @env{LANG} whose value is
809 A font for X Windows typically defines shapes for one alphabet or
810 script. Therefore, displaying the entire range of scripts that Emacs
811 supports requires a collection of many fonts. In Emacs, such a
812 collection is called a @dfn{fontset}. A fontset is defined by a list of
813 fonts, each assigned to handle a range of character codes.
815 Each fontset has a name, like a font. The available X fonts are
816 defined by the X server; fontsets, however, are defined within Emacs
817 itself. Once you have defined a fontset, you can use it within Emacs by
818 specifying its name, anywhere that you could use a single font. Of
819 course, Emacs fontsets can use only the fonts that the X server
820 supports; if certain characters appear on the screen as hollow boxes,
821 this means that the fontset in use for them has no font for those
824 Emacs creates two fontsets automatically: the @dfn{standard fontset}
825 and the @dfn{startup fontset}. The standard fontset is most likely to
826 have fonts for a wide variety of non-ASCII characters; however, this is
827 not the default for Emacs to use. (By default, Emacs tries to find a
828 font which has bold and italic variants.) You can specify use of the
829 standard fontset with the @samp{-fn} option, or with the @samp{Font} X
830 resource (@pxref{Font X}). For example,
833 emacs -fn fontset-standard
836 A fontset does not necessarily specify a font for every character
837 code. If a fontset specifies no font for a certain character, or if it
838 specifies a font that does not exist on your system, then it cannot
839 display that character properly. It will display that character as an
842 @vindex highlight-wrong-size-font
843 The fontset height and width are determined by the ASCII characters
844 (that is, by the font used for ASCII characters in that fontset). If
845 another font in the fontset has a different height, or a different
846 width, then characters assigned to that font are clipped to the
847 fontset's size. If @code{highlight-wrong-size-font} is non-@code{nil},
848 a box is displayed around these wrong-size characters as well.
850 @node Defining Fontsets
851 @section Defining fontsets
853 @vindex standard-fontset-spec
854 @cindex standard fontset
855 Emacs creates a standard fontset automatically according to the value
856 of @code{standard-fontset-spec}. This fontset's name is
859 -*-fixed-medium-r-normal-*-16-*-*-*-*-*-fontset-standard
863 or just @samp{fontset-standard} for short.
865 Bold, italic, and bold-italic variants of the standard fontset are
866 created automatically. Their names have @samp{bold} instead of
867 @samp{medium}, or @samp{i} instead of @samp{r}, or both.
869 @cindex startup fontset
870 If you specify a default ASCII font with the @samp{Font} resource or
871 the @samp{-fn} argument, Emacs generates a fontset from it
872 automatically. This is the @dfn{startup fontset} and its name is
873 @code{fontset-startup}. It does this by replacing the @var{foundry},
874 @var{family}, @var{add_style}, and @var{average_width} fields of the
875 font name with @samp{*}, replacing @var{charset_registry} field with
876 @samp{fontset}, and replacing @var{charset_encoding} field with
877 @samp{startup}, then using the resulting string to specify a fontset.
879 For instance, if you start Emacs this way,
882 emacs -fn "*courier-medium-r-normal--14-140-*-iso8859-1"
886 Emacs generates the following fontset and uses it for the initial X
890 -*-*-medium-r-normal-*-14-140-*-*-*-*-fontset-startup
893 With the X resource @samp{Emacs.Font}, you can specify a fontset name
894 just like an actual font name. But be careful not to specify a fontset
895 name in a wildcard resource like @samp{Emacs*Font}---that wildcard
896 specification applies to various other purposes, such as menus, and
897 menus cannot handle fontsets.
899 You can specify additional fontsets using X resources named
900 @samp{Fontset-@var{n}}, where @var{n} is an integer starting from 0.
901 The resource value should have this form:
904 @var{fontpattern}, @r{[}@var{charsetname}:@var{fontname}@r{]@dots{}}
908 @var{fontpattern} should have the form of a standard X font name, except
909 for the last two fields. They should have the form
910 @samp{fontset-@var{alias}}.
912 The fontset has two names, one long and one short. The long name is
913 @var{fontpattern}. The short name is @samp{fontset-@var{alias}}. You
914 can refer to the fontset by either name.
916 The construct @samp{@var{charset}:@var{font}} specifies which font to
917 use (in this fontset) for one particular character set. Here,
918 @var{charset} is the name of a character set, and @var{font} is the
919 font to use for that character set. You can use this construct any
920 number of times in defining one fontset.
922 For the other character sets, Emacs chooses a font based on
923 @var{fontpattern}. It replaces @samp{fontset-@var{alias}} with values
924 that describe the character set. For the ASCII character font,
925 @samp{fontset-@var{alias}} is replaced with @samp{ISO8859-1}.
927 In addition, when several consecutive fields are wildcards, Emacs
928 collapses them into a single wildcard. This is to prevent use of
929 auto-scaled fonts. Fonts made by scaling larger fonts are not usable
930 for editing, and scaling a smaller font is not useful because it is
931 better to use the smaller font in its own size, which Emacs does.
933 Thus if @var{fontpattern} is this,
936 -*-fixed-medium-r-normal-*-24-*-*-*-*-*-fontset-24
940 the font specification for ASCII characters would be this:
943 -*-fixed-medium-r-normal-*-24-*-ISO8859-1
947 and the font specification for Chinese GB2312 characters would be this:
950 -*-fixed-medium-r-normal-*-24-*-gb2312*-*
953 You may not have any Chinese font matching the above font
954 specification. Most X distributions include only Chinese fonts that
955 have @samp{song ti} or @samp{fangsong ti} in @var{family} field. In
956 such a case, @samp{Fontset-@var{n}} can be specified as below:
959 Emacs.Fontset-0: -*-fixed-medium-r-normal-*-24-*-*-*-*-*-fontset-24,\
960 chinese-gb2312:-*-*-medium-r-normal-*-24-*-gb2312*-*
964 Then, the font specifications for all but Chinese GB2312 characters have
965 @samp{fixed} in the @var{family} field, and the font specification for
966 Chinese GB2312 characters has a wild card @samp{*} in the @var{family}
969 @findex create-fontset-from-fontset-spec
970 The function that processes the fontset resource value to create the
971 fontset is called @code{create-fontset-from-fontset-spec}. You can also
972 call this function explicitly to create a fontset.
974 @xref{Font X}, for more information about font naming in X.
976 @node Single-Byte European Support
977 @section Single-byte European Character Support
979 @cindex European character sets
980 @cindex accented characters
981 @cindex ISO Latin character sets
982 @cindex Unibyte operation
983 @vindex enable-multibyte-characters
984 The ISO 8859 Latin-@var{n} character sets define character codes in
985 the range 160 to 255 to handle the accented letters and punctuation
986 needed by various European languages. If you disable multibyte
987 characters, Emacs can still handle @emph{one} of these character codes
988 at a time. To specify @emph{which} of these codes to use, invoke
989 @kbd{M-x set-language-environment} and specify a suitable language
990 environment such as @samp{Latin-@var{n}}.
992 For more information about unibyte operation, see @ref{Enabling
993 Multibyte}. Note particularly that you probably want to ensure that
994 your initialization files are read as unibyte if they contain non-ASCII
997 @vindex unibyte-display-via-language-environment
998 Emacs can also display those characters, provided the terminal or font
999 in use supports them. This works automatically. Alternatively, if you
1000 are using a window system, Emacs can also display single-byte characters
1001 through fontsets, in effect by displaying the equivalent multibyte
1002 characters according to the current language environment. To request
1003 this, set the variable @code{unibyte-display-via-language-environment}
1004 to a non-@code{nil} value.
1006 @cindex @code{iso-ascii} library
1007 If your terminal does not support display of the Latin-1 character
1008 set, Emacs can display these characters as ASCII sequences which at
1009 least give you a clear idea of what the characters are. To do this,
1010 load the library @code{iso-ascii}. Similar libraries for other
1011 Latin-@var{n} character sets could be implemented, but we don't have
1014 @findex standard-display-8bit
1015 @cindex 8-bit display
1016 Normally non-ISO-8859 characters (between characters 128 and 159
1017 inclusive) are displayed as octal escapes. You can change this for
1018 non-standard `extended' versions of ISO-8859 character sets by using the
1019 function @code{standard-display-8bit} in the @code{disp-table} library.
1021 There are three different ways you can input single-byte non-ASCII
1026 If your keyboard can generate character codes 128 and up, representing
1027 non-ASCII characters, execute the following expression to enable Emacs to
1031 (set-input-mode (car (current-input-mode))
1032 (nth 1 (current-input-mode))
1037 You can use an input method for the selected language environment.
1038 @xref{Input Methods}. When you use an input method in a unibyte buffer,
1039 the non-ASCII character you specify with it is converted to unibyte.
1042 @cindex @code{iso-transl} library
1044 For Latin-1 only, you can use the
1045 key @kbd{C-x 8} as a ``compose character'' prefix for entry of
1046 non-ASCII Latin-1 printing characters. @kbd{C-x 8} is good for
1047 insertion (in the minibuffer as well as other buffers), for searching,
1048 and in any other context where a key sequence is allowed.
1050 @kbd{C-x 8} works by loading the @code{iso-transl} library. Once that
1051 library is loaded, the @key{ALT} modifier key, if you have one, serves
1052 the same purpose as @kbd{C-x 8}; use @key{ALT} together with an accent
1053 character to modify the following letter. In addition, if you have keys
1054 for the Latin-1 ``dead accent characters'', they too are defined to
1055 compose with the following character, once @code{iso-transl} is loaded.