How can I edit Unicode text in Notepad++?

Question

Sometimes I edit English text that includes Unicode characters. For some reason, on my PC, Notepad++ converts Unicode characters to ???'s thereby corrupting the text and losing all that data. I'm looking for a way to edit such text, while preserving Unicode characters. I'm using Consolas as my Font. If the font doesn't have all those characters, why should I lose the data when I copy the text out of Notepad++ (via Windows' clipboard)?

Solution 1

If the file is actually encoded in Unicode, Notepad++ should detect it automatically. The Consolas font works well for me. You can try one of these two menu options:

• Encoding -> Encode in UTF-8
• Encoding -> Convert to UTF-8

I'm pretty sure the first one will do what you want.

Solution 2

The problem described in the question happens when an empty/new document is set to "ANSI", and Unicode characters are pasted into it.

There isn't any auto-detection when used with an empty/new document, at least not in the version of Notepad++ I tested it on (v5.4.5). "ANSI" is the default in Notepad++ for a new document, unless set in menu Settings → Preferences → tab New Document/Open Save Directory.

Solution

The solution is to set the encoding to UTF-8 before pasting, menu Format → Encode in UTF-8:

Example

I copied some text to a new Notepad++ document, Russian (русский язык, russkiy yazyk), from Firefox showing the Wikipedia page Russian language.

If the encoding is not changed from "ANSI" this is the result:

If the encoding is changed this is the result:

As can be seen in the figure below (the Cyrillic part is highlighted), Notepad++ actually converts the Unicode characters into ASCII 63 (hexadecimal 3F), question marks. That is why the Unicode characters are lost (in "ANSI" mode) when copying the text out through the clipboard (it is not a font issue - information is lost).

Tested on: Notepad++ v5.4.5 (UNICODE).

Solution 3

There are good news and bad news.

Good news: Notepad++ supports Unicode (at least from what I can gather).

Bad news: Apparently Unicode support is only on Windows XP.

I actually do not have a Windows machine in front of me. From what I remember, there is an Encoding menu under the Format menu somewhere. The encoding for Unicode is actually most commonly UTF-8.

Here is a 'pretty' picture of Unicode support in Notepad++,

Solution 4

Unicode works perfectly on Windows 7. The only issue that comes up is that you have to retype the characters that have been changed. It's happened to me. I'm writing with Scandinavian letters so ä -> E4, ö -> F6. It's a pain in the butt to replace them all, but it's worth it.

If you encode a page from ANSI -> UTF-8 then there will be some character problems.

I would suggest that you first create a new page in UTF-8 and then copy/paste your information over. There won't/shouldn't be any trouble then.

Solution 5

This is worked for me:

I changed the font to Courier New in style configurator on my PC (Windows 7 with English/US character set and Romanian for non-Unicode set). It´s working with Courier New & Tahoma fonts + UTF-8 encoding.

View more solutions

Comments

[Ivo Flipse]

Could it be you're using a plugin that doesn't support Unicode?

[Joey]

If those are question marks in boxes, then it's in fact the font's glyph for missing glyphs and your data is not lost.

[Robin Rodricks]

No its not in boxes, instead its the plain '?' character. Confirmed.

[John]

you may need to change the font. see superuser.com/questions/16831/…

[Val]

I do not have the Format menu.

[Ken Bellows]

For posterity, you need the Encoding menu, not Format

[Toto]

What question are you answering?

[James Bowery]

I don't understand your question. Why isn't it obvious I'm answering the original question and that none of the other answers would render the ℠ unicode within Notepad++?

[Toto]

Where have you seen in the question that they want to treat ℠ unicode character?

[James Bowery]

I clarified the reason for mentioning ℠