Unicode to UTF-8 in C++

15,984

Solution 1

Boost.Locale has also functions for encoding conversions:

#include <boost/locale.hpp>

int main() {
  unsigned int point = 0x5e9;
  std::string utf8 = boost::locale::conv::utf_to_utf<char>(&point, &point + 1);
  assert(utf8.length() == 2);
  assert(utf8[0] == '\xD7');
  assert(utf8[1] == '\xA9');
}

Solution 2

Unicode conversions are part of C++11:

#include <codecvt>
#include <locale>
#include <string>
#include <cassert>

int main() {
  std::wstring_convert<std::codecvt_utf8<char32_t>, char32_t> convert;
  std::string utf8 = convert.to_bytes(0x5e9);
  assert(utf8.length() == 2);
  assert(utf8[0] == '\xD7');
  assert(utf8[1] == '\xA9');
}

Solution 3

You might want to give a try to UTF8-CPP library. Encoding a Unicode character with it would look like this:

std::wstring unicodeChar(L"\u05e9");
std::string utf8Char;
encode_utf8(unicodeChar, utf8Char);

std::string is used here just as a container for UTF-8 bytes.

Share:
15,984
Ezra
Author by

Ezra

Updated on June 11, 2022

Comments

  • Ezra
    Ezra over 1 year

    I searched a lot, but couldn't find anything:

    unsigned int unicodeChar = 0x5e9;
    unsigned int utf8Char;
    uni2utf8(unicodeChar, utf8Char);
    assert(utf8Char == 0xd7a9);
    

    Is there a library (preferably boost) that implements something similar to uni2utf8?