ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum IndexWebSphere Message Broker SupportIIB 9 Unicode and UTF-8 support clarification needed

Post new topicReply to topic Goto page Previous  1, 2
IIB 9 Unicode and UTF-8 support clarification needed View previous topic :: View next topic
Author Message
rekarm01
PostPosted: Wed Jun 24, 2020 4:31 pm Post subject: Re: IIB 9 Unicode and UTF-8 support clarification needed Reply with quote

Grand Master

Joined: 25 Jun 2008
Posts: 1388

timber wrote:
In an ideal world, IBM would correct that page in the Knowledge Center.

I used the "Feedback" link at the very bottom of the KC web page to request that IBM update any references to "UCS-2", for either iib10 or ace11.

PeterPotkay wrote:
Thanks guys, I thought I remember reading / hearing the broker uses UTF-16 internally, just couldn't find anything official in the KC.

Check back in another 6 years ... ;-)

timber wrote:
All character data in the IIB/ACE message tree is in UTF-16, not UCS-2. All Unicode characters can be represented in the message tree - no restrictions at all.

Additionally, IIB/ACE optionally supports UTF-16 for ESQL string functions, but that is disabled by default:

Quote:
useICUStringManipulation

Set ESQL to provide full support for UTF-16 surrogate pairs.
  • Value type - boolean
  • Initial value - no

Note: ESQL supports a mode where ICU string functions are used to provide full support for UTF-16 surrogate pairs. The mode is disabled by default, but can be enabled by running the following command:
    mqsichangeproperties integrationNodeName -e integrationServerName -o ImbESQLManager -n useICUStringManipulation -v yes

This option affects how the string functions calculate the length of the string, or the position of text within the string, etc.
Back to top
View user's profile Send private message
timber
PostPosted: Thu Jun 25, 2020 4:31 am Post subject: Reply with quote

Grand Master

Joined: 25 Aug 2015
Posts: 1120

Quote:
Additionally, IIB/ACE optionally supports UTF-16 for ESQL string functions,
I know that rekarm01 knows this, but just in case anybody gets confused...

All ESQL CHAR/CHARACTER data is in UTF-16 always. But UTF-16 is not really a 16-bit encoding. Some characters occupy two 'code points' and take up a total of 32 bits. This is called a 'surrogate pair'.

The useICUStringManipulation option controls whether ESQL counts 'code points' (i.e. 16-bit quantities) or 'characters' (which might occupy 32 bits).
Back to top
View user's profile Send private message
Display posts from previous:
Post new topicReply to topic Goto page Previous  1, 2 Page 2 of 2

MQSeries.net Forum IndexWebSphere Message Broker SupportIIB 9 Unicode and UTF-8 support clarification needed
Jump to:



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP


Theme by Dustin Baccetti
Powered by phpBB 2001, 2002 phpBB Group

Copyright MQSeries.net. All rights reserved.