ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Large Message Split (ideas from Samples Gallery)

Post new topic  Reply to topic
 Large Message Split (ideas from Samples Gallery) « View previous topic :: View next topic » 
Author Message
4integration
PostPosted: Fri May 11, 2007 9:50 pm    Post subject: Large Message Split (ideas from Samples Gallery) Reply with quote

Disciple

Joined: 04 Sep 2006
Posts: 197
Location: Gothenburg, Sweden
Hello,

I have a large message from WBIA for JDBC that I need to split before transforming. I have taken ideas from the example "Large Messages" in WMBT Samples Gallery.

On the input node I have set MRM as Message Domain and no message set/type/format to avoid parsing.

Directly after input node I do a trace ${root} to a file but the data gets incomplete.

Why does this happen? How can I solve it?

When using the same input message on a MRM Message Domain WITH message set/type/format to avoid parsing it works fine.

What I get in the trace:
Code:
*********** INPUT *********************
(
  (0x01000000):Properties = (
    (0x03000000):MessageSet      = 'AGRTHIG002001'
    (0x03000000):MessageType     = 'JDBC_VIT_PARENT_ORDER_PLAN'
    (0x03000000):MessageFormat   = 'CwXML'
    (0x03000000):Encoding        = 273
    (0x03000000):CodedCharSetId  = 1208
    (0x03000000):Transactional   = TRUE
    (0x03000000):Persistence     = TRUE
    (0x03000000):CreationTime    = GMTTIMESTAMP '2007-05-02 08:18:40.760'
    (0x03000000):ExpirationTime  = -1
    (0x03000000):Priority        = 4
    (0x03000000):ReplyIdentifier = X'000000000000000000000000000000000000000000000000'
    (0x03000000):ReplyProtocol   = 'MQ'
    (0x03000000):Topic           = NULL
    (0x03000000):ContentType     = ''
  )
  (0x01000000):MQMD       = (
    (0x03000000):SourceQueue      = 'WBIA.JDBC_PLGMM2.DELIVERYQUEUE'
    (0x03000000):Transactional    = TRUE
    (0x03000000):Encoding         = 273
    (0x03000000):CodedCharSetId   = 437
    (0x03000000):Format           = 'MQHRF2  '
    (0x03000000):Version          = 2
    (0x03000000):Report           = 0
    (0x03000000):MsgType          = 8
    (0x03000000):Expiry           = -1
    (0x03000000):Feedback         = 0
    (0x03000000):Priority         = 4
    (0x03000000):Persistence      = 1
    (0x03000000):MsgId            = X'414d5120454f57594e5f423320202020a0ac3046201d7d02'
    (0x03000000):CorrelId         = X'000000000000000000000000000000000000000000000000'
    (0x03000000):BackoutCount     = 0
    (0x03000000):ReplyToQ         = '                                                '
    (0x03000000):ReplyToQMgr      = 'EOWYN_B3                                        '
    (0x03000000):UserIdentifier   = 'gmm-jms     '
    (0x03000000):AccountingToken  = X'16010515000000ab2e90923ce2475c15b9981e1204000000000000000000000b'
    (0x03000000):ApplIdentityData = '                                '
    (0x03000000):PutApplType      = 28
    (0x03000000):PutApplName      = 'WebSphere MQ Client for Java'
    (0x03000000):PutDate          = DATE '2007-05-02'
    (0x03000000):PutTime          = GMTTIME '08:18:40.760'
    (0x03000000):ApplOriginData   = '    '
    (0x03000000):GroupId          = X'000000000000000000000000000000000000000000000000'
    (0x03000000):MsgSeqNumber     = 1
    (0x03000000):Offset           = 0
    (0x03000000):MsgFlags         = 0
    (0x03000000):OriginalLength   = -1
  )
  (0x01000000):MQRFH2     = (
    (0x03000000):Version        = 2
    (0x03000000):Format         = 'MQSTR   '
    (0x03000000):Encoding       = 273
    (0x03000000):CodedCharSetId = 1208
    (0x03000000):Flags          = 0
    (0x03000000):NameValueCCSID = 1208
    (0x01000000):mcd            = (
      (0x01000000):Msd  = (
        (0x02000000): = 'mrm'
      )
      (0x01000000):Set  = (
        (0x02000000): = 'AGRTHIG002001'
      )
      (0x01000000):Type = (
        (0x02000000): = 'JDBC_VIT_PARENT_ORDER_PLAN'
      )
      (0x01000000):Fmt  = (
        (0x02000000): = 'CwXML'
      )
    )
    (0x01000000):jms            = (
      (0x01000000):Dst = (
        (0x02000000): = 'queue:///WBIA.JDBC_PLGMM2.DELIVERYQUEUE'
      )
      (0x01000000):Tms = (
        (0x02000000): = '1178093920705'
      )
      (0x01000000):Dlv = (
        (0x02000000): = '2'
      )
    )
    (0x01000000):usr            = (
      (0x01000000):WSDLBinding   = (
        (0x02000000): = 'JDBC_VIT_PARENT_ORDER_PLANAgentDeliveryBinding'
      )
      (0x01000000):WSDLOperation = (
        (0x02000000): = 'JDBC_VIT_PARENT_ORDER_PLANCreate'
      )
      (0x01000000):PrivacyLevel  = (
        (0x02000000): = 'None'
      )
      (0x01000000):MessageType   = (
        (0x02000000): = 'JDBC_VIT_PARENT_ORDER_PLAN'
      )
    )
  )
  (0x0100001B):MRM        = (
    (0x0300000B):version                                                                                           = '3.0.0'
    (0x0300000B):verb                                                                                              = 'Create'
    (0x0300000B):locale                                                                                            = 'en_US'
    (0x0300000B):delta                                                                                             = FALSE
    (0x0300000B)http://www.ibm.com/websphere/crossworlds/2002/BOSchema/JDBC_VIT_PARENT_ORDER_PLAN:UPLOADID         = 8
    (0x01000013)http://www.ibm.com/websphere/crossworlds/2002/BOSchema/JDBC_VIT_PARENT_ORDER_PLAN:ORDER_PLAN_LINES = (
      (0x0300000B):size                                                                                                      = 100
      (0x01000013)http://www.ibm.com/websphere/crossworlds/2002/BOSchema/JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2 = (
        (0x0300000B):version = '3.0.0'
        (0x0300000B):verb    = ''
      )
    )
  )
)


The input message looks like (I have cut it down a bit):
Code:
<mcd>
   <Msd>mrm</Msd>
   <Set>AGRTHIG002001</Set>
   <Type>JDBC_VIT_PARENT_ORDER_PLAN</Type>
   <Fmt>CwXML</Fmt>
</mcd>
<jms>
   <Dst>queue:///WBIA.JDBC_PLGMM2.DELIVERYQUEUE</Dst>
   <Tms>1178093920705</Tms>
   <Dlv>2</Dlv>
</jms>
<usr>
   <WSDLBinding>
      JDBC_VIT_PARENT_ORDER_PLANAgentDeliveryBinding
   </WSDLBinding>
   <WSDLOperation>JDBC_VIT_PARENT_ORDER_PLANCreate</WSDLOperation>
   <PrivacyLevel>None</PrivacyLevel>
   <MessageType>JDBC_VIT_PARENT_ORDER_PLAN</MessageType>
</usr>
<?xml version="1.0" encoding="UTF-8"?>
<JDBC_VIT_PARENT_ORDER_PLAN:JDBC_VIT_PARENT_ORDER_PLAN
   xmlns:JDBC_VIT_PARENT_ORDER_PLAN="http://www.ibm.com/websphere/crossworlds/2002/BOSchema/JDBC_VIT_PARENT_ORDER_PLAN"
   xmlns:JDBC_IPCSDU_ORDER_PLAN_v2="http://www.ibm.com/websphere/crossworlds/2002/BOSchema/JDBC_IPCSDU_ORDER_PLAN_v2"
   xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
   xsi:schemaLocation="http://www.ibm.com/websphere/crossworlds/2002/BOSchema/JDBC_VIT_PARENT_ORDER_PLAN file:JDBC_VIT_PARENT_ORDER_PLAN.xsd"
   version="3.0.0" verb="Create" locale="en_US" delta="false">
   <JDBC_VIT_PARENT_ORDER_PLAN:UPLOADID>8</JDBC_VIT_PARENT_ORDER_PLAN:UPLOADID>
   <JDBC_VIT_PARENT_ORDER_PLAN:ORDER_PLAN_LINES size="100">
        <!--  REMOVED approx 94 elements -->
        <JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2 version="3.0.0" verb="" locale="en_US" delta="false">
          <JDBC_IPCSDU_ORDER_PLAN_v2:HOSTLOCID>VO 1075440</JDBC_IPCSDU_ORDER_PLAN_v2:HOSTLOCID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:HOSTPARTID>7838-250413</JDBC_IPCSDU_ORDER_PLAN_v2:HOSTPARTID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:ORDERID>SVG-74</JDBC_IPCSDU_ORDER_PLAN_v2:ORDERID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:PLANQUANTITY>100</JDBC_IPCSDU_ORDER_PLAN_v2:PLANQUANTITY>
          <JDBC_IPCSDU_ORDER_PLAN_v2:UPLOADID>8</JDBC_IPCSDU_ORDER_PLAN_v2:UPLOADID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:PLANRCVDATE>20070422</JDBC_IPCSDU_ORDER_PLAN_v2:PLANRCVDATE>
        </JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2>
        <JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2 version="3.0.0" verb="" locale="en_US" delta="false">
          <JDBC_IPCSDU_ORDER_PLAN_v2:HOSTLOCID>VO 1075440</JDBC_IPCSDU_ORDER_PLAN_v2:HOSTLOCID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:HOSTPARTID>7838-250413</JDBC_IPCSDU_ORDER_PLAN_v2:HOSTPARTID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:ORDERID>SVG-75</JDBC_IPCSDU_ORDER_PLAN_v2:ORDERID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:PLANQUANTITY>100</JDBC_IPCSDU_ORDER_PLAN_v2:PLANQUANTITY>
          <JDBC_IPCSDU_ORDER_PLAN_v2:UPLOADID>8</JDBC_IPCSDU_ORDER_PLAN_v2:UPLOADID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:PLANRCVDATE>20070422</JDBC_IPCSDU_ORDER_PLAN_v2:PLANRCVDATE>
        </JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2>
        <JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2 version="3.0.0" verb="" locale="en_US" delta="false">
          <JDBC_IPCSDU_ORDER_PLAN_v2:HOSTLOCID>VO 1075440</JDBC_IPCSDU_ORDER_PLAN_v2:HOSTLOCID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:HOSTPARTID>7838-250413</JDBC_IPCSDU_ORDER_PLAN_v2:HOSTPARTID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:ORDERID>SVG-76</JDBC_IPCSDU_ORDER_PLAN_v2:ORDERID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:PLANQUANTITY>100</JDBC_IPCSDU_ORDER_PLAN_v2:PLANQUANTITY>
          <JDBC_IPCSDU_ORDER_PLAN_v2:UPLOADID>8</JDBC_IPCSDU_ORDER_PLAN_v2:UPLOADID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:PLANRCVDATE>20070422</JDBC_IPCSDU_ORDER_PLAN_v2:PLANRCVDATE>
        </JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2>
        <JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2 version="3.0.0" verb="" locale="en_US" delta="false">
          <JDBC_IPCSDU_ORDER_PLAN_v2:HOSTLOCID>VO 1075440</JDBC_IPCSDU_ORDER_PLAN_v2:HOSTLOCID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:HOSTPARTID>7838-250413</JDBC_IPCSDU_ORDER_PLAN_v2:HOSTPARTID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:ORDERID>SVG-77</JDBC_IPCSDU_ORDER_PLAN_v2:ORDERID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:PLANQUANTITY>100</JDBC_IPCSDU_ORDER_PLAN_v2:PLANQUANTITY>
          <JDBC_IPCSDU_ORDER_PLAN_v2:UPLOADID>8</JDBC_IPCSDU_ORDER_PLAN_v2:UPLOADID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:PLANRCVDATE>20070422</JDBC_IPCSDU_ORDER_PLAN_v2:PLANRCVDATE>
        </JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2>
        <JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2 version="3.0.0" verb="" locale="en_US" delta="false">
          <JDBC_IPCSDU_ORDER_PLAN_v2:HOSTLOCID>VO 1075440</JDBC_IPCSDU_ORDER_PLAN_v2:HOSTLOCID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:HOSTPARTID>7838-250413</JDBC_IPCSDU_ORDER_PLAN_v2:HOSTPARTID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:ORDERID>SVG-78</JDBC_IPCSDU_ORDER_PLAN_v2:ORDERID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:PLANQUANTITY>100</JDBC_IPCSDU_ORDER_PLAN_v2:PLANQUANTITY>
          <JDBC_IPCSDU_ORDER_PLAN_v2:UPLOADID>8</JDBC_IPCSDU_ORDER_PLAN_v2:UPLOADID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:PLANRCVDATE>20070422</JDBC_IPCSDU_ORDER_PLAN_v2:PLANRCVDATE>
        </JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2>
        <JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2 version="3.0.0" verb="" locale="en_US" delta="false">
          <JDBC_IPCSDU_ORDER_PLAN_v2:HOSTLOCID>VO 1075440</JDBC_IPCSDU_ORDER_PLAN_v2:HOSTLOCID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:HOSTPARTID>7838-250413</JDBC_IPCSDU_ORDER_PLAN_v2:HOSTPARTID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:ORDERID>SVG-79</JDBC_IPCSDU_ORDER_PLAN_v2:ORDERID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:PLANQUANTITY>100</JDBC_IPCSDU_ORDER_PLAN_v2:PLANQUANTITY>
          <JDBC_IPCSDU_ORDER_PLAN_v2:UPLOADID>8</JDBC_IPCSDU_ORDER_PLAN_v2:UPLOADID>
          <JDBC_IPCSDU_ORDER_PLAN_v2:PLANRCVDATE>20070422</JDBC_IPCSDU_ORDER_PLAN_v2:PLANRCVDATE>
        </JDBC_IPCSDU_ORDER_PLAN_v2:JDBC_IPCSDU_ORDER_PLAN_v2>
   </JDBC_VIT_PARENT_ORDER_PLAN:ORDER_PLAN_LINES>
   <JDBC_VIT_PARENT_ORDER_PLAN:ObjectEventId>JDBCConnector_83VIT_WBIA_JDBC_EVENTSTORE20070502101331.0</JDBC_VIT_PARENT_ORDER_PLAN:ObjectEventId>
</JDBC_VIT_PARENT_ORDER_PLAN:JDBC_VIT_PARENT_ORDER_PLAN>

_________________
Best regards
4 Integration
Back to top
View user's profile Send private message
jefflowrey
PostPosted: Sat May 12, 2007 2:06 am    Post subject: Reply with quote

Grand Poobah

Joined: 16 Oct 2002
Posts: 19981
Partial parsing.
_________________
I am *not* the model of the modern major general.
Back to top
View user's profile Send private message
4integration
PostPosted: Sat May 12, 2007 6:48 am    Post subject: Reply with quote

Disciple

Joined: 04 Sep 2006
Posts: 197
Location: Gothenburg, Sweden
jefflowrey, ok you mean the value of "Parse timing" is set to "On Demand" (=partial parsing).

The strange thing is that my flow are using MRM + On demand and the trace are not complete. On the example "Large Messages" are using XML and On Demand, using the sample data + a trace node it traces all content.

I have tested XML and XMLNSC with the same result.

Also I suppose that I should have On Demand to get the best performance, or?

One other thing...in the example there is a statement that says:

Code:
CREATE FIRSTCHILD OF rowCachedInputXML DOMAIN ('XML') NAME 'XML';


And since I am using MRM, is it correct to change both XML strings to MRM?
_________________
Best regards
4 Integration
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Large Message Split (ideas from Samples Gallery)
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
  
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.