ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » DFDL parser issue with fixed length

Post new topic  Reply to topic Goto page 1, 2  Next
 DFDL parser issue with fixed length « View previous topic :: View next topic » 
Author Message
albert940
PostPosted: Tue Apr 02, 2013 5:14 pm    Post subject: DFDL parser issue with fixed length Reply with quote

Novice

Joined: 02 Apr 2013
Posts: 10
Have an issue with DFDL parser at run time. Will provide the details in the next post.
Back to top
View user's profile Send private message
albert940
PostPosted: Tue Apr 02, 2013 5:16 pm    Post subject: Reply with quote

Novice

Joined: 02 Apr 2013
Posts: 10
Hello,
I have created an XSD using DFDL domain and tested in DFDL test client and appears to be working fine, but when deployed at runtime it is generating errors.
The fixed length data is generated from AS400 in a flat file. Each record is of length 35.The data is sent unpacked before being sent. Below are the details. Any help is appreciated. Thanks in advance. I thought i posted the request already, if this appears to be duplicate post please ignore. Thanks again.

XSD:
Code:
<?xml version="1.0" encoding="UTF-8"?><xsd:schema xmlns:dfdl="http://www.ogf.org/dfdl/dfdl-1.0/" xmlns:ibmDfdlExtn="http://www.ibm.com/dfdl/extensions" xmlns:ibmSchExtn="http://www.ibm.com/schema/extensions" xmlns:recFixLengthFieldsFmt="http://www.ibm.com/dfdl/RecordFixLengthFieldFormat" xmlns:xsd="http://www.w3.org/2001/XMLSchema">

    <xsd:import namespace="http://www.ibm.com/dfdl/RecordFixLengthFieldFormat" schemaLocation="IBMdefined/RecordFixLengthFieldFormat.xsd"/>
            <xsd:annotation>
      <xsd:appinfo source="http://www.ogf.org/dfdl/">
         <dfdl:format byteOrder="{$dfdl:byteOrder}" encoding="{$dfdl:encoding}" escapeSchemeRef="recFixLengthFieldsFmt:RecordEscapeScheme" occursCountKind="fixed" ref="recFixLengthFieldsFmt:RecordFixLengthFieldsFormat" separatorPolicy="suppressed" textNumberJustification="left"/>
      </xsd:appinfo>
   </xsd:annotation>

   <xsd:element dfdl:lengthKind="delimited" dfdl:terminator="" ibmSchExtn:docRoot="true" name="REWARDS">
      <xsd:complexType>
         <xsd:sequence dfdl:outputNewLine="{$dfdl:outputNewLine}" dfdl:separator="" dfdl:terminator="">
            <xsd:element dfdl:lengthKind="delimited" dfdl:occursCountKind="implicit" dfdl:terminator="" maxOccurs="unbounded" name="body">
               <xsd:complexType>
                  <xsd:sequence dfdl:encoding="{$dfdl:encoding}" dfdl:outputNewLine="{$dfdl:outputNewLine}" dfdl:separator="" dfdl:separatorPolicy="suppressedAtEndLax" dfdl:terminator="%CR;%LF;">
                     <xsd:element dfdl:length="9" dfdl:lengthUnits="characters" dfdl:nilValueDelimiterPolicy="none" dfdl:outputNewLine="%CR;%LF;" dfdl:representation="text" dfdl:textNumberPattern="#0.###" dfdl:textPadKind="none" ibmDfdlExtn:sampleValue="12345.67" maxOccurs="1" name="POINTS" type="xsd:decimal"/>
                     <xsd:element dfdl:length="10" dfdl:lengthUnits="characters" dfdl:textNumberPattern="#0.###" dfdl:textPadKind="padChar" ibmDfdlExtn:sampleValue="1.0" maxOccurs="1" name="CREATED_AT" type="xsd:string"/>
                     <xsd:element dfdl:length="4" dfdl:lengthUnits="characters" dfdl:textNumberPattern="#0.###" dfdl:textPadKind="none" ibmDfdlExtn:sampleValue="123" maxOccurs="1" name="PT_CODE" type="xsd:decimal"/>
                            <xsd:element dfdl:length="12" dfdl:lengthKind="delimited" dfdl:lengthUnits="characters" dfdl:nilValueDelimiterPolicy="none" dfdl:outputNewLine="{$dfdl:outputNewLine}" dfdl:terminator="" dfdl:textNumberPadCharacter="%SP;" dfdl:textNumberPattern="#0.###" dfdl:textPadKind="none" ibmDfdlExtn:sampleValue="12345678901" maxOccurs="1" name="MEMS_ID" type="xsd:decimal"/>
                        </xsd:sequence>
               </xsd:complexType>
            </xsd:element>
         </xsd:sequence>
      </xsd:complexType>
   </xsd:element>


</xsd:schema>


Error Trace file:
Code:
 UserTrace   BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''1'' obtained from file ''C:\Users\s\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''0'' to terminal ''out''.
                                       The FileInput node read a record from the file, and will propagate it to the named terminal.
                                       No action is required.
2013-04-02 15:59:20.710348     7336   UserTrace   BIP3907I: Message received and propagated to 'out' terminal of input node 'RewardsFromAS400.File Input'.
2013-04-02 15:59:20.710430     7336   UserTrace   BIP6063I: Node 'RewardsFromAS400.File Input' used parser type ''Properties'' to process the input stream, beginning at offset '0'.
2013-04-02 15:59:20.711486     7336   UserTrace   BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''DFDL'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''DFDL'' from the previous parser.
2013-04-02 15:59:20.711544     7336   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-02 15:59:20.711570     7336   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''SET OutputRoot.XMLNSC = InputRoot.DFDL;'' at ('.RewardsFromAS400_Compute.Main', '3.6').
2013-04-02 15:59:20.711602     7336   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL'' at ('.RewardsFromAS400_Compute.Main', '3.30'). This resolved to ''InputRoot.DFDL''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='DFDL' Value=NULL''.
2013-04-02 15:59:20.711658     7336   UserTrace   BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL'' to ''OutputRoot.XMLNSC''.
2013-04-02 15:59:20.711732     7336   UserTrace   BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-02 15:59:20.711828     7336   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-02 15:59:20.711872     7336   UserTrace   BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-02 15:59:20.711902     7336   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-02 15:59:20.711934     7336   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-02 15:59:20.711986     7336   UserTrace   BIP5841I: ''Offset: 0. Found fixed length value: ' 12345.00' for element 'POINTS'.''
2013-04-02 15:59:20.712032     7336   UserTrace   BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-02 15:59:20.712084     7336   UserTrace   BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-02 15:59:20.712116     7336   UserTrace   BIP5841I: ''Offset: 9. Found fixed length value: '2013-01-20' for element 'CREATED_AT'.''
2013-04-02 15:59:20.712154     7336   UserTrace   BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-02 15:59:20.712184     7336   UserTrace   BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-02 15:59:20.712216     7336   UserTrace   BIP5841I: ''Offset: 19. Found fixed length value: ' 130' for element 'PT_CODE'.''
2013-04-02 15:59:20.712272     7336   UserTrace   BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-02 15:59:20.712306     7336   UserTrace   BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-02 15:59:20.712338     7336   UserTrace   BIP5841I: ''Offset: 23. Found fixed length value: '    44263559' for element 'MEMS_ID'.''
2013-04-02 15:59:20.712372     7336   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-02 15:59:20.712466     7336   UserTrace   BIP5841I: ''Offset: 35. Did not find terminator for '(null)'.  Expected terminator list is '%CR;%LF;'.''
2013-04-02 15:59:20.712500     7336   UserTrace   BIP5843E: ''Terminator is missing for element '#xscd(/schemaElement::REWARDS/type::0/model::sequence/schemaElement::body/type::0/model::sequence)'.''
2013-04-02 15:59:20.712524     7336   UserTrace   BIP5807E: The DFDL parser signalled that a processing error occurred. 
                                       The message from the DFDL parser is: 
                                       'CTDP3042E: Terminator is missing for element '#xscd(/schemaElement::REWARDS/type::0/model::sequence/schemaElement::body/type::0/model::sequence)'.'
                                       Processing errors occurred during the parsing a DFDL message.
                                       Review and resolve the problems indicated in the message from the DFDL parser.
2013-04-02 15:59:20.712784     7336   UserTrace   BIP2231E: Error detected whilst processing a message in node 'RewardsFromAS400.File Input'.
                                       The message broker detected an error whilst processing a message in node 'RewardsFromAS400.File Input'. The message has been augmented with an exception list and has been propagated to the node's failure terminal for further processing.
                                       See the following messages for details of the error.
2013-04-02 15:59:20.712808     7336   RecoverableException  BIP2230E: Error detected whilst processing a message in node 'RewardsFromAS400.Compute'.
                                       The message broker detected an error whilst processing a message in node 'RewardsFromAS400.Compute'. An exception has been thrown to cut short the processing of the message.
                                       See the following messages for details of the error.
2013-04-02 15:59:20.712826     7336   RecoverableException  BIP2488E:  ('.RewardsFromAS400_Compute.Main', '3.6') Error detected whilst executing the SQL statement ''SET OutputRoot.XMLNSC = InputRoot.DFDL;''.
                                       The message broker detected an error whilst executing the given statement. An exception has been thrown to cut short the SQL program.
                                       See the following messages for details of the error.
2013-04-02 15:59:20.712842     7336   ParserException  BIP5803E: DFDL parsing was stopped due to errors occurring.
                                       Errors have occurred during the parsing of a DFDL message. This has caused parsing to stop.
                                       Review further error messages for an indication to the cause of the errors.
2013-04-02 15:59:20.712856     7336   ParserException  BIP5807E: The DFDL parser signalled that a processing error occurred. 
                                       The message from the DFDL parser is: 
                                       'CTDP3042E: Terminator is missing for element '#xscd(/schemaElement::REWARDS/type::0/model::sequence/schemaElement::body/type::0/model::sequence)'.'
                                       Processing errors occurred during the parsing a DFDL message.
                                       Review and resolve the problems indicated in the message from the DFDL parser.
2013-04-02 15:59:20.713014     7336   UserTrace   BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''1'' obtained from file ''C:\Userss\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''0'' to terminal ''catch''.
                                       The FileInput node read a record from the file, and will propagate it to the named terminal.
                                       No action is required.
2013-04-02 15:59:20.713072     7336   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace1': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-02 15:59:20.713184     7336   UserTrace   BIP4060I: Data ''( ['GENERICROOT' : 0xbd4eee0]
                                         (0x01000000:Name):Properties = ( ['GENERICPROPERTYPARSER' : 0xbeed6f0]
                                           (0x03000000:NameValue):MessageSet             = '' (CHARACTER)
                                           (0x03000000:NameValue):MessageType            = '{}:REWARDS' (CHARACTER)
                                           (0x03000000:NameValue):MessageFormat          = '' (CHARACTER)
                                           (0x03000000:NameValue):Encoding               = 546 (INTEGER)
                                           (0x03000000:NameValue):CodedCharSetId         = 437 (INTEGER)
                                           (0x03000000:NameValue):Transactional          = FALSE (BOOLEAN)
                                           (0x03000000:NameValue):Persistence            = FALSE (BOOLEAN)
                                           (0x03000000:NameValue):CreationTime           = GMTTIMESTAMP '2013-04-02 22:59:20.709' (GMTTIMESTAMP)
                                           (0x03000000:NameValue):ExpirationTime         = -1 (INTEGER)
                                           (0x03000000:NameValue):Priority               = 0 (INTEGER)
                                           (0x03000000:NameValue):ReplyIdentifier        = X'' (BLOB)
                                           (0x03000000:NameValue):ReplyProtocol          = 'ADAPTOR' (CHARACTER)
                                           (0x03000000:NameValue):Topic                  = NULL
                                           (0x03000000:NameValue):ContentType            = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceType     = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceToken    = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourcePassword = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceIssuedBy = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedType     = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedToken    = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedPassword = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedIssuedBy = '' (CHARACTER)
                                         )
                                         (0x01000000:Name):DFDL       = ( ['dfdl' : 0xbed3dc0]
                                           (0x01000000:Name):REWARDS = (
                                             (0x01000000:Name):body = (
                                               (0x03000000:NameValue):POINTS     = ' 12345.00' (CHARACTER)
                                               (0x03000000:NameValue):CREATED_AT = '2013-01-20' (CHARACTER)
                                               (0x03000000:NameValue):PT_CODE    = ' 130' (CHARACTER)
                                               (0x03000000:NameValue):MEMS_ID    = '    44263559' (CHARACTER)
                                             )
                                           )
                                         )
                                       )
                                       '' from trace node 'RewardsFromAS400.Trace1'.
                                       The trace node 'RewardsFromAS400.Trace1' has output the specified trace data.
                                       This is an information message provided by the message flow designer.  The user response will be determined by the local environment.
2013-04-02 15:59:20.713208     7336   UserTrace   BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace1'.
                                       The trace node 'RewardsFromAS400.Trace1' has received a message and is propagating it to any nodes connected to its output terminal.
                                       No user action required.
2013-04-02 15:59:20.713340     7336   UserTrace   BIP11506I: Committed a local transaction.
                                       A local transaction has been committed for work done on the message flow thread.
2013-04-02 15:59:20.713432     7336   UserTrace   BIP11501I: Received data from input node ''File Input''.
                                       The input node ''File Input'' has received data and has propagated it to the message flow ''RewardsFromAS400''.
2013-04-02 15:59:20.713518     7336   UserTrace   BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50e90, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
                                       Entered the specified function with the specified parameters.
                                       No user action required.
2013-04-02 15:59:20.713542     7336   UserTrace   BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
                                       About to exit the specified the function with the specified result.
                                       No user action required.
2013-04-02 15:59:20.713558     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '16777216'.
                                       Element ''Type'' has been changed to '16777216'.
                                       No user action required.
2013-04-02 15:59:20.713578     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''File''.
                                       Element ''Name'' has been changed to ''File''.
                                       No user action required.
2013-04-02 15:59:20.713606     7336   UserTrace   BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50f20, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
                                       Entered the specified function with the specified parameters.
                                       No user action required.
2013-04-02 15:59:20.713622     7336   UserTrace   BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
                                       About to exit the specified the function with the specified result.
                                       No user action required.
2013-04-02 15:59:20.713636     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '50331648'.
                                       Element ''Type'' has been changed to '50331648'.
                                       No user action required.
2013-04-02 15:59:20.713652     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''LastModified''.
                                       Element ''Name'' has been changed to ''LastModified''.
                                       No user action required.
2013-04-02 15:59:20.713686     7336   UserTrace   BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50f20, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
                                       Entered the specified function with the specified parameters.
                                       No user action required.
2013-04-02 15:59:20.713704     7336   UserTrace   BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
                                       About to exit the specified the function with the specified result.
                                       No user action required.
2013-04-02 15:59:20.713718     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '50331648'.
                                       Element ''Type'' has been changed to '50331648'.
                                       No user action required.
2013-04-02 15:59:20.713736     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''Offset''.
                                       Element ''Name'' has been changed to ''Offset''.
                                       No user action required.
2013-04-02 15:59:20.713750     7336   UserTrace   BIP4142I: Evaluating cniElementSet'IntegerValue'. Changing value from ''NULL integer'' to '35'.
                                       Element ''IntegerValue'' has been changed to '35'.
                                       No user action required.
2013-04-02 15:59:20.713770     7336   UserTrace   BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50f20, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
                                       Entered the specified function with the specified parameters.
                                       No user action required.
2013-04-02 15:59:20.713786     7336   UserTrace   BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
                                       About to exit the specified the function with the specified result.
                                       No user action required.
2013-04-02 15:59:20.713800     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '50331648'.
                                       Element ''Type'' has been changed to '50331648'.
                                       No user action required.
2013-04-02 15:59:20.713816     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''Record''.
                                       Element ''Name'' has been changed to ''Record''.
                                       No user action required.
2013-04-02 15:59:20.713832     7336   UserTrace   BIP4142I: Evaluating cniElementSet'IntegerValue'. Changing value from ''NULL integer'' to '2'.
                                       Element ''IntegerValue'' has been changed to '2'.
                                       No user action required.
2013-04-02 15:59:20.713848     7336   UserTrace   BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50f20, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
                                       Entered the specified function with the specified parameters.
                                       No user action required.
2013-04-02 15:59:20.713864     7336   UserTrace   BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
                                       About to exit the specified the function with the specified result.
                                       No user action required.
2013-04-02 15:59:20.713878     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '50331648'.
                                       Element ''Type'' has been changed to '50331648'.
                                       No user action required.
2013-04-02 15:59:20.713896     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''Delimiter''.
                                       Element ''Name'' has been changed to ''Delimiter''.
                                       No user action required.
2013-04-02 15:59:20.713912     7336   UserTrace   BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50f20, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
                                       Entered the specified function with the specified parameters.
                                       No user action required.
2013-04-02 15:59:20.713926     7336   UserTrace   BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
                                       About to exit the specified the function with the specified result.
                                       No user action required.
2013-04-02 15:59:20.713942     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '50331648'.
                                       Element ''Type'' has been changed to '50331648'.
                                       No user action required.
2013-04-02 15:59:20.713956     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''IsEmpty''.
                                       Element ''Name'' has been changed to ''IsEmpty''.
                                       No user action required.
2013-04-02 15:59:20.713974     7336   UserTrace   BIP4142I: Evaluating cniElementSet'BooleanValue'. Changing value from ''unknown'' to ''false''.
                                       Element ''BooleanValue'' has been changed to ''false''.
                                       No user action required.
2013-04-02 15:59:20.713994     7336   UserTrace   BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50e90, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
                                       Entered the specified function with the specified parameters.
                                       No user action required.
2013-04-02 15:59:20.714010     7336   UserTrace   BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
                                       About to exit the specified the function with the specified result.
                                       No user action required.
2013-04-02 15:59:20.714026     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '16777216'.
                                       Element ''Type'' has been changed to '16777216'.
                                       No user action required.
2013-04-02 15:59:20.714040     7336   UserTrace   BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''Wildcard''.
                                       Element ''Name'' has been changed to ''Wildcard''.
                                       No user action required.
2013-04-02 15:59:20.714110     7336   UserTrace   BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''2'' obtained from file ''C:\Userss\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''35'' to terminal ''out''.
                                       The FileInput node read a record from the file, and will propagate it to the named terminal.
                                       No action is required.
2013-04-02 15:59:20.714134     7336   UserTrace   BIP3907I: Message received and propagated to 'out' terminal of input node 'RewardsFromAS400.File Input'.
2013-04-02 15:59:20.714172     7336   UserTrace   BIP6063I: Node 'RewardsFromAS400.File Input' used parser type ''Properties'' to process the input stream, beginning at offset '0'.
2013-04-02 15:59:20.714220     7336   UserTrace   BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''DFDL'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''DFDL'' from the previous parser.
2013-04-02 15:59:20.714252     7336   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-02 15:59:20.714278     7336   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''SET OutputRoot.XMLNSC = InputRoot.DFDL;'' at ('.RewardsFromAS400_Compute.Main', '3.6').
2013-04-02 15:59:20.714300     7336   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL'' at ('.RewardsFromAS400_Compute.Main', '3.30'). This resolved to ''InputRoot.DFDL''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='DFDL' Value=NULL''.
2013-04-02 15:59:20.714334     7336   UserTrace   BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL'' to ''OutputRoot.XMLNSC''.
2013-04-02 15:59:20.714380     7336   UserTrace   BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-02 15:59:20.714440     7336   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-02 15:59:20.714480     7336   UserTrace   BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-02 15:59:20.714508     7336   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-02 15:59:20.714538     7336   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-02 15:59:20.714590     7336   UserTrace   BIP5841I: ''Offset: 0. Found fixed length value: '%CR;%LF;     3.' for element 'POINTS'.''
2013-04-02 15:59:20.714624     7336   UserTrace   BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-02 15:59:20.714658     7336   UserTrace   BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-02 15:59:20.714688     7336   UserTrace   BIP5841I: ''Offset: 9. Found fixed length value: '312012-12-' for element 'CREATED_AT'.''
2013-04-02 15:59:20.714718     7336   UserTrace   BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-02 15:59:20.714748     7336   UserTrace   BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-02 15:59:20.714778     7336   UserTrace   BIP5841I: ''Offset: 19. Found fixed length value: '20 1' for element 'PT_CODE'.''
2013-04-02 15:59:20.714808     7336   UserTrace   BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-02 15:59:20.714838     7336   UserTrace   BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-02 15:59:20.714868     7336   UserTrace   BIP5841I: ''Offset: 23. Found fixed length value: '30     29792' for element 'MEMS_ID'.''
2013-04-02 15:59:20.714898     7336   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-02 15:59:20.714944     7336   UserTrace   BIP5841I: ''Offset: 35. Did not find terminator for '(null)'.  Expected terminator list is '%CR;%LF;'.''
2013-04-02 15:59:20.714976     7336   UserTrace   BIP5843E: ''Terminator is missing for element '#xscd(/schemaElement::REWARDS/type::0/model::sequence/schemaElement::body/type::0/model::sequence)'.''
2013-04-02 15:59:20.715018     7336   UserTrace   BIP5807E: The DFDL parser signalled that a processing error occurred. 
                                       The message from the DFDL parser is: 
                                       'CTDP3042E: Terminator is missing for element '#xscd(/schemaElement::REWARDS/type::0/model::sequence/schemaElement::body/type::0/model::sequence)'.'
                                       Processing errors occurred during the parsing a DFDL message.
                                       Review and resolve the problems indicated in the message from the DFDL parser.
2013-04-02 15:59:20.715196     7336   UserTrace   BIP2231E: Error detected whilst processing a message in node 'RewardsFromAS400.File Input'.
                                       The message broker detected an error whilst processing a message in node 'RewardsFromAS400.File Input'. The message has been augmented with an exception list and has been propagated to the node's failure terminal for further processing.
                                       See the following messages for details of the error.
2013-04-02 15:59:20.715220     7336   RecoverableException  BIP2230E: Error detected whilst processing a message in node 'RewardsFromAS400.Compute'.
                                       The message broker detected an error whilst processing a message in node 'RewardsFromAS400.Compute'. An exception has been thrown to cut short the processing of the message.
                                       See the following messages for details of the error.
2013-04-02 15:59:20.715232     7336   RecoverableException  BIP2488E:  ('.RewardsFromAS400_Compute.Main', '3.6') Error detected whilst executing the SQL statement ''SET OutputRoot.XMLNSC = InputRoot.DFDL;''.
                                       The message broker detected an error whilst executing the given statement. An exception has been thrown to cut short the SQL program.
                                       See the following messages for details of the error.
2013-04-02 15:59:20.715246     7336   ParserException  BIP5803E: DFDL parsing was stopped due to errors occurring.
                                       Errors have occurred during the parsing of a DFDL message. This has caused parsing to stop.
                                       Review further error messages for an indication to the cause of the errors.
2013-04-02 15:59:20.715260     7336   ParserException  BIP5807E: The DFDL parser signalled that a processing error occurred. 
                                       The message from the DFDL parser is: 
                                       'CTDP3042E: Terminator is missing for element '#xscd(/schemaElement::REWARDS/type::0/model::sequence/schemaElement::body/type::0/model::sequence)'.'
                                       Processing errors occurred during the parsing a DFDL message.
                                       Review and resolve the problems indicated in the message from the DFDL parser.
2013-04-02 15:59:20.715358     7336   UserTrace   BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''2'' obtained from file ''C:\Userss\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''35'' to terminal ''catch''.
                                       The FileInput node read a record from the file, and will propagate it to the named terminal.
                                       No action is required.
2013-04-02 15:59:20.715396     7336   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace1': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-02 15:59:20.715498     7336   UserTrace   BIP4060I: Data ''( ['GENERICROOT' : 0xbd4eee0]
                                         (0x01000000:Name):Properties = ( ['GENERICPROPERTYPARSER' : 0xbeed6f0]
                                           (0x03000000:NameValue):MessageSet             = '' (CHARACTER)
                                           (0x03000000:NameValue):MessageType            = '{}:REWARDS' (CHARACTER)
                                           (0x03000000:NameValue):MessageFormat          = '' (CHARACTER)
                                           (0x03000000:NameValue):Encoding               = 546 (INTEGER)
                                           (0x03000000:NameValue):CodedCharSetId         = 437 (INTEGER)
                                           (0x03000000:NameValue):Transactional          = FALSE (BOOLEAN)
                                           (0x03000000:NameValue):Persistence            = FALSE (BOOLEAN)
                                           (0x03000000:NameValue):CreationTime           = GMTTIMESTAMP '2013-04-02 22:59:20.712999' (GMTTIMESTAMP)
                                           (0x03000000:NameValue):ExpirationTime         = -1 (INTEGER)
                                           (0x03000000:NameValue):Priority               = 0 (INTEGER)
                                           (0x03000000:NameValue):ReplyIdentifier        = X'' (BLOB)
                                           (0x03000000:NameValue):ReplyProtocol          = 'ADAPTOR' (CHARACTER)
                                           (0x03000000:NameValue):Topic                  = NULL
                                           (0x03000000:NameValue):ContentType            = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceType     = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceToken    = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourcePassword = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceIssuedBy = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedType     = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedToken    = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedPassword = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedIssuedBy = '' (CHARACTER)
                                         )
                                         (0x01000000:Name):DFDL       = ( ['dfdl' : 0xbed3dc0]
                                           (0x01000000:Name):REWARDS = (
                                             (0x01000000:Name):body = (
                                               (0x03000000:NameValue):POINTS     = '
                                            3.' (CHARACTER)
                                               (0x03000000:NameValue):CREATED_AT = '312012-12-' (CHARACTER)
                                               (0x03000000:NameValue):PT_CODE    = '20 1' (CHARACTER)
                                               (0x03000000:NameValue):MEMS_ID    = '30     29792' (CHARACTER)
                                             )
                                           )
                                         )
                                       )
                                       '' from trace node 'RewardsFromAS400.Trace1'.
                                       The trace node 'RewardsFromAS400.Trace1' has output the specified trace data.
                                       This is an information message provided by the message flow designer.  The user response will be determined by the local environment.
2013-04-02 15:59:20.715520     7336   UserTrace   BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace1'.
                                       The trace node 'RewardsFromAS400.Trace1' has received a message and is propagating it to any nodes connected to its output terminal.
                                       No user action required.
2013-04-02 15:59:20.715598     7336   UserTrace   BIP11506I: Committed a local transaction.
                                       A local transaction has been committed for work done on the message flow thread.


Sample input data:
12345.002013-01-20 130 44263559
3.312012-12-20 130 2979234
3.362012-10-20 130 26744330

Last edited by albert940 on Wed Apr 03, 2013 9:46 am; edited 1 time in total
Back to top
View user's profile Send private message
goffinf
PostPosted: Tue Apr 02, 2013 11:39 pm    Post subject: Reply with quote

Chevalier

Joined: 05 Nov 2005
Posts: 401
The error appears to relate to the fact that the expected CRLF terminator is missing. Are you sure that you are getting that from your AS400 file and not just LF ?

Fraser.
Back to top
View user's profile Send private message
lancelotlinc
PostPosted: Wed Apr 03, 2013 4:23 am    Post subject: Reply with quote

Jedi Knight

Joined: 22 Mar 2010
Posts: 4941
Location: Bloomington, IL USA
Would help the readability of your post if you were to use [c o de] tags.
_________________
http://leanpub.com/IIB_Tips_and_Tricks
Save $20: Coupon Code: MQSERIES_READER
Back to top
View user's profile Send private message Send e-mail
albert940
PostPosted: Wed Apr 03, 2013 9:43 am    Post subject: Reply with quote

Novice

Joined: 02 Apr 2013
Posts: 10
A batch job runs in AS400 which generates this flat file. I dont think this is a logical file. I will double check and confirm with the resource who provided me this file.

lancelotlinc : i was too quick to post this again. I will try to edit and include [c o d e] tags.
Back to top
View user's profile Send private message
lancelotlinc
PostPosted: Wed Apr 03, 2013 9:46 am    Post subject: Reply with quote

Jedi Knight

Joined: 22 Mar 2010
Posts: 4941
Location: Bloomington, IL USA
albert940 wrote:
lancelotlinc : i was too quick to post this again. I will try to edit and include [c o d e] tags.


Thank you.
_________________
http://leanpub.com/IIB_Tips_and_Tricks
Save $20: Coupon Code: MQSERIES_READER
Back to top
View user's profile Send private message Send e-mail
kimbert
PostPosted: Wed Apr 03, 2013 11:36 am    Post subject: Reply with quote

Jedi Council

Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
Thanks for a good problem description - and thanks also for editing your second post to fix the formatting.

As goffinf has pointed out, the problem is that the DFDL xsd defines a terminator for the REWARDS element. The input data received by the flow did not contain any such terminator, so the parser ( correctly ) has reported an error.

It is quite common for the trailing terminator to be missing from a data stream - so common that DFDL has a property specifically for this scenario. It is 'documentFinalTerminatorCanBeMissing' and it can only be set in the global format block of an XSD. Your XSD may not have a global format block - it may be inheriting all of its default property values from an IBM-defined xsd. If that is the case, then don't edit the IBM-defined XSD. Instead, you should create a global format block for your own XSD and then set the documentFinalTerminatorCanBeMissing property to 'yes' in that format block.
You may need to click the 'Show All Sections' button in order to see the correct options in the DFDL editor.
Back to top
View user's profile Send private message
albert940
PostPosted: Wed Apr 03, 2013 3:27 pm    Post subject: Reply with quote

Novice

Joined: 02 Apr 2013
Posts: 10
Thanks for the quick reply kimbert. It did work after setting the documentFinalTerMinatorCanBeMissing Property to 'yes'. The 1st record got processed and the above error is gone.
But when it reaches 2nd record , the 'CR' and 'LF' are included in the first element of the 2nd record. The trace file error is below. I believe it is something to do with sequence 'terminator' property. Trying to debug.

Trace File:

Code:
2013-04-03 16:19:31.561492     8464   UserTrace   BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''1'' obtained from file ''C:\Userss\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''0'' to terminal ''out''.
                                       The FileInput node read a record from the file, and will propagate it to the named terminal.
                                       No action is required.
2013-04-03 16:19:31.563064     8464   UserTrace   BIP3907I: Message received and propagated to 'out' terminal of input node 'RewardsFromAS400.File Input'.
2013-04-03 16:19:31.563154     8464   UserTrace   BIP6063I: Node 'RewardsFromAS400.File Input' used parser type ''Properties'' to process the input stream, beginning at offset '0'.
2013-04-03 16:19:31.564206     8464   UserTrace   BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''DFDL'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''DFDL'' from the previous parser.
2013-04-03 16:19:31.564260     8464   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-03 16:19:31.564288     8464   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''SET OutputRoot.XMLNSC = InputRoot.DFDL;'' at ('.RewardsFromAS400_Compute.Main', '3.6').
2013-04-03 16:19:31.564316     8464   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL'' at ('.RewardsFromAS400_Compute.Main', '3.30'). This resolved to ''InputRoot.DFDL''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='DFDL' Value=NULL''.
2013-04-03 16:19:31.564370     8464   UserTrace   BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL'' to ''OutputRoot.XMLNSC''.
2013-04-03 16:19:31.564442     8464   UserTrace   BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-03 16:19:31.564530     8464   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-03 16:19:31.564574     8464   UserTrace   BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-03 16:19:31.564606     8464   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-03 16:19:31.564638     8464   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-03 16:19:31.564690     8464   UserTrace   BIP5841I: ''Offset: 0. Found fixed length value: ' 12345.00' for element 'POINTS'.''
2013-04-03 16:19:31.564812     8464   UserTrace   BIP5841I: ''Offset: 9. The simple content region of element 'POINTS' was converted to logical value '12345'.   ''
2013-04-03 16:19:31.564854     8464   UserTrace   BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-03 16:19:31.564888     8464   UserTrace   BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-03 16:19:31.564918     8464   UserTrace   BIP5841I: ''Offset: 9. Found fixed length value: '2013-01-20' for element 'CREATED_AT'.''
2013-04-03 16:19:31.564950     8464   UserTrace   BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-03 16:19:31.564982     8464   UserTrace   BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-03 16:19:31.565010     8464   UserTrace   BIP5841I: ''Offset: 19. Found fixed length value: ' 130' for element 'PT_CODE'.''
2013-04-03 16:19:31.565088     8464   UserTrace   BIP5841I: ''Offset: 23. The simple content region of element 'PT_CODE' was converted to logical value '130'.   ''
2013-04-03 16:19:31.565148     8464   UserTrace   BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-03 16:19:31.565182     8464   UserTrace   BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-03 16:19:31.565212     8464   UserTrace   BIP5841I: ''Offset: 23. Found fixed length value: '    44263559' for element 'MEMS_ID'.''
2013-04-03 16:19:31.565290     8464   UserTrace   BIP5841I: ''Offset: 35. The simple content region of element 'MEMS_ID' was converted to logical value '44263559'.   ''
2013-04-03 16:19:31.565326     8464   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-03 16:19:31.565410     8464   UserTrace   BIP5841I: ''Offset: 35. Did not find terminator for '(null)'.  Expected terminator list is '%CR;%LF;'.''
2013-04-03 16:19:31.565444     8464   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'body'.''
2013-04-03 16:19:31.565472     8464   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'REWARDS'.''
2013-04-03 16:19:31.565500     8464   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''RETURN TRUE;'' at ('.RewardsFromAS400_Compute.Main', '4.1').
2013-04-03 16:19:31.565526     8464   UserTrace   BIP4015I: Message propagated to the 'out' terminal of node 'RewardsFromAS400.Compute' with the following message trees: 'OutputLocalEnvironment, OutputRoot, OutputExceptionList'.
2013-04-03 16:19:31.565568     8464   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-03 16:19:31.565666     8464   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''ExceptionList'' at ('', '2.3'). This resolved to ''ExceptionList''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-03 16:19:31.565688     8464   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''LocalEnvironment'' at ('', '3.3'). This resolved to ''LocalEnvironment''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-03 16:19:31.565712     8464   UserTrace   BIP4060I: Data ''( ['GENERICROOT' : 0xaa96630]
                                         (0x01000000:Name  ):Properties = ( ['MQPROPERTYPARSER' : 0xaa98c90]
                                           (0x03000000:NameValue):MessageSet             = NULL
                                           (0x03000000:NameValue):MessageType            = NULL
                                           (0x03000000:NameValue):MessageFormat          = NULL
                                           (0x03000000:NameValue):Encoding               = NULL
                                           (0x03000000:NameValue):CodedCharSetId         = NULL
                                           (0x03000000:NameValue):Transactional          = NULL
                                           (0x03000000:NameValue):Persistence            = NULL
                                           (0x03000000:NameValue):CreationTime           = NULL
                                           (0x03000000:NameValue):ExpirationTime         = NULL
                                           (0x03000000:NameValue):Priority               = NULL
                                           (0x03000000:NameValue):ReplyIdentifier        = NULL
                                           (0x03000000:NameValue):ReplyProtocol          = 'ADAPTOR' (CHARACTER)
                                           (0x03000000:NameValue):Topic                  = NULL
                                           (0x03000000:NameValue):ContentType            = NULL
                                           (0x03000000:NameValue):IdentitySourceType     = NULL
                                           (0x03000000:NameValue):IdentitySourceToken    = NULL
                                           (0x03000000:NameValue):IdentitySourcePassword = NULL
                                           (0x03000000:NameValue):IdentitySourceIssuedBy = NULL
                                           (0x03000000:NameValue):IdentityMappedType     = NULL
                                           (0x03000000:NameValue):IdentityMappedToken    = NULL
                                           (0x03000000:NameValue):IdentityMappedPassword = NULL
                                           (0x03000000:NameValue):IdentityMappedIssuedBy = NULL
                                         )
                                         (0x01000000:Folder):XMLNSC     = ( ['xmlnsc' : 0x1ff6440]
                                           (0x01000000:Folder):REWARDS = (
                                             (0x01000000:Folder):body = (
                                               (0x03000000:PCDataField):POINTS     = 12345 (DECIMAL)
                                               (0x03000000:PCDataField):CREATED_AT = '2013-01-20' (CHARACTER)
                                               (0x03000000:PCDataField):PT_CODE    = 130 (DECIMAL)
                                               (0x03000000:PCDataField):MEMS_ID    = 44263559 (DECIMAL)
                                             )
                                           )
                                         )
                                       )
                                       
                                       
                                       '' from trace node 'RewardsFromAS400.Trace2'.
                                       The trace node 'RewardsFromAS400.Trace2' has output the specified trace data.
                                       This is an information message provided by the message flow designer.  The user response will be determined by the local environment.
2013-04-03 16:19:31.565732     8464   UserTrace   BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace2'.

2013-04-03 16:19:31.569908     8464   UserTrace   BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''2'' obtained from file ''C:\Userss\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''35'' to terminal ''out''.
                                       The FileInput node read a record from the file, and will propagate it to the named terminal.
                                       No action is required.
2013-04-03 16:19:31.569934     8464   UserTrace   BIP3907I: Message received and propagated to 'out' terminal of input node 'RewardsFromAS400.File Input'.
2013-04-03 16:19:31.569976     8464   UserTrace   BIP6063I: Node 'RewardsFromAS400.File Input' used parser type ''Properties'' to process the input stream, beginning at offset '0'.
2013-04-03 16:19:31.570024     8464   UserTrace   BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''DFDL'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''DFDL'' from the previous parser.
2013-04-03 16:19:31.570058     8464   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-03 16:19:31.570082     8464   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''SET OutputRoot.XMLNSC = InputRoot.DFDL;'' at ('.RewardsFromAS400_Compute.Main', '3.6').
2013-04-03 16:19:31.570104     8464   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL'' at ('.RewardsFromAS400_Compute.Main', '3.30'). This resolved to ''InputRoot.DFDL''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='DFDL' Value=NULL''.
2013-04-03 16:19:31.570142     8464   UserTrace   BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL'' to ''OutputRoot.XMLNSC''.
2013-04-03 16:19:31.570196     8464   UserTrace   BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-03 16:19:31.570260     8464   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-03 16:19:31.570308     8464   UserTrace   BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-03 16:19:31.570338     8464   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-03 16:19:31.570370     8464   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-03 16:19:31.570422     8464   UserTrace   BIP5841I: ''Offset: 0. Found fixed length value: '%CR;%LF;     3.' for element 'POINTS'.''
2013-04-03 16:19:31.570468     8464   UserTrace   BIP5841I: ''Offset: 9. The simple content region of element 'POINTS' was converted to logical value '3'.   ''
2013-04-03 16:19:31.570506     8464   UserTrace   BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-03 16:19:31.570540     8464   UserTrace   BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-03 16:19:31.570572     8464   UserTrace   BIP5841I: ''Offset: 9. Found fixed length value: '312012-12-' for element 'CREATED_AT'.''
2013-04-03 16:19:31.570604     8464   UserTrace   BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-03 16:19:31.570636     8464   UserTrace   BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-03 16:19:31.570666     8464   UserTrace   BIP5841I: ''Offset: 19. Found fixed length value: '20 1' for element 'PT_CODE'.''
2013-04-03 16:19:31.570702     8464   UserTrace   BIP5841I: ''Offset: 23. The simple content region of element 'PT_CODE' was converted to logical value '2001'.   ''
2013-04-03 16:19:31.570734     8464   UserTrace   BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-03 16:19:31.570764     8464   UserTrace   BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-03 16:19:31.570796     8464   UserTrace   BIP5841I: ''Offset: 23. Found fixed length value: '30     29792' for element 'MEMS_ID'.''
2013-04-03 16:19:31.570834     8464   UserTrace   BIP5841I: ''Offset: 35. The simple content region of element 'MEMS_ID' was converted to logical value '300000029792'.   ''
2013-04-03 16:19:31.570892     8464   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-03 16:19:31.570946     8464   UserTrace   BIP5841I: ''Offset: 35. Did not find terminator for '(null)'.  Expected terminator list is '%CR;%LF;'.''
2013-04-03 16:19:31.570976     8464   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'body'.''
2013-04-03 16:19:31.571006     8464   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'REWARDS'.''
2013-04-03 16:19:31.571036     8464   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''RETURN TRUE;'' at ('.RewardsFromAS400_Compute.Main', '4.1').
2013-04-03 16:19:31.571060     8464   UserTrace   BIP4015I: Message propagated to the 'out' terminal of node 'RewardsFromAS400.Compute' with the following message trees: 'OutputLocalEnvironment, OutputRoot, OutputExceptionList'.
2013-04-03 16:19:31.571090     8464   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-03 16:19:31.571180     8464   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''ExceptionList'' at ('', '2.3'). This resolved to ''ExceptionList''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-03 16:19:31.571202     8464   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''LocalEnvironment'' at ('', '3.3'). This resolved to ''LocalEnvironment''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-03 16:19:31.571226     8464   UserTrace   BIP4060I: Data ''( ['GENERICROOT' : 0xaa96630]
                                         (0x01000000:Name  ):Properties = ( ['MQPROPERTYPARSER' : 0xaa98c90]
                                           (0x03000000:NameValue):MessageSet             = NULL
                                           (0x03000000:NameValue):MessageType            = NULL
                                           (0x03000000:NameValue):MessageFormat          = NULL
                                           (0x03000000:NameValue):Encoding               = NULL
                                           (0x03000000:NameValue):CodedCharSetId         = NULL
                                           (0x03000000:NameValue):Transactional          = NULL
                                           (0x03000000:NameValue):Persistence            = NULL
                                           (0x03000000:NameValue):CreationTime           = NULL
                                           (0x03000000:NameValue):ExpirationTime         = NULL
                                           (0x03000000:NameValue):Priority               = NULL
                                           (0x03000000:NameValue):ReplyIdentifier        = NULL
                                           (0x03000000:NameValue):ReplyProtocol          = 'ADAPTOR' (CHARACTER)
                                           (0x03000000:NameValue):Topic                  = NULL
                                           (0x03000000:NameValue):ContentType            = NULL
                                           (0x03000000:NameValue):IdentitySourceType     = NULL
                                           (0x03000000:NameValue):IdentitySourceToken    = NULL
                                           (0x03000000:NameValue):IdentitySourcePassword = NULL
                                           (0x03000000:NameValue):IdentitySourceIssuedBy = NULL
                                           (0x03000000:NameValue):IdentityMappedType     = NULL
                                           (0x03000000:NameValue):IdentityMappedToken    = NULL
                                           (0x03000000:NameValue):IdentityMappedPassword = NULL
                                           (0x03000000:NameValue):IdentityMappedIssuedBy = NULL
                                         )
                                         (0x01000000:Folder):XMLNSC     = ( ['xmlnsc' : 0x1ff6440]
                                           (0x01000000:Folder):REWARDS = (
                                             (0x01000000:Folder):body = (
                                               (0x03000000:PCDataField):POINTS     = 3 (DECIMAL)
                                               (0x03000000:PCDataField):CREATED_AT = '312012-12-' (CHARACTER)
                                               (0x03000000:PCDataField):PT_CODE    = 2001 (DECIMAL)
                                               (0x03000000:PCDataField):MEMS_ID    = 300000029792 (DECIMAL)
                                             )
                                           )
                                         )
                                       )
                                       
                                       
                                       '' from trace node 'RewardsFromAS400.Trace2'.
                                       The trace node 'RewardsFromAS400.Trace2' has output the specified trace data.
                                       This is an information message provided by the message flow designer.  The user response will be determined by the local environment.
2013-04-03 16:19:31.571248     8464   UserTrace   BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace2'.
                                       The trace node 'RewardsFromAS400.Trace2' has received a message and is propagating it to any nodes connected to its output terminal.
                                       No user action required.
2013-04-03 16:19:31.571370     8464   UserTrace   BIP2638I: The MQ output node 'RewardsFromAS400.MQ Output' attempted to write a message to queue ''SAMPLE_IN'' connected to queue manager ''''. The MQCC was '0' and the MQRC was '0'.
2013-04-03 16:19:31.571394     8464   UserTrace   BIP2622I: Message successfully output by output node 'RewardsFromAS400.MQ Output' to queue ''SAMPLE_IN'' on queue manager ''''.
2013-04-03 16:19:31.571476     8464   UserTrace   BIP11506I: Committed a local transaction.
                                       A local transaction has been committed for work done on the message flow thread.
2013-04-03 16:19:31.571540     8464   UserTrace   BIP11501I: Received data from input node ''File Input''.
                                       The input node ''File Input'' has received data and has propagated it to the message flow ''RewardsFromAS400''.
2013-04-03 16:19:31.571620     8464   UserTrace   BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)b45bff0, (*ptr)aae2f80, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').


Back to top
View user's profile Send private message
kimbert
PostPosted: Thu Apr 04, 2013 12:14 pm    Post subject: Reply with quote

Jedi Council

Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
Quote:
It did work after setting the documentFinalTerMinatorCanBeMissing Property to 'yes'. The 1st record got processed and the above error is gone.
But when it reaches 2nd record , the 'CR' and 'LF' are included in the first element of the 2nd record.
That's interesting. It looks as if that terminator was not, in fact, missing from the data. The DFDL mnemonic %CR;%LF; should match a carriage-return and line-feed pair. The second trace claims that this was found at offset 35 ( when parsing the second message from the file ).
At this point I would inspect the actual bytes being sent, and compare them with the DFDL model. You could easily do that by parsing using the BLOB domain and putting in a Trace node.

One possible fix would be to set the terminator to %NL; which will match a CR/LF pair as well as any other line terminator. But I don't advise you to try that until you have checked the actual bytes received.
Back to top
View user's profile Send private message
albert940
PostPosted: Thu Apr 04, 2013 1:04 pm    Post subject: Reply with quote

Novice

Joined: 02 Apr 2013
Posts: 10
I tried both options.
Using the BLOB domain, i counted the length of input data and it appears to be 35 which is correct. The trace file is below.

Code:
The message broker received a message that requires the handling of data of type ''BLOB'', but the broker does not have the capability to handle data of this type.
                                       Check both the message being sent to the message broker and the configuration data for the node. References to the unsupported data type must be removed if the message is to be processed by the broker.
2013-04-04 13:37:58.890208     6692   UserTrace   BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''BLOB'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''NONE'' from the previous parser.
2013-04-04 13:37:58.890236     6692   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890320     6692   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace': Evaluating expression ''ExceptionList'' at ('', '2.3'). This resolved to ''ExceptionList''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890340     6692   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace': Evaluating expression ''LocalEnvironment'' at ('', '3.3'). This resolved to ''LocalEnvironment''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890388     6692   UserTrace   BIP4060I: Data ''( ['GENERICROOT' : 0x113145f0]
                                         (0x01000000:Name):Properties = ( ['GENERICPROPERTYPARSER' : 0xacf4fb0]
                                           (0x03000000:NameValue):MessageSet             = '' (CHARACTER)
                                           (0x03000000:NameValue):MessageType            = '' (CHARACTER)
                                           (0x03000000:NameValue):MessageFormat          = '' (CHARACTER)
                                           (0x03000000:NameValue):Encoding               = 546 (INTEGER)
                                           (0x03000000:NameValue):CodedCharSetId         = 437 (INTEGER)
                                           (0x03000000:NameValue):Transactional          = FALSE (BOOLEAN)
                                           (0x03000000:NameValue):Persistence            = FALSE (BOOLEAN)
                                           (0x03000000:NameValue):CreationTime           = GMTTIMESTAMP '2013-04-04 20:37:58.889' (GMTTIMESTAMP)
                                           (0x03000000:NameValue):ExpirationTime         = -1 (INTEGER)
                                           (0x03000000:NameValue):Priority               = 0 (INTEGER)
                                           (0x03000000:NameValue):ReplyIdentifier        = X'' (BLOB)
                                           (0x03000000:NameValue):ReplyProtocol          = 'ADAPTOR' (CHARACTER)
                                           (0x03000000:NameValue):Topic                  = NULL
                                           (0x03000000:NameValue):ContentType            = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceType     = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceToken    = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourcePassword = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceIssuedBy = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedType     = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedToken    = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedPassword = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedIssuedBy = '' (CHARACTER)
                                         )
                                         (0x01000000:Name):BLOB       = ( ['none' : 0xaa91920]
                                           (0x03000000:NameValue):UnknownParserName = 'BLOB' (CHARACTER)
                                           (0x03000000:NameValue):BLOB              = X'3339333437330d0a2020202020202e3030323031322d31302d30352031333020202020' (BLOB)
                                         )
                                       )
                                       
                                       ( ['MQROOT' : 0x11314920]
                                         (0x01000000:Name):File     = (
                                           (0x03000000:NameValue):Directory    = 'C:\Users\callipuram\Documents\GEMINI_PROJECT\INT41\SampleCSVFiles' (CHARACTER)
                                           (0x03000000:NameValue):Name         = 'sqlexec1.txt' (CHARACTER)
                                           (0x03000000:NameValue):LastModified = GMTTIMESTAMP '2013-04-02 23:59:34.602' (GMTTIMESTAMP)
                                           (0x03000000:NameValue):TimeStamp    = '20130404_203754_674357' (CHARACTER)
                                           (0x03000000:NameValue):Offset       = 140 (INTEGER)
                                           (0x03000000:NameValue):Record       = 5 (INTEGER)
                                           (0x03000000:NameValue):Delimiter    = NULL
                                           (0x03000000:NameValue):IsEmpty      = FALSE (BOOLEAN)
                                         )
                                         (0x01000000:Name):Wildcard = (
                                           (0x03000000:NameValue):WildcardMatch = 'sqlexec1' (CHARACTER)
                                         )
                                       )
                                       '' from trace node 'RewardsFromAS400.Trace'.
                                       The trace node 'RewardsFromAS400.Trace' has output the specified trace data.
                                       This is an information message provided by the message flow designer.  The user response will be determined by the local environment.
2013-04-04 13:37:58.890408     6692   UserTrace   BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace'.
                                       The trace node 'RewardsFromAS400.Trace' has received a message and is propagating it to any nodes connected to its output terminal.
                                       No user action required.
2013-04-04 13:37:58.890444     6692   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-04 13:37:58.890468     6692   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''DECLARE I INTEGER LENGTH(InputRoot.BLOB.BLOB);'' at ('.RewardsFromAS400_Compute.Main', '5.6').
2013-04-04 13:37:58.890492     6692   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot.BLOB.BLOB'' at ('.RewardsFromAS400_Compute.Main', '5.31'). This resolved to ''InputRoot.BLOB.BLOB''. The result was ''X'3339333437330d0a2020202020202e3030323031322d31302d30352031333020202020'''.
2013-04-04 13:37:58.890520     6692   UserTrace   BIP2539I: Node '': Evaluating expression ''LENGTH(InputRoot.BLOB.BLOB)'' at ('.RewardsFromAS400_Compute.Main', '5.24'). This resolved to ''LENGTH(X'3339333437330d0a2020202020202e3030323031322d31302d30352031333020202020')''. The result was ''35''.
2013-04-04 13:37:58.890548     6692   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''SET OutputRoot = InputRoot;'' at ('.RewardsFromAS400_Compute.Main', '6.6').
2013-04-04 13:37:58.890564     6692   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot'' at ('.RewardsFromAS400_Compute.Main', '6.23'). This resolved to ''InputRoot''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890592     6692   UserTrace   BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot'' to ''OutputRoot''.
2013-04-04 13:37:58.890616     6692   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''RETURN TRUE;'' at ('.RewardsFromAS400_Compute.Main', '7.1').
2013-04-04 13:37:58.890740     6692   UserTrace   BIP4015I: Message propagated to the 'out' terminal of node 'RewardsFromAS400.Compute' with the following message trees: 'OutputLocalEnvironment, OutputRoot, OutputExceptionList'.
2013-04-04 13:37:58.890772     6692   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890852     6692   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''ExceptionList'' at ('', '2.3'). This resolved to ''ExceptionList''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890872     6692   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''LocalEnvironment'' at ('', '3.3'). This resolved to ''LocalEnvironment''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890896     6692   UserTrace   BIP4060I: Data ''( ['GENERICROOT' : 0xa9fae00]
                                         (0x01000000:Name):Properties = ( ['GENERICPROPERTYPARSER' : 0xacf63d0]
                                           (0x03000000:NameValue):MessageSet             = '' (CHARACTER)
                                           (0x03000000:NameValue):MessageType            = '' (CHARACTER)
                                           (0x03000000:NameValue):MessageFormat          = '' (CHARACTER)
                                           (0x03000000:NameValue):Encoding               = 546 (INTEGER)
                                           (0x03000000:NameValue):CodedCharSetId         = 437 (INTEGER)
                                           (0x03000000:NameValue):Transactional          = FALSE (BOOLEAN)
                                           (0x03000000:NameValue):Persistence            = FALSE (BOOLEAN)
                                           (0x03000000:NameValue):CreationTime           = GMTTIMESTAMP '2013-04-04 20:37:58.889' (GMTTIMESTAMP)
                                           (0x03000000:NameValue):ExpirationTime         = -1 (INTEGER)
                                           (0x03000000:NameValue):Priority               = 0 (INTEGER)
                                           (0x03000000:NameValue):ReplyIdentifier        = X'' (BLOB)
                                           (0x03000000:NameValue):ReplyProtocol          = 'ADAPTOR' (CHARACTER)
                                           (0x03000000:NameValue):Topic                  = NULL
                                           (0x03000000:NameValue):ContentType            = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceType     = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceToken    = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourcePassword = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceIssuedBy = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedType     = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedToken    = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedPassword = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedIssuedBy = '' (CHARACTER)
                                         )
                                         (0x01000000:Name):BLOB       = ( ['none' : 0xab5caf0]
                                           (0x03000000:NameValue):UnknownParserName = 'BLOB' (CHARACTER)
                                           (0x03000000:NameValue):BLOB              = X'3339333437330d0a2020202020202e3030323031322d31302d30352031333020202020' (BLOB)
                                         )
                                       )
                                       
                                       
                                       '' from trace node 'RewardsFromAS400.Trace2'.
                                       The trace node 'RewardsFromAS400.Trace2' has output the specified trace data.
                                       This is an information message provided by the message flow designer.  The user response will be determined by the local environment.
2013-04-04 13:37:58.890912     6692   UserTrace   BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace2'.
                                       The trace node 'RewardsFromAS400.Trace2' has received a message and is propagating it to any nodes connected to its output terminal.
                                       No user action required.
2013-04-04 13:37:58.890964     6692   UserTrace   BIP2638I: The MQ output node 'RewardsFromAS400.MQ Output' attempted to write a message to queue ''SAMPLE_IN'' connected to queue manager ''''. The MQCC was '0' and the MQRC was '0'.
2013-04-04 13:37:58.890984     6692   UserTrace   BIP2622I: Message successfully output by output node 'RewardsFromAS400.MQ Output' to queue ''SAMPLE_IN'' on queue manager ''''.
2013-04-04 13:37:58.891048     6692   UserTrace   BIP11506I: Committed a local transaction.


Tried using the '%NL' terminator. Below is the trace. Surprisingly no change and it is still taking 'CR' and 'LF'. It si working in DFDL Test client but not at run time which is weird.

Trace file when using '%NL'.

Code:
2013-04-04 13:44:26.464862     8144   UserTrace   BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''2'' obtained from file ''C:\Users\callipuram\Documents\GEMINI_PROJECT\INT41\SampleCSVFiles\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''35'' to terminal ''out''.
                                       The FileInput node read a record from the file, and will propagate it to the named terminal.
                                       No action is required.
2013-04-04 13:44:26.464888     8144   UserTrace   BIP3907I: Message received and propagated to 'out' terminal of input node 'RewardsFromAS400.File Input'.
2013-04-04 13:44:26.464918     8144   UserTrace   BIP6063I: Node 'RewardsFromAS400.File Input' used parser type ''Properties'' to process the input stream, beginning at offset '0'.
2013-04-04 13:44:26.464962     8144   UserTrace   BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''DFDL'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''DFDL'' from the previous parser.
2013-04-04 13:44:26.464990     8144   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.465086     8144   UserTrace   BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-04 13:44:26.465138     8144   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-04 13:44:26.465178     8144   UserTrace   BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-04 13:44:26.465204     8144   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-04 13:44:26.465234     8144   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-04 13:44:26.465280     8144   UserTrace   BIP5841I: ''Offset: 0. Found fixed length value: '%CR;%LF;     3.' for element 'POINTS'.''
2013-04-04 13:44:26.465322     8144   UserTrace   BIP5841I: ''Offset: 9. The simple content region of element 'POINTS' was converted to logical value '3'.   ''
2013-04-04 13:44:26.465356     8144   UserTrace   BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-04 13:44:26.465388     8144   UserTrace   BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-04 13:44:26.465416     8144   UserTrace   BIP5841I: ''Offset: 9. Found fixed length value: '312012-12-' for element 'CREATED_AT'.''
2013-04-04 13:44:26.465446     8144   UserTrace   BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-04 13:44:26.465476     8144   UserTrace   BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-04 13:44:26.465504     8144   UserTrace   BIP5841I: ''Offset: 19. Found fixed length value: '20 1' for element 'PT_CODE'.''
2013-04-04 13:44:26.465536     8144   UserTrace   BIP5841I: ''Offset: 23. The simple content region of element 'PT_CODE' was converted to logical value '2001'.   ''
2013-04-04 13:44:26.465568     8144   UserTrace   BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-04 13:44:26.465598     8144   UserTrace   BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-04 13:44:26.465628     8144   UserTrace   BIP5841I: ''Offset: 23. Found fixed length value: '30     29792' for element 'MEMS_ID'.''
2013-04-04 13:44:26.465662     8144   UserTrace   BIP5841I: ''Offset: 35. The simple content region of element 'MEMS_ID' was converted to logical value '300000029792'.   ''
2013-04-04 13:44:26.465694     8144   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-04 13:44:26.465742     8144   UserTrace   BIP5841I: ''Offset: 35. Did not find terminator for '(null)'.  Expected terminator list is '%NL;'.''
2013-04-04 13:44:26.465770     8144   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'body'.''
2013-04-04 13:44:26.465800     8144   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'REWARDS'.''
2013-04-04 13:44:26.465840     8144   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace': Evaluating expression ''ExceptionList'' at ('', '2.3'). This resolved to ''ExceptionList''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.465860     8144   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace': Evaluating expression ''LocalEnvironment'' at ('', '3.3'). This resolved to ''LocalEnvironment''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.465908     8144   UserTrace   BIP4060I: Data ''( ['GENERICROOT' : 0xaa52510]
                                         (0x01000000:Name):Properties = ( ['GENERICPROPERTYPARSER' : 0xacf59c0]
                                           (0x03000000:NameValue):MessageSet             = '' (CHARACTER)
                                           (0x03000000:NameValue):MessageType            = '{}:REWARDS' (CHARACTER)
                                           (0x03000000:NameValue):MessageFormat          = '' (CHARACTER)
                                           (0x03000000:NameValue):Encoding               = 546 (INTEGER)
                                           (0x03000000:NameValue):CodedCharSetId         = 437 (INTEGER)
                                           (0x03000000:NameValue):Transactional          = FALSE (BOOLEAN)
                                           (0x03000000:NameValue):Persistence            = FALSE (BOOLEAN)
                                           (0x03000000:NameValue):CreationTime           = GMTTIMESTAMP '2013-04-04 20:44:26.464001' (GMTTIMESTAMP)
                                           (0x03000000:NameValue):ExpirationTime         = -1 (INTEGER)
                                           (0x03000000:NameValue):Priority               = 0 (INTEGER)
                                           (0x03000000:NameValue):ReplyIdentifier        = X'' (BLOB)
                                           (0x03000000:NameValue):ReplyProtocol          = 'ADAPTOR' (CHARACTER)
                                           (0x03000000:NameValue):Topic                  = NULL
                                           (0x03000000:NameValue):ContentType            = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceType     = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceToken    = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourcePassword = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceIssuedBy = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedType     = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedToken    = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedPassword = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedIssuedBy = '' (CHARACTER)
                                         )
                                         (0x01000000:Name):DFDL       = ( ['dfdl' : 0x11071a30]
                                           (0x01000000:Name):REWARDS = (
                                             (0x01000000:Name):body = (
                                               (0x03000000:NameValue):POINTS     = 3 (DECIMAL)
                                               (0x03000000:NameValue):CREATED_AT = '312012-12-' (CHARACTER)
                                               (0x03000000:NameValue):PT_CODE    = 2001 (DECIMAL)
                                               (0x03000000:NameValue):MEMS_ID    = 300000029792 (DECIMAL)
                                             )
                                           )
                                         )
                                       )
                                       
                                       ( ['MQROOT' : 0xaa521e0]
                                         (0x01000000:Name):File     = (
                                           (0x03000000:NameValue):Directory    = 'C:\Users\callipuram\Documents\GEMINI_PROJECT\INT41\SampleCSVFiles' (CHARACTER)
                                           (0x03000000:NameValue):Name         = 'sqlexec1.txt' (CHARACTER)
                                           (0x03000000:NameValue):LastModified = GMTTIMESTAMP '2013-04-02 23:59:34.602' (GMTTIMESTAMP)
                                           (0x03000000:NameValue):TimeStamp    = '20130404_204422_240645' (CHARACTER)
                                           (0x03000000:NameValue):Offset       = 35 (INTEGER)
                                           (0x03000000:NameValue):Record       = 2 (INTEGER)
                                           (0x03000000:NameValue):Delimiter    = NULL
                                           (0x03000000:NameValue):IsEmpty      = FALSE (BOOLEAN)
                                         )
                                         (0x01000000:Name):Wildcard = (
                                           (0x03000000:NameValue):WildcardMatch = 'sqlexec1' (CHARACTER)
                                         )
                                       )
                                       '' from trace node 'RewardsFromAS400.Trace'.
                                       The trace node 'RewardsFromAS400.Trace' has output the specified trace data.
                                       This is an information message provided by the message flow designer.  The user response will be determined by the local environment.
2013-04-04 13:44:26.465930     8144   UserTrace   BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace'.
                                       The trace node 'RewardsFromAS400.Trace' has received a message and is propagating it to any nodes connected to its output terminal.
                                       No user action required.
2013-04-04 13:44:26.465972     8144   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-04 13:44:26.465996     8144   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''DECLARE I INTEGER LENGTH(InputRoot.BLOB.BLOB);'' at ('.RewardsFromAS400_Compute.Main', '5.6').
2013-04-04 13:44:26.466014     8144   UserTrace   BIP2543I: Node '': ('.RewardsFromAS400_Compute.Main', '5.31') : Failed to navigate to path element number '2' because it does not exist.
2013-04-04 13:44:26.466044     8144   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot.BLOB.BLOB'' at ('.RewardsFromAS400_Compute.Main', '5.31'). This resolved to ''InputRoot.BLOB.BLOB''. The result was ''NULL''.
2013-04-04 13:44:26.466070     8144   UserTrace   BIP2539I: Node '': Evaluating expression ''LENGTH(InputRoot.BLOB.BLOB)'' at ('.RewardsFromAS400_Compute.Main', '5.24'). This resolved to ''LENGTH(NULL)''. The result was ''NULL''.
2013-04-04 13:44:26.466098     8144   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''SET OutputRoot = InputRoot;'' at ('.RewardsFromAS400_Compute.Main', '6.6').
2013-04-04 13:44:26.466118     8144   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot'' at ('.RewardsFromAS400_Compute.Main', '6.23'). This resolved to ''InputRoot''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.466142     8144   UserTrace   BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot'' to ''OutputRoot''.
2013-04-04 13:44:26.466178     8144   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''RETURN TRUE;'' at ('.RewardsFromAS400_Compute.Main', '7.1').
2013-04-04 13:44:26.466214     8144   UserTrace   BIP4015I: Message propagated to the 'out' terminal of node 'RewardsFromAS400.Compute' with the following message trees: 'OutputLocalEnvironment, OutputRoot, OutputExceptionList'.
2013-04-04 13:44:26.466240     8144   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.466328     8144   UserTrace   BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-04 13:44:26.466378     8144   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-04 13:44:26.466416     8144   UserTrace   BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-04 13:44:26.466444     8144   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-04 13:44:26.466474     8144   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-04 13:44:26.466514     8144   UserTrace   BIP5841I: ''Offset: 0. Found fixed length value: '%CR;%LF;     3.' for element 'POINTS'.''
2013-04-04 13:44:26.466550     8144   UserTrace   BIP5841I: ''Offset: 9. The simple content region of element 'POINTS' was converted to logical value '3'.   ''
2013-04-04 13:44:26.466584     8144   UserTrace   BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-04 13:44:26.466614     8144   UserTrace   BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-04 13:44:26.466644     8144   UserTrace   BIP5841I: ''Offset: 9. Found fixed length value: '312012-12-' for element 'CREATED_AT'.''
2013-04-04 13:44:26.466672     8144   UserTrace   BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-04 13:44:26.466700     8144   UserTrace   BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-04 13:44:26.466728     8144   UserTrace   BIP5841I: ''Offset: 19. Found fixed length value: '20 1' for element 'PT_CODE'.''
2013-04-04 13:44:26.466760     8144   UserTrace   BIP5841I: ''Offset: 23. The simple content region of element 'PT_CODE' was converted to logical value '2001'.   ''
2013-04-04 13:44:26.466794     8144   UserTrace   BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-04 13:44:26.466824     8144   UserTrace   BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-04 13:44:26.466852     8144   UserTrace   BIP5841I: ''Offset: 23. Found fixed length value: '30     29792' for element 'MEMS_ID'.''
2013-04-04 13:44:26.466886     8144   UserTrace   BIP5841I: ''Offset: 35. The simple content region of element 'MEMS_ID' was converted to logical value '300000029792'.   ''
2013-04-04 13:44:26.466918     8144   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-04 13:44:26.466948     8144   UserTrace   BIP5841I: ''Offset: 35. Did not find terminator for '(null)'.  Expected terminator list is '%NL;'.''
2013-04-04 13:44:26.466974     8144   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'body'.''
2013-04-04 13:44:26.467000     8144   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'REWARDS'.''
2013-04-04 13:44:26.467040     8144   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''ExceptionList'' at ('', '2.3'). This resolved to ''ExceptionList''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.467058     8144   UserTrace   BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''LocalEnvironment'' at ('', '3.3'). This resolved to ''LocalEnvironment''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.467084     8144   UserTrace   BIP4060I: Data ''( ['GENERICROOT' : 0x11072090]
                                         (0x01000000:Name):Properties = ( ['GENERICPROPERTYPARSER' : 0xacf4fb0]
                                           (0x03000000:NameValue):MessageSet             = '' (CHARACTER)
                                           (0x03000000:NameValue):MessageType            = '{}:REWARDS' (CHARACTER)
                                           (0x03000000:NameValue):MessageFormat          = '' (CHARACTER)
                                           (0x03000000:NameValue):Encoding               = 546 (INTEGER)
                                           (0x03000000:NameValue):CodedCharSetId         = 437 (INTEGER)
                                           (0x03000000:NameValue):Transactional          = FALSE (BOOLEAN)
                                           (0x03000000:NameValue):Persistence            = FALSE (BOOLEAN)
                                           (0x03000000:NameValue):CreationTime           = GMTTIMESTAMP '2013-04-04 20:44:26.464001' (GMTTIMESTAMP)
                                           (0x03000000:NameValue):ExpirationTime         = -1 (INTEGER)
                                           (0x03000000:NameValue):Priority               = 0 (INTEGER)
                                           (0x03000000:NameValue):ReplyIdentifier        = X'' (BLOB)
                                           (0x03000000:NameValue):ReplyProtocol          = 'ADAPTOR' (CHARACTER)
                                           (0x03000000:NameValue):Topic                  = NULL
                                           (0x03000000:NameValue):ContentType            = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceType     = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceToken    = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourcePassword = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentitySourceIssuedBy = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedType     = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedToken    = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedPassword = '' (CHARACTER)
                                           (0x03000000:NameValue):IdentityMappedIssuedBy = '' (CHARACTER)
                                         )
                                         (0x01000000:Name):DFDL       = ( ['dfdl' : 0x11072a20]
                                           (0x01000000:Name):REWARDS = (
                                             (0x01000000:Name):body = (
                                               (0x03000000:NameValue):POINTS     = 3 (DECIMAL)
                                               (0x03000000:NameValue):CREATED_AT = '312012-12-' (CHARACTER)
                                               (0x03000000:NameValue):PT_CODE    = 2001 (DECIMAL)
                                               (0x03000000:NameValue):MEMS_ID    = 300000029792 (DECIMAL)
                                             )
                                           )
                                         )
                                       )
                                       
                                       
                                       '' from trace node 'RewardsFromAS400.Trace2'.
                                       The trace node 'RewardsFromAS400.Trace2' has output the specified trace data.
Back to top
View user's profile Send private message
kimbert
PostPosted: Sat Apr 06, 2013 12:49 pm    Post subject: Reply with quote

Jedi Council

Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
In the FileInput node, I think you have probably set the Record Identification to 'Fixed Length' and the length to 35. The FileInput node is taking exactly 35 bytes from the file and passing them to the flow. The terminator is not included in those 35 bytes ( I can see that from the BLOB data that you have posted ).
You need to do one of the following:
a) Set the length to 37. Only do this if you are 100% certain that every record will contain a terminator ( including the last record in the file ).
b) Change the 'Record Identification' property to 'Parsed Record Sequence'. The FileInput node will use the DFDL parser to recognise each record, and it will tolerate missing terminators.
Back to top
View user's profile Send private message
albert940
PostPosted: Tue Apr 09, 2013 2:43 pm    Post subject: Reply with quote

Novice

Joined: 02 Apr 2013
Posts: 10
I tried with option #b last week and it did work.
The trace response for #a is below. I see the messages being sent to output queue but there is an error generated in the trace file for every record.

Code:
2013-04-09 15:30:22.360938     5724   UserTrace   BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''1'' obtained from file ''C:\temp\files\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''0'' to terminal ''out''.
                                       The FileInput node read a record from the file, and will propagate it to the named terminal.
                                       No action is required.
2013-04-09 15:30:22.360966     5724   UserTrace   BIP3907I: Message received and propagated to 'out' terminal of input node 'RewardsFromAS400.File Input'.
2013-04-09 15:30:22.361074     5724   UserTrace   BIP6063I: Node 'RewardsFromAS400.File Input' used parser type ''Properties'' to process the input stream, beginning at offset '0'.
2013-04-09 15:30:22.362066     5724   UserTrace   BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''DFDL'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''DFDL'' from the previous parser.
2013-04-09 15:30:22.362130     5724   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-09 15:30:22.362156     5724   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''SET OutputRoot.Properties = InputProperties;'' at ('.RewardsFromAS400_Compute.Main', '5.6').
2013-04-09 15:30:22.362182     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''InputProperties'' at ('.RewardsFromAS400_Compute.Main', '5.34'). This resolved to ''InputProperties''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Properties' Value=NULL''.
2013-04-09 15:30:22.362216     5724   UserTrace   BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputProperties'' to ''OutputRoot.Properties''.
2013-04-09 15:30:22.362252     5724   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''DECLARE i INTEGER 1;'' at ('.RewardsFromAS400_Compute.Main', '7.6').
2013-04-09 15:30:22.362274     5724   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''DECLARE j INTEGER CARDINALITY(InputRoot.DFDL.REWARDS.body[ ]);'' at ('.RewardsFromAS400_Compute.Main', '8.6').
2013-04-09 15:30:22.362368     5724   UserTrace   BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-09 15:30:22.362458     5724   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-09 15:30:22.362504     5724   UserTrace   BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-09 15:30:22.362534     5724   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-09 15:30:22.362560     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL.REWARDS.body[ ]'' at ('.RewardsFromAS400_Compute.Main', '8.37'). This resolved to ''InputRoot.DFDL.REWARDS.body[]''. The result was ''LIST... First Element Type=16777216 NameSpace='' Name='body' Value=NULL''.
2013-04-09 15:30:22.362602     5724   UserTrace   BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-09 15:30:22.362656     5724   UserTrace   BIP5841I: ''Offset: 0. Found fixed length value: ' 12345.00' for element 'POINTS'.''
2013-04-09 15:30:22.362782     5724   UserTrace   BIP5841I: ''Offset: 9. The simple content region of element 'POINTS' was converted to logical value '12345'.   ''
2013-04-09 15:30:22.362826     5724   UserTrace   BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-09 15:30:22.362858     5724   UserTrace   BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-09 15:30:22.362918     5724   UserTrace   BIP5841I: ''Offset: 9. Found fixed length value: '2013-01-20' for element 'CREATED_AT'.''
2013-04-09 15:30:22.362954     5724   UserTrace   BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-09 15:30:22.362990     5724   UserTrace   BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-09 15:30:22.363022     5724   UserTrace   BIP5841I: ''Offset: 19. Found fixed length value: ' 130' for element 'PT_CODE'.''
2013-04-09 15:30:22.363106     5724   UserTrace   BIP5841I: ''Offset: 23. The simple content region of element 'PT_CODE' was converted to logical value '130'.   ''
2013-04-09 15:30:22.363142     5724   UserTrace   BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-09 15:30:22.363172     5724   UserTrace   BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-09 15:30:22.363204     5724   UserTrace   BIP5841I: ''Offset: 23. Found fixed length value: '    44263559' for element 'MEMS_ID'.''
2013-04-09 15:30:22.363284     5724   UserTrace   BIP5841I: ''Offset: 35. The simple content region of element 'MEMS_ID' was converted to logical value '44263559'.   ''
2013-04-09 15:30:22.363320     5724   UserTrace   BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-09 15:30:22.363372     5724   UserTrace   BIP5841I: ''Offset: 35. Found terminator '%CR;%LF;' for element '(null)'.''
2013-04-09 15:30:22.363408     5724   UserTrace   BIP5841I: ''Offset: 37. Finished processing element 'body'.''
2013-04-09 15:30:22.363444     5724   UserTrace   BIP5841I: ''Offset: 37. Optional element 'body' encountered. The DFDL parser will return to this position if the element is not present in the data stream.''
2013-04-09 15:30:22.363478     5724   UserTrace   BIP5841I: ''Offset: 37. Starting to process element 'body'.''
2013-04-09 15:30:22.363508     5724   UserTrace   BIP5841I: ''Offset: 37. Starting to process element 'POINTS'.''
2013-04-09 15:30:22.363570     5724   UserTrace   BIP5843E: ''Unexpected end of data at byte offset '<MISSING INSERT 0>' while parsing element '<MISSING INSERT 1>'. The parser encountered the end of the data stream or the end of a parent element.''
2013-04-09 15:30:22.363604     5724   UserTrace   BIP5841I: ''offset: 37. Parser was unable to resolve data on the current branch and will evaluate the next available branch beginning at offset '37' owned by the 'sequence' group contained within element 'REWARDS'.''
2013-04-09 15:30:22.363638     5724   UserTrace   BIP5841I: ''Offset: 37. Occurrence '2' of element 'body' was not found in the data. occursCountKind is 'parsed' so no more occurrences of this element will be expected. ''
2013-04-09 15:30:22.363666     5724   UserTrace   BIP5841I: ''Offset: 37. Finished processing element 'REWARDS'.''
2013-04-09 15:30:22.363692     5724   UserTrace   BIP2540I: Node '': Finished evaluating expression ''CARDINALITY(InputRoot.DFDL.REWARDS.body[ ])'' at ('.RewardsFromAS400_Compute.Main', '8.24'). The result was ''1''.
2013-04-09 15:30:22.363726     5724   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''DECLARE Z INTEGER 20;'' at ('.RewardsFromAS400_Compute.Main', '9.6').
2013-04-09 15:30:22.363746     5724   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''WHILE i <= j DO ... END WHILE;'' at ('.RewardsFromAS400_Compute.Main', '18.6').
2013-04-09 15:30:22.363764     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '18.12'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.363786     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''j'' at ('.RewardsFromAS400_Compute.Main', '18.17'). This resolved to ''j''. The result was ''1''.
2013-04-09 15:30:22.363812     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''i <= j'' at ('.RewardsFromAS400_Compute.Main', '18.12'). This resolved to ''1 <= 1''. The result was ''TRUE''.
2013-04-09 15:30:22.363842     5724   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''SET OutputRoot.XMLNSC.REWARDS.body.POINTS = InputRoot.DFDL.REWARDS.body[i].POINTS;'' at ('.RewardsFromAS400_Compute.Main', '20.7').
2013-04-09 15:30:22.363860     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '20.79'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.363890     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '20.79'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.363914     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL.REWARDS.body[i].POINTS'' at ('.RewardsFromAS400_Compute.Main', '20.51'). This resolved to ''InputRoot.DFDL.REWARDS.body[1].POINTS''. The result was ''ROW... Root Element Type=50331648 NameSpace='' Name='POINTS' Value=12345''.
2013-04-09 15:30:22.363974     5724   UserTrace   BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL.REWARDS.body[i].POINTS'' to ''OutputRoot.XMLNSC.REWARDS.body.POINTS''.
2013-04-09 15:30:22.364002     5724   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''SET OutputRoot.XMLNSC.REWARDS.body.CREATED_AT = InputRoot.DFDL.REWARDS.body[i].CREATED_AT;'' at ('.RewardsFromAS400_Compute.Main', '21.7').
2013-04-09 15:30:22.364022     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '21.83'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.364052     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '21.83'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.364074     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL.REWARDS.body[i].CREATED_AT'' at ('.RewardsFromAS400_Compute.Main', '21.55'). This resolved to ''InputRoot.DFDL.REWARDS.body[1].CREATED_AT''. The result was ''ROW... Root Element Type=50331648 NameSpace='' Name='CREATED_AT' Value='2013-01-20'''.
2013-04-09 15:30:22.364104     5724   UserTrace   BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL.REWARDS.body[i].CREATED_AT'' to ''OutputRoot.XMLNSC.REWARDS.body.CREATED_AT''.
2013-04-09 15:30:22.364124     5724   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''SET OutputRoot.XMLNSC.REWARDS.body.PT_CODE = InputRoot.DFDL.REWARDS.body[i].PT_CODE;'' at ('.RewardsFromAS400_Compute.Main', '22.7').
2013-04-09 15:30:22.364144     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '22.80'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.364174     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '22.80'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.364200     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL.REWARDS.body[i].PT_CODE'' at ('.RewardsFromAS400_Compute.Main', '22.52'). This resolved to ''InputRoot.DFDL.REWARDS.body[1].PT_CODE''. The result was ''ROW... Root Element Type=50331648 NameSpace='' Name='PT_CODE' Value=130''.
2013-04-09 15:30:22.364228     5724   UserTrace   BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL.REWARDS.body[i].PT_CODE'' to ''OutputRoot.XMLNSC.REWARDS.body.PT_CODE''.
2013-04-09 15:30:22.364250     5724   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''SET OutputRoot.XMLNSC.REWARDS.body.MEMS_ID = InputRoot.DFDL.REWARDS.body[i].MEMS_ID;'' at ('.RewardsFromAS400_Compute.Main', '23.7').
2013-04-09 15:30:22.364268     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '23.80'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.364296     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '23.80'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.364318     5724   UserTrace   BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL.REWARDS.body[i].MEMS_ID'' at ('.RewardsFromAS400_Compute.Main', '23.52'). This resolved to ''InputRoot.DFDL.REWARDS.body[1].MEMS_ID''. The result was ''ROW... Root Element Type=50331648 NameSpace='' Name='MEMS_ID' Value=44263559''.
2013-04-09 15:30:22.364346     5724   UserTrace   BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL.REWARDS.body[i].MEMS_ID'' to ''OutputRoot.XMLNSC.REWARDS.body.MEMS_ID''.
2013-04-09 15:30:22.364368     5724   UserTrace   BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement   ''PROPAGATE FINALIZE DEFAULT DELETE NONE;'' at ('.RewardsFromAS400_Compute.Main', '25.7').
2013-04-09 15:30:22.364412     5724   UserTrace   BIP4015I: Message propagated to the 'out' terminal of node 'RewardsFromAS400.Compute' with the following message trees: 'OutputLocalEnvironment, OutputRoot, OutputExceptionList'.
2013-04-09 15:30:22.364452     5724   UserTrace   BIP3904I: Invoking the evaluate() method of node (class='ComIbmMQHeaderNode', name='RewardsFromAS400#FCMComposite_1_2').
                                       About to pass a message to the evaluate() method of  the specified node.
                                       No user action required.



Another situation: The test data that is generated out of AS400 has a blank 1st record and then actual data starts from the second record. I tried to execute the DFDL test case but it errors out in the test client.

Sample Test Data:
***Beginning**

12345.002013-01-20 130 44263559
3.312012-12-20 130 2979234
3.362012-10-20 130 26744330
.002012-01-05 130 45393473
**End**

TestClient Output: Parser reads the 1st record and when it reaches the second record the 'CR' and 'LF' are included in the first element of the 2nd record due to which the entire data is being changed. I used even the 'skip first record' option provided in file input node but no use.
Back to top
View user's profile Send private message
kimbert
PostPosted: Wed Apr 10, 2013 1:07 am    Post subject: Reply with quote

Jedi Council

Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
I assume that you are referring to this error:
Code:
2013-04-09 15:30:22.363478     5724   UserTrace   BIP5841I: ''Offset: 37. Starting to process element 'body'.''
2013-04-09 15:30:22.363508     5724   UserTrace   BIP5841I: ''Offset: 37. Starting to process element 'POINTS'.''
2013-04-09 15:30:22.363570     5724   UserTrace   BIP5843E: ''Unexpected end of data at byte offset '<MISSING INSERT 0>' while parsing element '<MISSING INSERT 1>'. The parser encountered the end of the data stream or the end of a parent element.''
2013-04-09 15:30:22.363604     5724   UserTrace   BIP5841I: ''offset: 37. Parser was unable to resolve data on the current branch and will evaluate the next available branch beginning at offset '37' owned by the 'sequence' group contained within element 'REWARDS'.''
2013-04-09 15:30:22.363638     5724   UserTrace   BIP5841I: ''Offset: 37. Occurrence '2' of element 'body' was not found in the data. occursCountKind is 'parsed' so no more occurrences of this element will be expected. ''
2013-04-09 15:30:22.363666     5724   UserTrace   BIP5841I: ''Offset: 37. Finished processing element 'REWARDS'.''


If you read the trace carefully you will see why this error is occurring:
Code:
2013-04-09 15:30:22.362504     5724   UserTrace   BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''

I believe your message is a fixed-length structure, so you should set occursCountKind to 'fixed' on all elements.
Back to top
View user's profile Send private message
kimbert
PostPosted: Wed Apr 10, 2013 1:15 am    Post subject: Reply with quote

Jedi Council

Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
Quote:
Another situation: The test data that is generated out of AS400 has a blank 1st record
I assume that the ***Beginning*** is your way of showing where the file contents begin? In which case, a [c o d e] section would have done an even better job because it would clearly show the extent of the quoted data.

I'm not surprised that the blank record has messed up the reading of the file - you have told the FileInput node to read 37 bytes per record, so that is what it will do. You need to be very clear on where these blank records can occur. Do they only occur at the beginning of a file, or can they occur elsewhere as well? When you know the answer to that question, you can design a solution.
Back to top
View user's profile Send private message
albert940
PostPosted: Wed Apr 10, 2013 1:18 pm    Post subject: Reply with quote

Novice

Joined: 02 Apr 2013
Posts: 10
If i set the 'occursCountKind' on 'body' element to 'fixed' then i should have the MaxOccurs = MinOccurs for that element, which is not possible in my case, as the count of records in the file vary everyday. I don't see 'occursCountKind' property defined for elements.


The blank record is only at the beginning of the file. It is the defined structure now.
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic  Reply to topic Goto page 1, 2  Next Page 1 of 2

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » DFDL parser issue with fixed length
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
  
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.