|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
DFDL parser issue with fixed length |
« View previous topic :: View next topic » |
Author |
Message
|
albert940 |
Posted: Tue Apr 02, 2013 5:14 pm Post subject: DFDL parser issue with fixed length |
|
|
Novice
Joined: 02 Apr 2013 Posts: 10
|
Have an issue with DFDL parser at run time. Will provide the details in the next post. |
|
Back to top |
|
 |
albert940 |
Posted: Tue Apr 02, 2013 5:16 pm Post subject: |
|
|
Novice
Joined: 02 Apr 2013 Posts: 10
|
Hello,
I have created an XSD using DFDL domain and tested in DFDL test client and appears to be working fine, but when deployed at runtime it is generating errors.
The fixed length data is generated from AS400 in a flat file. Each record is of length 35.The data is sent unpacked before being sent. Below are the details. Any help is appreciated. Thanks in advance. I thought i posted the request already, if this appears to be duplicate post please ignore. Thanks again.
XSD:
Code: |
<?xml version="1.0" encoding="UTF-8"?><xsd:schema xmlns:dfdl="http://www.ogf.org/dfdl/dfdl-1.0/" xmlns:ibmDfdlExtn="http://www.ibm.com/dfdl/extensions" xmlns:ibmSchExtn="http://www.ibm.com/schema/extensions" xmlns:recFixLengthFieldsFmt="http://www.ibm.com/dfdl/RecordFixLengthFieldFormat" xmlns:xsd="http://www.w3.org/2001/XMLSchema">
<xsd:import namespace="http://www.ibm.com/dfdl/RecordFixLengthFieldFormat" schemaLocation="IBMdefined/RecordFixLengthFieldFormat.xsd"/>
<xsd:annotation>
<xsd:appinfo source="http://www.ogf.org/dfdl/">
<dfdl:format byteOrder="{$dfdl:byteOrder}" encoding="{$dfdl:encoding}" escapeSchemeRef="recFixLengthFieldsFmt:RecordEscapeScheme" occursCountKind="fixed" ref="recFixLengthFieldsFmt:RecordFixLengthFieldsFormat" separatorPolicy="suppressed" textNumberJustification="left"/>
</xsd:appinfo>
</xsd:annotation>
<xsd:element dfdl:lengthKind="delimited" dfdl:terminator="" ibmSchExtn:docRoot="true" name="REWARDS">
<xsd:complexType>
<xsd:sequence dfdl:outputNewLine="{$dfdl:outputNewLine}" dfdl:separator="" dfdl:terminator="">
<xsd:element dfdl:lengthKind="delimited" dfdl:occursCountKind="implicit" dfdl:terminator="" maxOccurs="unbounded" name="body">
<xsd:complexType>
<xsd:sequence dfdl:encoding="{$dfdl:encoding}" dfdl:outputNewLine="{$dfdl:outputNewLine}" dfdl:separator="" dfdl:separatorPolicy="suppressedAtEndLax" dfdl:terminator="%CR;%LF;">
<xsd:element dfdl:length="9" dfdl:lengthUnits="characters" dfdl:nilValueDelimiterPolicy="none" dfdl:outputNewLine="%CR;%LF;" dfdl:representation="text" dfdl:textNumberPattern="#0.###" dfdl:textPadKind="none" ibmDfdlExtn:sampleValue="12345.67" maxOccurs="1" name="POINTS" type="xsd:decimal"/>
<xsd:element dfdl:length="10" dfdl:lengthUnits="characters" dfdl:textNumberPattern="#0.###" dfdl:textPadKind="padChar" ibmDfdlExtn:sampleValue="1.0" maxOccurs="1" name="CREATED_AT" type="xsd:string"/>
<xsd:element dfdl:length="4" dfdl:lengthUnits="characters" dfdl:textNumberPattern="#0.###" dfdl:textPadKind="none" ibmDfdlExtn:sampleValue="123" maxOccurs="1" name="PT_CODE" type="xsd:decimal"/>
<xsd:element dfdl:length="12" dfdl:lengthKind="delimited" dfdl:lengthUnits="characters" dfdl:nilValueDelimiterPolicy="none" dfdl:outputNewLine="{$dfdl:outputNewLine}" dfdl:terminator="" dfdl:textNumberPadCharacter="%SP;" dfdl:textNumberPattern="#0.###" dfdl:textPadKind="none" ibmDfdlExtn:sampleValue="12345678901" maxOccurs="1" name="MEMS_ID" type="xsd:decimal"/>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:schema> |
Error Trace file:
Code: |
UserTrace BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''1'' obtained from file ''C:\Users\s\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''0'' to terminal ''out''.
The FileInput node read a record from the file, and will propagate it to the named terminal.
No action is required.
2013-04-02 15:59:20.710348 7336 UserTrace BIP3907I: Message received and propagated to 'out' terminal of input node 'RewardsFromAS400.File Input'.
2013-04-02 15:59:20.710430 7336 UserTrace BIP6063I: Node 'RewardsFromAS400.File Input' used parser type ''Properties'' to process the input stream, beginning at offset '0'.
2013-04-02 15:59:20.711486 7336 UserTrace BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''DFDL'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''DFDL'' from the previous parser.
2013-04-02 15:59:20.711544 7336 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-02 15:59:20.711570 7336 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''SET OutputRoot.XMLNSC = InputRoot.DFDL;'' at ('.RewardsFromAS400_Compute.Main', '3.6').
2013-04-02 15:59:20.711602 7336 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL'' at ('.RewardsFromAS400_Compute.Main', '3.30'). This resolved to ''InputRoot.DFDL''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='DFDL' Value=NULL''.
2013-04-02 15:59:20.711658 7336 UserTrace BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL'' to ''OutputRoot.XMLNSC''.
2013-04-02 15:59:20.711732 7336 UserTrace BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-02 15:59:20.711828 7336 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-02 15:59:20.711872 7336 UserTrace BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-02 15:59:20.711902 7336 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-02 15:59:20.711934 7336 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-02 15:59:20.711986 7336 UserTrace BIP5841I: ''Offset: 0. Found fixed length value: ' 12345.00' for element 'POINTS'.''
2013-04-02 15:59:20.712032 7336 UserTrace BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-02 15:59:20.712084 7336 UserTrace BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-02 15:59:20.712116 7336 UserTrace BIP5841I: ''Offset: 9. Found fixed length value: '2013-01-20' for element 'CREATED_AT'.''
2013-04-02 15:59:20.712154 7336 UserTrace BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-02 15:59:20.712184 7336 UserTrace BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-02 15:59:20.712216 7336 UserTrace BIP5841I: ''Offset: 19. Found fixed length value: ' 130' for element 'PT_CODE'.''
2013-04-02 15:59:20.712272 7336 UserTrace BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-02 15:59:20.712306 7336 UserTrace BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-02 15:59:20.712338 7336 UserTrace BIP5841I: ''Offset: 23. Found fixed length value: ' 44263559' for element 'MEMS_ID'.''
2013-04-02 15:59:20.712372 7336 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-02 15:59:20.712466 7336 UserTrace BIP5841I: ''Offset: 35. Did not find terminator for '(null)'. Expected terminator list is '%CR;%LF;'.''
2013-04-02 15:59:20.712500 7336 UserTrace BIP5843E: ''Terminator is missing for element '#xscd(/schemaElement::REWARDS/type::0/model::sequence/schemaElement::body/type::0/model::sequence)'.''
2013-04-02 15:59:20.712524 7336 UserTrace BIP5807E: The DFDL parser signalled that a processing error occurred.
The message from the DFDL parser is:
'CTDP3042E: Terminator is missing for element '#xscd(/schemaElement::REWARDS/type::0/model::sequence/schemaElement::body/type::0/model::sequence)'.'
Processing errors occurred during the parsing a DFDL message.
Review and resolve the problems indicated in the message from the DFDL parser.
2013-04-02 15:59:20.712784 7336 UserTrace BIP2231E: Error detected whilst processing a message in node 'RewardsFromAS400.File Input'.
The message broker detected an error whilst processing a message in node 'RewardsFromAS400.File Input'. The message has been augmented with an exception list and has been propagated to the node's failure terminal for further processing.
See the following messages for details of the error.
2013-04-02 15:59:20.712808 7336 RecoverableException BIP2230E: Error detected whilst processing a message in node 'RewardsFromAS400.Compute'.
The message broker detected an error whilst processing a message in node 'RewardsFromAS400.Compute'. An exception has been thrown to cut short the processing of the message.
See the following messages for details of the error.
2013-04-02 15:59:20.712826 7336 RecoverableException BIP2488E: ('.RewardsFromAS400_Compute.Main', '3.6') Error detected whilst executing the SQL statement ''SET OutputRoot.XMLNSC = InputRoot.DFDL;''.
The message broker detected an error whilst executing the given statement. An exception has been thrown to cut short the SQL program.
See the following messages for details of the error.
2013-04-02 15:59:20.712842 7336 ParserException BIP5803E: DFDL parsing was stopped due to errors occurring.
Errors have occurred during the parsing of a DFDL message. This has caused parsing to stop.
Review further error messages for an indication to the cause of the errors.
2013-04-02 15:59:20.712856 7336 ParserException BIP5807E: The DFDL parser signalled that a processing error occurred.
The message from the DFDL parser is:
'CTDP3042E: Terminator is missing for element '#xscd(/schemaElement::REWARDS/type::0/model::sequence/schemaElement::body/type::0/model::sequence)'.'
Processing errors occurred during the parsing a DFDL message.
Review and resolve the problems indicated in the message from the DFDL parser.
2013-04-02 15:59:20.713014 7336 UserTrace BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''1'' obtained from file ''C:\Userss\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''0'' to terminal ''catch''.
The FileInput node read a record from the file, and will propagate it to the named terminal.
No action is required.
2013-04-02 15:59:20.713072 7336 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace1': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-02 15:59:20.713184 7336 UserTrace BIP4060I: Data ''( ['GENERICROOT' : 0xbd4eee0]
(0x01000000:Name):Properties = ( ['GENERICPROPERTYPARSER' : 0xbeed6f0]
(0x03000000:NameValue):MessageSet = '' (CHARACTER)
(0x03000000:NameValue):MessageType = '{}:REWARDS' (CHARACTER)
(0x03000000:NameValue):MessageFormat = '' (CHARACTER)
(0x03000000:NameValue):Encoding = 546 (INTEGER)
(0x03000000:NameValue):CodedCharSetId = 437 (INTEGER)
(0x03000000:NameValue):Transactional = FALSE (BOOLEAN)
(0x03000000:NameValue):Persistence = FALSE (BOOLEAN)
(0x03000000:NameValue):CreationTime = GMTTIMESTAMP '2013-04-02 22:59:20.709' (GMTTIMESTAMP)
(0x03000000:NameValue):ExpirationTime = -1 (INTEGER)
(0x03000000:NameValue):Priority = 0 (INTEGER)
(0x03000000:NameValue):ReplyIdentifier = X'' (BLOB)
(0x03000000:NameValue):ReplyProtocol = 'ADAPTOR' (CHARACTER)
(0x03000000:NameValue):Topic = NULL
(0x03000000:NameValue):ContentType = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceType = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceToken = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourcePassword = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceIssuedBy = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedType = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedToken = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedPassword = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedIssuedBy = '' (CHARACTER)
)
(0x01000000:Name):DFDL = ( ['dfdl' : 0xbed3dc0]
(0x01000000:Name):REWARDS = (
(0x01000000:Name):body = (
(0x03000000:NameValue):POINTS = ' 12345.00' (CHARACTER)
(0x03000000:NameValue):CREATED_AT = '2013-01-20' (CHARACTER)
(0x03000000:NameValue):PT_CODE = ' 130' (CHARACTER)
(0x03000000:NameValue):MEMS_ID = ' 44263559' (CHARACTER)
)
)
)
)
'' from trace node 'RewardsFromAS400.Trace1'.
The trace node 'RewardsFromAS400.Trace1' has output the specified trace data.
This is an information message provided by the message flow designer. The user response will be determined by the local environment.
2013-04-02 15:59:20.713208 7336 UserTrace BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace1'.
The trace node 'RewardsFromAS400.Trace1' has received a message and is propagating it to any nodes connected to its output terminal.
No user action required.
2013-04-02 15:59:20.713340 7336 UserTrace BIP11506I: Committed a local transaction.
A local transaction has been committed for work done on the message flow thread.
2013-04-02 15:59:20.713432 7336 UserTrace BIP11501I: Received data from input node ''File Input''.
The input node ''File Input'' has received data and has propagated it to the message flow ''RewardsFromAS400''.
2013-04-02 15:59:20.713518 7336 UserTrace BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50e90, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
Entered the specified function with the specified parameters.
No user action required.
2013-04-02 15:59:20.713542 7336 UserTrace BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
About to exit the specified the function with the specified result.
No user action required.
2013-04-02 15:59:20.713558 7336 UserTrace BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '16777216'.
Element ''Type'' has been changed to '16777216'.
No user action required.
2013-04-02 15:59:20.713578 7336 UserTrace BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''File''.
Element ''Name'' has been changed to ''File''.
No user action required.
2013-04-02 15:59:20.713606 7336 UserTrace BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50f20, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
Entered the specified function with the specified parameters.
No user action required.
2013-04-02 15:59:20.713622 7336 UserTrace BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
About to exit the specified the function with the specified result.
No user action required.
2013-04-02 15:59:20.713636 7336 UserTrace BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '50331648'.
Element ''Type'' has been changed to '50331648'.
No user action required.
2013-04-02 15:59:20.713652 7336 UserTrace BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''LastModified''.
Element ''Name'' has been changed to ''LastModified''.
No user action required.
2013-04-02 15:59:20.713686 7336 UserTrace BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50f20, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
Entered the specified function with the specified parameters.
No user action required.
2013-04-02 15:59:20.713704 7336 UserTrace BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
About to exit the specified the function with the specified result.
No user action required.
2013-04-02 15:59:20.713718 7336 UserTrace BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '50331648'.
Element ''Type'' has been changed to '50331648'.
No user action required.
2013-04-02 15:59:20.713736 7336 UserTrace BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''Offset''.
Element ''Name'' has been changed to ''Offset''.
No user action required.
2013-04-02 15:59:20.713750 7336 UserTrace BIP4142I: Evaluating cniElementSet'IntegerValue'. Changing value from ''NULL integer'' to '35'.
Element ''IntegerValue'' has been changed to '35'.
No user action required.
2013-04-02 15:59:20.713770 7336 UserTrace BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50f20, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
Entered the specified function with the specified parameters.
No user action required.
2013-04-02 15:59:20.713786 7336 UserTrace BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
About to exit the specified the function with the specified result.
No user action required.
2013-04-02 15:59:20.713800 7336 UserTrace BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '50331648'.
Element ''Type'' has been changed to '50331648'.
No user action required.
2013-04-02 15:59:20.713816 7336 UserTrace BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''Record''.
Element ''Name'' has been changed to ''Record''.
No user action required.
2013-04-02 15:59:20.713832 7336 UserTrace BIP4142I: Evaluating cniElementSet'IntegerValue'. Changing value from ''NULL integer'' to '2'.
Element ''IntegerValue'' has been changed to '2'.
No user action required.
2013-04-02 15:59:20.713848 7336 UserTrace BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50f20, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
Entered the specified function with the specified parameters.
No user action required.
2013-04-02 15:59:20.713864 7336 UserTrace BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
About to exit the specified the function with the specified result.
No user action required.
2013-04-02 15:59:20.713878 7336 UserTrace BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '50331648'.
Element ''Type'' has been changed to '50331648'.
No user action required.
2013-04-02 15:59:20.713896 7336 UserTrace BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''Delimiter''.
Element ''Name'' has been changed to ''Delimiter''.
No user action required.
2013-04-02 15:59:20.713912 7336 UserTrace BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50f20, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
Entered the specified function with the specified parameters.
No user action required.
2013-04-02 15:59:20.713926 7336 UserTrace BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
About to exit the specified the function with the specified result.
No user action required.
2013-04-02 15:59:20.713942 7336 UserTrace BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '50331648'.
Element ''Type'' has been changed to '50331648'.
No user action required.
2013-04-02 15:59:20.713956 7336 UserTrace BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''IsEmpty''.
Element ''Name'' has been changed to ''IsEmpty''.
No user action required.
2013-04-02 15:59:20.713974 7336 UserTrace BIP4142I: Evaluating cniElementSet'BooleanValue'. Changing value from ''unknown'' to ''false''.
Element ''BooleanValue'' has been changed to ''false''.
No user action required.
2013-04-02 15:59:20.713994 7336 UserTrace BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)91ec0d0, (*ptr)bf50e90, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
Entered the specified function with the specified parameters.
No user action required.
2013-04-02 15:59:20.714010 7336 UserTrace BIP4145I: Exiting function 'cniCreateElementAsLastChild' with result: 'CCI_SUCCESS'(0).
About to exit the specified the function with the specified result.
No user action required.
2013-04-02 15:59:20.714026 7336 UserTrace BIP4142I: Evaluating cniElementSet'Type'. Changing value from '0' to '16777216'.
Element ''Type'' has been changed to '16777216'.
No user action required.
2013-04-02 15:59:20.714040 7336 UserTrace BIP4142I: Evaluating cniElementSet'Name'. Changing value from '''' to ''Wildcard''.
Element ''Name'' has been changed to ''Wildcard''.
No user action required.
2013-04-02 15:59:20.714110 7336 UserTrace BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''2'' obtained from file ''C:\Userss\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''35'' to terminal ''out''.
The FileInput node read a record from the file, and will propagate it to the named terminal.
No action is required.
2013-04-02 15:59:20.714134 7336 UserTrace BIP3907I: Message received and propagated to 'out' terminal of input node 'RewardsFromAS400.File Input'.
2013-04-02 15:59:20.714172 7336 UserTrace BIP6063I: Node 'RewardsFromAS400.File Input' used parser type ''Properties'' to process the input stream, beginning at offset '0'.
2013-04-02 15:59:20.714220 7336 UserTrace BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''DFDL'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''DFDL'' from the previous parser.
2013-04-02 15:59:20.714252 7336 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-02 15:59:20.714278 7336 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''SET OutputRoot.XMLNSC = InputRoot.DFDL;'' at ('.RewardsFromAS400_Compute.Main', '3.6').
2013-04-02 15:59:20.714300 7336 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL'' at ('.RewardsFromAS400_Compute.Main', '3.30'). This resolved to ''InputRoot.DFDL''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='DFDL' Value=NULL''.
2013-04-02 15:59:20.714334 7336 UserTrace BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL'' to ''OutputRoot.XMLNSC''.
2013-04-02 15:59:20.714380 7336 UserTrace BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-02 15:59:20.714440 7336 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-02 15:59:20.714480 7336 UserTrace BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-02 15:59:20.714508 7336 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-02 15:59:20.714538 7336 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-02 15:59:20.714590 7336 UserTrace BIP5841I: ''Offset: 0. Found fixed length value: '%CR;%LF; 3.' for element 'POINTS'.''
2013-04-02 15:59:20.714624 7336 UserTrace BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-02 15:59:20.714658 7336 UserTrace BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-02 15:59:20.714688 7336 UserTrace BIP5841I: ''Offset: 9. Found fixed length value: '312012-12-' for element 'CREATED_AT'.''
2013-04-02 15:59:20.714718 7336 UserTrace BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-02 15:59:20.714748 7336 UserTrace BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-02 15:59:20.714778 7336 UserTrace BIP5841I: ''Offset: 19. Found fixed length value: '20 1' for element 'PT_CODE'.''
2013-04-02 15:59:20.714808 7336 UserTrace BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-02 15:59:20.714838 7336 UserTrace BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-02 15:59:20.714868 7336 UserTrace BIP5841I: ''Offset: 23. Found fixed length value: '30 29792' for element 'MEMS_ID'.''
2013-04-02 15:59:20.714898 7336 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-02 15:59:20.714944 7336 UserTrace BIP5841I: ''Offset: 35. Did not find terminator for '(null)'. Expected terminator list is '%CR;%LF;'.''
2013-04-02 15:59:20.714976 7336 UserTrace BIP5843E: ''Terminator is missing for element '#xscd(/schemaElement::REWARDS/type::0/model::sequence/schemaElement::body/type::0/model::sequence)'.''
2013-04-02 15:59:20.715018 7336 UserTrace BIP5807E: The DFDL parser signalled that a processing error occurred.
The message from the DFDL parser is:
'CTDP3042E: Terminator is missing for element '#xscd(/schemaElement::REWARDS/type::0/model::sequence/schemaElement::body/type::0/model::sequence)'.'
Processing errors occurred during the parsing a DFDL message.
Review and resolve the problems indicated in the message from the DFDL parser.
2013-04-02 15:59:20.715196 7336 UserTrace BIP2231E: Error detected whilst processing a message in node 'RewardsFromAS400.File Input'.
The message broker detected an error whilst processing a message in node 'RewardsFromAS400.File Input'. The message has been augmented with an exception list and has been propagated to the node's failure terminal for further processing.
See the following messages for details of the error.
2013-04-02 15:59:20.715220 7336 RecoverableException BIP2230E: Error detected whilst processing a message in node 'RewardsFromAS400.Compute'.
The message broker detected an error whilst processing a message in node 'RewardsFromAS400.Compute'. An exception has been thrown to cut short the processing of the message.
See the following messages for details of the error.
2013-04-02 15:59:20.715232 7336 RecoverableException BIP2488E: ('.RewardsFromAS400_Compute.Main', '3.6') Error detected whilst executing the SQL statement ''SET OutputRoot.XMLNSC = InputRoot.DFDL;''.
The message broker detected an error whilst executing the given statement. An exception has been thrown to cut short the SQL program.
See the following messages for details of the error.
2013-04-02 15:59:20.715246 7336 ParserException BIP5803E: DFDL parsing was stopped due to errors occurring.
Errors have occurred during the parsing of a DFDL message. This has caused parsing to stop.
Review further error messages for an indication to the cause of the errors.
2013-04-02 15:59:20.715260 7336 ParserException BIP5807E: The DFDL parser signalled that a processing error occurred.
The message from the DFDL parser is:
'CTDP3042E: Terminator is missing for element '#xscd(/schemaElement::REWARDS/type::0/model::sequence/schemaElement::body/type::0/model::sequence)'.'
Processing errors occurred during the parsing a DFDL message.
Review and resolve the problems indicated in the message from the DFDL parser.
2013-04-02 15:59:20.715358 7336 UserTrace BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''2'' obtained from file ''C:\Userss\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''35'' to terminal ''catch''.
The FileInput node read a record from the file, and will propagate it to the named terminal.
No action is required.
2013-04-02 15:59:20.715396 7336 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace1': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-02 15:59:20.715498 7336 UserTrace BIP4060I: Data ''( ['GENERICROOT' : 0xbd4eee0]
(0x01000000:Name):Properties = ( ['GENERICPROPERTYPARSER' : 0xbeed6f0]
(0x03000000:NameValue):MessageSet = '' (CHARACTER)
(0x03000000:NameValue):MessageType = '{}:REWARDS' (CHARACTER)
(0x03000000:NameValue):MessageFormat = '' (CHARACTER)
(0x03000000:NameValue):Encoding = 546 (INTEGER)
(0x03000000:NameValue):CodedCharSetId = 437 (INTEGER)
(0x03000000:NameValue):Transactional = FALSE (BOOLEAN)
(0x03000000:NameValue):Persistence = FALSE (BOOLEAN)
(0x03000000:NameValue):CreationTime = GMTTIMESTAMP '2013-04-02 22:59:20.712999' (GMTTIMESTAMP)
(0x03000000:NameValue):ExpirationTime = -1 (INTEGER)
(0x03000000:NameValue):Priority = 0 (INTEGER)
(0x03000000:NameValue):ReplyIdentifier = X'' (BLOB)
(0x03000000:NameValue):ReplyProtocol = 'ADAPTOR' (CHARACTER)
(0x03000000:NameValue):Topic = NULL
(0x03000000:NameValue):ContentType = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceType = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceToken = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourcePassword = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceIssuedBy = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedType = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedToken = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedPassword = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedIssuedBy = '' (CHARACTER)
)
(0x01000000:Name):DFDL = ( ['dfdl' : 0xbed3dc0]
(0x01000000:Name):REWARDS = (
(0x01000000:Name):body = (
(0x03000000:NameValue):POINTS = '
3.' (CHARACTER)
(0x03000000:NameValue):CREATED_AT = '312012-12-' (CHARACTER)
(0x03000000:NameValue):PT_CODE = '20 1' (CHARACTER)
(0x03000000:NameValue):MEMS_ID = '30 29792' (CHARACTER)
)
)
)
)
'' from trace node 'RewardsFromAS400.Trace1'.
The trace node 'RewardsFromAS400.Trace1' has output the specified trace data.
This is an information message provided by the message flow designer. The user response will be determined by the local environment.
2013-04-02 15:59:20.715520 7336 UserTrace BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace1'.
The trace node 'RewardsFromAS400.Trace1' has received a message and is propagating it to any nodes connected to its output terminal.
No user action required.
2013-04-02 15:59:20.715598 7336 UserTrace BIP11506I: Committed a local transaction.
A local transaction has been committed for work done on the message flow thread. |
Sample input data:
12345.002013-01-20 130 44263559
3.312012-12-20 130 2979234
3.362012-10-20 130 26744330
Last edited by albert940 on Wed Apr 03, 2013 9:46 am; edited 1 time in total |
|
Back to top |
|
 |
goffinf |
Posted: Tue Apr 02, 2013 11:39 pm Post subject: |
|
|
Chevalier
Joined: 05 Nov 2005 Posts: 401
|
The error appears to relate to the fact that the expected CRLF terminator is missing. Are you sure that you are getting that from your AS400 file and not just LF ?
Fraser. |
|
Back to top |
|
 |
lancelotlinc |
Posted: Wed Apr 03, 2013 4:23 am Post subject: |
|
|
 Jedi Knight
Joined: 22 Mar 2010 Posts: 4941 Location: Bloomington, IL USA
|
|
Back to top |
|
 |
albert940 |
Posted: Wed Apr 03, 2013 9:43 am Post subject: |
|
|
Novice
Joined: 02 Apr 2013 Posts: 10
|
A batch job runs in AS400 which generates this flat file. I dont think this is a logical file. I will double check and confirm with the resource who provided me this file.
lancelotlinc : i was too quick to post this again. I will try to edit and include [c o d e] tags. |
|
Back to top |
|
 |
lancelotlinc |
Posted: Wed Apr 03, 2013 9:46 am Post subject: |
|
|
 Jedi Knight
Joined: 22 Mar 2010 Posts: 4941 Location: Bloomington, IL USA
|
albert940 wrote: |
lancelotlinc : i was too quick to post this again. I will try to edit and include [c o d e] tags. |
Thank you. _________________ http://leanpub.com/IIB_Tips_and_Tricks
Save $20: Coupon Code: MQSERIES_READER |
|
Back to top |
|
 |
kimbert |
Posted: Wed Apr 03, 2013 11:36 am Post subject: |
|
|
 Jedi Council
Joined: 29 Jul 2003 Posts: 5542 Location: Southampton
|
Thanks for a good problem description - and thanks also for editing your second post to fix the formatting.
As goffinf has pointed out, the problem is that the DFDL xsd defines a terminator for the REWARDS element. The input data received by the flow did not contain any such terminator, so the parser ( correctly ) has reported an error.
It is quite common for the trailing terminator to be missing from a data stream - so common that DFDL has a property specifically for this scenario. It is 'documentFinalTerminatorCanBeMissing' and it can only be set in the global format block of an XSD. Your XSD may not have a global format block - it may be inheriting all of its default property values from an IBM-defined xsd. If that is the case, then don't edit the IBM-defined XSD. Instead, you should create a global format block for your own XSD and then set the documentFinalTerminatorCanBeMissing property to 'yes' in that format block.
You may need to click the 'Show All Sections' button in order to see the correct options in the DFDL editor. |
|
Back to top |
|
 |
albert940 |
Posted: Wed Apr 03, 2013 3:27 pm Post subject: |
|
|
Novice
Joined: 02 Apr 2013 Posts: 10
|
Thanks for the quick reply kimbert. It did work after setting the documentFinalTerMinatorCanBeMissing Property to 'yes'. The 1st record got processed and the above error is gone.
But when it reaches 2nd record , the 'CR' and 'LF' are included in the first element of the 2nd record. The trace file error is below. I believe it is something to do with sequence 'terminator' property. Trying to debug.
Trace File:
Code: |
2013-04-03 16:19:31.561492 8464 UserTrace BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''1'' obtained from file ''C:\Userss\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''0'' to terminal ''out''.
The FileInput node read a record from the file, and will propagate it to the named terminal.
No action is required.
2013-04-03 16:19:31.563064 8464 UserTrace BIP3907I: Message received and propagated to 'out' terminal of input node 'RewardsFromAS400.File Input'.
2013-04-03 16:19:31.563154 8464 UserTrace BIP6063I: Node 'RewardsFromAS400.File Input' used parser type ''Properties'' to process the input stream, beginning at offset '0'.
2013-04-03 16:19:31.564206 8464 UserTrace BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''DFDL'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''DFDL'' from the previous parser.
2013-04-03 16:19:31.564260 8464 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-03 16:19:31.564288 8464 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''SET OutputRoot.XMLNSC = InputRoot.DFDL;'' at ('.RewardsFromAS400_Compute.Main', '3.6').
2013-04-03 16:19:31.564316 8464 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL'' at ('.RewardsFromAS400_Compute.Main', '3.30'). This resolved to ''InputRoot.DFDL''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='DFDL' Value=NULL''.
2013-04-03 16:19:31.564370 8464 UserTrace BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL'' to ''OutputRoot.XMLNSC''.
2013-04-03 16:19:31.564442 8464 UserTrace BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-03 16:19:31.564530 8464 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-03 16:19:31.564574 8464 UserTrace BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-03 16:19:31.564606 8464 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-03 16:19:31.564638 8464 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-03 16:19:31.564690 8464 UserTrace BIP5841I: ''Offset: 0. Found fixed length value: ' 12345.00' for element 'POINTS'.''
2013-04-03 16:19:31.564812 8464 UserTrace BIP5841I: ''Offset: 9. The simple content region of element 'POINTS' was converted to logical value '12345'. ''
2013-04-03 16:19:31.564854 8464 UserTrace BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-03 16:19:31.564888 8464 UserTrace BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-03 16:19:31.564918 8464 UserTrace BIP5841I: ''Offset: 9. Found fixed length value: '2013-01-20' for element 'CREATED_AT'.''
2013-04-03 16:19:31.564950 8464 UserTrace BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-03 16:19:31.564982 8464 UserTrace BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-03 16:19:31.565010 8464 UserTrace BIP5841I: ''Offset: 19. Found fixed length value: ' 130' for element 'PT_CODE'.''
2013-04-03 16:19:31.565088 8464 UserTrace BIP5841I: ''Offset: 23. The simple content region of element 'PT_CODE' was converted to logical value '130'. ''
2013-04-03 16:19:31.565148 8464 UserTrace BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-03 16:19:31.565182 8464 UserTrace BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-03 16:19:31.565212 8464 UserTrace BIP5841I: ''Offset: 23. Found fixed length value: ' 44263559' for element 'MEMS_ID'.''
2013-04-03 16:19:31.565290 8464 UserTrace BIP5841I: ''Offset: 35. The simple content region of element 'MEMS_ID' was converted to logical value '44263559'. ''
2013-04-03 16:19:31.565326 8464 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-03 16:19:31.565410 8464 UserTrace BIP5841I: ''Offset: 35. Did not find terminator for '(null)'. Expected terminator list is '%CR;%LF;'.''
2013-04-03 16:19:31.565444 8464 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'body'.''
2013-04-03 16:19:31.565472 8464 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'REWARDS'.''
2013-04-03 16:19:31.565500 8464 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''RETURN TRUE;'' at ('.RewardsFromAS400_Compute.Main', '4.1').
2013-04-03 16:19:31.565526 8464 UserTrace BIP4015I: Message propagated to the 'out' terminal of node 'RewardsFromAS400.Compute' with the following message trees: 'OutputLocalEnvironment, OutputRoot, OutputExceptionList'.
2013-04-03 16:19:31.565568 8464 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-03 16:19:31.565666 8464 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''ExceptionList'' at ('', '2.3'). This resolved to ''ExceptionList''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-03 16:19:31.565688 8464 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''LocalEnvironment'' at ('', '3.3'). This resolved to ''LocalEnvironment''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-03 16:19:31.565712 8464 UserTrace BIP4060I: Data ''( ['GENERICROOT' : 0xaa96630]
(0x01000000:Name ):Properties = ( ['MQPROPERTYPARSER' : 0xaa98c90]
(0x03000000:NameValue):MessageSet = NULL
(0x03000000:NameValue):MessageType = NULL
(0x03000000:NameValue):MessageFormat = NULL
(0x03000000:NameValue):Encoding = NULL
(0x03000000:NameValue):CodedCharSetId = NULL
(0x03000000:NameValue):Transactional = NULL
(0x03000000:NameValue):Persistence = NULL
(0x03000000:NameValue):CreationTime = NULL
(0x03000000:NameValue):ExpirationTime = NULL
(0x03000000:NameValue):Priority = NULL
(0x03000000:NameValue):ReplyIdentifier = NULL
(0x03000000:NameValue):ReplyProtocol = 'ADAPTOR' (CHARACTER)
(0x03000000:NameValue):Topic = NULL
(0x03000000:NameValue):ContentType = NULL
(0x03000000:NameValue):IdentitySourceType = NULL
(0x03000000:NameValue):IdentitySourceToken = NULL
(0x03000000:NameValue):IdentitySourcePassword = NULL
(0x03000000:NameValue):IdentitySourceIssuedBy = NULL
(0x03000000:NameValue):IdentityMappedType = NULL
(0x03000000:NameValue):IdentityMappedToken = NULL
(0x03000000:NameValue):IdentityMappedPassword = NULL
(0x03000000:NameValue):IdentityMappedIssuedBy = NULL
)
(0x01000000:Folder):XMLNSC = ( ['xmlnsc' : 0x1ff6440]
(0x01000000:Folder):REWARDS = (
(0x01000000:Folder):body = (
(0x03000000:PCDataField):POINTS = 12345 (DECIMAL)
(0x03000000:PCDataField):CREATED_AT = '2013-01-20' (CHARACTER)
(0x03000000:PCDataField):PT_CODE = 130 (DECIMAL)
(0x03000000:PCDataField):MEMS_ID = 44263559 (DECIMAL)
)
)
)
)
'' from trace node 'RewardsFromAS400.Trace2'.
The trace node 'RewardsFromAS400.Trace2' has output the specified trace data.
This is an information message provided by the message flow designer. The user response will be determined by the local environment.
2013-04-03 16:19:31.565732 8464 UserTrace BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace2'.
2013-04-03 16:19:31.569908 8464 UserTrace BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''2'' obtained from file ''C:\Userss\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''35'' to terminal ''out''.
The FileInput node read a record from the file, and will propagate it to the named terminal.
No action is required.
2013-04-03 16:19:31.569934 8464 UserTrace BIP3907I: Message received and propagated to 'out' terminal of input node 'RewardsFromAS400.File Input'.
2013-04-03 16:19:31.569976 8464 UserTrace BIP6063I: Node 'RewardsFromAS400.File Input' used parser type ''Properties'' to process the input stream, beginning at offset '0'.
2013-04-03 16:19:31.570024 8464 UserTrace BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''DFDL'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''DFDL'' from the previous parser.
2013-04-03 16:19:31.570058 8464 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-03 16:19:31.570082 8464 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''SET OutputRoot.XMLNSC = InputRoot.DFDL;'' at ('.RewardsFromAS400_Compute.Main', '3.6').
2013-04-03 16:19:31.570104 8464 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL'' at ('.RewardsFromAS400_Compute.Main', '3.30'). This resolved to ''InputRoot.DFDL''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='DFDL' Value=NULL''.
2013-04-03 16:19:31.570142 8464 UserTrace BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL'' to ''OutputRoot.XMLNSC''.
2013-04-03 16:19:31.570196 8464 UserTrace BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-03 16:19:31.570260 8464 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-03 16:19:31.570308 8464 UserTrace BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-03 16:19:31.570338 8464 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-03 16:19:31.570370 8464 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-03 16:19:31.570422 8464 UserTrace BIP5841I: ''Offset: 0. Found fixed length value: '%CR;%LF; 3.' for element 'POINTS'.''
2013-04-03 16:19:31.570468 8464 UserTrace BIP5841I: ''Offset: 9. The simple content region of element 'POINTS' was converted to logical value '3'. ''
2013-04-03 16:19:31.570506 8464 UserTrace BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-03 16:19:31.570540 8464 UserTrace BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-03 16:19:31.570572 8464 UserTrace BIP5841I: ''Offset: 9. Found fixed length value: '312012-12-' for element 'CREATED_AT'.''
2013-04-03 16:19:31.570604 8464 UserTrace BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-03 16:19:31.570636 8464 UserTrace BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-03 16:19:31.570666 8464 UserTrace BIP5841I: ''Offset: 19. Found fixed length value: '20 1' for element 'PT_CODE'.''
2013-04-03 16:19:31.570702 8464 UserTrace BIP5841I: ''Offset: 23. The simple content region of element 'PT_CODE' was converted to logical value '2001'. ''
2013-04-03 16:19:31.570734 8464 UserTrace BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-03 16:19:31.570764 8464 UserTrace BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-03 16:19:31.570796 8464 UserTrace BIP5841I: ''Offset: 23. Found fixed length value: '30 29792' for element 'MEMS_ID'.''
2013-04-03 16:19:31.570834 8464 UserTrace BIP5841I: ''Offset: 35. The simple content region of element 'MEMS_ID' was converted to logical value '300000029792'. ''
2013-04-03 16:19:31.570892 8464 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-03 16:19:31.570946 8464 UserTrace BIP5841I: ''Offset: 35. Did not find terminator for '(null)'. Expected terminator list is '%CR;%LF;'.''
2013-04-03 16:19:31.570976 8464 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'body'.''
2013-04-03 16:19:31.571006 8464 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'REWARDS'.''
2013-04-03 16:19:31.571036 8464 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''RETURN TRUE;'' at ('.RewardsFromAS400_Compute.Main', '4.1').
2013-04-03 16:19:31.571060 8464 UserTrace BIP4015I: Message propagated to the 'out' terminal of node 'RewardsFromAS400.Compute' with the following message trees: 'OutputLocalEnvironment, OutputRoot, OutputExceptionList'.
2013-04-03 16:19:31.571090 8464 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-03 16:19:31.571180 8464 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''ExceptionList'' at ('', '2.3'). This resolved to ''ExceptionList''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-03 16:19:31.571202 8464 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''LocalEnvironment'' at ('', '3.3'). This resolved to ''LocalEnvironment''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-03 16:19:31.571226 8464 UserTrace BIP4060I: Data ''( ['GENERICROOT' : 0xaa96630]
(0x01000000:Name ):Properties = ( ['MQPROPERTYPARSER' : 0xaa98c90]
(0x03000000:NameValue):MessageSet = NULL
(0x03000000:NameValue):MessageType = NULL
(0x03000000:NameValue):MessageFormat = NULL
(0x03000000:NameValue):Encoding = NULL
(0x03000000:NameValue):CodedCharSetId = NULL
(0x03000000:NameValue):Transactional = NULL
(0x03000000:NameValue):Persistence = NULL
(0x03000000:NameValue):CreationTime = NULL
(0x03000000:NameValue):ExpirationTime = NULL
(0x03000000:NameValue):Priority = NULL
(0x03000000:NameValue):ReplyIdentifier = NULL
(0x03000000:NameValue):ReplyProtocol = 'ADAPTOR' (CHARACTER)
(0x03000000:NameValue):Topic = NULL
(0x03000000:NameValue):ContentType = NULL
(0x03000000:NameValue):IdentitySourceType = NULL
(0x03000000:NameValue):IdentitySourceToken = NULL
(0x03000000:NameValue):IdentitySourcePassword = NULL
(0x03000000:NameValue):IdentitySourceIssuedBy = NULL
(0x03000000:NameValue):IdentityMappedType = NULL
(0x03000000:NameValue):IdentityMappedToken = NULL
(0x03000000:NameValue):IdentityMappedPassword = NULL
(0x03000000:NameValue):IdentityMappedIssuedBy = NULL
)
(0x01000000:Folder):XMLNSC = ( ['xmlnsc' : 0x1ff6440]
(0x01000000:Folder):REWARDS = (
(0x01000000:Folder):body = (
(0x03000000:PCDataField):POINTS = 3 (DECIMAL)
(0x03000000:PCDataField):CREATED_AT = '312012-12-' (CHARACTER)
(0x03000000:PCDataField):PT_CODE = 2001 (DECIMAL)
(0x03000000:PCDataField):MEMS_ID = 300000029792 (DECIMAL)
)
)
)
)
'' from trace node 'RewardsFromAS400.Trace2'.
The trace node 'RewardsFromAS400.Trace2' has output the specified trace data.
This is an information message provided by the message flow designer. The user response will be determined by the local environment.
2013-04-03 16:19:31.571248 8464 UserTrace BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace2'.
The trace node 'RewardsFromAS400.Trace2' has received a message and is propagating it to any nodes connected to its output terminal.
No user action required.
2013-04-03 16:19:31.571370 8464 UserTrace BIP2638I: The MQ output node 'RewardsFromAS400.MQ Output' attempted to write a message to queue ''SAMPLE_IN'' connected to queue manager ''''. The MQCC was '0' and the MQRC was '0'.
2013-04-03 16:19:31.571394 8464 UserTrace BIP2622I: Message successfully output by output node 'RewardsFromAS400.MQ Output' to queue ''SAMPLE_IN'' on queue manager ''''.
2013-04-03 16:19:31.571476 8464 UserTrace BIP11506I: Committed a local transaction.
A local transaction has been committed for work done on the message flow thread.
2013-04-03 16:19:31.571540 8464 UserTrace BIP11501I: Received data from input node ''File Input''.
The input node ''File Input'' has received data and has propagated it to the message flow ''RewardsFromAS400''.
2013-04-03 16:19:31.571620 8464 UserTrace BIP4144I: Entered function 'cniCreateElementAsLastChild'((*ptr)b45bff0, (*ptr)aae2f80, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A').
|
|
|
Back to top |
|
 |
kimbert |
Posted: Thu Apr 04, 2013 12:14 pm Post subject: |
|
|
 Jedi Council
Joined: 29 Jul 2003 Posts: 5542 Location: Southampton
|
Quote: |
It did work after setting the documentFinalTerMinatorCanBeMissing Property to 'yes'. The 1st record got processed and the above error is gone.
But when it reaches 2nd record , the 'CR' and 'LF' are included in the first element of the 2nd record. |
That's interesting. It looks as if that terminator was not, in fact, missing from the data. The DFDL mnemonic %CR;%LF; should match a carriage-return and line-feed pair. The second trace claims that this was found at offset 35 ( when parsing the second message from the file ).
At this point I would inspect the actual bytes being sent, and compare them with the DFDL model. You could easily do that by parsing using the BLOB domain and putting in a Trace node.
One possible fix would be to set the terminator to %NL; which will match a CR/LF pair as well as any other line terminator. But I don't advise you to try that until you have checked the actual bytes received. |
|
Back to top |
|
 |
albert940 |
Posted: Thu Apr 04, 2013 1:04 pm Post subject: |
|
|
Novice
Joined: 02 Apr 2013 Posts: 10
|
I tried both options.
Using the BLOB domain, i counted the length of input data and it appears to be 35 which is correct. The trace file is below.
Code: |
The message broker received a message that requires the handling of data of type ''BLOB'', but the broker does not have the capability to handle data of this type.
Check both the message being sent to the message broker and the configuration data for the node. References to the unsupported data type must be removed if the message is to be processed by the broker.
2013-04-04 13:37:58.890208 6692 UserTrace BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''BLOB'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''NONE'' from the previous parser.
2013-04-04 13:37:58.890236 6692 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890320 6692 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace': Evaluating expression ''ExceptionList'' at ('', '2.3'). This resolved to ''ExceptionList''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890340 6692 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace': Evaluating expression ''LocalEnvironment'' at ('', '3.3'). This resolved to ''LocalEnvironment''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890388 6692 UserTrace BIP4060I: Data ''( ['GENERICROOT' : 0x113145f0]
(0x01000000:Name):Properties = ( ['GENERICPROPERTYPARSER' : 0xacf4fb0]
(0x03000000:NameValue):MessageSet = '' (CHARACTER)
(0x03000000:NameValue):MessageType = '' (CHARACTER)
(0x03000000:NameValue):MessageFormat = '' (CHARACTER)
(0x03000000:NameValue):Encoding = 546 (INTEGER)
(0x03000000:NameValue):CodedCharSetId = 437 (INTEGER)
(0x03000000:NameValue):Transactional = FALSE (BOOLEAN)
(0x03000000:NameValue):Persistence = FALSE (BOOLEAN)
(0x03000000:NameValue):CreationTime = GMTTIMESTAMP '2013-04-04 20:37:58.889' (GMTTIMESTAMP)
(0x03000000:NameValue):ExpirationTime = -1 (INTEGER)
(0x03000000:NameValue):Priority = 0 (INTEGER)
(0x03000000:NameValue):ReplyIdentifier = X'' (BLOB)
(0x03000000:NameValue):ReplyProtocol = 'ADAPTOR' (CHARACTER)
(0x03000000:NameValue):Topic = NULL
(0x03000000:NameValue):ContentType = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceType = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceToken = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourcePassword = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceIssuedBy = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedType = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedToken = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedPassword = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedIssuedBy = '' (CHARACTER)
)
(0x01000000:Name):BLOB = ( ['none' : 0xaa91920]
(0x03000000:NameValue):UnknownParserName = 'BLOB' (CHARACTER)
(0x03000000:NameValue):BLOB = X'3339333437330d0a2020202020202e3030323031322d31302d30352031333020202020' (BLOB)
)
)
( ['MQROOT' : 0x11314920]
(0x01000000:Name):File = (
(0x03000000:NameValue):Directory = 'C:\Users\callipuram\Documents\GEMINI_PROJECT\INT41\SampleCSVFiles' (CHARACTER)
(0x03000000:NameValue):Name = 'sqlexec1.txt' (CHARACTER)
(0x03000000:NameValue):LastModified = GMTTIMESTAMP '2013-04-02 23:59:34.602' (GMTTIMESTAMP)
(0x03000000:NameValue):TimeStamp = '20130404_203754_674357' (CHARACTER)
(0x03000000:NameValue):Offset = 140 (INTEGER)
(0x03000000:NameValue):Record = 5 (INTEGER)
(0x03000000:NameValue):Delimiter = NULL
(0x03000000:NameValue):IsEmpty = FALSE (BOOLEAN)
)
(0x01000000:Name):Wildcard = (
(0x03000000:NameValue):WildcardMatch = 'sqlexec1' (CHARACTER)
)
)
'' from trace node 'RewardsFromAS400.Trace'.
The trace node 'RewardsFromAS400.Trace' has output the specified trace data.
This is an information message provided by the message flow designer. The user response will be determined by the local environment.
2013-04-04 13:37:58.890408 6692 UserTrace BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace'.
The trace node 'RewardsFromAS400.Trace' has received a message and is propagating it to any nodes connected to its output terminal.
No user action required.
2013-04-04 13:37:58.890444 6692 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-04 13:37:58.890468 6692 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''DECLARE I INTEGER LENGTH(InputRoot.BLOB.BLOB);'' at ('.RewardsFromAS400_Compute.Main', '5.6').
2013-04-04 13:37:58.890492 6692 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot.BLOB.BLOB'' at ('.RewardsFromAS400_Compute.Main', '5.31'). This resolved to ''InputRoot.BLOB.BLOB''. The result was ''X'3339333437330d0a2020202020202e3030323031322d31302d30352031333020202020'''.
2013-04-04 13:37:58.890520 6692 UserTrace BIP2539I: Node '': Evaluating expression ''LENGTH(InputRoot.BLOB.BLOB)'' at ('.RewardsFromAS400_Compute.Main', '5.24'). This resolved to ''LENGTH(X'3339333437330d0a2020202020202e3030323031322d31302d30352031333020202020')''. The result was ''35''.
2013-04-04 13:37:58.890548 6692 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''SET OutputRoot = InputRoot;'' at ('.RewardsFromAS400_Compute.Main', '6.6').
2013-04-04 13:37:58.890564 6692 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot'' at ('.RewardsFromAS400_Compute.Main', '6.23'). This resolved to ''InputRoot''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890592 6692 UserTrace BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot'' to ''OutputRoot''.
2013-04-04 13:37:58.890616 6692 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''RETURN TRUE;'' at ('.RewardsFromAS400_Compute.Main', '7.1').
2013-04-04 13:37:58.890740 6692 UserTrace BIP4015I: Message propagated to the 'out' terminal of node 'RewardsFromAS400.Compute' with the following message trees: 'OutputLocalEnvironment, OutputRoot, OutputExceptionList'.
2013-04-04 13:37:58.890772 6692 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890852 6692 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''ExceptionList'' at ('', '2.3'). This resolved to ''ExceptionList''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890872 6692 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''LocalEnvironment'' at ('', '3.3'). This resolved to ''LocalEnvironment''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:37:58.890896 6692 UserTrace BIP4060I: Data ''( ['GENERICROOT' : 0xa9fae00]
(0x01000000:Name):Properties = ( ['GENERICPROPERTYPARSER' : 0xacf63d0]
(0x03000000:NameValue):MessageSet = '' (CHARACTER)
(0x03000000:NameValue):MessageType = '' (CHARACTER)
(0x03000000:NameValue):MessageFormat = '' (CHARACTER)
(0x03000000:NameValue):Encoding = 546 (INTEGER)
(0x03000000:NameValue):CodedCharSetId = 437 (INTEGER)
(0x03000000:NameValue):Transactional = FALSE (BOOLEAN)
(0x03000000:NameValue):Persistence = FALSE (BOOLEAN)
(0x03000000:NameValue):CreationTime = GMTTIMESTAMP '2013-04-04 20:37:58.889' (GMTTIMESTAMP)
(0x03000000:NameValue):ExpirationTime = -1 (INTEGER)
(0x03000000:NameValue):Priority = 0 (INTEGER)
(0x03000000:NameValue):ReplyIdentifier = X'' (BLOB)
(0x03000000:NameValue):ReplyProtocol = 'ADAPTOR' (CHARACTER)
(0x03000000:NameValue):Topic = NULL
(0x03000000:NameValue):ContentType = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceType = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceToken = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourcePassword = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceIssuedBy = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedType = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedToken = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedPassword = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedIssuedBy = '' (CHARACTER)
)
(0x01000000:Name):BLOB = ( ['none' : 0xab5caf0]
(0x03000000:NameValue):UnknownParserName = 'BLOB' (CHARACTER)
(0x03000000:NameValue):BLOB = X'3339333437330d0a2020202020202e3030323031322d31302d30352031333020202020' (BLOB)
)
)
'' from trace node 'RewardsFromAS400.Trace2'.
The trace node 'RewardsFromAS400.Trace2' has output the specified trace data.
This is an information message provided by the message flow designer. The user response will be determined by the local environment.
2013-04-04 13:37:58.890912 6692 UserTrace BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace2'.
The trace node 'RewardsFromAS400.Trace2' has received a message and is propagating it to any nodes connected to its output terminal.
No user action required.
2013-04-04 13:37:58.890964 6692 UserTrace BIP2638I: The MQ output node 'RewardsFromAS400.MQ Output' attempted to write a message to queue ''SAMPLE_IN'' connected to queue manager ''''. The MQCC was '0' and the MQRC was '0'.
2013-04-04 13:37:58.890984 6692 UserTrace BIP2622I: Message successfully output by output node 'RewardsFromAS400.MQ Output' to queue ''SAMPLE_IN'' on queue manager ''''.
2013-04-04 13:37:58.891048 6692 UserTrace BIP11506I: Committed a local transaction. |
Tried using the '%NL' terminator. Below is the trace. Surprisingly no change and it is still taking 'CR' and 'LF'. It si working in DFDL Test client but not at run time which is weird.
Trace file when using '%NL'.
Code: |
2013-04-04 13:44:26.464862 8144 UserTrace BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''2'' obtained from file ''C:\Users\callipuram\Documents\GEMINI_PROJECT\INT41\SampleCSVFiles\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''35'' to terminal ''out''.
The FileInput node read a record from the file, and will propagate it to the named terminal.
No action is required.
2013-04-04 13:44:26.464888 8144 UserTrace BIP3907I: Message received and propagated to 'out' terminal of input node 'RewardsFromAS400.File Input'.
2013-04-04 13:44:26.464918 8144 UserTrace BIP6063I: Node 'RewardsFromAS400.File Input' used parser type ''Properties'' to process the input stream, beginning at offset '0'.
2013-04-04 13:44:26.464962 8144 UserTrace BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''DFDL'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''DFDL'' from the previous parser.
2013-04-04 13:44:26.464990 8144 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.465086 8144 UserTrace BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-04 13:44:26.465138 8144 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-04 13:44:26.465178 8144 UserTrace BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-04 13:44:26.465204 8144 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-04 13:44:26.465234 8144 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-04 13:44:26.465280 8144 UserTrace BIP5841I: ''Offset: 0. Found fixed length value: '%CR;%LF; 3.' for element 'POINTS'.''
2013-04-04 13:44:26.465322 8144 UserTrace BIP5841I: ''Offset: 9. The simple content region of element 'POINTS' was converted to logical value '3'. ''
2013-04-04 13:44:26.465356 8144 UserTrace BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-04 13:44:26.465388 8144 UserTrace BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-04 13:44:26.465416 8144 UserTrace BIP5841I: ''Offset: 9. Found fixed length value: '312012-12-' for element 'CREATED_AT'.''
2013-04-04 13:44:26.465446 8144 UserTrace BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-04 13:44:26.465476 8144 UserTrace BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-04 13:44:26.465504 8144 UserTrace BIP5841I: ''Offset: 19. Found fixed length value: '20 1' for element 'PT_CODE'.''
2013-04-04 13:44:26.465536 8144 UserTrace BIP5841I: ''Offset: 23. The simple content region of element 'PT_CODE' was converted to logical value '2001'. ''
2013-04-04 13:44:26.465568 8144 UserTrace BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-04 13:44:26.465598 8144 UserTrace BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-04 13:44:26.465628 8144 UserTrace BIP5841I: ''Offset: 23. Found fixed length value: '30 29792' for element 'MEMS_ID'.''
2013-04-04 13:44:26.465662 8144 UserTrace BIP5841I: ''Offset: 35. The simple content region of element 'MEMS_ID' was converted to logical value '300000029792'. ''
2013-04-04 13:44:26.465694 8144 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-04 13:44:26.465742 8144 UserTrace BIP5841I: ''Offset: 35. Did not find terminator for '(null)'. Expected terminator list is '%NL;'.''
2013-04-04 13:44:26.465770 8144 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'body'.''
2013-04-04 13:44:26.465800 8144 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'REWARDS'.''
2013-04-04 13:44:26.465840 8144 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace': Evaluating expression ''ExceptionList'' at ('', '2.3'). This resolved to ''ExceptionList''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.465860 8144 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace': Evaluating expression ''LocalEnvironment'' at ('', '3.3'). This resolved to ''LocalEnvironment''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.465908 8144 UserTrace BIP4060I: Data ''( ['GENERICROOT' : 0xaa52510]
(0x01000000:Name):Properties = ( ['GENERICPROPERTYPARSER' : 0xacf59c0]
(0x03000000:NameValue):MessageSet = '' (CHARACTER)
(0x03000000:NameValue):MessageType = '{}:REWARDS' (CHARACTER)
(0x03000000:NameValue):MessageFormat = '' (CHARACTER)
(0x03000000:NameValue):Encoding = 546 (INTEGER)
(0x03000000:NameValue):CodedCharSetId = 437 (INTEGER)
(0x03000000:NameValue):Transactional = FALSE (BOOLEAN)
(0x03000000:NameValue):Persistence = FALSE (BOOLEAN)
(0x03000000:NameValue):CreationTime = GMTTIMESTAMP '2013-04-04 20:44:26.464001' (GMTTIMESTAMP)
(0x03000000:NameValue):ExpirationTime = -1 (INTEGER)
(0x03000000:NameValue):Priority = 0 (INTEGER)
(0x03000000:NameValue):ReplyIdentifier = X'' (BLOB)
(0x03000000:NameValue):ReplyProtocol = 'ADAPTOR' (CHARACTER)
(0x03000000:NameValue):Topic = NULL
(0x03000000:NameValue):ContentType = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceType = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceToken = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourcePassword = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceIssuedBy = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedType = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedToken = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedPassword = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedIssuedBy = '' (CHARACTER)
)
(0x01000000:Name):DFDL = ( ['dfdl' : 0x11071a30]
(0x01000000:Name):REWARDS = (
(0x01000000:Name):body = (
(0x03000000:NameValue):POINTS = 3 (DECIMAL)
(0x03000000:NameValue):CREATED_AT = '312012-12-' (CHARACTER)
(0x03000000:NameValue):PT_CODE = 2001 (DECIMAL)
(0x03000000:NameValue):MEMS_ID = 300000029792 (DECIMAL)
)
)
)
)
( ['MQROOT' : 0xaa521e0]
(0x01000000:Name):File = (
(0x03000000:NameValue):Directory = 'C:\Users\callipuram\Documents\GEMINI_PROJECT\INT41\SampleCSVFiles' (CHARACTER)
(0x03000000:NameValue):Name = 'sqlexec1.txt' (CHARACTER)
(0x03000000:NameValue):LastModified = GMTTIMESTAMP '2013-04-02 23:59:34.602' (GMTTIMESTAMP)
(0x03000000:NameValue):TimeStamp = '20130404_204422_240645' (CHARACTER)
(0x03000000:NameValue):Offset = 35 (INTEGER)
(0x03000000:NameValue):Record = 2 (INTEGER)
(0x03000000:NameValue):Delimiter = NULL
(0x03000000:NameValue):IsEmpty = FALSE (BOOLEAN)
)
(0x01000000:Name):Wildcard = (
(0x03000000:NameValue):WildcardMatch = 'sqlexec1' (CHARACTER)
)
)
'' from trace node 'RewardsFromAS400.Trace'.
The trace node 'RewardsFromAS400.Trace' has output the specified trace data.
This is an information message provided by the message flow designer. The user response will be determined by the local environment.
2013-04-04 13:44:26.465930 8144 UserTrace BIP4067I: Message propagated to output terminal for trace node 'RewardsFromAS400.Trace'.
The trace node 'RewardsFromAS400.Trace' has received a message and is propagating it to any nodes connected to its output terminal.
No user action required.
2013-04-04 13:44:26.465972 8144 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-04 13:44:26.465996 8144 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''DECLARE I INTEGER LENGTH(InputRoot.BLOB.BLOB);'' at ('.RewardsFromAS400_Compute.Main', '5.6').
2013-04-04 13:44:26.466014 8144 UserTrace BIP2543I: Node '': ('.RewardsFromAS400_Compute.Main', '5.31') : Failed to navigate to path element number '2' because it does not exist.
2013-04-04 13:44:26.466044 8144 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot.BLOB.BLOB'' at ('.RewardsFromAS400_Compute.Main', '5.31'). This resolved to ''InputRoot.BLOB.BLOB''. The result was ''NULL''.
2013-04-04 13:44:26.466070 8144 UserTrace BIP2539I: Node '': Evaluating expression ''LENGTH(InputRoot.BLOB.BLOB)'' at ('.RewardsFromAS400_Compute.Main', '5.24'). This resolved to ''LENGTH(NULL)''. The result was ''NULL''.
2013-04-04 13:44:26.466098 8144 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''SET OutputRoot = InputRoot;'' at ('.RewardsFromAS400_Compute.Main', '6.6').
2013-04-04 13:44:26.466118 8144 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot'' at ('.RewardsFromAS400_Compute.Main', '6.23'). This resolved to ''InputRoot''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.466142 8144 UserTrace BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot'' to ''OutputRoot''.
2013-04-04 13:44:26.466178 8144 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''RETURN TRUE;'' at ('.RewardsFromAS400_Compute.Main', '7.1').
2013-04-04 13:44:26.466214 8144 UserTrace BIP4015I: Message propagated to the 'out' terminal of node 'RewardsFromAS400.Compute' with the following message trees: 'OutputLocalEnvironment, OutputRoot, OutputExceptionList'.
2013-04-04 13:44:26.466240 8144 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''Root'' at ('', '1.3'). This resolved to ''Root''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.466328 8144 UserTrace BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-04 13:44:26.466378 8144 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-04 13:44:26.466416 8144 UserTrace BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-04 13:44:26.466444 8144 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-04 13:44:26.466474 8144 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-04 13:44:26.466514 8144 UserTrace BIP5841I: ''Offset: 0. Found fixed length value: '%CR;%LF; 3.' for element 'POINTS'.''
2013-04-04 13:44:26.466550 8144 UserTrace BIP5841I: ''Offset: 9. The simple content region of element 'POINTS' was converted to logical value '3'. ''
2013-04-04 13:44:26.466584 8144 UserTrace BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-04 13:44:26.466614 8144 UserTrace BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-04 13:44:26.466644 8144 UserTrace BIP5841I: ''Offset: 9. Found fixed length value: '312012-12-' for element 'CREATED_AT'.''
2013-04-04 13:44:26.466672 8144 UserTrace BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-04 13:44:26.466700 8144 UserTrace BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-04 13:44:26.466728 8144 UserTrace BIP5841I: ''Offset: 19. Found fixed length value: '20 1' for element 'PT_CODE'.''
2013-04-04 13:44:26.466760 8144 UserTrace BIP5841I: ''Offset: 23. The simple content region of element 'PT_CODE' was converted to logical value '2001'. ''
2013-04-04 13:44:26.466794 8144 UserTrace BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-04 13:44:26.466824 8144 UserTrace BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-04 13:44:26.466852 8144 UserTrace BIP5841I: ''Offset: 23. Found fixed length value: '30 29792' for element 'MEMS_ID'.''
2013-04-04 13:44:26.466886 8144 UserTrace BIP5841I: ''Offset: 35. The simple content region of element 'MEMS_ID' was converted to logical value '300000029792'. ''
2013-04-04 13:44:26.466918 8144 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-04 13:44:26.466948 8144 UserTrace BIP5841I: ''Offset: 35. Did not find terminator for '(null)'. Expected terminator list is '%NL;'.''
2013-04-04 13:44:26.466974 8144 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'body'.''
2013-04-04 13:44:26.467000 8144 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'REWARDS'.''
2013-04-04 13:44:26.467040 8144 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''ExceptionList'' at ('', '2.3'). This resolved to ''ExceptionList''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.467058 8144 UserTrace BIP2539I: Node 'RewardsFromAS400.Trace2': Evaluating expression ''LocalEnvironment'' at ('', '3.3'). This resolved to ''LocalEnvironment''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Root' Value=NULL''.
2013-04-04 13:44:26.467084 8144 UserTrace BIP4060I: Data ''( ['GENERICROOT' : 0x11072090]
(0x01000000:Name):Properties = ( ['GENERICPROPERTYPARSER' : 0xacf4fb0]
(0x03000000:NameValue):MessageSet = '' (CHARACTER)
(0x03000000:NameValue):MessageType = '{}:REWARDS' (CHARACTER)
(0x03000000:NameValue):MessageFormat = '' (CHARACTER)
(0x03000000:NameValue):Encoding = 546 (INTEGER)
(0x03000000:NameValue):CodedCharSetId = 437 (INTEGER)
(0x03000000:NameValue):Transactional = FALSE (BOOLEAN)
(0x03000000:NameValue):Persistence = FALSE (BOOLEAN)
(0x03000000:NameValue):CreationTime = GMTTIMESTAMP '2013-04-04 20:44:26.464001' (GMTTIMESTAMP)
(0x03000000:NameValue):ExpirationTime = -1 (INTEGER)
(0x03000000:NameValue):Priority = 0 (INTEGER)
(0x03000000:NameValue):ReplyIdentifier = X'' (BLOB)
(0x03000000:NameValue):ReplyProtocol = 'ADAPTOR' (CHARACTER)
(0x03000000:NameValue):Topic = NULL
(0x03000000:NameValue):ContentType = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceType = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceToken = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourcePassword = '' (CHARACTER)
(0x03000000:NameValue):IdentitySourceIssuedBy = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedType = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedToken = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedPassword = '' (CHARACTER)
(0x03000000:NameValue):IdentityMappedIssuedBy = '' (CHARACTER)
)
(0x01000000:Name):DFDL = ( ['dfdl' : 0x11072a20]
(0x01000000:Name):REWARDS = (
(0x01000000:Name):body = (
(0x03000000:NameValue):POINTS = 3 (DECIMAL)
(0x03000000:NameValue):CREATED_AT = '312012-12-' (CHARACTER)
(0x03000000:NameValue):PT_CODE = 2001 (DECIMAL)
(0x03000000:NameValue):MEMS_ID = 300000029792 (DECIMAL)
)
)
)
)
'' from trace node 'RewardsFromAS400.Trace2'.
The trace node 'RewardsFromAS400.Trace2' has output the specified trace data. |
|
|
Back to top |
|
 |
kimbert |
Posted: Sat Apr 06, 2013 12:49 pm Post subject: |
|
|
 Jedi Council
Joined: 29 Jul 2003 Posts: 5542 Location: Southampton
|
In the FileInput node, I think you have probably set the Record Identification to 'Fixed Length' and the length to 35. The FileInput node is taking exactly 35 bytes from the file and passing them to the flow. The terminator is not included in those 35 bytes ( I can see that from the BLOB data that you have posted ).
You need to do one of the following:
a) Set the length to 37. Only do this if you are 100% certain that every record will contain a terminator ( including the last record in the file ).
b) Change the 'Record Identification' property to 'Parsed Record Sequence'. The FileInput node will use the DFDL parser to recognise each record, and it will tolerate missing terminators. |
|
Back to top |
|
 |
albert940 |
Posted: Tue Apr 09, 2013 2:43 pm Post subject: |
|
|
Novice
Joined: 02 Apr 2013 Posts: 10
|
I tried with option #b last week and it did work.
The trace response for #a is below. I see the messages being sent to output queue but there is an error generated in the trace file for every record.
Code: |
2013-04-09 15:30:22.360938 5724 UserTrace BIP3352I: ''FileInput'' node ''File Input'' in message flow ''RewardsFromAS400'' is propagating record ''1'' obtained from file ''C:\temp\files\mqsitransitin\3e13146f-3d01-0000-0080-d858e0ecd734-sqlexec1.txt'' at offset ''0'' to terminal ''out''.
The FileInput node read a record from the file, and will propagate it to the named terminal.
No action is required.
2013-04-09 15:30:22.360966 5724 UserTrace BIP3907I: Message received and propagated to 'out' terminal of input node 'RewardsFromAS400.File Input'.
2013-04-09 15:30:22.361074 5724 UserTrace BIP6063I: Node 'RewardsFromAS400.File Input' used parser type ''Properties'' to process the input stream, beginning at offset '0'.
2013-04-09 15:30:22.362066 5724 UserTrace BIP6064I: Node 'RewardsFromAS400.File Input' used parser type ''DFDL'' to process the input stream, beginning at offset '0'. The parser type was selected based on value ''DFDL'' from the previous parser.
2013-04-09 15:30:22.362130 5724 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''BEGIN ... END;'' at ('.RewardsFromAS400_Compute.Main', '2.2').
2013-04-09 15:30:22.362156 5724 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''SET OutputRoot.Properties = InputProperties;'' at ('.RewardsFromAS400_Compute.Main', '5.6').
2013-04-09 15:30:22.362182 5724 UserTrace BIP2539I: Node '': Evaluating expression ''InputProperties'' at ('.RewardsFromAS400_Compute.Main', '5.34'). This resolved to ''InputProperties''. The result was ''ROW... Root Element Type=16777216 NameSpace='' Name='Properties' Value=NULL''.
2013-04-09 15:30:22.362216 5724 UserTrace BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputProperties'' to ''OutputRoot.Properties''.
2013-04-09 15:30:22.362252 5724 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''DECLARE i INTEGER 1;'' at ('.RewardsFromAS400_Compute.Main', '7.6').
2013-04-09 15:30:22.362274 5724 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''DECLARE j INTEGER CARDINALITY(InputRoot.DFDL.REWARDS.body[ ]);'' at ('.RewardsFromAS400_Compute.Main', '8.6').
2013-04-09 15:30:22.362368 5724 UserTrace BIP5841I: ''Offset: 0. Parsing will start from root element 'REWARDS'.''
2013-04-09 15:30:22.362458 5724 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'REWARDS'.''
2013-04-09 15:30:22.362504 5724 UserTrace BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.''
2013-04-09 15:30:22.362534 5724 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'body'.''
2013-04-09 15:30:22.362560 5724 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL.REWARDS.body[ ]'' at ('.RewardsFromAS400_Compute.Main', '8.37'). This resolved to ''InputRoot.DFDL.REWARDS.body[]''. The result was ''LIST... First Element Type=16777216 NameSpace='' Name='body' Value=NULL''.
2013-04-09 15:30:22.362602 5724 UserTrace BIP5841I: ''Offset: 0. Starting to process element 'POINTS'.''
2013-04-09 15:30:22.362656 5724 UserTrace BIP5841I: ''Offset: 0. Found fixed length value: ' 12345.00' for element 'POINTS'.''
2013-04-09 15:30:22.362782 5724 UserTrace BIP5841I: ''Offset: 9. The simple content region of element 'POINTS' was converted to logical value '12345'. ''
2013-04-09 15:30:22.362826 5724 UserTrace BIP5841I: ''Offset: 9. Finished processing element 'POINTS'.''
2013-04-09 15:30:22.362858 5724 UserTrace BIP5841I: ''Offset: 9. Starting to process element 'CREATED_AT'.''
2013-04-09 15:30:22.362918 5724 UserTrace BIP5841I: ''Offset: 9. Found fixed length value: '2013-01-20' for element 'CREATED_AT'.''
2013-04-09 15:30:22.362954 5724 UserTrace BIP5841I: ''Offset: 19. Finished processing element 'CREATED_AT'.''
2013-04-09 15:30:22.362990 5724 UserTrace BIP5841I: ''Offset: 19. Starting to process element 'PT_CODE'.''
2013-04-09 15:30:22.363022 5724 UserTrace BIP5841I: ''Offset: 19. Found fixed length value: ' 130' for element 'PT_CODE'.''
2013-04-09 15:30:22.363106 5724 UserTrace BIP5841I: ''Offset: 23. The simple content region of element 'PT_CODE' was converted to logical value '130'. ''
2013-04-09 15:30:22.363142 5724 UserTrace BIP5841I: ''Offset: 23. Finished processing element 'PT_CODE'.''
2013-04-09 15:30:22.363172 5724 UserTrace BIP5841I: ''Offset: 23. Starting to process element 'MEMS_ID'.''
2013-04-09 15:30:22.363204 5724 UserTrace BIP5841I: ''Offset: 23. Found fixed length value: ' 44263559' for element 'MEMS_ID'.''
2013-04-09 15:30:22.363284 5724 UserTrace BIP5841I: ''Offset: 35. The simple content region of element 'MEMS_ID' was converted to logical value '44263559'. ''
2013-04-09 15:30:22.363320 5724 UserTrace BIP5841I: ''Offset: 35. Finished processing element 'MEMS_ID'.''
2013-04-09 15:30:22.363372 5724 UserTrace BIP5841I: ''Offset: 35. Found terminator '%CR;%LF;' for element '(null)'.''
2013-04-09 15:30:22.363408 5724 UserTrace BIP5841I: ''Offset: 37. Finished processing element 'body'.''
2013-04-09 15:30:22.363444 5724 UserTrace BIP5841I: ''Offset: 37. Optional element 'body' encountered. The DFDL parser will return to this position if the element is not present in the data stream.''
2013-04-09 15:30:22.363478 5724 UserTrace BIP5841I: ''Offset: 37. Starting to process element 'body'.''
2013-04-09 15:30:22.363508 5724 UserTrace BIP5841I: ''Offset: 37. Starting to process element 'POINTS'.''
2013-04-09 15:30:22.363570 5724 UserTrace BIP5843E: ''Unexpected end of data at byte offset '<MISSING INSERT 0>' while parsing element '<MISSING INSERT 1>'. The parser encountered the end of the data stream or the end of a parent element.''
2013-04-09 15:30:22.363604 5724 UserTrace BIP5841I: ''offset: 37. Parser was unable to resolve data on the current branch and will evaluate the next available branch beginning at offset '37' owned by the 'sequence' group contained within element 'REWARDS'.''
2013-04-09 15:30:22.363638 5724 UserTrace BIP5841I: ''Offset: 37. Occurrence '2' of element 'body' was not found in the data. occursCountKind is 'parsed' so no more occurrences of this element will be expected. ''
2013-04-09 15:30:22.363666 5724 UserTrace BIP5841I: ''Offset: 37. Finished processing element 'REWARDS'.''
2013-04-09 15:30:22.363692 5724 UserTrace BIP2540I: Node '': Finished evaluating expression ''CARDINALITY(InputRoot.DFDL.REWARDS.body[ ])'' at ('.RewardsFromAS400_Compute.Main', '8.24'). The result was ''1''.
2013-04-09 15:30:22.363726 5724 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''DECLARE Z INTEGER 20;'' at ('.RewardsFromAS400_Compute.Main', '9.6').
2013-04-09 15:30:22.363746 5724 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''WHILE i <= j DO ... END WHILE;'' at ('.RewardsFromAS400_Compute.Main', '18.6').
2013-04-09 15:30:22.363764 5724 UserTrace BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '18.12'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.363786 5724 UserTrace BIP2539I: Node '': Evaluating expression ''j'' at ('.RewardsFromAS400_Compute.Main', '18.17'). This resolved to ''j''. The result was ''1''.
2013-04-09 15:30:22.363812 5724 UserTrace BIP2539I: Node '': Evaluating expression ''i <= j'' at ('.RewardsFromAS400_Compute.Main', '18.12'). This resolved to ''1 <= 1''. The result was ''TRUE''.
2013-04-09 15:30:22.363842 5724 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''SET OutputRoot.XMLNSC.REWARDS.body.POINTS = InputRoot.DFDL.REWARDS.body[i].POINTS;'' at ('.RewardsFromAS400_Compute.Main', '20.7').
2013-04-09 15:30:22.363860 5724 UserTrace BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '20.79'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.363890 5724 UserTrace BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '20.79'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.363914 5724 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL.REWARDS.body[i].POINTS'' at ('.RewardsFromAS400_Compute.Main', '20.51'). This resolved to ''InputRoot.DFDL.REWARDS.body[1].POINTS''. The result was ''ROW... Root Element Type=50331648 NameSpace='' Name='POINTS' Value=12345''.
2013-04-09 15:30:22.363974 5724 UserTrace BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL.REWARDS.body[i].POINTS'' to ''OutputRoot.XMLNSC.REWARDS.body.POINTS''.
2013-04-09 15:30:22.364002 5724 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''SET OutputRoot.XMLNSC.REWARDS.body.CREATED_AT = InputRoot.DFDL.REWARDS.body[i].CREATED_AT;'' at ('.RewardsFromAS400_Compute.Main', '21.7').
2013-04-09 15:30:22.364022 5724 UserTrace BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '21.83'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.364052 5724 UserTrace BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '21.83'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.364074 5724 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL.REWARDS.body[i].CREATED_AT'' at ('.RewardsFromAS400_Compute.Main', '21.55'). This resolved to ''InputRoot.DFDL.REWARDS.body[1].CREATED_AT''. The result was ''ROW... Root Element Type=50331648 NameSpace='' Name='CREATED_AT' Value='2013-01-20'''.
2013-04-09 15:30:22.364104 5724 UserTrace BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL.REWARDS.body[i].CREATED_AT'' to ''OutputRoot.XMLNSC.REWARDS.body.CREATED_AT''.
2013-04-09 15:30:22.364124 5724 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''SET OutputRoot.XMLNSC.REWARDS.body.PT_CODE = InputRoot.DFDL.REWARDS.body[i].PT_CODE;'' at ('.RewardsFromAS400_Compute.Main', '22.7').
2013-04-09 15:30:22.364144 5724 UserTrace BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '22.80'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.364174 5724 UserTrace BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '22.80'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.364200 5724 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL.REWARDS.body[i].PT_CODE'' at ('.RewardsFromAS400_Compute.Main', '22.52'). This resolved to ''InputRoot.DFDL.REWARDS.body[1].PT_CODE''. The result was ''ROW... Root Element Type=50331648 NameSpace='' Name='PT_CODE' Value=130''.
2013-04-09 15:30:22.364228 5724 UserTrace BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL.REWARDS.body[i].PT_CODE'' to ''OutputRoot.XMLNSC.REWARDS.body.PT_CODE''.
2013-04-09 15:30:22.364250 5724 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''SET OutputRoot.XMLNSC.REWARDS.body.MEMS_ID = InputRoot.DFDL.REWARDS.body[i].MEMS_ID;'' at ('.RewardsFromAS400_Compute.Main', '23.7').
2013-04-09 15:30:22.364268 5724 UserTrace BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '23.80'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.364296 5724 UserTrace BIP2539I: Node '': Evaluating expression ''i'' at ('.RewardsFromAS400_Compute.Main', '23.80'). This resolved to ''i''. The result was ''1''.
2013-04-09 15:30:22.364318 5724 UserTrace BIP2539I: Node '': Evaluating expression ''InputRoot.DFDL.REWARDS.body[i].MEMS_ID'' at ('.RewardsFromAS400_Compute.Main', '23.52'). This resolved to ''InputRoot.DFDL.REWARDS.body[1].MEMS_ID''. The result was ''ROW... Root Element Type=50331648 NameSpace='' Name='MEMS_ID' Value=44263559''.
2013-04-09 15:30:22.364346 5724 UserTrace BIP2568I: Node 'RewardsFromAS400.Compute': Copying sub-tree from ''InputRoot.DFDL.REWARDS.body[i].MEMS_ID'' to ''OutputRoot.XMLNSC.REWARDS.body.MEMS_ID''.
2013-04-09 15:30:22.364368 5724 UserTrace BIP2537I: Node 'RewardsFromAS400.Compute': Executing statement ''PROPAGATE FINALIZE DEFAULT DELETE NONE;'' at ('.RewardsFromAS400_Compute.Main', '25.7').
2013-04-09 15:30:22.364412 5724 UserTrace BIP4015I: Message propagated to the 'out' terminal of node 'RewardsFromAS400.Compute' with the following message trees: 'OutputLocalEnvironment, OutputRoot, OutputExceptionList'.
2013-04-09 15:30:22.364452 5724 UserTrace BIP3904I: Invoking the evaluate() method of node (class='ComIbmMQHeaderNode', name='RewardsFromAS400#FCMComposite_1_2').
About to pass a message to the evaluate() method of the specified node.
No user action required. |
Another situation: The test data that is generated out of AS400 has a blank 1st record and then actual data starts from the second record. I tried to execute the DFDL test case but it errors out in the test client.
Sample Test Data:
***Beginning**
12345.002013-01-20 130 44263559
3.312012-12-20 130 2979234
3.362012-10-20 130 26744330
.002012-01-05 130 45393473
**End**
TestClient Output: Parser reads the 1st record and when it reaches the second record the 'CR' and 'LF' are included in the first element of the 2nd record due to which the entire data is being changed. I used even the 'skip first record' option provided in file input node but no use. |
|
Back to top |
|
 |
kimbert |
Posted: Wed Apr 10, 2013 1:07 am Post subject: |
|
|
 Jedi Council
Joined: 29 Jul 2003 Posts: 5542 Location: Southampton
|
I assume that you are referring to this error:
Code: |
2013-04-09 15:30:22.363478 5724 UserTrace BIP5841I: ''Offset: 37. Starting to process element 'body'.''
2013-04-09 15:30:22.363508 5724 UserTrace BIP5841I: ''Offset: 37. Starting to process element 'POINTS'.''
2013-04-09 15:30:22.363570 5724 UserTrace BIP5843E: ''Unexpected end of data at byte offset '<MISSING INSERT 0>' while parsing element '<MISSING INSERT 1>'. The parser encountered the end of the data stream or the end of a parent element.''
2013-04-09 15:30:22.363604 5724 UserTrace BIP5841I: ''offset: 37. Parser was unable to resolve data on the current branch and will evaluate the next available branch beginning at offset '37' owned by the 'sequence' group contained within element 'REWARDS'.''
2013-04-09 15:30:22.363638 5724 UserTrace BIP5841I: ''Offset: 37. Occurrence '2' of element 'body' was not found in the data. occursCountKind is 'parsed' so no more occurrences of this element will be expected. ''
2013-04-09 15:30:22.363666 5724 UserTrace BIP5841I: ''Offset: 37. Finished processing element 'REWARDS'.''
|
If you read the trace carefully you will see why this error is occurring:
Code: |
2013-04-09 15:30:22.362504 5724 UserTrace BIP5841I: ''Offset: 0. Element 'body' has occursCountKind='parsed'. The number of occurrences of element 'body' will be determined by reading the input data stream, and the maxOccurs property will not control the number of occurrences that are parsed.'' |
I believe your message is a fixed-length structure, so you should set occursCountKind to 'fixed' on all elements. |
|
Back to top |
|
 |
kimbert |
Posted: Wed Apr 10, 2013 1:15 am Post subject: |
|
|
 Jedi Council
Joined: 29 Jul 2003 Posts: 5542 Location: Southampton
|
Quote: |
Another situation: The test data that is generated out of AS400 has a blank 1st record |
I assume that the ***Beginning*** is your way of showing where the file contents begin? In which case, a [c o d e] section would have done an even better job because it would clearly show the extent of the quoted data.
I'm not surprised that the blank record has messed up the reading of the file - you have told the FileInput node to read 37 bytes per record, so that is what it will do. You need to be very clear on where these blank records can occur. Do they only occur at the beginning of a file, or can they occur elsewhere as well? When you know the answer to that question, you can design a solution. |
|
Back to top |
|
 |
albert940 |
Posted: Wed Apr 10, 2013 1:18 pm Post subject: |
|
|
Novice
Joined: 02 Apr 2013 Posts: 10
|
If i set the 'occursCountKind' on 'body' element to 'fixed' then i should have the MaxOccurs = MinOccurs for that element, which is not possible in my case, as the count of records in the file vary everyday. I don't see 'occursCountKind' property defined for elements.
The blank record is only at the beginning of the file. It is the defined structure now. |
|
Back to top |
|
 |
|
|
 |
Goto page 1, 2 Next |
Page 1 of 2 |
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
|
|
|