MQSeries.net :: View topic

ravikumarlankalapalli · Posted: Thu Aug 05, 2010 3:52 am Post subject: Reg:Splitting the files

I have a file of 4mb which has 10000 records i need to split the file into multiple files based on the 500 records.every 500 records it generates a new file with new file name.
I took fileinput node for input i select properties
DELIMETER:Custom delimeter;
CUSTOM DELIMETER:0A;
DELIMETER TYPE:Postfix;

and i took computenode and fileoutput node.

Compute node:

DECLARE SIZE SHARED INTEGER 5;
DECLARE SEQNO SHARED INTEGER 0;
CREATE COMPUTE MODULE LargeFileHandling_Compute
CREATE FUNCTION Main() RETURNS BOOLEAN
BEGIN
DECLARE CNT INTEGER 1;
DECLARE FNAME CHARACTER;
SET Environment.Variable.OutDirName='C:\\Output';
SET Environment.Variable.FileName=InputLocalEnvironment.File.Name;
SET Environment.Variable.DirName=InputLocalEnvironment.File.Directory;
SET Environment.Variable.FilPos=POSITION('.' IN Environment.Variable.FileName REPEAT 3);
SET Environment.Variable.FirstFile=SUBSTRING(Environment.Variable.FileName FROM 1 FOR Environment.Variable.FilPos);
SET Environment.Variable.SecondFile=SUBSTRING(Environment.Variable.FileName FROM Environment.Variable.FilPos+2);
SET Environment.Variable.Seqno=SUBSTRING(Environment.Variable.FileName FROM Environment.Variable.FilPos+1 for 1);
IF SEQNO=0 THEN
SET SEQNO=Environment.Variable.Seqno;
END IF;
SET Environment.Variable.CastSeqNo=CAST(SEQNO AS CHARACTER);
SET FNAME=Environment.Variable.FirstFile||Environment.Variable.CastSeqNo||Environment.Variable.SecondFile;
IF InputLocalEnvironment.File.IsEmpty=FALSE THEN
IF InputLocalEnvironment.File.Record<=SIZE THEN
SET OutputLocalEnvironment.Destination.File.Directory = Environment.Variable.OutDirName;
SET OutputLocalEnvironment.Destination.File.Name = FNAME;
SET OutputRoot = InputRoot;
ELSE
SET OutputLocalEnvironment.Destination.File.Directory = Environment.Variable.OutDirName;
SET OutputLocalEnvironment.Destination.File.Name = FNAME;
PROPAGATE TO TERMINAL 'out1' DELETE NONE;
SET SIZE=SIZE+5;
SET SEQNO=SEQNO+1;
END IF;
END IF;
RETURN TRUE;
END;

but it splits multiple files problem is it generates after the records complted also it generating files with white spaces.