ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » IIB9: Custom Java InputNode

Post new topic  Reply to topic
 IIB9: Custom Java InputNode « View previous topic :: View next topic » 
Author Message
akil
PostPosted: Sun Mar 05, 2017 8:31 am    Post subject: IIB9: Custom Java InputNode Reply with quote

Partisan

Joined: 27 May 2014
Posts: 338
Location: Mumbai

I am planning to create a custom FileInputNode that will process large XLS files, using the POI-HSSF java classes. The node would read the XLS file one row at a time, created a BLOB message for the row and send it to the out terminal.

This node needs to support multiple instances like the FileInput node, meaning that additional instances will allow multiple XLS files to be processed at the same time, while each file will be processed row by row & serially.

The documentation mentions calling dispatchThread, but from what I see, while the file will be read 1 row at a time, multiple threads will result in a single file to be processed in parallel. This isn't what I want..

What would be the threading model to use to be similar to the FileInput node?


Quote:

To create multithreaded message flows, you call the dispatchThread method after a message is created, but before the message is propagated to an output terminal. This action ensures that only one thread is waiting for data while other threads are processing the message. New threads are obtained from the thread pool up to the maximum limit specified by the Additional Instances property of the message flow. For example:
[/list]
_________________
Regards
Back to top
View user's profile Send private message Visit poster's website
aruncg
PostPosted: Sun Apr 11, 2021 9:14 pm    Post subject: Reply with quote

Novice

Joined: 08 Mar 2013
Posts: 22

Hi Akil,

I am also looking for suggestion on a similar situation where Java User defined input node needs to have additional instances. How is that achievable in a thread safe manner?

thanks in advance.
Back to top
View user's profile Send private message
fjb_saper
PostPosted: Sun Apr 11, 2021 9:57 pm    Post subject: Reply with quote

Grand High Poobah

Joined: 18 Nov 2003
Posts: 20696
Location: LI,NY

aruncg wrote:
Hi Akil,

I am also looking for suggestion on a similar situation where Java User defined input node needs to have additional instances. How is that achievable in a thread safe manner?

thanks in advance.

You need to use the existing File Input Node, use a Streaming parser and park your stream in the Local Environment. This way you still get to read one record at a time and you get to delete the record after reading it... Have fun
_________________
MQ & Broker admin
Back to top
View user's profile Send private message Send e-mail
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » IIB9: Custom Java InputNode
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.