Author |
Message
|
Tero |
Posted: Tue Jan 31, 2006 4:43 am Post subject: Reading large files from a hard drive |
|
|
Newbie
Joined: 31 Jan 2006 Posts: 3
|
Hi!
I have two questions about the WBIMB/MQ.
First I should be reading large EDI-files to XML. They will exceed the 100 mb limit of the MQ. Is there a way to cope with this (segment the files or something like that).
The second question is about reading files from a hard drive. How can this be done? Is there a file adapter for the WBIMB V5 or some other ways to solve the problem.
I am open to any ideas so please feel free to comment.
Thanks in advance! |
|
Back to top |
|
 |
kimbert |
Posted: Tue Jan 31, 2006 5:52 am Post subject: |
|
|
 Jedi Council
Joined: 29 Jul 2003 Posts: 5542 Location: Southampton
|
|
Back to top |
|
 |
ashoon |
Posted: Tue Jan 31, 2006 9:23 am Post subject: websphere pm4data |
|
|
Master
Joined: 26 Oct 2004 Posts: 235
|
is a file-to-queue technology that can handle any size files converting to multiple MQ messages which can then be read/transformed by the broker. |
|
Back to top |
|
 |
Tero |
Posted: Wed Feb 01, 2006 1:53 am Post subject: |
|
|
Newbie
Joined: 31 Jan 2006 Posts: 3
|
Thank you both!
Kimbert:
The link you sent handled only messages from a queue if I am not mistaken. Are there any diffenrences the using the file-domain?
Ashoon:
Thank you for idea. I'll be sure to check that software out.
Does anyone have experience on the WBIMB File Extender?
I would be interested in hearing about that also.
 |
|
Back to top |
|
 |
kimbert |
Posted: Wed Feb 01, 2006 2:10 am Post subject: |
|
|
 Jedi Council
Joined: 29 Jul 2003 Posts: 5542 Location: Southampton
|
Of course not. Once your file has been put onto a queue it will be indistinguishable from any other message which appears on an input queue. |
|
Back to top |
|
 |
elvis_gn |
Posted: Wed Feb 01, 2006 2:11 am Post subject: |
|
|
 Padawan
Joined: 08 Oct 2004 Posts: 1905 Location: Dubai
|
Hi Tero,
The file Extender node is a paid supportpac, but that will be an easy way of working with files.
If you are using MQ v6 then it also provides file transfer.
Regards. |
|
Back to top |
|
 |
Ian |
Posted: Wed Feb 01, 2006 7:38 am Post subject: |
|
|
Disciple
Joined: 22 Nov 2002 Posts: 152 Location: London, UK
|
The functionality you are looking for is available via the Websphere Message Broker File Extender product :
See the full MBFE Announcement
See the latest MBFE technical FAQ's
MBFE v5 provides support for WBIMB v5.
MBFE v5 FP1a provides support for WMB v6. _________________ Regards, Ian |
|
Back to top |
|
 |
kman |
Posted: Wed Feb 08, 2006 7:14 pm Post subject: |
|
|
Partisan
Joined: 21 Jan 2003 Posts: 309 Location: Kuala Lumpur, Malaysia
|
Ian,
what's the file size limit for the MBFE? Is it based on JVM heap size, MBFE.* queue ? |
|
Back to top |
|
 |
fjb_saper |
Posted: Wed Feb 08, 2006 7:53 pm Post subject: |
|
|
 Grand High Poobah
Joined: 18 Nov 2003 Posts: 20756 Location: LI,NY
|
I don't think that there really is a filesize limit .... depending on what you do with the file....
To your question about the EDI file:
A) You need to set the parser up in such a way that each document in the file gets parsed to it's own message. My understanding is that you will have multiple messages/documents in the file. Split them using the File Extender Node and do not send all at once. Enjoy  _________________ MQ & Broker admin |
|
Back to top |
|
 |
kman |
Posted: Wed Feb 08, 2006 7:58 pm Post subject: |
|
|
Partisan
Joined: 21 Jan 2003 Posts: 309 Location: Kuala Lumpur, Malaysia
|
I got from the search results (from Jeff) referring to qm, q, and chl size (was it 4MB? default) |
|
Back to top |
|
 |
Ian |
Posted: Fri Feb 10, 2006 4:28 am Post subject: |
|
|
Disciple
Joined: 22 Nov 2002 Posts: 152 Location: London, UK
|
I am not aware of a hard limit on the file size if you are using F2F flows.
If you are using F2M or M2F then this may be constrained by the MQSeries queue size (max 100MB). _________________ Regards, Ian |
|
Back to top |
|
 |
|