ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Reading large files from a hard drive

Post new topic  Reply to topic
 Reading large files from a hard drive « View previous topic :: View next topic » 
Author Message
Tero
PostPosted: Tue Jan 31, 2006 4:43 am    Post subject: Reading large files from a hard drive Reply with quote

Newbie

Joined: 31 Jan 2006
Posts: 3

Hi!

I have two questions about the WBIMB/MQ.

First I should be reading large EDI-files to XML. They will exceed the 100 mb limit of the MQ. Is there a way to cope with this (segment the files or something like that).

The second question is about reading files from a hard drive. How can this be done? Is there a file adapter for the WBIMB V5 or some other ways to solve the problem.

I am open to any ideas so please feel free to comment.
Thanks in advance!
Back to top
View user's profile Send private message
kimbert
PostPosted: Tue Jan 31, 2006 5:52 am    Post subject: Reply with quote

Jedi Council

Joined: 29 Jul 2003
Posts: 5542
Location: Southampton

You should consider a third question as well: how to avoid excessive memory usage and poor performance in your message flow. Look here for the answer http://www-128.ibm.com/developerworks/websphere/library/techarticles/0505_storey/0505_storey.html
Back to top
View user's profile Send private message
ashoon
PostPosted: Tue Jan 31, 2006 9:23 am    Post subject: websphere pm4data Reply with quote

Master

Joined: 26 Oct 2004
Posts: 235

is a file-to-queue technology that can handle any size files converting to multiple MQ messages which can then be read/transformed by the broker.
Back to top
View user's profile Send private message
Tero
PostPosted: Wed Feb 01, 2006 1:53 am    Post subject: Reply with quote

Newbie

Joined: 31 Jan 2006
Posts: 3

Thank you both!

Kimbert:
The link you sent handled only messages from a queue if I am not mistaken. Are there any diffenrences the using the file-domain?

Ashoon:
Thank you for idea. I'll be sure to check that software out.

Does anyone have experience on the WBIMB File Extender?
I would be interested in hearing about that also.

Back to top
View user's profile Send private message
kimbert
PostPosted: Wed Feb 01, 2006 2:10 am    Post subject: Reply with quote

Jedi Council

Joined: 29 Jul 2003
Posts: 5542
Location: Southampton

Of course not. Once your file has been put onto a queue it will be indistinguishable from any other message which appears on an input queue.
Back to top
View user's profile Send private message
elvis_gn
PostPosted: Wed Feb 01, 2006 2:11 am    Post subject: Reply with quote

Padawan

Joined: 08 Oct 2004
Posts: 1905
Location: Dubai

Hi Tero,

The file Extender node is a paid supportpac, but that will be an easy way of working with files.

If you are using MQ v6 then it also provides file transfer.

Regards.
Back to top
View user's profile Send private message Send e-mail
Ian
PostPosted: Wed Feb 01, 2006 7:38 am    Post subject: Reply with quote

Disciple

Joined: 22 Nov 2002
Posts: 152
Location: London, UK

The functionality you are looking for is available via the Websphere Message Broker File Extender product :

See the full MBFE Announcement
See the latest MBFE technical FAQ's

MBFE v5 provides support for WBIMB v5.
MBFE v5 FP1a provides support for WMB v6.
_________________
Regards, Ian
Back to top
View user's profile Send private message
kman
PostPosted: Wed Feb 08, 2006 7:14 pm    Post subject: Reply with quote

Partisan

Joined: 21 Jan 2003
Posts: 309
Location: Kuala Lumpur, Malaysia

Ian,
what's the file size limit for the MBFE? Is it based on JVM heap size, MBFE.* queue ?
Back to top
View user's profile Send private message Yahoo Messenger
fjb_saper
PostPosted: Wed Feb 08, 2006 7:53 pm    Post subject: Reply with quote

Grand High Poobah

Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY

I don't think that there really is a filesize limit .... depending on what you do with the file....

To your question about the EDI file:
A) You need to set the parser up in such a way that each document in the file gets parsed to it's own message. My understanding is that you will have multiple messages/documents in the file. Split them using the File Extender Node and do not send all at once. Enjoy
_________________
MQ & Broker admin
Back to top
View user's profile Send private message Send e-mail
kman
PostPosted: Wed Feb 08, 2006 7:58 pm    Post subject: Reply with quote

Partisan

Joined: 21 Jan 2003
Posts: 309
Location: Kuala Lumpur, Malaysia

I got from the search results (from Jeff) referring to qm, q, and chl size (was it 4MB? default)
Back to top
View user's profile Send private message Yahoo Messenger
Ian
PostPosted: Fri Feb 10, 2006 4:28 am    Post subject: Reply with quote

Disciple

Joined: 22 Nov 2002
Posts: 152
Location: London, UK

I am not aware of a hard limit on the file size if you are using F2F flows.

If you are using F2M or M2F then this may be constrained by the MQSeries queue size (max 100MB).
_________________
Regards, Ian
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Reading large files from a hard drive
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.