| Author |
Message
|
| findarun |
 Posted: Tue Aug 29, 2006 10:31 pm Post subject: Tab Delimiter |
 |
|
Newbie
Joined: 21 Jun 2006
Posts: 5
|
Has anyone used "Tab" as delimiter in TDS format messageset?
_________________
Runner |
|
| Back to top |
|
 |
| kimbert |
| Posted: Wed Aug 30, 2006 9:06 am Post subject: |
|
|
Jedi Council
Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
|
| Why do you ask? Have you tried it? If you didn't, why not? If you did, what happened? |
|
| Back to top |
|
|
| findarun |
| Posted: Thu Aug 31, 2006 4:41 am Post subject: |
|
|
Newbie
Joined: 21 Jun 2006
Posts: 5
|
We are trying to use TDS with TAB as delimiter.
It's a huge file (300 MB). Running a PERL script to to replace TAB by comma is an option. Is there a possibility of using TAB itself? In case yes what will be the representation in the message set
_________________
Runner |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Thu Aug 31, 2006 4:49 am Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
|
| Back to top |
|
|
| kimbert |
| Posted: Thu Aug 31, 2006 12:05 pm Post subject: |
|
|
Jedi Council
Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
|
| Quote: |
| Running a PERL script to to replace TAB by comma is an option |
...but not a very good one, since the TDS format can handle this with no problems at all ( see the link which Jeff posted. <HT> is the one you need ).
If you are processing files this large, you also need to know two other things:
1. v6.0 TDS performance is much better than v5 or v2.1
2. If you want to keep heap usage within reasonable limits, you might need to get clever with the design of your message flow, as described here: http://www-128.ibm.com/developerworks/websphere/library/techarticles/0505_storey/0505_storey.html |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Thu Aug 31, 2006 12:15 pm Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
Plus, of course, you need to split the file into more than one message, since a single MQ message can only be 104857600 bytes long.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
|
|
