OFBiz › OFBiz - User

exporting as tab delimited

_‹ Previous Topic Next Topic _›

Classic

List

Threaded

9 messages Options

Vince Clark

exporting as tab delimited

I'm trying to define a report with the ability to export as a tab delimited file. There are decorators for xml and pdf, but I don't see how to do csv or other text delimiters.
An export is step one. We will be exporting orders in a specific format to a third party fulfillment warehouse. So I need to do it by date range. I can figure this out by looking at other examples of searches by date.

Once we are successfully sending the data by manually exporting on a daily basis we want to automate the process. I would be interested in any helpful hints on the best approach to this. I assume it will involve creating a job that is scheduled to run at the desired frequency. We would also need to connect to a remote ftp server and upload, then update all the records as sent so they aren't included on subsequent reports.

Vince Clark
Global Era
The Freedom of Open Source
[hidden email]
(303) 493-6723

BJ Freeman

Re: exporting as tab delimited

look at the /framework/datafile/dtd/datafile.xsd
for exporting
then use the ftp
there is another example in the financial package from Opentaps.com
you can ask about it here
https://sourceforge.net/forum/forum.php?forum_id=540292

Vince M. Clark sent the following on 11/4/2007 2:40 PM:

> I'm trying to define a report with the ability to export as a tab delimited file. There are decorators for xml and pdf, but I don't see how to do csv or other text delimiters.
> An export is step one. We will be exporting orders in a specific format to a third party fulfillment warehouse. So I need to do it by date range. I can figure this out by looking at other examples of searches by date.
>
> Once we are successfully sending the data by manually exporting on a daily basis we want to automate the process. I would be interested in any helpful hints on the best approach to this. I assume it will involve creating a job that is scheduled to run at the desired frequency. We would also need to connect to a remote ftp server and upload, then update all the records as sent so they aren't included on subsequent reports.
>
> Vince Clark
> Global Era
> The Freedom of Open Source
> [hidden email]
> (303) 493-6723
>

Vince Clark

Re: exporting as tab delimited

I have looked at that and the Work with Data Files screen in Web Tools. This appears to only be used for importing from a flat file. I need to export in a delimited format, not XML.

Vince Clark
Global Era
The Freedom of Open Source
[hidden email]
(303) 493-6723

----- Original Message -----
From: "BJ Freeman" <[hidden email]>
To: [hidden email]
Sent: Sunday, November 4, 2007 6:37:54 PM (GMT-0700) America/Chihuahua
Subject: Re: exporting as tab delimited

look at the /framework/datafile/dtd/datafile.xsd
for exporting
then use the ftp
there is another example in the financial package from Opentaps.com
you can ask about it here
https://sourceforge.net/forum/forum.php?forum_id=540292

Vince M. Clark sent the following on 11/4/2007 2:40 PM:

BJ Freeman

Re: exporting as tab delimited

if you went to the second example you would see how the file is written
out using a datafile.
sorry I don't have any code that I can put in the jira right now.
I have to re-factor it into trunk before I do that.

got to
https://sourceforge.net/forum/forum.php?forum_id=540292
and ask how to connect to their Financial svn
look at GLExport.xml

Vince M. Clark sent the following on 11/4/2007 5:44 PM:

> I have looked at that and the Work with Data Files screen in Web Tools. This appears to only be used for importing from a flat file. I need to export in a delimited format, not XML.
>
> Vince Clark
> Global Era
> The Freedom of Open Source
> [hidden email]
> (303) 493-6723
>
> ----- Original Message -----
> From: "BJ Freeman" <[hidden email]>
> To: [hidden email]
> Sent: Sunday, November 4, 2007 6:37:54 PM (GMT-0700) America/Chihuahua
> Subject: Re: exporting as tab delimited
>
> look at the /framework/datafile/dtd/datafile.xsd
> for exporting
> then use the ftp
> there is another example in the financial package from Opentaps.com
> you can ask about it here
> https://sourceforge.net/forum/forum.php?forum_id=540292
>
> Vince M. Clark sent the following on 11/4/2007 2:40 PM:
>> I'm trying to define a report with the ability to export as a tab delimited file. There are decorators for xml and pdf, but I don't see how to do csv or other text delimiters.
>> An export is step one. We will be exporting orders in a specific format to a third party fulfillment warehouse. So I need to do it by date range. I can figure this out by looking at other examples of searches by date.
>>
>> Once we are successfully sending the data by manually exporting on a daily basis we want to automate the process. I would be interested in any helpful hints on the best approach to this. I assume it will involve creating a job that is scheduled to run at the desired frequency. We would also need to connect to a remote ftp server and upload, then update all the records as sent so they aren't included on subsequent reports.
>>
>> Vince Clark
>> Global Era
>> The Freedom of Open Source
>> [hidden email]
>> (303) 493-6723
>>
>

Vince Clark

Re: exporting as tab delimited

Thanks BJ. I'll look at the example from opentaps you referred to.

Am I pursuing the correct path given the fact that this will ultimately need to be automated as a nightly process?

Also, in your first response you said, "then use the ftp". What are you referring to? Is there an ftp library already in OfBiz, or are you suggesting using a standard ftp command line client?

Vince Clark
Global Era
The Freedom of Open Source
[hidden email]
(303) 493-6723

----- Original Message -----
From: "BJ Freeman" <[hidden email]>
To: [hidden email]
Sent: Sunday, November 4, 2007 7:16:06 PM (GMT-0700) America/Chihuahua
Subject: Re: exporting as tab delimited

if you went to the second example you would see how the file is written
out using a datafile.
sorry I don't have any code that I can put in the jira right now.
I have to re-factor it into trunk before I do that.

got to
https://sourceforge.net/forum/forum.php?forum_id=540292
and ask how to connect to their Financial svn
look at GLExport.xml

Vince M. Clark sent the following on 11/4/2007 5:44 PM:

BJ Freeman

Re: exporting as tab delimited

there is a FTp service in ofbiz
https://localhost:8443/webtools/control/availableServices?sel_service_name=ftpPutFile

Vince M. Clark sent the following on 11/4/2007 6:17 PM:

> Thanks BJ. I'll look at the example from opentaps you referred to.
>
> Am I pursuing the correct path given the fact that this will ultimately need to be automated as a nightly process?
>
> Also, in your first response you said, "then use the ftp". What are you referring to? Is there an ftp library already in OfBiz, or are you suggesting using a standard ftp command line client?
>
> Vince Clark
> Global Era
> The Freedom of Open Source
> [hidden email]
> (303) 493-6723
>
> ----- Original Message -----
> From: "BJ Freeman" <[hidden email]>
> To: [hidden email]
> Sent: Sunday, November 4, 2007 7:16:06 PM (GMT-0700) America/Chihuahua
> Subject: Re: exporting as tab delimited
>
> if you went to the second example you would see how the file is written
> out using a datafile.
> sorry I don't have any code that I can put in the jira right now.
> I have to re-factor it into trunk before I do that.
>
> got to
> https://sourceforge.net/forum/forum.php?forum_id=540292
> and ask how to connect to their Financial svn
> look at GLExport.xml
>
>
> Vince M. Clark sent the following on 11/4/2007 5:44 PM:
>> I have looked at that and the Work with Data Files screen in Web Tools. This appears to only be used for importing from a flat file. I need to export in a delimited format, not XML.
>>
>> Vince Clark
>> Global Era
>> The Freedom of Open Source
>> [hidden email]
>> (303) 493-6723
>>
>> ----- Original Message -----
>> From: "BJ Freeman" <[hidden email]>
>> To: [hidden email]
>> Sent: Sunday, November 4, 2007 6:37:54 PM (GMT-0700) America/Chihuahua
>> Subject: Re: exporting as tab delimited
>>
>> look at the /framework/datafile/dtd/datafile.xsd
>> for exporting
>> then use the ftp
>> there is another example in the financial package from Opentaps.com
>> you can ask about it here
>> https://sourceforge.net/forum/forum.php?forum_id=540292
>>
>> Vince M. Clark sent the following on 11/4/2007 2:40 PM:
>>> I'm trying to define a report with the ability to export as a tab delimited file. There are decorators for xml and pdf, but I don't see how to do csv or other text delimiters.
>>> An export is step one. We will be exporting orders in a specific format to a third party fulfillment warehouse. So I need to do it by date range. I can figure this out by looking at other examples of searches by date.
>>>
>>> Once we are successfully sending the data by manually exporting on a daily basis we want to automate the process. I would be interested in any helpful hints on the best approach to this. I assume it will involve creating a job that is scheduled to run at the desired frequency. We would also need to connect to a remote ftp server and upload, then update all the records as sent so they aren't included on subsequent reports.
>>>
>>> Vince Clark
>>> Global Era
>>> The Freedom of Open Source
>>> [hidden email]
>>> (303) 493-6723
>>>
>

BJ Freeman

Re: exporting as tab delimited

In reply to this post by Vince Clark

sorry second part
I use basically the same thing in my supplier communications i will be
adding to the jira.
https://issues.apache.org/jira/browse/OFBIZ-1286
I have taken a more global approach to that each communications can be
handle with more flexibility
I am using the Contact mech to provide the variable data for FTP
I have added more Contact Purpose types

Vince M. Clark sent the following on 11/4/2007 6:17 PM:

David E Jones

Re: exporting as tab delimited

In reply to this post by Vince Clark

On Nov 4, 2007, at 3:40 PM, Vince M. Clark wrote:

> I'm trying to define a report with the ability to export as a tab
> delimited file. There are decorators for xml and pdf, but I don't
> see how to do csv or other text delimiters.
> An export is step one. We will be exporting orders in a specific
> format to a third party fulfillment warehouse. So I need to do it by
> date range. I can figure this out by looking at other examples of
> searches by date.
>
> Once we are successfully sending the data by manually exporting on a
> daily basis we want to automate the process. I would be interested
> in any helpful hints on the best approach to this. I assume it will
> involve creating a job that is scheduled to run at the desired
> frequency. We would also need to connect to a remote ftp server and
> upload, then update all the records as sent so they aren't included
> on subsequent reports.

You can use the DataFile stuff to both parse and generate "flat" text
files. There are actually lots of great options there for more
complicated files.

If all you need is something simple and character-separated, using an
FTL template to generate the output is often a nice, easy approach.

There is an example of this in the catalog webapp of the product
component. Look at the exportproducts view def (and related request)
in the controller.xml file in the catalog webapp. This takes the
results of a product search in the catalog manager and exports them to
a text file. You can see the form that calls this on the product
search results page there.

-David

smime.p7s (3K) Download Attachment

Vince Clark

Re: exporting as tab delimited

Thanks David. Since we will need to automate and have this run nightly I think the DataFile utility is the way I want to go. Unfortunately I cannot find any examples of using it to export data, only import.

Vince Clark
Global Era
The Freedom of Open Source
[hidden email]
(303) 493-6723

----- Original Message -----
From: "David E Jones" <[hidden email]>
To: [hidden email]
Sent: Sunday, November 4, 2007 11:12:04 PM (GMT-0700) America/Denver
Subject: Re: exporting as tab delimited

On Nov 4, 2007, at 3:40 PM, Vince M. Clark wrote: