Datawarehouse implementation

[Oleg Kozyrev Jr.]

Hello, all

My partner Kirill Kuznetsov and I were working last year on the integration of Data Warehouse module. Finally we reached following results:
1. ETL processes described in XML, executed in Ofbiz and realized via Octopus, which transform and transfer data from some JDBC source to Ofbiz SQL database.
2. OLAP tool which makes it possible to process MDX queries & OLAP Operations (sorting, filters, drilldowns, and so on) in Ofbiz interface.
3. Ofbiz Interfaces including some nice diagrams (implemented as applets using JFreeChart).
In addition we have some working examples (data models + star schemas, e.g. Healthcare data model)

Certainly it's not a ready result, and this year new students of our university will probably continue our efforts making  it more functional & easy to use (it's planned to finish old functionalities, add new math tools like regressions, etc.)

Still it would be great if you took a look at out project (it is downloadable at sourceforge.net), or if it is interesting we could make online access (demos to our working version). The most interesting question for us is if it  can be after some modifications be included into Ofbiz Source Code.

There  was also an issue in the old Jira (jira.ofbiz.org) called "Ofbiz Datawarehouse component" (617 as far as i remember).

Best Regards,
Kirill Kuzntetsov & Oleg Kozyrev

[Jacopo Cappellato]

Oleg,

this is interesting and I'll have a look at it, thanks.
About including the new component into OFBiz, the first (but not the
only one) thing we should consider is the license issue: we can only
include in our svn tree jar files, xsd schemas and code compatible with
the licenses listed here:

http://docs.ofbiz.org/display/OFBADMIN/Libraries+Included+in+OFBiz

Jacopo

PS: the direct link to Oleg's project in Sourceforge.net is:

http://sourceforge.net/projects/datawarehouse/


Oleg Kozyrev Jr. wrote:

> Hello, all
>
> My partner Kirill Kuznetsov and I were working last year on the integration
> of Data Warehouse module. Finally we reached following results:
> 1. ETL processes described in XML, executed in Ofbiz and realized via
> Octopus, which transform and transfer data from some JDBC source to Ofbiz
> SQL database.
> 2. OLAP tool which makes it possible to process MDX queries & OLAP
> Operations (sorting, filters, drilldowns, and so on) in Ofbiz interface.
> 3. Ofbiz Interfaces including some nice diagrams (implemented as applets
> using JFreeChart).
> In addition we have some working examples (data models + star schemas, e.g.
> Healthcare data model)
>
> Certainly it's not a ready result, and this year new students of our
> university will probably continue our efforts making  it more functional &
> easy to use (it's planned to finish old functionalities, add new math tools
> like regressions, etc.)
>
> Still it would be great if you took a look at out project (it is
> downloadable at sourceforge.net), or if it is interesting we could make
> online access (demos to our working version). The most interesting question
> for us is if it  can be after some modifications be included into Ofbiz
> Source Code.
>
> There  was also an issue in the old Jira (jira.ofbiz.org) called "Ofbiz
> Datawarehouse component" (617 as far as i remember).
>
> Best Regards,
> Kirill Kuzntetsov & Oleg Kozyrev

[cjhowe]

Hello Oleg,

I was just doing a quick browse of your project (
http://sourceforge.net/projects/datawarehouse/ ) and
noticed that you still had the FoodMart cube.  Have
you created a cube based on OFBiz yet or were you just
testing the request/response capabilities?  Thanks!


--- "Oleg Kozyrev Jr." <[hidden email]> wrote:

>
> Hello, all
>
> My partner Kirill Kuznetsov and I were working last
> year on the integration
> of Data Warehouse module. Finally we reached
> following results:
> 1. ETL processes described in XML, executed in Ofbiz
> and realized via
> Octopus, which transform and transfer data from some
> JDBC source to Ofbiz
> SQL database.
> 2. OLAP tool which makes it possible to process MDX
> queries & OLAP
> Operations (sorting, filters, drilldowns, and so on)
> in Ofbiz interface.
> 3. Ofbiz Interfaces including some nice diagrams
> (implemented as applets
> using JFreeChart).
> In addition we have some working examples (data
> models + star schemas, e.g.
> Healthcare data model)
>
> Certainly it's not a ready result, and this year new
> students of our
> university will probably continue our efforts making
>  it more functional &
> easy to use (it's planned to finish old
> functionalities, add new math tools
> like regressions, etc.)
>
> Still it would be great if you took a look at out
> project (it is
> downloadable at sourceforge.net), or if it is
> interesting we could make
> online access (demos to our working version). The
> most interesting question
> for us is if it  can be after some modifications be
> included into Ofbiz
> Source Code.
>
> There  was also an issue in the old Jira
> (jira.ofbiz.org) called "Ofbiz
> Datawarehouse component" (617 as far as i remember).
>
> Best Regards,
> Kirill Kuzntetsov & Oleg Kozyrev
> --
> View this message in context:
>

http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671426
> Sent from the OFBiz - Dev mailing list archive at
> Nabble.com.
>
>

[Oleg Kozyrev Jr.]

Frankly speaking, now we were using FoodMart, because it contains much more data when the OFBiz from SVN. And that's why it's better for testing.

But, we have ETL based on Octopus and we have managed to build another model from OFBiz database. Unfortunatelly, it is using SQL terms, but not OFBiz Entities. As I alredy said next year new students are going to work on this. They will probably extend ETL functionality to work more with OFBiz Entities. It's better for modelling to my mind.

Still the project is in pretty early stage, but we hope that it will under extensive development in future.

cjhowe wrote

Hello Oleg,

I was just doing a quick browse of your project (
http://sourceforge.net/projects/datawarehouse/ ) and
noticed that you still had the FoodMart cube.  Have
you created a cube based on OFBiz yet or were you just
testing the request/response capabilities?  Thanks!


--- "Oleg Kozyrev Jr." <[e-mail]> wrote:

>
> Hello, all
>
> My partner Kirill Kuznetsov and I were working last
> year on the integration
> of Data Warehouse module. Finally we reached
> following results:
> 1. ETL processes described in XML, executed in Ofbiz
> and realized via
> Octopus, which transform and transfer data from some
> JDBC source to Ofbiz
> SQL database.
> 2. OLAP tool which makes it possible to process MDX
> queries & OLAP
> Operations (sorting, filters, drilldowns, and so on)
> in Ofbiz interface.
> 3. Ofbiz Interfaces including some nice diagrams
> (implemented as applets
> using JFreeChart).
> In addition we have some working examples (data
> models + star schemas, e.g.
> Healthcare data model)
>
> Certainly it's not a ready result, and this year new
> students of our
> university will probably continue our efforts making
>  it more functional &
> easy to use (it's planned to finish old
> functionalities, add new math tools
> like regressions, etc.)
>
> Still it would be great if you took a look at out
> project (it is
> downloadable at sourceforge.net), or if it is
> interesting we could make
> online access (demos to our working version). The
> most interesting question
> for us is if it  can be after some modifications be
> included into Ofbiz
> Source Code.
>
> There  was also an issue in the old Jira
> (jira.ofbiz.org) called "Ofbiz
> Datawarehouse component" (617 as far as i remember).
>
> Best Regards,
> Kirill Kuzntetsov & Oleg Kozyrev
> --
> View this message in context:
>
http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671426
> Sent from the OFBiz - Dev mailing list archive at
> Nabble.com.
>
>

[Oleg Kozyrev Jr.]

Jacopo,

We were using Octopus (http://forge.objectweb.org/projects/octopus/). It's made under LGPL. So, it can be used in the same way as Shark.

Also we have used Mondrian (http://sourceforge.net/projects/mondrian/). It's made under CPL and as far as I understand it's ok.

OLAP part is using JFreeChart and it is aldo LGPL. Also we are using only css files from JPivot and, certainly, we can easily make our own and have nothing in common with JPivot. OLAP is fully made on OFBiz Widgets.

Well, I hope, that licence stuff is ok.

Oleg.

Jacopo Cappellato wrote

Oleg,

this is interesting and I'll have a look at it, thanks.
About including the new component into OFBiz, the first (but not the
only one) thing we should consider is the license issue: we can only
include in our svn tree jar files, xsd schemas and code compatible with
the licenses listed here:

http://docs.ofbiz.org/display/OFBADMIN/Libraries+Included+in+OFBiz

Jacopo

PS: the direct link to Oleg's project in Sourceforge.net is:

http://sourceforge.net/projects/datawarehouse/


Oleg Kozyrev Jr. wrote:
> Hello, all
>
> My partner Kirill Kuznetsov and I were working last year on the integration
> of Data Warehouse module. Finally we reached following results:
> 1. ETL processes described in XML, executed in Ofbiz and realized via
> Octopus, which transform and transfer data from some JDBC source to Ofbiz
> SQL database.
> 2. OLAP tool which makes it possible to process MDX queries & OLAP
> Operations (sorting, filters, drilldowns, and so on) in Ofbiz interface.
> 3. Ofbiz Interfaces including some nice diagrams (implemented as applets
> using JFreeChart).
> In addition we have some working examples (data models + star schemas, e.g.
> Healthcare data model)
>
> Certainly it's not a ready result, and this year new students of our
> university will probably continue our efforts making  it more functional &
> easy to use (it's planned to finish old functionalities, add new math tools
> like regressions, etc.)
>
> Still it would be great if you took a look at out project (it is
> downloadable at sourceforge.net), or if it is interesting we could make
> online access (demos to our working version). The most interesting question
> for us is if it  can be after some modifications be included into Ofbiz
> Source Code.
>
> There  was also an issue in the old Jira (jira.ofbiz.org) called "Ofbiz
> Datawarehouse component" (617 as far as i remember).
>
> Best Regards,
> Kirill Kuzntetsov & Oleg Kozyrev

[cjhowe]

Couple small details about the build.xml file. For
those who want to try it out...

Line 40 correct with your deployment's location of
ofbizhome

Line 47-49  /base should now be /framework/base



--- "Oleg Kozyrev Jr." <[hidden email]> wrote:

>
> Frankly speaking, now we were using FoodMart,
> because it contains much more
> data when the OFBiz from SVN. And that's why it's
> better for testing.
>
> But, we have ETL based on Octopus and we have
> managed to build another model
> from OFBiz database. Unfortunatelly, it is using SQL
> terms, but not OFBiz
> Entities. As I alredy said next year new students
> are going to work on this.
> They will probably extend ETL functionality to work
> more with OFBiz
> Entities. It's better for modelling to my mind.
>
> Still the project is in pretty early stage, but we
> hope that it will under
> extensive development in future.
>
>
> cjhowe wrote:
> >
> > Hello Oleg,
> >
> > I was just doing a quick browse of your project (
> > http://sourceforge.net/projects/datawarehouse/ )
> and
> > noticed that you still had the FoodMart cube.
> Have
> > you created a cube based on OFBiz yet or were you
> just
> > testing the request/response capabilities?
> Thanks!
> >
> >
> > --- "Oleg Kozyrev Jr." <[hidden email]>
> wrote:
> >
> >>
> >> Hello, all
> >>
> >> My partner Kirill Kuznetsov and I were working
> last
> >> year on the integration
> >> of Data Warehouse module. Finally we reached
> >> following results:
> >> 1. ETL processes described in XML, executed in
> Ofbiz
> >> and realized via
> >> Octopus, which transform and transfer data from
> some
> >> JDBC source to Ofbiz
> >> SQL database.
> >> 2. OLAP tool which makes it possible to process
> MDX
> >> queries & OLAP
> >> Operations (sorting, filters, drilldowns, and so
> on)
> >> in Ofbiz interface.
> >> 3. Ofbiz Interfaces including some nice diagrams
> >> (implemented as applets
> >> using JFreeChart).
> >> In addition we have some working examples (data
> >> models + star schemas, e.g.
> >> Healthcare data model)
> >>
> >> Certainly it's not a ready result, and this year
> new
> >> students of our
> >> university will probably continue our efforts
> making
> >>  it more functional &
> >> easy to use (it's planned to finish old
> >> functionalities, add new math tools
> >> like regressions, etc.)
> >>
> >> Still it would be great if you took a look at out
> >> project (it is
> >> downloadable at sourceforge.net), or if it is
> >> interesting we could make
> >> online access (demos to our working version). The
> >> most interesting question
> >> for us is if it  can be after some modifications
> be
> >> included into Ofbiz
> >> Source Code.
> >>
> >> There  was also an issue in the old Jira
> >> (jira.ofbiz.org) called "Ofbiz
> >> Datawarehouse component" (617 as far as i
> remember).
> >>
> >> Best Regards,
> >> Kirill Kuzntetsov & Oleg Kozyrev
> >> --
> >> View this message in context:
> >>
> >
>

http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671426

> >> Sent from the OFBiz - Dev mailing list archive at
> >> Nabble.com.
> >>
> >>
> >
> >
> >
>
> --
> View this message in context:
>

http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671789
> Sent from the OFBiz - Dev mailing list archive at
> Nabble.com.
>
>

[cjhowe]

In addition, requires updating web.xml and
controller.xml to utilize the current
org.ofbiz.webapp.control.LoginEventListener
instead of the securityext stuff.

After getting the webapp loaded successfully, I was
not able to successfully run a query despite having
the foodmart database installed on a mysql server and
changing the settings to correspond to it. The java
methods used need to implement try/catch statements to
narrow down the problem, otherwise you just get
generic service failure messages.

Oleg,

There are quite a few unlicensed source files in your
repository, are you releasing these under the apache
license as well or are these source files in
collaboration with another project (The debug
statements make reference to mondrian.properties
whereas the file in your distribution is
dwh-mondrian.properties suggesting that at least part
of the java source files - ie QueryTag.java - are
derivative of files from another project - most likely
mondrian and AFAIK thereby not able to be released
under an Apache license)

I would very much like to help make this something
that can eventually be worked in to Apache Ofbiz, but
need to fully understand the licensing limitations so
that I know if a solution needs to actually become a
part of Apache Ofbiz or simply run inside it as a
supplemental work.

Last week I wrote up a simple guide on how to get
openI to run inside ofbiz (at least to use embedded
tomcat), but would very much prefer your solution as
it moves down the milestone path to already utilize
controller.xml, the screen widgets  the login tools,
etc.  I look forward to working on this.


--- Chris Howe <[hidden email]> wrote:

> Couple small details about the build.xml file. For
> those who want to try it out...
>
> Line 40 correct with your deployment's location of
> ofbizhome
>
> Line 47-49  /base should now be /framework/base
>
>
>
> --- "Oleg Kozyrev Jr." <[hidden email]> wrote:
>
> >
> > Frankly speaking, now we were using FoodMart,
> > because it contains much more
> > data when the OFBiz from SVN. And that's why it's
> > better for testing.
> >
> > But, we have ETL based on Octopus and we have
> > managed to build another model
> > from OFBiz database. Unfortunatelly, it is using
> SQL
> > terms, but not OFBiz
> > Entities. As I alredy said next year new students
> > are going to work on this.
> > They will probably extend ETL functionality to
> work
> > more with OFBiz
> > Entities. It's better for modelling to my mind.
> >
> > Still the project is in pretty early stage, but we
> > hope that it will under
> > extensive development in future.
> >
> >
> > cjhowe wrote:
> > >
> > > Hello Oleg,
> > >
> > > I was just doing a quick browse of your project
> (
> > > http://sourceforge.net/projects/datawarehouse/ )
> > and
> > > noticed that you still had the FoodMart cube.
> > Have
> > > you created a cube based on OFBiz yet or were
> you
> > just
> > > testing the request/response capabilities?
> > Thanks!
> > >
> > >
> > > --- "Oleg Kozyrev Jr." <[hidden email]>
> > wrote:
> > >
> > >>
> > >> Hello, all
> > >>
> > >> My partner Kirill Kuznetsov and I were working
> > last
> > >> year on the integration
> > >> of Data Warehouse module. Finally we reached
> > >> following results:
> > >> 1. ETL processes described in XML, executed in
> > Ofbiz
> > >> and realized via
> > >> Octopus, which transform and transfer data from
> > some
> > >> JDBC source to Ofbiz
> > >> SQL database.
> > >> 2. OLAP tool which makes it possible to process
> > MDX
> > >> queries & OLAP
> > >> Operations (sorting, filters, drilldowns, and
> so
> > on)
> > >> in Ofbiz interface.
> > >> 3. Ofbiz Interfaces including some nice
> diagrams
> > >> (implemented as applets
> > >> using JFreeChart).
> > >> In addition we have some working examples (data
> > >> models + star schemas, e.g.
> > >> Healthcare data model)
> > >>
> > >> Certainly it's not a ready result, and this
> year
> > new
> > >> students of our
> > >> university will probably continue our efforts
> > making
> > >>  it more functional &
> > >> easy to use (it's planned to finish old
> > >> functionalities, add new math tools
> > >> like regressions, etc.)
> > >>
> > >> Still it would be great if you took a look at
> out
> > >> project (it is
> > >> downloadable at sourceforge.net), or if it is
> > >> interesting we could make
> > >> online access (demos to our working version).
> The
> > >> most interesting question
> > >> for us is if it  can be after some
> modifications
> > be
> > >> included into Ofbiz
> > >> Source Code.
> > >>
> > >> There  was also an issue in the old Jira
> > >> (jira.ofbiz.org) called "Ofbiz
> > >> Datawarehouse component" (617 as far as i
> > remember).
> > >>
> > >> Best Regards,
> > >> Kirill Kuzntetsov & Oleg Kozyrev
> > >> --
> > >> View this message in context:
> > >>
> > >
> >
>

http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671426

> > >> Sent from the OFBiz - Dev mailing list archive
> at
> > >> Nabble.com.
> > >>
> > >>
> > >
> > >
> > >
> >
> > --
> > View this message in context:
> >
>

http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671789
> > Sent from the OFBiz - Dev mailing list archive at
> > Nabble.com.
> >
> >
>
>

[David E Jones-2]

Oleg,

It's great to see that you guys have made progress on this.  
Reporting, data warehousing and data analysis have been problems with  
OFBiz for a while.

Depending on licensing it may be a good goal to get this into the  
main OFBiz code base, but if it is working okay as a separate project  
then it can be an add-on for people to use on top of OFBiz without  
worrying so much about licensing issues (ie you can continue to  
include LGPL licensed libraries, etc). I should make it clear that  
I'm just thinking out loud about this and while it would be cool to  
have this stuff in OFBiz itself, it certainly isn't required in order  
to be of use to OFBiz users, and hopefully to allow some community/
interesting building around it.

The one concern I would have as a separate project or even using LGPL  
libraries is having a large library of OFBiz application specific ETL  
artifacts, and reports based on the warehouse database. If that is  
the direction this is going it would be a lot easier to maintain  
those along with the applications and data model and such of OFBiz.  
If the goal for now is just to produce a tool set along with  
examples, it's not such a big deal.

-David


On Dec 3, 2006, at 11:38 PM, Oleg Kozyrev Jr. wrote:

> Hello, all
>
> My partner Kirill Kuznetsov and I were working last year on the  
> integration
> of Data Warehouse module. Finally we reached following results:
> 1. ETL processes described in XML, executed in Ofbiz and realized via
> Octopus, which transform and transfer data from some JDBC source to  
> Ofbiz
> SQL database.
> 2. OLAP tool which makes it possible to process MDX queries & OLAP
> Operations (sorting, filters, drilldowns, and so on) in Ofbiz  
> interface.
> 3. Ofbiz Interfaces including some nice diagrams (implemented as  
> applets
> using JFreeChart).
> In addition we have some working examples (data models + star  
> schemas, e.g.
> Healthcare data model)
>
> Certainly it's not a ready result, and this year new students of our
> university will probably continue our efforts making  it more  
> functional &
> easy to use (it's planned to finish old functionalities, add new  
> math tools
> like regressions, etc.)
>
> Still it would be great if you took a look at out project (it is
> downloadable at sourceforge.net), or if it is interesting we could  
> make
> online access (demos to our working version). The most interesting  
> question
> for us is if it  can be after some modifications be included into  
> Ofbiz
> Source Code.
>
> There  was also an issue in the old Jira (jira.ofbiz.org) called  
> "Ofbiz
> Datawarehouse component" (617 as far as i remember).
>
> Best Regards,
> Kirill Kuzntetsov & Oleg Kozyrev
> --
> View this message in context: http://www.nabble.com/Datawarehouse- 
> implementation-tf2749621.html#a7671426
> Sent from the OFBiz - Dev mailing list archive at Nabble.com.
>

[Si Chen-2]

Hi everybody -

We have been experimenting with openi, olap, and mondrian with ofbiz  
ourselves, thanks to Chris's documentation, and have had some  
success.  We're now able to generate some cubes for ofbiz.

Do you want to take a look at what we've done?  Do you have some code  
samples that you're willing to post/share somewhere online, so we can  
coordinate?

Longer term, I do agree with David -- it might not be ideal for OFBiz  
per se to have so much reliance on LGPL libraries.


On Dec 4, 2006, at 8:45 AM, David E Jones wrote:

>
> Oleg,
>
> It's great to see that you guys have made progress on this.  
> Reporting, data warehousing and data analysis have been problems  
> with OFBiz for a while.
>
> Depending on licensing it may be a good goal to get this into the  
> main OFBiz code base, but if it is working okay as a separate  
> project then it can be an add-on for people to use on top of OFBiz  
> without worrying so much about licensing issues (ie you can  
> continue to include LGPL licensed libraries, etc). I should make it  
> clear that I'm just thinking out loud about this and while it would  
> be cool to have this stuff in OFBiz itself, it certainly isn't  
> required in order to be of use to OFBiz users, and hopefully to  
> allow some community/interesting building around it.
>
> The one concern I would have as a separate project or even using  
> LGPL libraries is having a large library of OFBiz application  
> specific ETL artifacts, and reports based on the warehouse  
> database. If that is the direction this is going it would be a lot  
> easier to maintain those along with the applications and data model  
> and such of OFBiz. If the goal for now is just to produce a tool  
> set along with examples, it's not such a big deal.
>
> -David
>
>
> On Dec 3, 2006, at 11:38 PM, Oleg Kozyrev Jr. wrote:
>
>> Hello, all
>>
>> My partner Kirill Kuznetsov and I were working last year on the  
>> integration
>> of Data Warehouse module. Finally we reached following results:
>> 1. ETL processes described in XML, executed in Ofbiz and realized via
>> Octopus, which transform and transfer data from some JDBC source  
>> to Ofbiz
>> SQL database.
>> 2. OLAP tool which makes it possible to process MDX queries & OLAP
>> Operations (sorting, filters, drilldowns, and so on) in Ofbiz  
>> interface.
>> 3. Ofbiz Interfaces including some nice diagrams (implemented as  
>> applets
>> using JFreeChart).
>> In addition we have some working examples (data models + star  
>> schemas, e.g.
>> Healthcare data model)
>>
>> Certainly it's not a ready result, and this year new students of our
>> university will probably continue our efforts making  it more  
>> functional &
>> easy to use (it's planned to finish old functionalities, add new  
>> math tools
>> like regressions, etc.)
>>
>> Still it would be great if you took a look at out project (it is
>> downloadable at sourceforge.net), or if it is interesting we could  
>> make
>> online access (demos to our working version). The most interesting  
>> question
>> for us is if it  can be after some modifications be included into  
>> Ofbiz
>> Source Code.
>>
>> There  was also an issue in the old Jira (jira.ofbiz.org) called  
>> "Ofbiz
>> Datawarehouse component" (617 as far as i remember).
>>
>> Best Regards,
>> Kirill Kuzntetsov & Oleg Kozyrev
>> --
>> View this message in context: http://www.nabble.com/Datawarehouse- 
>> implementation-tf2749621.html#a7671426
>> Sent from the OFBiz - Dev mailing list archive at Nabble.com.
>>

Best Regards,

Si
[hidden email]

[cjhowe]

Hey Si,

What have you done so far with the openI stuff?  I'm
thinking if some of Oleg's stuff were incorporated it
would be fairly short work to have openI utilize the
delegator for the connection info and then benefit
from the openI's analysis generation but keep it
templated through screens and such.

I'd be very interested in seeing what y'all have come
up with so far.  Everything I've done so far with it
has predominately been using it along side ofbiz with
the integration steps just giving the benefit of not
having to have an additional tomcat instance running
on another port.


--- Si Chen <[hidden email]> wrote:

> Hi everybody -
>
> We have been experimenting with openi, olap, and
> mondrian with ofbiz  
> ourselves, thanks to Chris's documentation, and have
> had some  
> success.  We're now able to generate some cubes for
> ofbiz.
>
> Do you want to take a look at what we've done?  Do
> you have some code  
> samples that you're willing to post/share somewhere
> online, so we can  
> coordinate?
>
> Longer term, I do agree with David -- it might not
> be ideal for OFBiz  
> per se to have so much reliance on LGPL libraries.
>
>

[Kirill Kuznetsov]

Hi, Chris

Thank you for useful comments & inspiring ideas. We plan to build server in the nearest time where it will be possible to see how it works. Certainly we (or our followers) will also work on bugs you have noticed (and hopefully will notice further). So we will post here when the server is ready.

Thanks
Kirill Kuznetsov

cjhowe wrote

In addition, requires updating web.xml and
controller.xml to utilize the current
org.ofbiz.webapp.control.LoginEventListener
instead of the securityext stuff.

After getting the webapp loaded successfully, I was
not able to successfully run a query despite having
the foodmart database installed on a mysql server and
changing the settings to correspond to it. The java
methods used need to implement try/catch statements to
narrow down the problem, otherwise you just get
generic service failure messages.

Oleg,

There are quite a few unlicensed source files in your
repository, are you releasing these under the apache
license as well or are these source files in
collaboration with another project (The debug
statements make reference to mondrian.properties
whereas the file in your distribution is
dwh-mondrian.properties suggesting that at least part
of the java source files - ie QueryTag.java - are
derivative of files from another project - most likely
mondrian and AFAIK thereby not able to be released
under an Apache license)

I would very much like to help make this something
that can eventually be worked in to Apache Ofbiz, but
need to fully understand the licensing limitations so
that I know if a solution needs to actually become a
part of Apache Ofbiz or simply run inside it as a
supplemental work.

Last week I wrote up a simple guide on how to get
openI to run inside ofbiz (at least to use embedded
tomcat), but would very much prefer your solution as
it moves down the milestone path to already utilize
controller.xml, the screen widgets  the login tools,
etc.  I look forward to working on this.


--- Chris Howe <[e-mail]> wrote:

> Couple small details about the build.xml file. For
> those who want to try it out...
>
> Line 40 correct with your deployment's location of
> ofbizhome
>
> Line 47-49  /base should now be /framework/base
>
>
>
> --- "Oleg Kozyrev Jr." <[e-mail]> wrote:
>
> >
> > Frankly speaking, now we were using FoodMart,
> > because it contains much more
> > data when the OFBiz from SVN. And that's why it's
> > better for testing.
> >
> > But, we have ETL based on Octopus and we have
> > managed to build another model
> > from OFBiz database. Unfortunatelly, it is using
> SQL
> > terms, but not OFBiz
> > Entities. As I alredy said next year new students
> > are going to work on this.
> > They will probably extend ETL functionality to
> work
> > more with OFBiz
> > Entities. It's better for modelling to my mind.
> >
> > Still the project is in pretty early stage, but we
> > hope that it will under
> > extensive development in future.
> >
> >
> > cjhowe wrote:
> > >
> > > Hello Oleg,
> > >
> > > I was just doing a quick browse of your project
> (
> > > http://sourceforge.net/projects/datawarehouse/ )
> > and
> > > noticed that you still had the FoodMart cube.
> > Have
> > > you created a cube based on OFBiz yet or were
> you
> > just
> > > testing the request/response capabilities?
> > Thanks!
> > >
> > >
> > > --- "Oleg Kozyrev Jr." <[e-mail]>
> > wrote:
> > >
> > >>
> > >> Hello, all
> > >>
> > >> My partner Kirill Kuznetsov and I were working
> > last
> > >> year on the integration
> > >> of Data Warehouse module. Finally we reached
> > >> following results:
> > >> 1. ETL processes described in XML, executed in
> > Ofbiz
> > >> and realized via
> > >> Octopus, which transform and transfer data from
> > some
> > >> JDBC source to Ofbiz
> > >> SQL database.
> > >> 2. OLAP tool which makes it possible to process
> > MDX
> > >> queries & OLAP
> > >> Operations (sorting, filters, drilldowns, and
> so
> > on)
> > >> in Ofbiz interface.
> > >> 3. Ofbiz Interfaces including some nice
> diagrams
> > >> (implemented as applets
> > >> using JFreeChart).
> > >> In addition we have some working examples (data
> > >> models + star schemas, e.g.
> > >> Healthcare data model)
> > >>
> > >> Certainly it's not a ready result, and this
> year
> > new
> > >> students of our
> > >> university will probably continue our efforts
> > making
> > >>  it more functional &
> > >> easy to use (it's planned to finish old
> > >> functionalities, add new math tools
> > >> like regressions, etc.)
> > >>
> > >> Still it would be great if you took a look at
> out
> > >> project (it is
> > >> downloadable at sourceforge.net), or if it is
> > >> interesting we could make
> > >> online access (demos to our working version).
> The
> > >> most interesting question
> > >> for us is if it  can be after some
> modifications
> > be
> > >> included into Ofbiz
> > >> Source Code.
> > >>
> > >> There  was also an issue in the old Jira
> > >> (jira.ofbiz.org) called "Ofbiz
> > >> Datawarehouse component" (617 as far as i
> > remember).
> > >>
> > >> Best Regards,
> > >> Kirill Kuzntetsov & Oleg Kozyrev
> > >> --
> > >> View this message in context:
> > >>
> > >
> >
>
http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671426
> > >> Sent from the OFBiz - Dev mailing list archive
> at
> > >> Nabble.com.
> > >>
> > >>
> > >
> > >
> > >
> >
> > --
> > View this message in context:
> >
>
http://www.nabble.com/Datawarehouse-implementation-tf2749621.html#a7671789
> > Sent from the OFBiz - Dev mailing list archive at
> > Nabble.com.
> >
> >
>
>