Proof of concept for an Integrated OFBiz framework for business intelligence
Locked
Proof of concept for an Integrated OFBiz framework for business intelligence
 
|
Hi all,
in rev. 584727 I've committed my work on a proof of concept for an Integrated OFBiz framework for business intelligence. This is essentially a new specialpurpose component (but it will probably disappear as soon as all its parts will be integrated in the main OFBiz applications) with a simple web application. For more details, visit the new tab "Business Intelligence" and read the component introduction in the main page (there are also instructions on how to start.... everything is very simple). And of course, let me know your opinions/questions/comments etc... *IMPORTANT*: the datawarehouse report will drill up/down correctly only if the patch attached to this mail is applied; I will commit it (or an equivalent variant) soon but I have to wait for feedback on this in the dev list before... by the way I'll let you know as soon as it is in. Jacopo Index: framework/entity/src/org/ofbiz/entity/datasource/GenericDAO.java =================================================================== --- framework/entity/src/org/ofbiz/entity/datasource/GenericDAO.java (revision 584577) +++ framework/entity/src/org/ofbiz/entity/datasource/GenericDAO.java (working copy) @@ -711,7 +711,7 @@ // GROUP BY clause for view-entity if (modelEntity instanceof ModelViewEntity) { ModelViewEntity modelViewEntity = (ModelViewEntity) modelEntity; - String groupByString = modelViewEntity.colNameString(modelViewEntity.getGroupBysCopy(), ", ", "", false); + String groupByString = modelViewEntity.colNameString(modelViewEntity.getGroupBysCopy(selectFields), ", ", "", false); if (UtilValidate.isNotEmpty(groupByString)) { sqlBuffer.append(" GROUP BY "); |
Re: Proof of concept for an Integrated OFBiz framework for business intelligence
|
|
Ok,
the patch to the framework is not officially in the svn trunk (rev. 585051); so now you can just update your ofbiz instance and play with the new component. Jacopo Jacopo Cappellato wrote: > Hi all, > > in rev. 584727 I've committed my work on a proof of concept for an > Integrated OFBiz framework for business intelligence. > This is essentially a new specialpurpose component (but it will probably > disappear as soon as all its parts will be integrated in the main OFBiz > applications) with a simple web application. > For more details, visit the new tab "Business Intelligence" and read the > component introduction in the main page (there are also instructions on > how to start.... everything is very simple). > And of course, let me know your opinions/questions/comments etc... > > *IMPORTANT*: the datawarehouse report will drill up/down correctly only > if the patch attached to this mail is applied; I will commit it (or an > equivalent variant) soon but I have to wait for feedback on this in the > dev list before... by the way I'll let you know as soon as it is in. > > Jacopo > > |
Re: Proof of concept for an Integrated OFBiz framework for business intelligence
|
|
it's greate, I will try this component later, but I think if we can use
some other open source BI component like BIRT will speed the goal up. 2007/10/16, Jacopo Cappellato <[hidden email]>: > > Ok, > > the patch to the framework is not officially in the svn trunk (rev. > 585051); so now you can just update your ofbiz instance and play with > the new component. > > Jacopo > > > Jacopo Cappellato wrote: > > Hi all, > > > > in rev. 584727 I've committed my work on a proof of concept for an > > Integrated OFBiz framework for business intelligence. > > This is essentially a new specialpurpose component (but it will probably > > disappear as soon as all its parts will be integrated in the main OFBiz > > applications) with a simple web application. > > For more details, visit the new tab "Business Intelligence" and read the > > component introduction in the main page (there are also instructions on > > how to start.... everything is very simple). > > And of course, let me know your opinions/questions/comments etc... > > > > *IMPORTANT*: the datawarehouse report will drill up/down correctly only > > if the patch attached to this mail is applied; I will commit it (or an > > equivalent variant) soon but I have to wait for feedback on this in the > > dev list before... by the way I'll let you know as soon as it is in. > > > > Jacopo > > > > > > > |
Re: Proof of concept for an Integrated OFBiz framework for business intelligence
|
|
Of course,
we are free to choose the best reporting tool for the reports done on the dimensional data model we are building. Jacopo guo weizhan wrote: > it's greate, I will try this component later, but I think if we can use > some other open source BI component like BIRT will speed the goal up. > > 2007/10/16, Jacopo Cappellato <[hidden email]>: >> Ok, >> >> the patch to the framework is not officially in the svn trunk (rev. >> 585051); so now you can just update your ofbiz instance and play with >> the new component. >> >> Jacopo >> >> >> Jacopo Cappellato wrote: >>> Hi all, >>> >>> in rev. 584727 I've committed my work on a proof of concept for an >>> Integrated OFBiz framework for business intelligence. >>> This is essentially a new specialpurpose component (but it will probably >>> disappear as soon as all its parts will be integrated in the main OFBiz >>> applications) with a simple web application. >>> For more details, visit the new tab "Business Intelligence" and read the >>> component introduction in the main page (there are also instructions on >>> how to start.... everything is very simple). >>> And of course, let me know your opinions/questions/comments etc... >>> >>> *IMPORTANT*: the datawarehouse report will drill up/down correctly only >>> if the patch attached to this mail is applied; I will commit it (or an >>> equivalent variant) soon but I have to wait for feedback on this in the >>> dev list before... by the way I'll let you know as soon as it is in. >>> >>> Jacopo >>> >>> >> >> > |
Re: Proof of concept for an Integrated OFBiz framework for business intelligence
Administrator
|
In reply to this post by Jacopo Cappellato
Hi Jacopo,
Using rev. 586670 and a new fresh postgres DB I got this message on ant run-install [java] 2007-10-20 14:07:59,218 (main) [ EntitySaxReader.java:217:INFO ] Beginning import from URL: file:/D:/workspace/ofbizRun/specialpurpose/bi/data/DimensionTypeData.xml [java] 2007-10-20 14:07:59,218 (main) [ EntitySaxReader.java:255:INFO ] Transaction Timeout set to 2 hours (7200 seconds) [java] 2007-10-20 14:07:59,234 (main) [ EntitySaxReader.java:556:WARN ] [java] ---- runtime exception report -------------------------------------------------- [java] Could not set field CurrencyDimension.dimensionId to the value _NF_ [java] Exception: java.lang.IllegalArgumentException [java] Message: Type id-ne not found [java] ---- stack trace --------------------------------------------------------------- [java] java.lang.IllegalArgumentException: Type id-ne not found [java] org.ofbiz.entity.GenericEntity.setString(GenericEntity.java:457) [java] org.ofbiz.entity.util.EntitySaxReader.startElement(EntitySaxReader.java:550) [java] javolution.xml.sax.XMLReaderImpl.parseAll(Unknown Source) [java] javolution.xml.sax.XMLReaderImpl.parse(Unknown Source) [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:258) [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:218) [java] org.ofbiz.entity.util.EntityDataLoader.loadData(EntityDataLoader.java:211) [java] org.ofbiz.entityext.data.EntityDataLoadContainer.start(EntityDataLoadContainer.java:267) [java] org.ofbiz.base.container.ContainerLoader.start(ContainerLoader.java:79) [java] org.ofbiz.base.start.Start.startStartLoaders(Start.java:261) [java] org.ofbiz.base.start.Start.startServer(Start.java:310) [java] org.ofbiz.base.start.Start.start(Start.java:314) [java] org.ofbiz.base.start.Start.main(Start.java:397) [java] -------------------------------------------------------------------------------- [java] [java] 2007-10-20 14:07:59,234 (main) [ EntitySaxReader.java:556:WARN ] [java] ---- runtime exception report -------------------------------------------------- [java] Could not set field CurrencyDimension.description to the value Currency Not Found. [java] Exception: java.lang.IllegalArgumentException [java] Message: Type description not found [java] ---- stack trace --------------------------------------------------------------- [java] java.lang.IllegalArgumentException: Type description not found [java] org.ofbiz.entity.GenericEntity.setString(GenericEntity.java:457) [java] org.ofbiz.entity.util.EntitySaxReader.startElement(EntitySaxReader.java:550) [java] javolution.xml.sax.XMLReaderImpl.parseAll(Unknown Source) [java] javolution.xml.sax.XMLReaderImpl.parse(Unknown Source) [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:258) [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:218) [java] org.ofbiz.entity.util.EntityDataLoader.loadData(EntityDataLoader.java:211) [java] org.ofbiz.entityext.data.EntityDataLoadContainer.start(EntityDataLoadContainer.java:267) [java] org.ofbiz.base.container.ContainerLoader.start(ContainerLoader.java:79) [java] org.ofbiz.base.start.Start.startStartLoaders(Start.java:261) [java] org.ofbiz.base.start.Start.startServer(Start.java:310) [java] org.ofbiz.base.start.Start.start(Start.java:314) [java] org.ofbiz.base.start.Start.main(Start.java:397) [java] -------------------------------------------------------------------------------- [java] [java] 2007-10-20 14:07:59,250 (main) [ SequenceUtil.java:236:WARN ] [SequenceUtil.SequenceBank.fillBank] first select failed: will try to add new row, result set was empty for sequence [CurrencyDi mension] [java] Used SQL: SELECT SEQ_ID FROM public.SEQUENCE_VALUE_ITEM WHERE SEQ_NAME='CurrencyDimension' [java] Thread Name is: main:Thread[main,5,main] [java] 2007-10-20 14:07:59,265 (main) [ SequenceUtil.java:341:INFO ] Got bank of sequenced IDs for [CurrencyDimension]; curSeqId=10000, maxSeqId=10010, bankSize=10 [java] 2007-10-20 14:07:59,265 (main) [ EntitySaxReader.java:267:ERROR] [java] ---- runtime exception report -------------------------------------------------- [java] An error occurred saving the data, rolling back transaction (true) [java] Exception: java.lang.IllegalArgumentException [java] Message: Type id-ne not found [java] ---- stack trace --------------------------------------------------------------- [java] java.lang.IllegalArgumentException: Type id-ne not found [java] org.ofbiz.entity.GenericEntity.setString(GenericEntity.java:457) [java] org.ofbiz.entity.util.EntitySaxReader.endElement(EntitySaxReader.java:396) [java] javolution.xml.sax.XMLReaderImpl.parseAll(Unknown Source) [java] javolution.xml.sax.XMLReaderImpl.parse(Unknown Source) [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:258) [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:218) [java] org.ofbiz.entity.util.EntityDataLoader.loadData(EntityDataLoader.java:211) [java] org.ofbiz.entityext.data.EntityDataLoadContainer.start(EntityDataLoadContainer.java:267) [java] org.ofbiz.base.container.ContainerLoader.start(ContainerLoader.java:79) [java] org.ofbiz.base.start.Start.startStartLoaders(Start.java:261) [java] org.ofbiz.base.start.Start.startServer(Start.java:310) [java] org.ofbiz.base.start.Start.start(Start.java:314) [java] org.ofbiz.base.start.Start.main(Start.java:397) [java] -------------------------------------------------------------------------------- [java] [java] 2007-10-20 14:07:59,265 (main) [ TransactionUtil.java:262:ERROR] [java] ---- exception report ---------------------------------------------------------- [java] [TransactionUtil.rollback] [java] Exception: java.lang.Exception [java] Message: Stack Trace [java] ---- stack trace --------------------------------------------------------------- [java] java.lang.Exception: Stack Trace [java] org.ofbiz.entity.transaction.TransactionUtil.rollback(TransactionUtil.java:261) [java] org.ofbiz.entity.transaction.TransactionUtil.rollback(TransactionUtil.java:243) [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:268) [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:218) [java] org.ofbiz.entity.util.EntityDataLoader.loadData(EntityDataLoader.java:211) [java] org.ofbiz.entityext.data.EntityDataLoadContainer.start(EntityDataLoadContainer.java:267) [java] org.ofbiz.base.container.ContainerLoader.start(ContainerLoader.java:79) [java] org.ofbiz.base.start.Start.startStartLoaders(Start.java:261) [java] org.ofbiz.base.start.Start.startServer(Start.java:310) [java] org.ofbiz.base.start.Start.start(Start.java:314) [java] org.ofbiz.base.start.Start.main(Start.java:397) [java] -------------------------------------------------------------------------------- [java] [java] 2007-10-20 14:07:59,265 (main) [ TransactionUtil.java:272:INFO ] [TransactionUtil.rollback] transaction rolled back [java] 2007-10-20 14:07:59,265 (main) [ EntityDataLoader.java:215:ERROR] [java] ---- exception report ---------------------------------------------------------- [java] [install.loadData]: Error loading XML Resource "file:/D:/workspace/ofbizRun/specialpurpose/bi/data/DimensionTypeData.xml"; Error was: A transaction error occurred reading data [java] Exception: org.xml.sax.SAXException [java] Message: A transaction error occurred reading data [java] ---- stack trace --------------------------------------------------------------- [java] java.lang.IllegalArgumentException: Type id-ne not found [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:269) [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:218) [java] org.ofbiz.entity.util.EntityDataLoader.loadData(EntityDataLoader.java:211) [java] org.ofbiz.entityext.data.EntityDataLoadContainer.start(EntityDataLoadContainer.java:267) [java] org.ofbiz.base.container.ContainerLoader.start(ContainerLoader.java:79) [java] org.ofbiz.base.start.Start.startStartLoaders(Start.java:261) [java] org.ofbiz.base.start.Start.startServer(Start.java:310) [java] org.ofbiz.base.start.Start.start(Start.java:314) [java] org.ofbiz.base.start.Start.main(Start.java:397) [java] -------------------------------------------------------------------------------- [java] [java] 2007-10-20 14:07:59,265 (main) [ EntitySaxReader.java:217:INFO ] Beginning import from URL: file:/D:/workspace/ofbizRun/applications/securityext/data/UserDemoData.xml Then using Quick Init DataWarehouse I got : 2007-10-20 14:11:20,296 (http-0.0.0.0-28443-Processor4) [ GenericDelegator.java:1959:ERROR] ---- exception report ---------------------------------------------------------- Failure in findByCondition operation for entity [DateDimension]: org.ofbiz.entity.GenericEntityException: Helper name not found for entity DateDimension. Rolling back transaction. Exception: org.ofbiz.entity.GenericEntityException Message: Helper name not found for entity DateDimension ---- stack trace --------------------------------------------------------------- org.ofbiz.entity.GenericEntityException: Helper name not found for entity DateDimension org.ofbiz.entity.GenericDelegator.getEntityHelper(GenericDelegator.java:389) org.ofbiz.entity.GenericDelegator.findListIteratorByCondition(GenericDelegator.java:2050) org.ofbiz.entity.GenericDelegator.findByCondition(GenericDelegator.java:1951) org.ofbiz.entity.GenericDelegator.findByCondition(GenericDelegator.java:1930) org.ofbiz.entity.GenericDelegator.findByAnd(GenericDelegator.java:1795) org.ofbiz.entity.GenericDelegator.findByAnd(GenericDelegator.java:1765) org.ofbiz.bi.util.DimensionServices.loadDateDimension(DimensionServices.java:151) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:585) org.ofbiz.service.engine.StandardJavaEngine.serviceInvoker(StandardJavaEngine.java:95) org.ofbiz.service.engine.StandardJavaEngine.runSync(StandardJavaEngine.java:53) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:371) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:206) org.ofbiz.service.GenericDispatcher.runSync(GenericDispatcher.java:154) org.ofbiz.minilang.method.callops.CallService.exec(CallService.java:239) org.ofbiz.minilang.SimpleMethod.runSubOps(SimpleMethod.java:931) org.ofbiz.minilang.SimpleMethod.exec(SimpleMethod.java:568) org.ofbiz.minilang.SimpleMethod.runSimpleMethod(SimpleMethod.java:105) org.ofbiz.minilang.SimpleMethod.runSimpleService(SimpleMethod.java:87) org.ofbiz.minilang.SimpleServiceEngine.serviceInvoker(SimpleServiceEngine.java:76) org.ofbiz.minilang.SimpleServiceEngine.runSync(SimpleServiceEngine.java:51) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:371) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:206) org.ofbiz.service.GenericDispatcher.runSync(GenericDispatcher.java:136) org.ofbiz.webapp.event.ServiceEventHandler.invoke(ServiceEventHandler.java:327) org.ofbiz.webapp.control.RequestHandler.runEvent(RequestHandler.java:454) org.ofbiz.webapp.control.RequestHandler.doRequest(RequestHandler.java:281) org.ofbiz.webapp.control.ControlServlet.doGet(ControlServlet.java:193) javax.servlet.http.HttpServlet.service(HttpServlet.java:595) javax.servlet.http.HttpServlet.service(HttpServlet.java:688) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188) org.ofbiz.webapp.control.ContextFilter.doFilter(ContextFilter.java:248) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:210) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:174) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108) org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:542) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:870) org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665) org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528) org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81) org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:685) java.lang.Thread.run(Thread.java:595) -------------------------------------------------------------------------------- I did not look further for now.. Jacques > Hi all, > > in rev. 584727 I've committed my work on a proof of concept for an > Integrated OFBiz framework for business intelligence. > This is essentially a new specialpurpose component (but it will probably > disappear as soon as all its parts will be integrated in the main OFBiz > applications) with a simple web application. > For more details, visit the new tab "Business Intelligence" and read the > component introduction in the main page (there are also instructions on > how to start.... everything is very simple). > And of course, let me know your opinions/questions/comments etc... > > *IMPORTANT*: the datawarehouse report will drill up/down correctly only > if the patch attached to this mail is applied; I will commit it (or an > equivalent variant) soon but I have to wait for feedback on this in the > dev list before... by the way I'll let you know as soon as it is in. > > Jacopo > > > -------------------------------------------------------------------------------- > Index: framework/entity/src/org/ofbiz/entity/datasource/GenericDAO.java > =================================================================== > --- framework/entity/src/org/ofbiz/entity/datasource/GenericDAO.java (revision 584577) > +++ framework/entity/src/org/ofbiz/entity/datasource/GenericDAO.java (working copy) > @@ -711,7 +711,7 @@ > // GROUP BY clause for view-entity > if (modelEntity instanceof ModelViewEntity) { > ModelViewEntity modelViewEntity = (ModelViewEntity) modelEntity; > - String groupByString = modelViewEntity.colNameString(modelViewEntity.getGroupBysCopy(), ", ", "", false); > + String groupByString = modelViewEntity.colNameString(modelViewEntity.getGroupBysCopy(selectFields), ", ", "", false); > > if (UtilValidate.isNotEmpty(groupByString)) { > sqlBuffer.append(" GROUP BY "); > |
Re: Proof of concept for an Integrated OFBiz framework for business intelligence
|
|
Hi Jacques,
the datawarehouse entities are stored in a separate database; have a look at the settings for derby, I think that you have to replicate them for Postgres... there are now two entity-groups: org.ofbiz org.ofbiz.olap My first guess is that the second one is not associated to a valid datasource. if it doesn't work let me know, and I will help to fix.! Jacopo Jacques Le Roux wrote: > Hi Jacopo, > > Using rev. 586670 and a new fresh postgres DB I got this message on ant run-install > > [java] 2007-10-20 14:07:59,218 (main) [ EntitySaxReader.java:217:INFO ] Beginning import from URL: > file:/D:/workspace/ofbizRun/specialpurpose/bi/data/DimensionTypeData.xml > [java] 2007-10-20 14:07:59,218 (main) [ EntitySaxReader.java:255:INFO ] Transaction Timeout set to 2 hours (7200 seconds) > [java] 2007-10-20 14:07:59,234 (main) [ EntitySaxReader.java:556:WARN ] > [java] ---- runtime exception report -------------------------------------------------- > [java] Could not set field CurrencyDimension.dimensionId to the value _NF_ > [java] Exception: java.lang.IllegalArgumentException > [java] Message: Type id-ne not found > [java] ---- stack trace --------------------------------------------------------------- > [java] java.lang.IllegalArgumentException: Type id-ne not found > [java] org.ofbiz.entity.GenericEntity.setString(GenericEntity.java:457) > [java] org.ofbiz.entity.util.EntitySaxReader.startElement(EntitySaxReader.java:550) > [java] javolution.xml.sax.XMLReaderImpl.parseAll(Unknown Source) > [java] javolution.xml.sax.XMLReaderImpl.parse(Unknown Source) > [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:258) > [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:218) > [java] org.ofbiz.entity.util.EntityDataLoader.loadData(EntityDataLoader.java:211) > [java] org.ofbiz.entityext.data.EntityDataLoadContainer.start(EntityDataLoadContainer.java:267) > [java] org.ofbiz.base.container.ContainerLoader.start(ContainerLoader.java:79) > [java] org.ofbiz.base.start.Start.startStartLoaders(Start.java:261) > [java] org.ofbiz.base.start.Start.startServer(Start.java:310) > [java] org.ofbiz.base.start.Start.start(Start.java:314) > [java] org.ofbiz.base.start.Start.main(Start.java:397) > [java] -------------------------------------------------------------------------------- > [java] > [java] 2007-10-20 14:07:59,234 (main) [ EntitySaxReader.java:556:WARN ] > [java] ---- runtime exception report -------------------------------------------------- > [java] Could not set field CurrencyDimension.description to the value Currency Not Found. > [java] Exception: java.lang.IllegalArgumentException > [java] Message: Type description not found > [java] ---- stack trace --------------------------------------------------------------- > [java] java.lang.IllegalArgumentException: Type description not found > [java] org.ofbiz.entity.GenericEntity.setString(GenericEntity.java:457) > [java] org.ofbiz.entity.util.EntitySaxReader.startElement(EntitySaxReader.java:550) > [java] javolution.xml.sax.XMLReaderImpl.parseAll(Unknown Source) > [java] javolution.xml.sax.XMLReaderImpl.parse(Unknown Source) > [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:258) > [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:218) > [java] org.ofbiz.entity.util.EntityDataLoader.loadData(EntityDataLoader.java:211) > [java] org.ofbiz.entityext.data.EntityDataLoadContainer.start(EntityDataLoadContainer.java:267) > [java] org.ofbiz.base.container.ContainerLoader.start(ContainerLoader.java:79) > [java] org.ofbiz.base.start.Start.startStartLoaders(Start.java:261) > [java] org.ofbiz.base.start.Start.startServer(Start.java:310) > [java] org.ofbiz.base.start.Start.start(Start.java:314) > [java] org.ofbiz.base.start.Start.main(Start.java:397) > [java] -------------------------------------------------------------------------------- > [java] > [java] 2007-10-20 14:07:59,250 (main) [ SequenceUtil.java:236:WARN ] [SequenceUtil.SequenceBank.fillBank] first select > failed: will try to add new row, result set was empty for sequence [CurrencyDi > mension] > [java] Used SQL: SELECT SEQ_ID FROM public.SEQUENCE_VALUE_ITEM WHERE SEQ_NAME='CurrencyDimension' > [java] Thread Name is: main:Thread[main,5,main] > [java] 2007-10-20 14:07:59,265 (main) [ SequenceUtil.java:341:INFO ] Got bank of sequenced IDs for [CurrencyDimension]; > curSeqId=10000, maxSeqId=10010, bankSize=10 > [java] 2007-10-20 14:07:59,265 (main) [ EntitySaxReader.java:267:ERROR] > [java] ---- runtime exception report -------------------------------------------------- > [java] An error occurred saving the data, rolling back transaction (true) > [java] Exception: java.lang.IllegalArgumentException > [java] Message: Type id-ne not found > [java] ---- stack trace --------------------------------------------------------------- > [java] java.lang.IllegalArgumentException: Type id-ne not found > [java] org.ofbiz.entity.GenericEntity.setString(GenericEntity.java:457) > [java] org.ofbiz.entity.util.EntitySaxReader.endElement(EntitySaxReader.java:396) > [java] javolution.xml.sax.XMLReaderImpl.parseAll(Unknown Source) > [java] javolution.xml.sax.XMLReaderImpl.parse(Unknown Source) > [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:258) > [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:218) > [java] org.ofbiz.entity.util.EntityDataLoader.loadData(EntityDataLoader.java:211) > [java] org.ofbiz.entityext.data.EntityDataLoadContainer.start(EntityDataLoadContainer.java:267) > [java] org.ofbiz.base.container.ContainerLoader.start(ContainerLoader.java:79) > [java] org.ofbiz.base.start.Start.startStartLoaders(Start.java:261) > [java] org.ofbiz.base.start.Start.startServer(Start.java:310) > [java] org.ofbiz.base.start.Start.start(Start.java:314) > [java] org.ofbiz.base.start.Start.main(Start.java:397) > [java] -------------------------------------------------------------------------------- > [java] > [java] 2007-10-20 14:07:59,265 (main) [ TransactionUtil.java:262:ERROR] > [java] ---- exception report ---------------------------------------------------------- > [java] [TransactionUtil.rollback] > [java] Exception: java.lang.Exception > [java] Message: Stack Trace > [java] ---- stack trace --------------------------------------------------------------- > [java] java.lang.Exception: Stack Trace > [java] org.ofbiz.entity.transaction.TransactionUtil.rollback(TransactionUtil.java:261) > [java] org.ofbiz.entity.transaction.TransactionUtil.rollback(TransactionUtil.java:243) > [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:268) > [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:218) > [java] org.ofbiz.entity.util.EntityDataLoader.loadData(EntityDataLoader.java:211) > [java] org.ofbiz.entityext.data.EntityDataLoadContainer.start(EntityDataLoadContainer.java:267) > [java] org.ofbiz.base.container.ContainerLoader.start(ContainerLoader.java:79) > [java] org.ofbiz.base.start.Start.startStartLoaders(Start.java:261) > [java] org.ofbiz.base.start.Start.startServer(Start.java:310) > [java] org.ofbiz.base.start.Start.start(Start.java:314) > [java] org.ofbiz.base.start.Start.main(Start.java:397) > [java] -------------------------------------------------------------------------------- > [java] > [java] 2007-10-20 14:07:59,265 (main) [ TransactionUtil.java:272:INFO ] [TransactionUtil.rollback] transaction rolled back > [java] 2007-10-20 14:07:59,265 (main) [ EntityDataLoader.java:215:ERROR] > [java] ---- exception report ---------------------------------------------------------- > [java] [install.loadData]: Error loading XML Resource > "file:/D:/workspace/ofbizRun/specialpurpose/bi/data/DimensionTypeData.xml"; Error was: A transaction error occurred reading data > [java] Exception: org.xml.sax.SAXException > [java] Message: A transaction error occurred reading data > [java] ---- stack trace --------------------------------------------------------------- > [java] java.lang.IllegalArgumentException: Type id-ne not found > [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:269) > [java] org.ofbiz.entity.util.EntitySaxReader.parse(EntitySaxReader.java:218) > [java] org.ofbiz.entity.util.EntityDataLoader.loadData(EntityDataLoader.java:211) > [java] org.ofbiz.entityext.data.EntityDataLoadContainer.start(EntityDataLoadContainer.java:267) > [java] org.ofbiz.base.container.ContainerLoader.start(ContainerLoader.java:79) > [java] org.ofbiz.base.start.Start.startStartLoaders(Start.java:261) > [java] org.ofbiz.base.start.Start.startServer(Start.java:310) > [java] org.ofbiz.base.start.Start.start(Start.java:314) > [java] org.ofbiz.base.start.Start.main(Start.java:397) > [java] -------------------------------------------------------------------------------- > [java] > [java] 2007-10-20 14:07:59,265 (main) [ EntitySaxReader.java:217:INFO ] Beginning import from URL: > file:/D:/workspace/ofbizRun/applications/securityext/data/UserDemoData.xml > > Then using Quick Init DataWarehouse I got : > > 2007-10-20 14:11:20,296 (http-0.0.0.0-28443-Processor4) [ GenericDelegator.java:1959:ERROR] > ---- exception report ---------------------------------------------------------- > Failure in findByCondition operation for entity [DateDimension]: org.ofbiz.entity.GenericEntityException: Helper name not found for > entity DateDimension. Rolling back transaction. > Exception: org.ofbiz.entity.GenericEntityException > Message: Helper name not found for entity DateDimension > ---- stack trace --------------------------------------------------------------- > org.ofbiz.entity.GenericEntityException: Helper name not found for entity DateDimension > org.ofbiz.entity.GenericDelegator.getEntityHelper(GenericDelegator.java:389) > org.ofbiz.entity.GenericDelegator.findListIteratorByCondition(GenericDelegator.java:2050) > org.ofbiz.entity.GenericDelegator.findByCondition(GenericDelegator.java:1951) > org.ofbiz.entity.GenericDelegator.findByCondition(GenericDelegator.java:1930) > org.ofbiz.entity.GenericDelegator.findByAnd(GenericDelegator.java:1795) > org.ofbiz.entity.GenericDelegator.findByAnd(GenericDelegator.java:1765) > org.ofbiz.bi.util.DimensionServices.loadDateDimension(DimensionServices.java:151) > sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > java.lang.reflect.Method.invoke(Method.java:585) > org.ofbiz.service.engine.StandardJavaEngine.serviceInvoker(StandardJavaEngine.java:95) > org.ofbiz.service.engine.StandardJavaEngine.runSync(StandardJavaEngine.java:53) > org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:371) > org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:206) > org.ofbiz.service.GenericDispatcher.runSync(GenericDispatcher.java:154) > org.ofbiz.minilang.method.callops.CallService.exec(CallService.java:239) > org.ofbiz.minilang.SimpleMethod.runSubOps(SimpleMethod.java:931) > org.ofbiz.minilang.SimpleMethod.exec(SimpleMethod.java:568) > org.ofbiz.minilang.SimpleMethod.runSimpleMethod(SimpleMethod.java:105) > org.ofbiz.minilang.SimpleMethod.runSimpleService(SimpleMethod.java:87) > org.ofbiz.minilang.SimpleServiceEngine.serviceInvoker(SimpleServiceEngine.java:76) > org.ofbiz.minilang.SimpleServiceEngine.runSync(SimpleServiceEngine.java:51) > org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:371) > org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:206) > org.ofbiz.service.GenericDispatcher.runSync(GenericDispatcher.java:136) > org.ofbiz.webapp.event.ServiceEventHandler.invoke(ServiceEventHandler.java:327) > org.ofbiz.webapp.control.RequestHandler.runEvent(RequestHandler.java:454) > org.ofbiz.webapp.control.RequestHandler.doRequest(RequestHandler.java:281) > org.ofbiz.webapp.control.ControlServlet.doGet(ControlServlet.java:193) > javax.servlet.http.HttpServlet.service(HttpServlet.java:595) > javax.servlet.http.HttpServlet.service(HttpServlet.java:688) > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269) > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188) > org.ofbiz.webapp.control.ContextFilter.doFilter(ContextFilter.java:248) > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215) > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188) > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:210) > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:174) > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117) > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108) > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:542) > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151) > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:870) > org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665) > org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528) > org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81) > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:685) > java.lang.Thread.run(Thread.java:595) > -------------------------------------------------------------------------------- > > I did not look further for now.. > > Jacques > >> Hi all, >> >> in rev. 584727 I've committed my work on a proof of concept for an >> Integrated OFBiz framework for business intelligence. >> This is essentially a new specialpurpose component (but it will probably >> disappear as soon as all its parts will be integrated in the main OFBiz >> applications) with a simple web application. >> For more details, visit the new tab "Business Intelligence" and read the >> component introduction in the main page (there are also instructions on >> how to start.... everything is very simple). >> And of course, let me know your opinions/questions/comments etc... >> >> *IMPORTANT*: the datawarehouse report will drill up/down correctly only >> if the patch attached to this mail is applied; I will commit it (or an >> equivalent variant) soon but I have to wait for feedback on this in the >> dev list before... by the way I'll let you know as soon as it is in. >> >> Jacopo >> >> >> > > > -------------------------------------------------------------------------------- > > >> Index: framework/entity/src/org/ofbiz/entity/datasource/GenericDAO.java >> =================================================================== >> --- framework/entity/src/org/ofbiz/entity/datasource/GenericDAO.java (revision 584577) >> +++ framework/entity/src/org/ofbiz/entity/datasource/GenericDAO.java (working copy) >> @@ -711,7 +711,7 @@ >> // GROUP BY clause for view-entity >> if (modelEntity instanceof ModelViewEntity) { >> ModelViewEntity modelViewEntity = (ModelViewEntity) modelEntity; >> - String groupByString = modelViewEntity.colNameString(modelViewEntity.getGroupBysCopy(), ", ", "", false); >> + String groupByString = modelViewEntity.colNameString(modelViewEntity.getGroupBysCopy(selectFields), ", ", "", false); >> >> if (UtilValidate.isNotEmpty(groupByString)) { >> sqlBuffer.append(" GROUP BY "); >> |
Re: Proof of concept for an Integrated OFBiz framework for business intelligence
|
Administrator
|
Thanks Jacopo,
Sorry I saw that briefly but did not note it and forgot. It was the cause. Moreover my entityengine.xml file was in svn conflict (I surely resolved by hand one day but forgot to resolve at the svn level) Jacques De : "Jacopo Cappellato" <[hidden email]> > Hi Jacques, > > the datawarehouse entities are stored in a separate database; have a > look at the settings for derby, I think that you have to replicate them > for Postgres... there are now two entity-groups: > org.ofbiz > org.ofbiz.olap > > My first guess is that the second one is not associated to a valid > datasource. > > if it doesn't work let me know, and I will help to fix.! > > Jacopo |
Re: Proof of concept for an Integrated OFBiz framework for business intelligence
|
|
Could someone clarify for the community what is the difference between this BI effort and the activity I see on Jira relatted to BIRT?
My sense is that BIRT is a reporting tool, and the new proof of concept for BI is about populating a data warehouse. Is this a correct assessment? Is there any relationship between the two initiatives or opportunities to build upon each other? Vince Clark Global Era The Freedom of Open Source [hidden email] (303) 493-6723 ----- Original Message ----- From: "Jacques Le Roux" <[hidden email]> To: [hidden email] Sent: Saturday, October 20, 2007 8:06:47 AM (GMT-0700) America/Chihuahua Subject: Re: Proof of concept for an Integrated OFBiz framework for business intelligence Thanks Jacopo, Sorry I saw that briefly but did not note it and forgot. It was the cause. Moreover my entityengine.xml file was in svn conflict (I surely resolved by hand one day but forgot to resolve at the svn level) Jacques De : "Jacopo Cappellato" <[hidden email]> > Hi Jacques, > > the datawarehouse entities are stored in a separate database; have a > look at the settings for derby, I think that you have to replicate them > for Postgres... there are now two entity-groups: > org.ofbiz > org.ofbiz.olap > > My first guess is that the second one is not associated to a valid > datasource. > > if it doesn't work let me know, and I will help to fix.! > > Jacopo |
Re: Proof of concept for an Integrated OFBiz framework for business intelligence
|
Administrator
|
De : "Vince M. Clark" <[hidden email]>
> Could someone clarify for the community what is the difference between this BI effort and the activity I see on Jira relatted to BIRT? Not sure I know all but here I go > My sense is that BIRT is a reporting tool, and the new proof of concept for BI is about populating a data warehouse. Is this a correct assessment? I believe the same >Is there any relationship between the two initiatives or opportunities to build upon each other? Not yet... (Jacopo and jack guo have begun to discuss about it : https://issues.apache.org/jira/browse/OFBIZ-1348) My 2 cts Jacques PS : I put some information about licence in https://issues.apache.org/jira/browse/OFBIZ-1348#action_12535273 > > Vince Clark > Global Era > The Freedom of Open Source > [hidden email] > (303) 493-6723 > > ----- Original Message ----- > From: "Jacques Le Roux" <[hidden email]> > To: [hidden email] > Sent: Saturday, October 20, 2007 8:06:47 AM (GMT-0700) America/Chihuahua > Subject: Re: Proof of concept for an Integrated OFBiz framework for business intelligence > > Thanks Jacopo, > > Sorry I saw that briefly but did not note it and forgot. It was the cause. Moreover my entityengine.xml file was in svn conflict > surely resolved by hand one day but forgot to resolve at the svn level) > > Jacques > > De : "Jacopo Cappellato" <[hidden email]> > > > > Hi Jacques, > > > > the datawarehouse entities are stored in a separate database; have a > > look at the settings for derby, I think that you have to replicate them > > for Postgres... there are now two entity-groups: > > org.ofbiz > > org.ofbiz.olap > > > > My first guess is that the second one is not associated to a valid > > datasource. > > > > if it doesn't work let me know, and I will help to fix.! > > > > Jacopo > > |
Re: Proof of concept for an Integrated OFBiz framework for business intelligence
|
|
In reply to this post by Vince Clark
Hi Vince,
you are totally correct: these are separate/independent efforts. BI effort: 1) creating a data model for dimensional analysis (datawarehouse) for OFBiz 2) low level services to facilitate the communication between the transactional and dimensional database 3) services to keep the dimensional data synchronized 4) (as a lower priority) a simple reporting tool for dimensional analysis BIRT effort (but Guo will probably be more precise on this, I've just read his Jira issue): a) integration of the BIRT reporting engine into OFBiz I don't know much about BIRT, but if it can be used for dimensional analysis, it would be interesting to use it to provide examples for advanced reports (see point 4 above). Jacopo Vince M. Clark wrote: > Could someone clarify for the community what is the difference between this BI effort and the activity I see on Jira relatted to BIRT? > > My sense is that BIRT is a reporting tool, and the new proof of concept for BI is about populating a data warehouse. Is this a correct assessment? Is there any relationship between the two initiatives or opportunities to build upon each other? > > Vince Clark > Global Era > The Freedom of Open Source > [hidden email] > (303) 493-6723 > > ----- Original Message ----- > From: "Jacques Le Roux" <[hidden email]> > To: [hidden email] > Sent: Saturday, October 20, 2007 8:06:47 AM (GMT-0700) America/Chihuahua > Subject: Re: Proof of concept for an Integrated OFBiz framework for business intelligence > > Thanks Jacopo, > > Sorry I saw that briefly but did not note it and forgot. It was the cause. Moreover my entityengine.xml file was in svn conflict (I > surely resolved by hand one day but forgot to resolve at the svn level) > > Jacques > > De : "Jacopo Cappellato" <[hidden email]> > > >> Hi Jacques, >> >> the datawarehouse entities are stored in a separate database; have a >> look at the settings for derby, I think that you have to replicate them >> for Postgres... there are now two entity-groups: >> org.ofbiz >> org.ofbiz.olap >> >> My first guess is that the second one is not associated to a valid >> datasource. >> >> if it doesn't work let me know, and I will help to fix.! >> >> Jacopo > > |
Re: Proof of concept for an Integrated OFBiz framework for business intelligence
|
|
In reply to this post by Jacopo Cappellato
had to read up to make sure what I called business intelligence did not
over lap yours. I am referring to the email i send on the dev group New concept for product store and products BTW did some OLAP work back in 97. built an app that let you build cube reports form various datawarehouses and import them in to spreadsheet. Might be interesting to integrate into openoffice spread sheet. time frame for this is probably 2008-2009.:) Jacopo Cappellato sent the following on 10/16/2007 2:18 AM: > Of course, > > we are free to choose the best reporting tool for the reports done on > the dimensional data model we are building. > > Jacopo > > > > guo weizhan wrote: >> it's greate, I will try this component later, but I think if we can use >> some other open source BI component like BIRT will speed the goal up. >> >> 2007/10/16, Jacopo Cappellato <[hidden email]>: >>> Ok, >>> >>> the patch to the framework is not officially in the svn trunk (rev. >>> 585051); so now you can just update your ofbiz instance and play with >>> the new component. >>> >>> Jacopo >>> >>> >>> Jacopo Cappellato wrote: >>>> Hi all, >>>> >>>> in rev. 584727 I've committed my work on a proof of concept for an >>>> Integrated OFBiz framework for business intelligence. >>>> This is essentially a new specialpurpose component (but it will >>>> probably >>>> disappear as soon as all its parts will be integrated in the main OFBiz >>>> applications) with a simple web application. >>>> For more details, visit the new tab "Business Intelligence" and read >>>> the >>>> component introduction in the main page (there are also instructions on >>>> how to start.... everything is very simple). >>>> And of course, let me know your opinions/questions/comments etc... >>>> >>>> *IMPORTANT*: the datawarehouse report will drill up/down correctly only >>>> if the patch attached to this mail is applied; I will commit it (or an >>>> equivalent variant) soon but I have to wait for feedback on this in the >>>> dev list before... by the way I'll let you know as soon as it is in. >>>> >>>> Jacopo >>>> >>>> >>> >>> >> > > > > |
«
Return to OFBiz - User
|
1 view|%1 views
| Free forum by Nabble | Edit this page |