OFBiz › OFBiz - User

Use of external database for generate product pages.-

_‹ Previous Topic Next Topic _›

Classic

List

Threaded

5 messages Options

Juan C. Cigala

Use of external database for generate product pages.-

Hi Everyone! This is our issue:

Our Customer has a 3 million's products database. It is likely that many of
the 3 million products not be sold, but must be able to show them if someone
wants to see while visiting the website.

This database is updated whenever has new product information; this can be
done even daily.

The product's database is MySQL, but we have installed PostgreSQL for OfBiz.

Of course, we need the ability to index and search for products.

We have some ideas to handle this requirement:

One, run the MySQL database in a local server, where we execute the updates,
and then export the changes to the production server (PostgreSQL)

Other one, install MySQL in the production server for make the updates and
the export process into the production server; this could affect the server
performance in the future, when the website has more visits.

Both proposals above are a few "brute force based", due to the need of
export ALL 3 million products from the external database (many of which will
not ever sell, so they will not generate purchasing, inventory, and other
movements) to the OfBiz database.

All of this for enjoys the product's search and index possibilities.

However, at the end of the day, the external product's database is a
"read-only" database or, in other words, a catalog, like the gadgets
catalog, which we read in the airplane: many pretty products but perhaps we
purchase one; so, why we will create millions of products in the database
that may never be used?

Also, faced with the integration issues...

Since we are working on OfBiz I'm looking for an easier and more elegant way
to solve this issue. I have thought to generate product pages via to access
external information (MySQL in this case) and, only if the Customer buys the
product, then create the product in the inventory system with the shopping
cart information. I think it could be related to the Content Manager System.

Today, some business have no merchandise stock, but they purchase once they
have sold. Our Customer has the inventory information of their providers,
and when he make a sale, then he put a order, asking to the provider if they
can ship the merchandise directly to the consumer.

Any idea? Thank you in advance.

--
J. Carlos Cigala
http://www.infovolution.com/

--
Juan Carlos Cigala

Malin Nicolas

Re: Use of external database for generate product pages.-

Hi Carlos.

You can load your product on dedicate entity (like "CustomerProduct) on
a dedicate entity group. OFBiz would be connected at both database. Each
night, run a incremental loading product service to load from
CustomerProduct to Product only new product. If you need manage update
and delete, see if you have stamp field on your customer database to
detect change quickly or look if you can use webservice to alert your OFBiz.

Nicolas

Le 20/11/2012 02:36, J. Carlos Cigala a écrit :

> Hi Everyone! This is our issue:
>
> Our Customer has a 3 million's products database. It is likely that many of
> the 3 million products not be sold, but must be able to show them if someone
> wants to see while visiting the website.
>
> This database is updated whenever has new product information; this can be
> done even daily.
>
> The product's database is MySQL, but we have installed PostgreSQL for OfBiz.
>
> Of course, we need the ability to index and search for products.
>
> We have some ideas to handle this requirement:
>
> One, run the MySQL database in a local server, where we execute the updates,
> and then export the changes to the production server (PostgreSQL)
>
> Other one, install MySQL in the production server for make the updates and
> the export process into the production server; this could affect the server
> performance in the future, when the website has more visits.
>
> Both proposals above are a few "brute force based", due to the need of
> export ALL 3 million products from the external database (many of which will
> not ever sell, so they will not generate purchasing, inventory, and other
> movements) to the OfBiz database.
>
> All of this for enjoys the product's search and index possibilities.
>
> However, at the end of the day, the external product's database is a
> "read-only" database or, in other words, a catalog, like the gadgets
> catalog, which we read in the airplane: many pretty products but perhaps we
> purchase one; so, why we will create millions of products in the database
> that may never be used?
>
> Also, faced with the integration issues...
>
> Since we are working on OfBiz I'm looking for an easier and more elegant way
> to solve this issue. I have thought to generate product pages via to access
> external information (MySQL in this case) and, only if the Customer buys the
> product, then create the product in the inventory system with the shopping
> cart information. I think it could be related to the Content Manager System.
>
> Today, some business have no merchandise stock, but they purchase once they
> have sold. Our Customer has the inventory information of their providers,
> and when he make a sale, then he put a order, asking to the provider if they
> can ship the merchandise directly to the consumer.
>
> Any idea? Thank you in advance.
>
> --
> J. Carlos Cigala
> http://www.infovolution.com/
>
>
>

Juan C. Cigala

Re: Use of external database for generate product pages.-

Thank you, Malin. If we need to use “brute force” we will apply your recommendation.

Actually, we are looking for use an external database (secondary) which can be indexed and which can use the search tool in OfBiz, without the need for export data to the primary OfBiz database. In other words, we want to have 2 databases online and connected, with the possibility to use the OfBiz tools in both of them.

Of course, in order to show the product information in the web pages, we will take the data from the secondary database, editing the .xml and/or .ftl files.

Ragards,

--
J. Carlos Cigala
http://www.infovolution.com/

--
Juan Carlos Cigala

Jacques Le Roux

Re: Use of external database for generate product pages.-

Administrator

Actually if you look at the entityengine.xml file which defines delegators (access to DB) you will see that OFBiz uses already 3 different DB OOTB
You can follow this way and add your own group-map, of course you will need to add custom code. Have a look into the bi component for instance...

Jacques

From: "jcigala" <[hidden email]>

> Thank you, Malin. If we need to use “brute force” we will apply your
> recommendation.
>
> Actually, we are looking for use an external database (secondary) which can
> be indexed and which can use the search tool in OfBiz, without the need for
> export data to the primary OfBiz database. In other words, we want to have 2
> databases online and connected, with the possibility to use the OfBiz tools
> in both of them.
>
> Of course, in order to show the product information in the web pages, we
> will take the data from the secondary database, editing the .xml and/or .ftl
> files.
>
> Ragards,
>
> --
> J. Carlos Cigala
> http://www.infovolution.com/

Juan C. Cigala

RE: Use of external database for generate product pages.-

Thank you, Jacques. We are working in the possibilities. Regards,

De: Jacques Le Roux [via OFBiz] [mailto:[hidden email]]
Enviado el: domingo, 25 de noviembre de 2012 06:01
Para: jcigala
Asunto: Re: Use of external database for generate product pages.-

If you reply to this email, your message will be added to the discussion below:

http://ofbiz.135035.n4.nabble.com/Use-of-external-database-for-generate-product-pages-tp4637770p4637871.html

To unsubscribe from Use of external database for generate product pages.-, click here.

NAML

--
Juan Carlos Cigala