Hi All,
Is there any doc to configure tomcat server on production server. Actually, We have multi instance OFBiz setup which is load balanced by separate apache via ajp. We are facing issue on OFBiz instance server having increasing thread randomly and because of this server and application become unresponsive. Usually, this happen with increasing OFBiz instance threads count. We are using OFBiz version 14.12 Thanks Satish Kumar -- View this message in context: http://ofbiz.135035.n4.nabble.com/Issue-with-Increasing-tomcat-Threads-tp4691056.html Sent from the OFBiz - User mailing list archive at Nabble.com. |
Administrator
|
Hi Satish,
There is still the appserver component in the R14.12 branch (note that the R14.12 was not and will never be released http://ofbiz.apache.org/download.html "Special Notice Regarding Branches 14.12 and 15.12:" section). This component was originally in the framework part but we stopped to support it already years ago and decided to downgrade it and move it to specialpurpose, then recently in Attic. I'd love to see it resurrected but it's not an effort the community decided to pursue. So the best you have is this component and the documentation at https://cwiki.apache.org/confluence/display/OFBIZ/Run+OFBiz+under+outside+Application+Servers In other words you are on your own on this; though I'd personally, and I guess the community too, appreciate a shareable success in this area! Jacques Le 22/08/2016 à 07:55, satish a écrit : > Hi All, > > Is there any doc to configure tomcat server on production server. Actually, > We have multi instance OFBiz setup which is load balanced by separate apache > via ajp. We are facing issue on OFBiz instance server having increasing > thread randomly and because of this server and application become > unresponsive. Usually, this happen with increasing OFBiz instance threads > count. We are using OFBiz version 14.12 > > Thanks > Satish Kumar > > > > -- > View this message in context: http://ofbiz.135035.n4.nabble.com/Issue-with-Increasing-tomcat-Threads-tp4691056.html > Sent from the OFBiz - User mailing list archive at Nabble.com. > |
Jacques,
I don't see how the old appserver component could help Satish to solve his problem: Satish, could you please confirm if you are looking to configure the Tomcat instance embedded in OFBiz to handle the load in a cluster? Thanks Jacopo On Mon, Aug 22, 2016 at 8:19 AM, Jacques Le Roux < [hidden email]> wrote: > Hi Satish, > > There is still the appserver component in the R14.12 branch (note that the > R14.12 was not and will never be released http://ofbiz.apache.org/downlo > ad.html "Special Notice Regarding Branches 14.12 and 15.12:" section). > > This component was originally in the framework part but we stopped to > support it already years ago and decided to downgrade it and move it to > specialpurpose, then recently in Attic. > > I'd love to see it resurrected but it's not an effort the community > decided to pursue. > > So the best you have is this component and the documentation at > https://cwiki.apache.org/confluence/display/OFBIZ/Run+OFBiz+ > under+outside+Application+Servers > > In other words you are on your own on this; though I'd personally, and I > guess the community too, appreciate a shareable success in this area! > > Jacques > > > > Le 22/08/2016 à 07:55, satish a écrit : > >> Hi All, >> >> Is there any doc to configure tomcat server on production server. >> Actually, >> We have multi instance OFBiz setup which is load balanced by separate >> apache >> via ajp. We are facing issue on OFBiz instance server having increasing >> thread randomly and because of this server and application become >> unresponsive. Usually, this happen with increasing OFBiz instance threads >> count. We are using OFBiz version 14.12 >> >> Thanks >> Satish Kumar >> >> >> >> -- >> View this message in context: http://ofbiz.135035.n4.nabble. >> com/Issue-with-Increasing-tomcat-Threads-tp4691056.html >> Sent from the OFBiz - User mailing list archive at Nabble.com. >> >> > |
Hi Jacopo,
Thank for your reply. Somehow, Satish is not getting the mails of this thread. He is working with me. Yes, the Tomcat instance is embedded one and we have to tune it to close idle threads relatively quickly. One machine is running an Apache Web server with mod_jk setup to communicate with different instances of Ofbiz. Though, the OFbiz instances are sometime unresponsive. We observed that the thread count is more when this happens. After 10-15 mins the thread counts become normal and application run smoothly. So looks like Tomcat is not clearing either idle threads or something wrong with configuration in the setup. If anyone suggest, optimal configurations setting that we can use for OFbiz instance running on machine with 2 core processor having 4 GB RAM. The machine is dedicated to run only 1 Ofbiz instance. Thanks, On Mon, Aug 22, 2016 at 12:18 PM, Jacopo Cappellato < [hidden email]> wrote: > Jacques, > > I don't see how the old appserver component could help Satish to solve his > problem: Satish, could you please confirm if you are looking to configure > the Tomcat instance embedded in OFBiz to handle the load in a cluster? > > Thanks > > Jacopo > > On Mon, Aug 22, 2016 at 8:19 AM, Jacques Le Roux < > [hidden email]> wrote: > > > Hi Satish, > > > > There is still the appserver component in the R14.12 branch (note that > the > > R14.12 was not and will never be released http://ofbiz.apache.org/downlo > > ad.html "Special Notice Regarding Branches 14.12 and 15.12:" section). > > > > This component was originally in the framework part but we stopped to > > support it already years ago and decided to downgrade it and move it to > > specialpurpose, then recently in Attic. > > > > I'd love to see it resurrected but it's not an effort the community > > decided to pursue. > > > > So the best you have is this component and the documentation at > > https://cwiki.apache.org/confluence/display/OFBIZ/Run+OFBiz+ > > under+outside+Application+Servers > > > > In other words you are on your own on this; though I'd personally, and I > > guess the community too, appreciate a shareable success in this area! > > > > Jacques > > > > > > > > Le 22/08/2016 à 07:55, satish a écrit : > > > >> Hi All, > >> > >> Is there any doc to configure tomcat server on production server. > >> Actually, > >> We have multi instance OFBiz setup which is load balanced by separate > >> apache > >> via ajp. We are facing issue on OFBiz instance server having increasing > >> thread randomly and because of this server and application become > >> unresponsive. Usually, this happen with increasing OFBiz instance > threads > >> count. We are using OFBiz version 14.12 > >> > >> Thanks > >> Satish Kumar > >> > >> > >> > >> -- > >> View this message in context: http://ofbiz.135035.n4.nabble. > >> com/Issue-with-Increasing-tomcat-Threads-tp4691056.html > >> Sent from the OFBiz - User mailing list archive at Nabble.com. > >> > >> > > > -- Thanks & Regards Ganesh Bawne Enterprise Software Developer Viithiisys Pvt. Ltd. http://www.viithiisys.com |
Hi Ganesh,
there are a few things that can improve the situation, but the proper solution depends on the specific usage and components involved, so it is difficult to be precise. However, here are a few miscellaneous ideas you could consider while you test: 1) try to (temporarily) move out of the mix the web server and ajp protocol/connector; let the Tomcat instances communicate directly with the load balancer; if you experience the same issue then we can exclude that the problem is in the setup of the ajp connectors; to be noted that recent versions of Tomcat are very efficient as web servers too 2) are you noticing this in production? are you running some load tests to recreate the issue? (i.e. with JMeter) 3) are you using the http or https connections (or both)? If both, would it be possible for you to initially try with http (or https) only, then fine tune the Tomcat's connector to work properly before testing with https (or http)? again, this would help to focus the scope of the research and optimizations 4) the behavior you are noticing (grow, under load, of thread count that are destroyed after some minutes) may indicate that these threads are created to maintain the user's session, that if ide are destroyed after the number of minutes set in the web.xml file of your webapp (see session-timeout element); how many users/browsers are hitting the system versus the number of hits each performs? Does your load balancer supports sticky sessions? 5) the file that is relevant for the proper setup of Tomcat connectors is in framework/catalina/ofbiz-component.xml 6) when you setup multiple instances of OFBiz in a cluster please make sure you configure them properly; this blog post may be useful as an introduction http://www.hotwaxsystems.com/ofbiz/apache-ofbiz-performance/ I will stop for now; based on your feedback I may ask further questions or may be able to be more precise. Good luck, Jacopo On Mon, Aug 22, 2016 at 9:31 AM, Ganesh Bawne <[hidden email]> wrote: > Hi Jacopo, > > Thank for your reply. > > Somehow, Satish is not getting the mails of this thread. He is working with > me. > Yes, the Tomcat instance is embedded one and we have to tune it to close > idle threads relatively quickly. > > One machine is running an Apache Web server with mod_jk setup to > communicate with different instances of Ofbiz. Though, the OFbiz instances > are sometime unresponsive. We observed that the thread count is more when > this happens. After 10-15 mins the thread counts become normal and > application run smoothly. So looks like Tomcat is not clearing either idle > threads or something wrong with configuration in the setup. > > If anyone suggest, optimal configurations setting that we can use for OFbiz > instance running on machine with 2 core processor having 4 GB RAM. The > machine is dedicated to run only 1 Ofbiz instance. > > Thanks, > > On Mon, Aug 22, 2016 at 12:18 PM, Jacopo Cappellato < > [hidden email]> wrote: > > > Jacques, > > > > I don't see how the old appserver component could help Satish to solve > his > > problem: Satish, could you please confirm if you are looking to configure > > the Tomcat instance embedded in OFBiz to handle the load in a cluster? > > > > Thanks > > > > Jacopo > > > > On Mon, Aug 22, 2016 at 8:19 AM, Jacques Le Roux < > > [hidden email]> wrote: > > > > > Hi Satish, > > > > > > There is still the appserver component in the R14.12 branch (note that > > the > > > R14.12 was not and will never be released > http://ofbiz.apache.org/downlo > > > ad.html "Special Notice Regarding Branches 14.12 and 15.12:" section). > > > > > > This component was originally in the framework part but we stopped to > > > support it already years ago and decided to downgrade it and move it to > > > specialpurpose, then recently in Attic. > > > > > > I'd love to see it resurrected but it's not an effort the community > > > decided to pursue. > > > > > > So the best you have is this component and the documentation at > > > https://cwiki.apache.org/confluence/display/OFBIZ/Run+OFBiz+ > > > under+outside+Application+Servers > > > > > > In other words you are on your own on this; though I'd personally, and > I > > > guess the community too, appreciate a shareable success in this area! > > > > > > Jacques > > > > > > > > > > > > Le 22/08/2016 à 07:55, satish a écrit : > > > > > >> Hi All, > > >> > > >> Is there any doc to configure tomcat server on production server. > > >> Actually, > > >> We have multi instance OFBiz setup which is load balanced by separate > > >> apache > > >> via ajp. We are facing issue on OFBiz instance server having > increasing > > >> thread randomly and because of this server and application become > > >> unresponsive. Usually, this happen with increasing OFBiz instance > > threads > > >> count. We are using OFBiz version 14.12 > > >> > > >> Thanks > > >> Satish Kumar > > >> > > >> > > >> > > >> -- > > >> View this message in context: http://ofbiz.135035.n4.nabble. > > >> com/Issue-with-Increasing-tomcat-Threads-tp4691056.html > > >> Sent from the OFBiz - User mailing list archive at Nabble.com. > > >> > > >> > > > > > > > > > -- > Thanks & Regards > Ganesh Bawne > Enterprise Software Developer > Viithiisys Pvt. Ltd. > http://www.viithiisys.com > |
Administrator
|
In reply to this post by Jacopo Cappellato-5
Oh Right indeed, I was still asleep it seems
Jaques Le 22/08/2016 à 08:48, Jacopo Cappellato a écrit : > Jacques, > > I don't see how the old appserver component could help Satish to solve his > problem: Satish, could you please confirm if you are looking to configure > the Tomcat instance embedded in OFBiz to handle the load in a cluster? > > Thanks > > Jacopo > > On Mon, Aug 22, 2016 at 8:19 AM, Jacques Le Roux < > [hidden email]> wrote: > >> Hi Satish, >> >> There is still the appserver component in the R14.12 branch (note that the >> R14.12 was not and will never be released http://ofbiz.apache.org/downlo >> ad.html "Special Notice Regarding Branches 14.12 and 15.12:" section). >> >> This component was originally in the framework part but we stopped to >> support it already years ago and decided to downgrade it and move it to >> specialpurpose, then recently in Attic. >> >> I'd love to see it resurrected but it's not an effort the community >> decided to pursue. >> >> So the best you have is this component and the documentation at >> https://cwiki.apache.org/confluence/display/OFBIZ/Run+OFBiz+ >> under+outside+Application+Servers >> >> In other words you are on your own on this; though I'd personally, and I >> guess the community too, appreciate a shareable success in this area! >> >> Jacques >> >> >> >> Le 22/08/2016 à 07:55, satish a écrit : >> >>> Hi All, >>> >>> Is there any doc to configure tomcat server on production server. >>> Actually, >>> We have multi instance OFBiz setup which is load balanced by separate >>> apache >>> via ajp. We are facing issue on OFBiz instance server having increasing >>> thread randomly and because of this server and application become >>> unresponsive. Usually, this happen with increasing OFBiz instance threads >>> count. We are using OFBiz version 14.12 >>> >>> Thanks >>> Satish Kumar >>> >>> >>> >>> -- >>> View this message in context: http://ofbiz.135035.n4.nabble. >>> com/Issue-with-Increasing-tomcat-Threads-tp4691056.html >>> Sent from the OFBiz - User mailing list archive at Nabble.com. >>> >>> |
Administrator
|
In reply to this post by Jacopo Cappellato-5
Hi Ganesh,
Also if several OFBiz instances share the same DB be sure to have the Distributed Entity Cache Clear (DCC) Mechanism <https://cwiki.apache.org/confluence/display/OFBIZ/Distributed+Entity+Cache+Clear+%28DCC%29+Mechanism> sets properly Jacques Le 22/08/2016 à 10:22, Jacopo Cappellato a écrit : > Hi Ganesh, > > there are a few things that can improve the situation, but the proper > solution depends on the specific usage and components involved, so it is > difficult to be precise. > > However, here are a few miscellaneous ideas you could consider while you > test: > > 1) try to (temporarily) move out of the mix the web server and ajp > protocol/connector; let the Tomcat instances communicate directly with the > load balancer; if you experience the same issue then we can exclude that > the problem is in the setup of the ajp connectors; to be noted that recent > versions of Tomcat are very efficient as web servers too > > 2) are you noticing this in production? are you running some load tests to > recreate the issue? (i.e. with JMeter) > > 3) are you using the http or https connections (or both)? If both, would it > be possible for you to initially try with http (or https) only, then fine > tune the Tomcat's connector to work properly before testing with https (or > http)? again, this would help to focus the scope of the research and > optimizations > > 4) the behavior you are noticing (grow, under load, of thread count that > are destroyed after some minutes) may indicate that these threads are > created to maintain the user's session, that if ide are destroyed after the > number of minutes set in the web.xml file of your webapp (see > session-timeout element); how many users/browsers are hitting the system > versus the number of hits each performs? Does your load balancer supports > sticky sessions? > > 5) the file that is relevant for the proper setup of Tomcat connectors is > in framework/catalina/ofbiz-component.xml > > 6) when you setup multiple instances of OFBiz in a cluster please make sure > you configure them properly; this blog post may be useful as an > introduction http://www.hotwaxsystems.com/ofbiz/apache-ofbiz-performance/ > > I will stop for now; based on your feedback I may ask further questions or > may be able to be more precise. > > Good luck, > > Jacopo > > > On Mon, Aug 22, 2016 at 9:31 AM, Ganesh Bawne <[hidden email]> > wrote: > >> Hi Jacopo, >> >> Thank for your reply. >> >> Somehow, Satish is not getting the mails of this thread. He is working with >> me. >> Yes, the Tomcat instance is embedded one and we have to tune it to close >> idle threads relatively quickly. >> >> One machine is running an Apache Web server with mod_jk setup to >> communicate with different instances of Ofbiz. Though, the OFbiz instances >> are sometime unresponsive. We observed that the thread count is more when >> this happens. After 10-15 mins the thread counts become normal and >> application run smoothly. So looks like Tomcat is not clearing either idle >> threads or something wrong with configuration in the setup. >> >> If anyone suggest, optimal configurations setting that we can use for OFbiz >> instance running on machine with 2 core processor having 4 GB RAM. The >> machine is dedicated to run only 1 Ofbiz instance. >> >> Thanks, >> >> On Mon, Aug 22, 2016 at 12:18 PM, Jacopo Cappellato < >> [hidden email]> wrote: >> >>> Jacques, >>> >>> I don't see how the old appserver component could help Satish to solve >> his >>> problem: Satish, could you please confirm if you are looking to configure >>> the Tomcat instance embedded in OFBiz to handle the load in a cluster? >>> >>> Thanks >>> >>> Jacopo >>> >>> On Mon, Aug 22, 2016 at 8:19 AM, Jacques Le Roux < >>> [hidden email]> wrote: >>> >>>> Hi Satish, >>>> >>>> There is still the appserver component in the R14.12 branch (note that >>> the >>>> R14.12 was not and will never be released >> http://ofbiz.apache.org/downlo >>>> ad.html "Special Notice Regarding Branches 14.12 and 15.12:" section). >>>> >>>> This component was originally in the framework part but we stopped to >>>> support it already years ago and decided to downgrade it and move it to >>>> specialpurpose, then recently in Attic. >>>> >>>> I'd love to see it resurrected but it's not an effort the community >>>> decided to pursue. >>>> >>>> So the best you have is this component and the documentation at >>>> https://cwiki.apache.org/confluence/display/OFBIZ/Run+OFBiz+ >>>> under+outside+Application+Servers >>>> >>>> In other words you are on your own on this; though I'd personally, and >> I >>>> guess the community too, appreciate a shareable success in this area! >>>> >>>> Jacques >>>> >>>> >>>> >>>> Le 22/08/2016 à 07:55, satish a écrit : >>>> >>>>> Hi All, >>>>> >>>>> Is there any doc to configure tomcat server on production server. >>>>> Actually, >>>>> We have multi instance OFBiz setup which is load balanced by separate >>>>> apache >>>>> via ajp. We are facing issue on OFBiz instance server having >> increasing >>>>> thread randomly and because of this server and application become >>>>> unresponsive. Usually, this happen with increasing OFBiz instance >>> threads >>>>> count. We are using OFBiz version 14.12 >>>>> >>>>> Thanks >>>>> Satish Kumar >>>>> >>>>> >>>>> >>>>> -- >>>>> View this message in context: http://ofbiz.135035.n4.nabble. >>>>> com/Issue-with-Increasing-tomcat-Threads-tp4691056.html >>>>> Sent from the OFBiz - User mailing list archive at Nabble.com. >>>>> >>>>> >> >> >> -- >> Thanks & Regards >> Ganesh Bawne >> Enterprise Software Developer >> Viithiisys Pvt. Ltd. >> http://www.viithiisys.com >> |
Hi Jacopo / Jacques,
Thank you very much for sharing your views. I will check the sites with the points you given and certainly it will help us to solve our issue. Between, our load balancer support sticky session and present session-timeout value is 120... using both http and https connections. The DCC and other setup is already done as per the documentation. However, one more thing I observed, the site has ~20 hits by legitimate spider in a minute so assume their session kept alive until its session timeout(120 minutes) reached? Thanks, Ganesh On Mon, Aug 22, 2016 at 3:07 PM, Jacques Le Roux < [hidden email]> wrote: > Hi Ganesh, > > Also if several OFBiz instances share the same DB be sure to have the > Distributed Entity Cache Clear (DCC) Mechanism < > https://cwiki.apache.org/confluence/display/OFBIZ/Distribut > ed+Entity+Cache+Clear+%28DCC%29+Mechanism> sets properly > > Jacques > > > Le 22/08/2016 à 10:22, Jacopo Cappellato a écrit : > >> Hi Ganesh, >> >> there are a few things that can improve the situation, but the proper >> solution depends on the specific usage and components involved, so it is >> difficult to be precise. >> >> However, here are a few miscellaneous ideas you could consider while you >> test: >> >> 1) try to (temporarily) move out of the mix the web server and ajp >> protocol/connector; let the Tomcat instances communicate directly with the >> load balancer; if you experience the same issue then we can exclude that >> the problem is in the setup of the ajp connectors; to be noted that recent >> versions of Tomcat are very efficient as web servers too >> >> 2) are you noticing this in production? are you running some load tests to >> recreate the issue? (i.e. with JMeter) >> >> 3) are you using the http or https connections (or both)? If both, would >> it >> be possible for you to initially try with http (or https) only, then fine >> tune the Tomcat's connector to work properly before testing with https (or >> http)? again, this would help to focus the scope of the research and >> optimizations >> >> 4) the behavior you are noticing (grow, under load, of thread count that >> are destroyed after some minutes) may indicate that these threads are >> created to maintain the user's session, that if ide are destroyed after >> the >> number of minutes set in the web.xml file of your webapp (see >> session-timeout element); how many users/browsers are hitting the system >> versus the number of hits each performs? Does your load balancer supports >> sticky sessions? >> >> 5) the file that is relevant for the proper setup of Tomcat connectors is >> in framework/catalina/ofbiz-component.xml >> >> 6) when you setup multiple instances of OFBiz in a cluster please make >> sure >> you configure them properly; this blog post may be useful as an >> introduction http://www.hotwaxsystems.com/ofbiz/apache-ofbiz-performance/ >> >> I will stop for now; based on your feedback I may ask further questions or >> may be able to be more precise. >> >> Good luck, >> >> Jacopo >> >> >> On Mon, Aug 22, 2016 at 9:31 AM, Ganesh Bawne <[hidden email]> >> wrote: >> >> Hi Jacopo, >>> >>> Thank for your reply. >>> >>> Somehow, Satish is not getting the mails of this thread. He is working >>> with >>> me. >>> Yes, the Tomcat instance is embedded one and we have to tune it to close >>> idle threads relatively quickly. >>> >>> One machine is running an Apache Web server with mod_jk setup to >>> communicate with different instances of Ofbiz. Though, the OFbiz >>> instances >>> are sometime unresponsive. We observed that the thread count is more when >>> this happens. After 10-15 mins the thread counts become normal and >>> application run smoothly. So looks like Tomcat is not clearing either >>> idle >>> threads or something wrong with configuration in the setup. >>> >>> If anyone suggest, optimal configurations setting that we can use for >>> OFbiz >>> instance running on machine with 2 core processor having 4 GB RAM. The >>> machine is dedicated to run only 1 Ofbiz instance. >>> >>> Thanks, >>> >>> On Mon, Aug 22, 2016 at 12:18 PM, Jacopo Cappellato < >>> [hidden email]> wrote: >>> >>> Jacques, >>>> >>>> I don't see how the old appserver component could help Satish to solve >>>> >>> his >>> >>>> problem: Satish, could you please confirm if you are looking to >>>> configure >>>> the Tomcat instance embedded in OFBiz to handle the load in a cluster? >>>> >>>> Thanks >>>> >>>> Jacopo >>>> >>>> On Mon, Aug 22, 2016 at 8:19 AM, Jacques Le Roux < >>>> [hidden email]> wrote: >>>> >>>> Hi Satish, >>>>> >>>>> There is still the appserver component in the R14.12 branch (note that >>>>> >>>> the >>>> >>>>> R14.12 was not and will never be released >>>>> >>>> http://ofbiz.apache.org/downlo >>> >>>> ad.html "Special Notice Regarding Branches 14.12 and 15.12:" section). >>>>> >>>>> This component was originally in the framework part but we stopped to >>>>> support it already years ago and decided to downgrade it and move it to >>>>> specialpurpose, then recently in Attic. >>>>> >>>>> I'd love to see it resurrected but it's not an effort the community >>>>> decided to pursue. >>>>> >>>>> So the best you have is this component and the documentation at >>>>> https://cwiki.apache.org/confluence/display/OFBIZ/Run+OFBiz+ >>>>> under+outside+Application+Servers >>>>> >>>>> In other words you are on your own on this; though I'd personally, and >>>>> >>>> I >>> >>>> guess the community too, appreciate a shareable success in this area! >>>>> >>>>> Jacques >>>>> >>>>> >>>>> >>>>> Le 22/08/2016 à 07:55, satish a écrit : >>>>> >>>>> Hi All, >>>>>> >>>>>> Is there any doc to configure tomcat server on production server. >>>>>> Actually, >>>>>> We have multi instance OFBiz setup which is load balanced by separate >>>>>> apache >>>>>> via ajp. We are facing issue on OFBiz instance server having >>>>>> >>>>> increasing >>> >>>> thread randomly and because of this server and application become >>>>>> unresponsive. Usually, this happen with increasing OFBiz instance >>>>>> >>>>> threads >>>> >>>>> count. We are using OFBiz version 14.12 >>>>>> >>>>>> Thanks >>>>>> Satish Kumar >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> View this message in context: http://ofbiz.135035.n4.nabble. >>>>>> com/Issue-with-Increasing-tomcat-Threads-tp4691056.html >>>>>> Sent from the OFBiz - User mailing list archive at Nabble.com. >>>>>> >>>>>> >>>>>> >>> >>> -- >>> Thanks & Regards >>> Ganesh Bawne >>> Enterprise Software Developer >>> Viithiisys Pvt. Ltd. >>> http://www.viithiisys.com >>> >>> > -- Thanks & Regards Ganesh Bawne Enterprise Software Developer Viithiisys Pvt. Ltd. http://www.viithiisys.com |
Free forum by Nabble | Edit this page |