OFBiz › OFBiz - Dev

[jira] Created: (OFBIZ-3670) TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode

_‹ Previous Topic Next Topic _›

Classic

List

Threaded

9 messages Options

Nicolas Malin (Jira)

[jira] Created: (OFBIZ-3670) TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode

TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode
---------------------------------------------------------------------------------------------

Key: OFBIZ-3670
URL: https://issues.apache.org/jira/browse/OFBIZ-3670
Project: OFBiz
Issue Type: Improvement
Components: framework
Affects Versions: SVN trunk
Reporter: Bob Morley
Fix For: SVN trunk
Attachments: OFBIZ-3670_StandaloneTestEnhancement.patch

This patch provides the framework that allows junit unit tests to be executed directly in Eclipse (without having to invoke Start directly). It total it contains:

- BaseTestCase - very top of the TestCase stack containing ofbiz specific assertions
- StandaloneTestCase - determines if application has executed "Start"; if not it will execute a scaled down "Start unittest" that is used in Eclipse
- RollbackTestCase - extends standalone and provides a transaction w/ auto-rollback
- TestRunContainer - provides ability to disable dispatcher attributes via configuration (used for unittest-containers.xml)

- GeoWorkerTest - unittester that provides "full" coverage of GeoWorker; can be executed from Eclipse or from command-line as it is plugged into standard testdef framework. Creates its own entities with transaction start/rollback so it can be re-executed.

Would appreciate if this can be a priority so I can provide additional test cases to boost our code coverage that will utilize these features.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

Nicolas Malin (Jira)

[jira] Updated: (OFBIZ-3670) TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode

[ https://issues.apache.org/jira/browse/OFBIZ-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bob Morley updated OFBIZ-3670:
------------------------------

Attachment: OFBIZ-3670_StandaloneTestEnhancement.patch

> TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode
> ---------------------------------------------------------------------------------------------
>
> Key: OFBIZ-3670
> URL: https://issues.apache.org/jira/browse/OFBIZ-3670
> Project: OFBiz
> Issue Type: Improvement
> Components: framework
> Affects Versions: SVN trunk
> Reporter: Bob Morley
> Fix For: SVN trunk
>
> Attachments: OFBIZ-3670_StandaloneTestEnhancement.patch
>
>
> This patch provides the framework that allows junit unit tests to be executed directly in Eclipse (without having to invoke Start directly). It total it contains:
> - BaseTestCase - very top of the TestCase stack containing ofbiz specific assertions
> - StandaloneTestCase - determines if application has executed "Start"; if not it will execute a scaled down "Start unittest" that is used in Eclipse
> - RollbackTestCase - extends standalone and provides a transaction w/ auto-rollback
> - TestRunContainer - provides ability to disable dispatcher attributes via configuration (used for unittest-containers.xml)
> - GeoWorkerTest - unittester that provides "full" coverage of GeoWorker; can be executed from Eclipse or from command-line as it is plugged into standard testdef framework. Creates its own entities with transaction start/rollback so it can be re-executed.
> Would appreciate if this can be a priority so I can provide additional test cases to boost our code coverage that will utilize these features.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

Nicolas Malin (Jira)

[jira] Commented: (OFBIZ-3670) TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode

In reply to this post by Nicolas Malin (Jira)

[ https://issues.apache.org/jira/browse/OFBIZ-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12858093#action_12858093 ]

Scott Gray commented on OFBIZ-3670:
-----------------------------------

Hi Bob,

I don't really like this approach for a couple of reasons:
1. We already have a rollback system in place
2. OFBiz allows unit tests to depend on each other within a suite which your approach won't allow because of each unit test doing a rollback
3. If this is committed then we'll end up with two different approaches to testing and it will be more complicated for people to write new tests

Why not just improve the TestRunContainer to allow it to start OFBiz and pass in arguments of what tests to run?

Nicolas Malin (Jira)

[jira] Commented: (OFBIZ-3670) TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode

In reply to this post by Nicolas Malin (Jira)

[ https://issues.apache.org/jira/browse/OFBIZ-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12858552#action_12858552 ]

Bob Morley commented on OFBIZ-3670:
-----------------------------------

Hey Scott,

1) This base test case uses the standard transaction rollback system.

2) The individual writing the unit test can decide what they should extend -- I am not suggesting that all unit tests should extend the RollbackTestCase; they may extend the StandaloneTestCase (which does not have the rollback nature). There were tests in my travels which were explicitly calling a "rollback" at the end of their test which this pattern would avoid. I would also argue that it is bad practice for having dependency in your test classes in the first place.

3) This is not providing a different approach at all; it merely provides extra functionality into the exist test framework. The tests remain in the testdef and are executed through standard means, you simply have the ability to execute the test immediately from Eclipse and get all of the tooling associated with that.

There is a method of executing the TestRunContainer to pass in arguments on which test to run. It is cumbersome to use in the IDE; but if people choose to execute their tests in that way then there is nothing about this patch that prevents that. In fact, I write the unit test and execute it through eclipse (individual methods, the whole class) get the tooling in Eclipse (or any other IDE) and then I add it to the testdef and execute the entire suite of tests form the command-line before creating any patch.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Nicolas Malin (Jira)

[jira] Assigned: (OFBIZ-3670) TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode

In reply to this post by Nicolas Malin (Jira)

[ https://issues.apache.org/jira/browse/OFBIZ-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Scott Gray reassigned OFBIZ-3670:
---------------------------------

Assignee: Scott Gray

> TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode
> ---------------------------------------------------------------------------------------------
>
> Key: OFBIZ-3670
> URL: https://issues.apache.org/jira/browse/OFBIZ-3670
> Project: OFBiz
> Issue Type: Improvement
> Components: framework
> Affects Versions: SVN trunk
> Reporter: Bob Morley
> Assignee: Scott Gray
> Fix For: SVN trunk
>
> Attachments: OFBIZ-3670_StandaloneTestEnhancement.patch
>
>
> This patch provides the framework that allows junit unit tests to be executed directly in Eclipse (without having to invoke Start directly). It total it contains:
> - BaseTestCase - very top of the TestCase stack containing ofbiz specific assertions
> - StandaloneTestCase - determines if application has executed "Start"; if not it will execute a scaled down "Start unittest" that is used in Eclipse
> - RollbackTestCase - extends standalone and provides a transaction w/ auto-rollback
> - TestRunContainer - provides ability to disable dispatcher attributes via configuration (used for unittest-containers.xml)
> - GeoWorkerTest - unittester that provides "full" coverage of GeoWorker; can be executed from Eclipse or from command-line as it is plugged into standard testdef framework. Creates its own entities with transaction start/rollback so it can be re-executed.
> Would appreciate if this can be a priority so I can provide additional test cases to boost our code coverage that will utilize these features.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Nicolas Malin (Jira)

[jira] Commented: (OFBIZ-3670) TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode

In reply to this post by Nicolas Malin (Jira)

[ https://issues.apache.org/jira/browse/OFBIZ-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12858809#action_12858809 ]

Scott Gray commented on OFBIZ-3670:
-----------------------------------

For #1, transaction rollbacks only work for simple use cases. It is not uncommon for OFBiz services to run in their own transaction which would suspend your transaction and then resume it once it is done, this is the reason for the system we have in place today. I don't want solutions that only work some of the time when we have one already that works (almost) all of the time.

I'm going to make some changes to your patch that incorporates what you are trying to do into the existing test tools, I'll post it here when I'm done and we can discuss it further.

> TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode
> ---------------------------------------------------------------------------------------------
>
> Key: OFBIZ-3670
> URL: https://issues.apache.org/jira/browse/OFBIZ-3670
> Project: OFBiz
> Issue Type: Improvement
> Components: framework
> Affects Versions: SVN trunk
> Reporter: Bob Morley
> Assignee: Scott Gray
> Fix For: SVN trunk
>
> Attachments: OFBIZ-3670_StandaloneTestEnhancement.patch
>
>
> This patch provides the framework that allows junit unit tests to be executed directly in Eclipse (without having to invoke Start directly). It total it contains:
> - BaseTestCase - very top of the TestCase stack containing ofbiz specific assertions
> - StandaloneTestCase - determines if application has executed "Start"; if not it will execute a scaled down "Start unittest" that is used in Eclipse
> - RollbackTestCase - extends standalone and provides a transaction w/ auto-rollback
> - TestRunContainer - provides ability to disable dispatcher attributes via configuration (used for unittest-containers.xml)
> - GeoWorkerTest - unittester that provides "full" coverage of GeoWorker; can be executed from Eclipse or from command-line as it is plugged into standard testdef framework. Creates its own entities with transaction start/rollback so it can be re-executed.
> Would appreciate if this can be a priority so I can provide additional test cases to boost our code coverage that will utilize these features.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Nicolas Malin (Jira)

[jira] Commented: (OFBIZ-3670) TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode

In reply to this post by Nicolas Malin (Jira)

[ https://issues.apache.org/jira/browse/OFBIZ-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12858934#action_12858934 ]

Bob Morley commented on OFBIZ-3670:
-----------------------------------

I dug in a little bit further based on your direction and now I see what you are referring to wrt suspended transactions in a new service. Thought of a potential problem with the current approach and would like to run it by you -- it appears that in all the code that does a DelegatorFactory.getDelegator will get the original delegator (not the "test" version) and consequently would not rollback. Perhaps I am missing where the test version of the delegator is stuffed into the delegator cache in DelegatorFactory ?

Reflecting on what the intent seems to be here, I would recommend that we consider a few minor changes.

1. We consider moving the test specific artifacts from GenericDelegator into either a TestGenericDelegator proxy or sub-class. I am kind of a big proponent of not having test specific code in production code; this proxy/sub-class could live in a org.ofbiz.entity.test package.

2. We consider a new implementation of DelegatorFactoryImpl which constructs "test" versions of the GenericDelegators. The very nice factory pattern would provide us with the ability to have this new test factory implementation and (hopefully) be able to easily plug it in when we run from the TestRunContainer or from a JUnit test case.

By doing number 2 what we would ensure is that all delegators created in a container that is for "test" would use test variants, would record their operations, and would "play them back" on rollback. My guess is that we may want to play a rollback on all delegators cached from a test run which would account for any multi-tenancy tests, etc.

I think we are now on the same page with this work and ensuring that the tests run in a consistent way. If you would like I could take a crack at these proposed changes for your review if you have not had time to start on your updates to my patch. Thoughts?

> TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode
> ---------------------------------------------------------------------------------------------
>
> Key: OFBIZ-3670
> URL: https://issues.apache.org/jira/browse/OFBIZ-3670
> Project: OFBiz
> Issue Type: Improvement
> Components: framework
> Affects Versions: SVN trunk
> Reporter: Bob Morley
> Assignee: Scott Gray
> Fix For: SVN trunk
>
> Attachments: OFBIZ-3670_StandaloneTestEnhancement.patch
>
>
> This patch provides the framework that allows junit unit tests to be executed directly in Eclipse (without having to invoke Start directly). It total it contains:
> - BaseTestCase - very top of the TestCase stack containing ofbiz specific assertions
> - StandaloneTestCase - determines if application has executed "Start"; if not it will execute a scaled down "Start unittest" that is used in Eclipse
> - RollbackTestCase - extends standalone and provides a transaction w/ auto-rollback
> - TestRunContainer - provides ability to disable dispatcher attributes via configuration (used for unittest-containers.xml)
> - GeoWorkerTest - unittester that provides "full" coverage of GeoWorker; can be executed from Eclipse or from command-line as it is plugged into standard testdef framework. Creates its own entities with transaction start/rollback so it can be re-executed.
> Would appreciate if this can be a priority so I can provide additional test cases to boost our code coverage that will utilize these features.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Nicolas Malin (Jira)

[jira] Commented: (OFBIZ-3670) TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode

In reply to this post by Nicolas Malin (Jira)

[ https://issues.apache.org/jira/browse/OFBIZ-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12858946#action_12858946 ]

Adrian Crum commented on OFBIZ-3670:
------------------------------------

Bob,

Your ideas kind of tie into the dual build paths mentioned recently. A test-only delegator factory would be specified in a test-only META-INF/services folder.

> TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode
> ---------------------------------------------------------------------------------------------
>
> Key: OFBIZ-3670
> URL: https://issues.apache.org/jira/browse/OFBIZ-3670
> Project: OFBiz
> Issue Type: Improvement
> Components: framework
> Affects Versions: SVN trunk
> Reporter: Bob Morley
> Assignee: Scott Gray
> Fix For: SVN trunk
>
> Attachments: OFBIZ-3670_StandaloneTestEnhancement.patch
>
>
> This patch provides the framework that allows junit unit tests to be executed directly in Eclipse (without having to invoke Start directly). It total it contains:
> - BaseTestCase - very top of the TestCase stack containing ofbiz specific assertions
> - StandaloneTestCase - determines if application has executed "Start"; if not it will execute a scaled down "Start unittest" that is used in Eclipse
> - RollbackTestCase - extends standalone and provides a transaction w/ auto-rollback
> - TestRunContainer - provides ability to disable dispatcher attributes via configuration (used for unittest-containers.xml)
> - GeoWorkerTest - unittester that provides "full" coverage of GeoWorker; can be executed from Eclipse or from command-line as it is plugged into standard testdef framework. Creates its own entities with transaction start/rollback so it can be re-executed.
> Would appreciate if this can be a priority so I can provide additional test cases to boost our code coverage that will utilize these features.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Nicolas Malin (Jira)

[jira] Commented: (OFBIZ-3670) TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode

In reply to this post by Nicolas Malin (Jira)

[ https://issues.apache.org/jira/browse/OFBIZ-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12859037#action_12859037 ]

Scott Gray commented on OFBIZ-3670:
-----------------------------------

I've tried this already :-)

I extended the GenericDelegator but it didn't work because the ECAs would get in the way and result in changes being tracked in the wrong order. You are more than welcome to give it a go though, I didn't spend too much time on it and I'm sure there is a solution in there somewhere.

As to how the existing system works, there isn't actually that much caching of the delegator or retrieving it by name, mostly just in the service dispatcher, job manager and eca handler. Aside from the job manager the others work fine with the current approach because you control their instantiation and can supply the delegator.

> TestCase base classes providing ability to execute unit tests in Eclipse in "standalone" mode
> ---------------------------------------------------------------------------------------------
>
> Key: OFBIZ-3670
> URL: https://issues.apache.org/jira/browse/OFBIZ-3670
> Project: OFBiz
> Issue Type: Improvement
> Components: framework
> Affects Versions: SVN trunk
> Reporter: Bob Morley
> Assignee: Scott Gray
> Fix For: SVN trunk
>
> Attachments: OFBIZ-3670_StandaloneTestEnhancement.patch
>
>
> This patch provides the framework that allows junit unit tests to be executed directly in Eclipse (without having to invoke Start directly). It total it contains:
> - BaseTestCase - very top of the TestCase stack containing ofbiz specific assertions
> - StandaloneTestCase - determines if application has executed "Start"; if not it will execute a scaled down "Start unittest" that is used in Eclipse
> - RollbackTestCase - extends standalone and provides a transaction w/ auto-rollback
> - TestRunContainer - provides ability to disable dispatcher attributes via configuration (used for unittest-containers.xml)
> - GeoWorkerTest - unittester that provides "full" coverage of GeoWorker; can be executed from Eclipse or from command-line as it is plugged into standard testdef framework. Creates its own entities with transaction start/rollback so it can be re-executed.
> Would appreciate if this can be a priority so I can provide additional test cases to boost our code coverage that will utilize these features.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.