[cbi-dev] Running CBI build with tests

Discussion:

Thanh Ha

2012-04-05 14:15:34 UTC

Hi Everyone,

I'm trying to build the CBI build without skipping the tests via
"-Dmaven.test.skip=true". Unfortunately I run into issues with "No tests
found" below. If I comment them out of the pom they get skipped and I
noticed some tests pass.

What can I do to get these tests working and for the tycho build to find
the tests? Any resources I can look at to point me in the right direction?

Thanks,

Thanh

[ERROR] Failed to execute goal
org.eclipse.tycho:tycho-surefire-plugin:0.14.1:test (default-test) on
project org.eclipse.jdt.compiler.tool.tests: No tests found. -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :org.eclipse.jdt.compiler.tool.tests

Igor Fedorenko

2012-04-05 14:18:19 UTC

Permalink

I think Platform team first needs to decide if they want to run unit
tests as part of the build or defer all tests to integration tests. I
believe current build tests everything at the end.

--
Regards,
Igor

Post by Thanh Ha
Hi Everyone,
I'm trying to build the CBI build without skipping the tests via
"-Dmaven.test.skip=true". Unfortunately I run into issues with "No tests
found" below. If I comment them out of the pom they get skipped and I
noticed some tests pass.
What can I do to get these tests working and for the tycho build to find
the tests? Any resources I can look at to point me in the right direction?
Thanks,
Thanh
[ERROR] Failed to execute goal
org.eclipse.tycho:tycho-surefire-plugin:0.14.1:test (default-test) on
project org.eclipse.jdt.compiler.tool.tests: No tests found. -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :org.eclipse.jdt.compiler.tool.tests
_______________________________________________
cbi-dev mailing list
http://dev.eclipse.org/mailman/listinfo/cbi-dev

Thanh Ha

2012-04-05 14:31:53 UTC

Permalink

Thanks Igor,

For clarification by "tests everything at the end" do you mean when we run:

mvn clean install \
-Dmaven.repo.local=/var/tmp/lts/R4_localrepo -Dmaven.test.skip=true

it runs the tests once everything's built automatically? or do you mean
the user runs the tests against the output of the build manually?

I know the build does output the junit test below which I guess we can
run manually.

TMP/eclipse-junit-tests/target/eclipse-junit-tests-1.0.0-SNAPSHOT-bundle.zip

Thanks,

Thanh

Post by Igor Fedorenko
I think Platform team first needs to decide if they want to run unit
tests as part of the build or defer all tests to integration tests. I
believe current build tests everything at the end.
--
Regards,
Igor

_______________________________________________
cbi-dev mailing list
http://dev.eclipse.org/mailman/listinfo/cbi-dev

Igor Fedorenko

2012-04-05 14:51:15 UTC

Permalink

I believe all automated tests are run manually against packaged eclipse
sdk. The tests themselves and the test fixture are packaged as
eclipse-junit-tests zip.

--
Regards,
Igor

Post by Thanh Ha
Thanks Igor,
mvn clean install \
-Dmaven.repo.local=/var/tmp/lts/R4_localrepo -Dmaven.test.skip=true
it runs the tests once everything's built automatically? or do you mean
the user runs the tests against the output of the build manually?
I know the build does output the junit test below which I guess we can
run manually.
TMP/eclipse-junit-tests/target/eclipse-junit-tests-1.0.0-SNAPSHOT-bundle.zip
Thanks,
Thanh

_______________________________________________
cbi-dev mailing list
http://dev.eclipse.org/mailman/listinfo/cbi-dev

Mickael Istria

2013-09-10 11:18:24 UTC

Permalink

Both are totally compatible.
By default Platform build uses skipTests=true and/or
maven.test.skip=true (in parent pom). So even if bundles get configured
correctly to use surefire, nothing will run by default
(skipTests/maven.test.skip needs to be overriden), and if tests are
enabled by default, the output would be the same and running integration
tests after build would still work.
IMO, there is no reason at all for not allow to run Platform tests with
tycho-surefire-plugin, and as "mvn clean verify" is much easier than the
current approach, allowing surefire to run tests is a way to reduce the
entry barrier for contribution.
It also seems to be a mandatory step if we want to set up Hudson jobs
that validate Gerrit patches when submitted.

--
Mickael Istria
Eclipse developer at JBoss, by Red Hat <http://www.jboss.org/tools>
My blog <http://mickaelistria.wordpress.com> - My Tweets
<http://twitter.com/mickaelistria>

Sievers, Jan

2012-04-05 14:34:51 UTC

Permalink

in general see the tycho mojo docs. In particular you may be interested in test inclusion patterns

http://www.eclipse.org/tycho/sitedocs/tycho-surefire/tycho-surefire-plugin/test-mojo.html#includes

Jan

-----Original Message-----
From: cbi-dev-***@eclipse.org [mailto:cbi-dev-***@eclipse.org] On Behalf Of Thanh Ha
Sent: Donnerstag, 5. April 2012 16:16
To: Common-build Developers discussion
Subject: [cbi-dev] Running CBI build with tests

Hi Everyone,

I'm trying to build the CBI build without skipping the tests via
"-Dmaven.test.skip=true". Unfortunately I run into issues with "No tests
found" below. If I comment them out of the pom they get skipped and I
noticed some tests pass.

What can I do to get these tests working and for the tycho build to find
the tests? Any resources I can look at to point me in the right direction?

Thanks,

Thanh

[ERROR] Failed to execute goal
org.eclipse.tycho:tycho-surefire-plugin:0.14.1:test (default-test) on
project org.eclipse.jdt.compiler.tool.tests: No tests found. -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :org.eclipse.jdt.compiler.tool.tests

Paul Webster

2012-04-05 15:12:40 UTC

Permalink

There's a discussion of the current state of running the eclipse automated
test framework from a CBI build on
https://bugs.eclipse.org/bugs/show_bug.cgi?id=375575

But yes, the current pattern in the Eclipse SDK build is build the SDK
repo, build the SDK zips, build the tests repo, package the automated
tests, and the run the automated tests against a built SDK.

PW

--
Paul Webster
Hi floor. Make me a sammich! - GIR

Thanh Ha

2012-04-05 15:16:29 UTC

Permalink

Thanks Paul,

At first I wasn't too sure why we did -Dmaven.test.skip=true but it
seems clear to me now.

Thanh

Post by Paul Webster
There's a discussion of the current state of running the eclipse
automated test framework from a CBI build on
https://bugs.eclipse.org/bugs/show_bug.cgi?id=375575
But yes, the current pattern in the Eclipse SDK build is build the SDK
repo, build the SDK zips, build the tests repo, package the automated
tests, and the run the automated tests against a built SDK.
PW
--
Paul Webster
Hi floor. Make me a sammich! - GIR
_______________________________________________
cbi-dev mailing list
http://dev.eclipse.org/mailman/listinfo/cbi-dev

Mickael Istria

2013-08-22 16:41:04 UTC

Permalink

I've tried a "mvn clean install -Dmaven.test.skip=false", and it seems
that some platform tests suffer from this issue:
https://bugs.eclipse.org/bugs/show_bug.cgi?id=415701

--
Mickael Istria
Eclipse developer at JBoss, by Red Hat <http://www.jboss.org/tools>
My blog <http://mickaelistria.wordpress.com> - My Tweets
<http://twitter.com/mickaelistria>

Mickael Istria

2013-09-10 11:20:55 UTC

Permalink

Please see and follow https://bugs.eclipse.org/bugs/show_bug.cgi?id=416904

--
Mickael Istria
Eclipse developer at JBoss, by Red Hat <http://www.jboss.org/tools>
My blog <http://mickaelistria.wordpress.com> - My Tweets
<http://twitter.com/mickaelistria>