Executing Tests

Previous Next Contents

5 Executing Tests

The JSON Processing TCK uses the Junit framework to execute the tests.

This chapter includes the following topics:

Note

The instructions in this chapter assume that you have installed and configured your test environment as described in Chapter 3, "Installation," and Chapter 4, "Setup and Configuration,", respectively.

5.1 Starting the tests

The JSON Processing TCK can be run from the command line in your shell environment by executing tests from the TCK jar.

Note

The mvn command referenced in the following two procedures and elsewhere in this guide is the Apache Maven build tool, which will need to be downloaded separately.

5.1.1 To Run All Tests

To run all tests, enter the following command:

cd $JSONPTCK_HOME/bin
mvn verify

5.2 Running a Subset of the Tests

Use the following modes to run a subset of the tests:

5.2.1 To Run a Single Test

To run a single test, enter the following command:

cd $JSONPTCK_HOME/bin
mvn verify -Dtest=ee/jakarta/tck/jsonp/api/jsoncoding/ClientTests

5.2.2 To Run a Subset of Tests

To run a subset of tests, enter the following command:

cd $JSONPTCK_HOME/bin
mvn verify -Dtest=ee/jakarta/tck/jsonp/api/**

5.2.3 To Run Signature Tests

To run the JSON Processing TCK Signature Tests, enter the following command:

cd $JSONPTCK_HOME/bin
mvn verify -Dtest=ee/jakarta/tck/jsonp/signaturetest/jsonp/**

5.3 Running the TCK Against another CI

Some test scenarios are designed to ensure that the configuration and deployment of all the prebuilt JSON Processing TCK tests against one Compatible Implementation are successful operating with other compatible implementations, and that the TCK is ready for compatibility testing against the Vendor and Compatible Implementations.

  1. Verify that you have followed the configuration instructions in Section 4.1, "Configuring Your Environment to Run the TCK Against the Compatible Implementation."

  2. Run the tests, as described in Section 5.1, "Starting the Tests", and, if desired, Section 5.2, "Running a Subset of the Tests."

Example:
cd $JSONPTCK_HOME/bin
mvn verify -Djsonp-impl.groupId=org.eclipse.parsson -Djsonp-impl.artifactId=parsson -Djsonp-impl.version=1.1.0

5.4 Running the TCK Against a Vendor’s Implementation

This test scenario is one of the compatibility test phases that all Vendors must pass.

  1. Verify that you have followed the configuration instructions in Section 4.2, "Configuring Your Environment to Run the TCK Against the Vendor Implementation."

  2. Run the tests, as described in Section 5.1, "Starting the Tests", and, if desired, Section 5.2, "Running a Subset of the Tests."

Example:
cd $JSONPTCK_HOME/bin
mvn verify -Djsonp-api.groupId=jakarta.json -Djsonp-api.artifactId=jakarta.json-api -Djsonp-api.version=2.1.0

5.5 Test Reports

A set of report files is created for every test run. These report files can be found in the target directory that the test is run. After a test run is completed, the Junit framework writes reports for the test run.


Previous Next Contents
Eclipse Foundation Logo  Copyright © 2017, 2022 Oracle and/or its affiliates. All rights reserved.