Benchmark Design

SPMarkJava JSR 184 is a MIDP 2.0 / JSR 184 benchmark based on workloads that correlate with a blend of popular, real world applications and theoretical tests, developed in partnership with leading industry members. SPMarkJava JSR 184 allows users to measure and compare Java app performance across development boards and existing product lines. The benchmark incorporates unbiased, consistent and fair tests that generate accurate measurement data for the mobile device industry, mobile reviewers and consumers.

Java Testing

The benchmark runs on most mobile devices using a variety of current Java APIs. It will utilize handset UI code depending on the model and its Java implementation. Supported Java APIs include JSR 184, JSR 135, using the MIDP 2.0 Profile on the CLDC 1.0 configuration (CLDC 1.1 required to run tests that require floating point calculations). Supported video codec is H.263. Running the complete series of default tests will result in a calculated overall performance score, SPMarkJava06 score. Any number of user selectable individual tests can be selected and run for custom benchmarking requirements. The optional battery test runs selected tests in a continuous loop until the battery is drained or the OS shuts down the Java application due to low battery.

Online ResultBrowser

SPMarkJava JSR 184 is the first mobile phone benchmark from Futuremark with online services enabled. The Online ResultBrowser (ORB), which has so far only been accessible via Futuremark’s PC performance benchmarks, is the ultimate tool for any user to search and compare benchmark results and system information online. Futuremark first implemented the ORB concept in 1997, to allow their users to upload their 3DMark and later PCMark benchmark results.
Performance results and system information can be uploaded directly from SPMarkJava JSR 184, which uses the device’s default internet browser. Users can create a free account on the ORB or log onto their existing account with their username and password. Once the data is loaded into the ORB, the results can be browsed using their internet connected PC or the device’s browser. This will permit the user to compare virtually any phone against each other and see which J2ME features are supported by various phones.

Game Tests

• High Detail 3D Game Test (available only in the Professional Edition)
• Low Detail 3D Game Test
• 2D Game Test

Feature Tests

• 3D fill rate and polygon throughput tests
• Video Processing (available only in the Professional Edition)
• Image Processing
• JVM tests