Performance of org.eclipse.core: I20060505-1306 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results. Grayed images mark explainable degradations or differences that are statistically insignificant at the 10% level.
"n/a" - results not available.

All 49 scenarios

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (2 GHz 512 MB)
Win XP Sun 1.4.2_08 (3 GHz 2 GB)
resources.perf.BenchFileStore#testStoreExists()
resources.perf.BenchFileStore#testStoreIsReadOnly()
resources.perf.BenchFileStore#testStoreLastModified()
resources.perf.BenchMiscWorkspace#testNoOp()
resources.perf.BenchWorkspace#testCountResources()
resources.perf.BenchWorkspace#testCountResourcesDuringOperation() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.06s is not within [0%, 110%] of 964ms
resources.perf.LocalHistoryPerformanceTest#testAddState() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 189ms is not within [0%, 110%] of 100ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 207ms is not within [0%, 110%] of 152ms
resources.perf.LocalHistoryPerformanceTest#testBug28603() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 43ms is not within [0%, 110%] of 38ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 30ms is not within [0%, 110%] of 26ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 51ms is not within [0%, 110%] of 23ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 78ms is not within [0%, 110%] of 65ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 60ms is not within [0%, 110%] of 50ms
resources.perf.LocalHistoryPerformanceTest#testClearHistory100x4() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 69ms is not within [0%, 110%] of 55ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 22ms is not within [0%, 110%] of 19ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 20ms is not within [0%, 110%] of 18ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 35ms is not within [0%, 110%] of 27ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 27ms is not within [0%, 110%] of 19ms
resources.perf.LocalHistoryPerformanceTest#testClearHistory20x20() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 11ms is not within [0%, 110%] of 9ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 9ms is not within [0%, 110%] of 7ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 11ms is not within [0%, 110%] of 3ms
resources.perf.LocalHistoryPerformanceTest#testClearHistory4x100() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 9ms is not within [0%, 110%] of 8ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 8ms is not within [0%, 110%] of 7ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 8ms is not within [0%, 110%] of 7ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 15ms is not within [0%, 110%] of 7ms
resources.perf.LocalHistoryPerformanceTest#testCopyHistory100x4()
resources.perf.LocalHistoryPerformanceTest#testCopyHistory20x20()
resources.perf.LocalHistoryPerformanceTest#testCopyHistory4x100()
resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers100x4() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 55ms is not within [0%, 110%] of 47ms
resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers20x20() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 23ms is not within [0%, 110%] of 15ms
resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers4x100()
resources.perf.LocalHistoryPerformanceTest#testGetHistory()
resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp100x4() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 686ms is not within [0%, 110%] of 257ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 365ms is not within [0%, 110%] of 246ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 259ms is not within [0%, 110%] of 217ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.68s is not within [0%, 110%] of 1.35s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 2.15s is not within [0%, 110%] of 1.15s
resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp20x20() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 439ms is not within [0%, 110%] of 252ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 261ms is not within [0%, 110%] of 224ms
resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp4x100() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.33s is not within [0%, 110%] of 590ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 406ms is not within [0%, 110%] of 259ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 263ms is not within [0%, 110%] of 223ms
resources.perf.MarkerPerformanceTest#testSetAttributes1()
resources.perf.MarkerPerformanceTest#testSetAttributes2()
resources.perf.PropertyManagerPerformanceTest#testGetProperty100x4()
resources.perf.PropertyManagerPerformanceTest#testGetProperty20x20()
resources.perf.PropertyManagerPerformanceTest#testGetProperty4x100()
resources.perf.PropertyManagerPerformanceTest#testSetProperty100x4()
resources.perf.PropertyManagerPerformanceTest#testSetProperty20x20()
resources.perf.PropertyManagerPerformanceTest#testSetProperty4x100()
resources.perf.WorkspacePerformanceTest#testCreateResources() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 26.75s is not within [0%, 110%] of 23.73s
resources.perf.WorkspacePerformanceTest#testDeleteProject() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 10.9s is not within [0%, 110%] of 8.19s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 15.88s is not within [0%, 110%] of 13.77s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 6.04s is not within [0%, 110%] of 5.19s
resources.perf.WorkspacePerformanceTest#testFolderCopy() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 41.16s is not within [0%, 110%] of 36.7s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 9.91s is not within [0%, 110%] of 7.71s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.47m is not within [0%, 110%] of 1.27m
resources.perf.WorkspacePerformanceTest#testFolderMove() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 2.99s is not within [0%, 110%] of 2.26s
runtime.perf.BenchPath#testHash() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 2.27s is not within [0%, 110%] of 2.06s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.5s is not within [0%, 110%] of 1.35s
runtime.perf.BenchPath#testPathCreation()
runtime.perf.BenchPath#testToOSString()
runtime.perf.BenchPath#testToString()
runtime.perf.ContentTypePerformanceTest#testContentMatching()
runtime.perf.ContentTypePerformanceTest#testIsKindOf()
runtime.perf.ContentTypePerformanceTest#testLoadCatalog() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 155ms is not within [0%, 110%] of 112ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 217ms is not within [0%, 110%] of 155ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 129ms is not within [0%, 110%] of 109ms
runtime.perf.ContentTypePerformanceTest#testNameMatching() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.95s is not within [0%, 110%] of 1.69s
runtime.perf.PreferencePerformanceTest#testGetStringCommonPrefixKeys()
runtime.perf.PreferencePerformanceTest#testGetStringMisses() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.26s is not within [0%, 110%] of 1.05s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 836ms is not within [0%, 110%] of 657ms
runtime.perf.PreferencePerformanceTest#testGetStringSequentialKeys() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.64s is not within [0%, 110%] of 1.4s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.06s is not within [0%, 110%] of 917ms
runtime.perf.PreferencePerformanceTest#testGetStringUniqueKeys() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.48s is not within [0%, 110%] of 1.29s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 972ms is not within [0%, 110%] of 823ms
runtime.perf.PreferencePerformanceTest#testPutStringKeys()
runtime.perf.PreferencePerformanceTest#testRemoveStringKeys()
runtime.perf.StartupTest.testApplicationStartup Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 2.27s is not within [0%, 105%] of 1.86s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.5s is not within [0%, 105%] of 1.24s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.28s is not within [0%, 105%] of 1.07s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.96s is not within [0%, 105%] of 1.68s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 1.36s is not within [0%, 105%] of 1.15s
runtime.perf.UIStartupTest.testUIApplicationStartup Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 15.23s is not within [50%, 105%] of 12s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 9.04s is not within [50%, 105%] of 6.8s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 8.63s is not within [50%, 105%] of 6.88s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 9.69s is not within [50%, 105%] of 7.69s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200605041557, jvm=sun1.4.2_08}': Elapsed Process: 6.56s is not within [50%, 105%] of 5.23s