Standard Performance Evaluation Corporation (SPEC)http://spec.org/OSG JAVA committee charter is to develop and maintain cross platform and cross architecture benchmarks for Java SE, Java EE and other managed runtime implementations. Current active benchmarks are SPECjvm2008 a freely available benchmark and consists of a suite of worklets, SPECjbb2015 an industry first benchmark increasing load gradually and reporting throughput as well as critical throughput bound by SLA, and SPECjEnterprise2010SPECpower Committee tackles the task of creating industry-standard benchmarks and tools to measure the power and performance characteristics of server-class compute equipment. They released SPECpower_ssj2008 in 2007, which exercises the CPUs, caches, memory hierarchy, and the scalability of shared memory processors on multiple load-levels. The work on the SERT suite started around 2009 with the ground-breaking design of the Chauffeur framework, followed by the design and implementation of the workload, automated hardware and software discovery, and GUI. Simultaneously to these efforts, the SPECpower Committee, in collaboration with the more academic-focused SPEC Power Research Working Group, conducted large-scale experiments in order to determine the server efficiency metric for SERT Suite 2.0, which enabled its release in 2017.

The SPEC Research Group (RG) serves as a platform for collaborative research efforts in the area of quantitative system evaluation and analysis, fostering interaction between industry and academia. The group develops methodologies, techniques and tools for measurement, load testing, profiling, workload characterization, dependability and efficiency evaluation of computing systems. SPEC RG currently has five working groups working in the areas of cloud computing, big data, DevOps, energy efficiency and security benchmarking. More information can be found at http://research.spec.org