Monday, 2018-12-17

 

 

Save

Save

Save

Save

Save

Save

Save

Save

Save

Save

SPEC Meetings

 

The Standard Performance Evaluation Corporation (SPEC) was formed in 1988 to establish industry standards for measuring computer performance. Since then, SPEC has become the largest and most influential benchmark consortium in the world.

SPEC offers more than 20 industry-standard benchmarks and tools for system performance evaluation in a variety of application areas. Thousands of SPEC benchmark licenses have been issued to companies, resource centers, and educational institutions globally. Many SPEC benchmarks are considered gold standards and being used to evaluate complete platforms to very specific hardware and software platforms as well as one of the critical components for innovation in hardware and software. As example, many students and researchers test their hypotheses for software and hardware innovation using SPEC benchmarks.

SPEC’s membership comprises more than 120 leading computer hardware and software vendors, educational institutions, research organizations, and government agencies worldwide. Membership provides a wide range of benefits, including free access to benchmark suites, participation in developing new benchmarks and tools, and publication of benchmark results on SPEC’s web site (http://spec.org/). For information on how to join, please contact us at info@spec.org.

SPEC has two groups meeting in Italy in conjunction with ICPE2017; the Open Systems Group (OSG) and Research Group (RG). OSG has two technical meetings on Monday and Tuesday and RG’s meetings will be Wednesday.

The OSG JAVA committee charter is to develop and maintain cross platform and cross architecture benchmarks for Java SE, Java EE and other managed runtime implementations. Current active benchmarks are SPECjvm2008 a freely available benchmark and consists of a suite of worklets, SPECjbb2015 an industry first benchmark increasing load gradually and reporting throughput as well as critical throughput bound by SLA, and SPECjEnterprise2010 a full system benchmark which allows performance measurement and characterization of Java EE 5.0 servers and supporting infrastructure such as JVM, Database, CPU, disk and servers. 

The SPECpower Committee tackles the task of creating industry-standard benchmarks and tools to measure the power and performance characteristics of server-class compute equipment. They released SPECpower_ssj2008 in 2007, which exercises the CPUs, caches, memory hierarchy, and the scalability of shared memory processors on multiple load-levels. The work on the SERT suite started around 2009 with the ground-breaking design of the Chauffeur framework, followed by the design and implementation of the workload, automated hardware and software discovery, and GUI. Simultaneously to these efforts, the SPECpower Committee, in collaboration with the more academic-focused SPEC Power Research Working Group, conducted large-scale experiments in order to determine the server efficiency metric for SERT Suite 2.0, which enabled its release in 2017.

The SPEC Research Group (RG) serves as a platform for collaborative research efforts in the area of quantitative system evaluation and analysis, fostering interaction between industry and academia. The group develops methodologies, techniques and tools for measurement, load testing, profiling, workload characterization, dependability and efficiency evaluation of computing systems. SPEC RG currently has five working groups working in the areas of cloud computing, big data, DevOps, energy efficiency and security benchmarking. More information can be found at http://research.spec.org. The SPEC RG meetings will take place on Wednesday afternoon:

Monday:  OSG Java and Power in L’Aquila

Tuesday: OSG Java and Power in L’Aquila

Wed 12:15-12:50 Presentation of SPEC RG

Wed 16:45-21:00 SPEC RG Annual Meeting including the RG Power, RG Cloud, RG DevOps and RG Big Data working groups

Thursday:  OSG Java and Power in Rome

Friday: OSG Java and Power in Rome