Presentation: Performance Beyond Throughput:An OpenJ9 Case Study

Track: Performance Mythbusting

Location: Bayview AB

Day of week:

Slides: Download Slides

Level: Intermediate

Persona: Architect, Backend Developer, CTO/CIO/Leadership, Developer, Developer, JVM, DevOps Engineer, General Software, Technical Engineering Manager

Abstract

Curious about Java application and JVM performance and how they are continuing to evolve? Come to this talk to learn more about exciting results and new advancements in the area of JVM performance using the latest open source JVM technology at Eclipse OpenJ9 running with OpenJDK! We'll talk about new performance boosts across a wide variety of applications and present results using different workloads and metrics to give you a fuller picture of what to expect from OpenJ9. We will also explore some common low-level Java performance problems and show how to look for these issues in an application. Low-level performance bottlenecks can be more challenging to diagnose since they can arise either from the OS kernel or from performance critical parts of the JVM such as the garbage collector (GC) or the just-in-time compiler (JIT). Rather than focusing on any single monitoring tool, we will explain the data you need to gather and provide you some examples of how to do so using system commands and profiling tools (like Linux Perf) as well as explaining different JVM tracing and logging capabilities. The view from “the bottom of the stack” can help in finding and fixing some stubborn performance problems often missed by high-level performance analysis tools.

Question: 

What is the focus of your work today?

Answer: 

For the past 14 years I've been working on Java JIT compiler development at IBM. However, I am not your typical compiler guy because I don't focus that much on code generator or optimizer. Instead I deal with heuristics that determine what methods to compile, when to compile them and how much to optimize them. With Java, and any other languages that can benefit from a JIT compiler, the overhead of the compilation needs to be kept in check. You simply cannot afford to compile every single method at the highest optimization level; instead the JIT compiler needs to be quite selective. I've also worked on the design of various runtime aspects of the JVM like code cache management, metadata cache management or interpreter profiler to name a few. More recently I got interested in the behavior of the JVM in the cloud which is a challenging domain because the environment is more dynamic.

Question: 

What’s the motivation for this talk?

Answer: 

The motivation for the talk is twofold:

First is to increase awareness about performance metrics that are usually ignored, for instance footprint to give just an example. Many times I have read in online forums the opinion that footprint is not important because nowadays servers have plenty of memory. This may not be true in the cloud where big machines are carved into smaller VMs.

Second is to draw attention to OpenJ9, a new open source JVM than IBM has donated to the Eclipse Foundation. OpenJ9 works in conjunction with OpenJDK and we think it offers a few performance advantages over HotSpot JVM which is traditionally used by developers.

Question: 

How you you describe the persona and level of the target audience?

Answer: 

Due to the OpenJ9 connection, the talk should appeal primarily to developers and architects that use Java in their projects. However, the performance aspects I touch on should appeal to a broader audience because performance is a key ingredient of any software system.

Question: 

With what does “that” persona walk away from your talk knowing that they might not have known 50 minutes before?

Answer: 

This is tightly connected to the motivation for this talk. We want the audience to leave with two key aspects: First is that there are many facets to performance and, as a developer, you have to consider them all because you don't know what your customer values most, you cannot fully guess how people are going to use your product. Even if you do guess it right today, that may change tomorrow. Secondly, we want to spread the word about OpenJ9 and why, in the cloud, it could be a good alternative to HotSpot. We want people to try it, use for their projects, come up with suggestions regarding improvements and, why not, even contribute code to the OpenJ9 project. I'll also show how to hunt for performance issues using OpenJ9 performance tools.

Question: 

What technology problem keeps you up at night?

Answer: 

For me it's about performance and more specifically it's about the balance between contradictory performance metrics. How do you make the right trade-offs without user guidance, without having to specify a long command line or go through a long and painful tuning process. How can the JVM adapt to the running environment especially when the environment is constantly changing from one minute to the next like in the cloud. The JVM (and other software application too) needs to become a lot smarter. It needs to collect information all the time about the environment, gather clues and change its behavior to match the environment.

Speaker: Marius Pirvu

Advisory Software Developer @IBM

Marius Pirvu is an Advisory Software Developer in the IBM Runtime Technologies Group. After receiving his Ph.D. degree in Computer Science from Texas A&M University in 2000 he joined HP where he designed the chipset architecture of next generation servers. For the last 14 years he has been working at the IBM Canada Lab on the design and implementation of Testarossa Just-In-Time compiler used in IBM’s J9 JVM (now Eclipse OpenJ9). His main focus is optimizing the JVM to improve start-up, ramp-up and footprint.

Find Marius Pirvu at

Similar Talks

Evolution of Edge @Netflix

Qcon

Engineering Leader @Netflix

Vasily Vlasov

Mistakes and Discoveries While Cultivating Ownership

Qcon

Engineering Manager @Netflix in Cloud Infrastructure

Aaron Blohowiak

Monitoring and Tracing @Netflix Streaming Data Infrastructure

Qcon

Architect & Engineer in Real Time Data Infrastructure Team @Netflix

Allen Wang

Future of Data Engineering

Qcon

Distinguished Engineer @WePay

Chris Riccomini

Coding without Complexity

Qcon

CEO/Cofounder @darklang

Ellen Chisa

Holistic EdTech & Diversity

Qcon

Holistic Tech Coach @unlockacademy

Antoine Patton