Presentation: Managing Data in Microservices

Track: Microservices: Patterns and Practices

Location: Ballroom A

Day of week:

Slides: Download Slides

Level: Intermediate

Persona: Architect, Backend Developer, Data Engineering, Data Scientist, Developer, General Software, ML Engineer

Abstract

This session is about the hard stuff -- managing data in microservices -- and about sharing proven patterns that have been successful at Google, eBay, and Stitch Fix. It begins with a quick tour of some prerequisites for being successful with microservices -- an organization of small teams with well-defined areas of responsibility; processes for test-driven development and continuous delivery; and a DevOps culture of "You Build It, You Run It."

The majority of the session is spent on managing data. It covers the need to isolate a microservice's data store behind the service interface, as well as the various persistence mechanisms for managing data. It discusses using events as a first-class tool in our architectural toolbox. It covers techniques for service extraction from a monolithic database. Then it composes those building blocks to build up patterns for handling shared data, joins, and transactions in a microservice world.

It concludes with lessons learned, as well as suggestions for how you can implement these ideas successfully in your own organization.

Speaker: Randy Shoup

VP Engineering and Chief Architect @eBay, Previously @StitchFix @Google & @Ebay

Randy is a 30-year veteran of Silicon Valley, and has worked as a senior technology leader and executive at companies ranging from small startups, to mid-sized places, to eBay and Google. Randy is currently VP Engineering at WeWork in San Francisco. He is particularly passionate about the nexus of culture, technology, and organization.

Find Randy Shoup at

Similar Talks

Stateful Programming Models in Serverless Functions

Qcon

Principal Engineering Manager @Microsoft, helping lead the Azure Functions Team

Chris Gillum

User & Device Identity for Microservices @ Netflix Scale

Qcon

Senior Software Engineer in Product Edge Access Services Team @Netflix

Satyajit Thadeshwar

Managing Failure Modes in Microservice Architectures

Qcon

VP Cloud Architecture Strategy @AWSCloud & Microservices Pioneer

Adrian Cockcroft

Beyond Microservices: Streams, State and Scalability

Qcon

Software Engineer @Confluent, PMC Member @Kafka, & Committer Apache Sqoop

Gwen Shapira