In this video interview conducted by Terry Coatta, Kate Matsudaira discusses key architectural choices in the design of systems and data partitioning.
Kate Matsudaira Kate Matsudaira has just recently made a foray into novel territory as founder of her own company Pop Forms. Prior to that she worked in engineering leadership roles at companies such as Decide, SEOmoz, and Amazon. Her technical experience spans a wealth of areas, but she has consistently been involved with the construction of high performance distributed systems and systems addressing data collection and analysis. Kate is also well-known for her blog on which deals with issues in leadership and management. In this video, she discusses her experience in building and scaling out systems that collect and analyze large volumes of data. She covers key architectural choices in the design of these systems, delving into data partitioning in particular.
Interview questions include:
- What are some fundamental issues with scaling data?
- What are some techniques for optimizing data locality?
- What important choices can you make while architecting a system to allow it to scale and remain flexible?
- What are some better ways to partition your data?
- Can you tell us a real world example of partitioning data?
- What kinds of things go into a good engineering feedback cycle?
- How do you pick the metrics that you are going to track in a monitoring system?
- What do you see as the intersection between technology, leadership and management?
Loading more stuff…
Hmm…it looks like things are taking a while to load. Try again?