Ville Tuulos - How Nokia uses Disco to mine terabytes of logs daily

Disco is an open-source MapReduce framework whose core is written in Erlang. Today, Disco is used by Nokia to store and process tens of terabytes of constantly updating log data.

We will talk about tricky issues we have faced when running Disco with production data, such as heterogeneous workloads, multiple concurrent users, and evolving schemas. Thanks to this evolutionary pressure, Disco is starting to support exciting new features, such as jobs written in arbitrary programming languages as first-class citizens.

Target audience: Anyone interested in Big Data and MapReduce, in particular developers of data-intensive Erlang applications.