Scaling Erlang cluster to 10,000 nodes

Growing user population beyond 1.5B does not leave a chance to keep server footprint as small as it used to be. Adding new capabilities requires more and more processing power. When it gets impossible to keep everything on just ten servers, we have to scale the cluster to a hundred. When a hundred gets too tight, we expand it to 1,000. What’s next? 10,000? And how is it possible, considering current scalability limits of a single Erlang cluster?

This talk will guide you along the way we took to improve Erlang scalability, remove bottlenecks and increase the efficiency of our Erlang-based applications.

OBJECTIVES

Demonstrate an example of live Erlang cluster being scaled from just a few nodes to 10,000 machines with no service interruption.

TARGET AUDIENCE

Scalability engineers, people interested in optimising Erlang for large-scale server applications.
 

ARTICLES: 1

How to serve 1.5 billion active users at the same time - scaling Erlang cluster to 10,000 nodes

Article by Maxim Fedorov

A growing user population beyond 1.7B, whilst simultaneously adding new capabilities, does not leave much chance to keep the server footprint as small as it used to be.

READ MORE