YTsaurus Flow source code

Yandex has released YTsaurus Flow source code under Apache 2.0. The system processes events as they arrive. Yandex reports that it handles more than 100 GB of data per second in the company’s advertising infrastructure.

The delay between an event and a decision

Stream processing reduces the wait between an event and its use in an application. Rather than periodically processing a collected batch, the system works on incoming records. The open code allows teams to study the mechanism and integrate it into their own infrastructure.

Sources