Fast iteration with Kafka, Druid and Airflow
Last month we went as fast as we could with a client to set up an infrastructure for huge amounts of data. The goal was to show that we could (a) handle all these events (b) make real-time reports and (c) combine this data with offline data for reporting. One amazing aspect of this project …