https://blog.turboawesome.win/tags/analytics/ Recent content in Analytics on Bits, Trades & Systems Hugo en-us Wed, 17 May 2023 14:08:00 +0000 https://blog.turboawesome.win/2023/05/clickhouse-for-application-analytics-fast-aggregations-without-spark/ Wed, 17 May 2023 14:08:00 +0000 https://blog.turboawesome.win/2023/05/clickhouse-for-application-analytics-fast-aggregations-without-spark/ When you need sub-second aggregations over billions of rows and don't want to run a Spark cluster, ClickHouse is often the answer. Notes from a year in production. https://blog.turboawesome.win/2017/04/column-stores-for-analytics-why-row-based-is-wrong-for-this-problem/ Wed, 05 Apr 2017 14:33:00 +0000 https://blog.turboawesome.win/2017/04/column-stores-for-analytics-why-row-based-is-wrong-for-this-problem/ When the data team started complaining about multi-hour Postgres queries on trade history, we rewrote the analytics layer around columnar storage. The why is interesting. https://blog.turboawesome.win/2016/10/kdb-/q-for-java-developers-reading-the-matrix/ Tue, 11 Oct 2016 14:17:00 +0000 https://blog.turboawesome.win/2016/10/kdb-/q-for-java-developers-reading-the-matrix/ KDB+ is the database of choice for time-series analytics in investment banks. It's fast, alien, and worth understanding. A Java developer's field guide. https://blog.turboawesome.win/2016/07/time-series-data-at-a-bank-why-relational-databases-break-and-what-comes-next/ Wed, 06 Jul 2016 11:34:00 +0000 https://blog.turboawesome.win/2016/07/time-series-data-at-a-bank-why-relational-databases-break-and-what-comes-next/ Financial institutions generate millions of time-stamped data points every day. The relational database model, designed for transactional workloads, breaks down spectacularly for this use case — here's why, and what replaces it.