Julian Hyde | Architect at Looker, Creator of Apache Calcite
ABOUT THE TALK
Did you know that databases often “cheat”? Even with a scalable query engine and smart optimizer, many real-world queries would be too slow if the engine read all the data, so the engine re-writes your query to use a pre-materialized result. B-tree indexes made the first relational databases possible, and there are now many flavors of materialization, from explicit materialized views to OLAP-style caching and spatial indexes. Materialization is more relevant than ever in today’s heterogenous, distributed systems.
If you are evaluating data engines, we describe what materialization features to look for in your next engine. If you are implementing an engine, we describe the features provided by Apache Calcite to design, maintain and use materializations.
Download Slides
Julian hyde
Architect at Looker | Creator of Apache Calcite
Julian Hyde is an expert in query optimization, in-memory analytics, and streaming. He is the original developer of Apache Calcite, the query planning framework behind Apache Hive, Drill, Kylin and Phoenix, and was also the original developer of the open source Mondrian OLAP engine.
Experience more insightful data science & engineering talks at DataEngConf NYC '17
