In this interview, Olimpiu Pop, a technologist and tech journalist, speaks with Andrew Lamb, a staff engineer at Fluxdata, about data systems and databases. Andrew elaborates on the FDAP stack (Arrow, Flight, DataFusion, and Parquet), explaining how these technologies facilitate the creation of time-series databases without rebuilding everything from scratch. He discusses the transition to column stores, the standardization of best practices across column representations with Apache Arrow, and the benefits of Parquet for data persistence. The conversation also covers Apache Flight for efficient data transfer over networks, the role of DataFusion as a query engine, and the potential of Apache Iceberg to standardize data access across multiple systems.
Sign in to continue reading, translating and more.
Continue