Tag: Infrastructure
-
No Ice for you. When Not to Use Iceberg: A Critical Evaluation
I love Ice, especially Iceberg, which helps simplify data management and enhances query performance without requiring users to manually manage partition metadata. Iceberg also provides transactional consistency between multiple applications where files can be added, removed, or modified atomically, with full read isolation and multiple concurrent writes. Given the recent hype that Databricks and Snowflake…
-
Unified Strategies for Promoting Effective Operating Model and Collaboration for Research Institute
One of the most requested mandates that I was asked to help with is how best to bring these functions together and create an effective operating model to deliver the organization’s goals. To effectively promote the roles and operational model of the described teams, the following strategies can be implemented: 1. Interdepartmental Collaboration and Communication…
-
Building the Future: Smart Strategies for a Scalable Data Infrastructure.
Recently, I have had an opportunity to discuss possible data infrastructure strategies with the XXX. organization. Given the NDA, I will not be able to give the name of the organization. I am focusing on robust data infrastructure strategies as they are essential to driving innovation and supporting the Institute’s goals. I have provided several…