geohernandez
Menu
  • HOME
  • ABOUT
  • CONTACT ME
  • WORK WITH GEO
    • Data Specialist
    • Speaker Events
    • Resume
  • English
    • English
    • EspaƱol
Menu

Data Modeling and its relevance in the Cloud Era

Posted on May 10, 2024July 6, 2024 by geohernandez

Since 2005, I’ve immersed myself in the dynamic world of data and its modeling. It’s been fascinating to witness how data modeling has evolved over the years, navigating through its challenges and successes. Throughout this journey, advocating for its significance has been a constant endeavour, emphasizing its crucial role not just as a practice, but as a cornerstone for ensuring accurate and actionable data.

“Data models are techniques for representing information, sufficiently structured and simplistic to fit well into computer technology.” This definition by William Kent from 1978 still resonates today, capturing the essence of data modeling as a powerful communication and reflective tool for understanding organizational processes and information exchange.

However, the rise of new technologies in recent years has led some to question the relevance of data modeling. There’s a misconception that storing data indiscriminately is sufficient, relying on future machine learning algorithms to make sense of it. Yet, this overlooks the foundational principles of effective software development, often resulting in failed projects. The importance of “garbage in, garbage out” becomes evident in the era of cloud computing and AI, highlighting the risks of accumulating unnecessary data.

Consider the costs associated with maintaining terabytes of irrelevant information. Beyond tangible expenses, there are opportunity costs, especially when data lakes turn into data swamps. It’s crucial to move away from the mentality of storing everything and instead focus on purposeful data storage. Even with a schema-on-read approach, it’s essential to consider transforming data into refined zones through modeling, enabling efficient analytics and decision-making.

Despite technological advancements, including the exciting world of opportunities that imply the Cloud, the essence of data modeling remains unchanged. It continues to play a vital role in converting data into actionable insights, fostering communication, and promoting reflection within organizations. Kent’s definition still holds true, reflecting the aspirations of organizations aiming for robust data governance.

Data modeling, like other pillars of IT and software development, is here to stay. Its enduring nature is rooted in human cognition; all it requires is paper, pencil, and collective expertise to depict reality accurately. As we look ahead, data modeling will continue to shape the landscape of software development for years to come.

Category: Data Architecture, Data Engineering

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search for articles

Recent Posts

  • Quick Guide: BigQuery Service Account Setup Using gcloud
  • The Art of Data Modeling in AI times
  • Getting Started with Snowflake’s Snowpipe for Data Ingestion on Azure

Categories

  • Airflow (1)
  • Azure (6)
  • Azure DevOps (2)
  • Bash script (1)
  • Blog (1)
  • Cassandra (3)
  • Chronicles from the trenches (26)
  • Data Architecture (3)
  • Data Engineering (11)
  • DB optimization (2)
  • Events (2)
  • GIT (1)
  • MySQL (1)
  • Python (7)
  • Snowflake (3)
  • SQL Saturday (1)
  • SSIS (2)
  • T-SQL (5)
  • Uncategorized (2)

Archives

  • May 2025 (1)
  • March 2025 (1)
  • January 2025 (2)
  • October 2024 (1)
  • July 2024 (1)
  • May 2024 (1)
  • December 2023 (1)
  • November 2023 (1)
  • August 2023 (1)
  • June 2023 (1)
  • December 2022 (1)
  • November 2022 (1)
  • July 2022 (1)
  • March 2022 (1)
  • September 2021 (1)
  • May 2021 (1)
  • March 2021 (1)
  • February 2021 (3)
  • December 2020 (1)
  • October 2020 (3)
  • September 2020 (1)
  • August 2020 (1)
  • January 2020 (1)
  • August 2019 (1)
  • July 2019 (1)
  • June 2019 (1)
  • May 2019 (1)
  • April 2019 (1)
  • March 2019 (1)
  • November 2018 (3)
  • October 2018 (1)
  • September 2018 (1)
  • August 2018 (2)
© 2025 geohernandez | Powered by Minimalist Blog WordPress Theme