In this post, I will guide you through the basic steps for defining a new Service Account and granting different roles on BigQuery through the cloud. It is a common choice to work at the command line and manage development workflow in a terminal window. Setting Up Your Environment with BigQuery Sandbox The easiest way…
Category: Chronicles from the trenches
Looking back to Kimball’s approach to Data Warehousing
Over time, it’s fascinating to witness how certain concepts, approaches, or visions age. Time, in its inexorable flow, often brings justice to ideas and individuals alike. Such a reflection is pertinent when considering the enduring impact of Ralph Kimball’s groundbreaking book on dimensional modeling for data warehousing and business intelligence.
Playing with some Pandas functions and Airflow operators
Recently, I was dealing with a task where I had to import raw information into a staging PostgreSQL Database as part of a task in the Airflow DAG pipeline. I would like to share the approach used and exposes the valuable Pandas.json_normalize function and how it helps to prepare the data before importing. Reading the…
Using interpolated format strings in Python
The release of Python 3.6 came with exciting functionalities. I want to speak about the feature called interpolated format string – f-strings for short- through this quick post. This new feature allows us to have a more readable, concise and even faster way of formatting string, in short words: pythonic code.