Data Engineering
In the first article of this series, I created a pipeline, loaded toy data into Duckdb and viewed loaded info. I used dlt.pipeline and pipeline.run() methods I used DuckDB, sql_client and dlt dataset to view tables and query data. In this articl...
Introduction Data Load Tool (DLT) is an open source library designed to simplify the process of extracting, loading and transforming (ELT) data from various, often messy data sources into well structured live datasets. Dlt loads data from a wide rang...
Introduction In the world of data engineering, the choice of file format is a crucial decision that can significantly impact the efficiency and effectiveness of your data pipeline. With popular options like CSV, JSON, Avro, Parquet, and ORC offering ...
Introduction Docker is an open-source platform that enables developers to automate the deployment, scaling, and management of applications using containerisation. It provides the capability to create, deploy, and manage containers, ensuring that appl...
Introduction Window functions are special types of functions in SQL that allow performance calculations in a set of rows within a query, known as a window. This is comparable to calculations done using aggregate functions such as SUM, AVG, MIN, MAX a...
Introduction Subqueries, also known as sub-selects or nested-selects, are queries nested inside another SQL query statement. They are a powerful tool in SQL, particularly when handling intricate data and logic. Subqueries offer a structured methodolo...
Getting Started with Git and Github
Introduction The real power of SQL comes from working with data from multiple tables at once. The term relational database refers to the fact that the tables relate to each other. Thus they contain common identifiers that allow information from multi...
Descriptive Statistics
