All work
04 / CLOUD & DATA ENGINEERING

Raw files. Connected data. Clearer answers.

A Spotify-themed learning lab connecting ingestion, transformation, and analytics-ready data.

01 / THE QUESTION

How do separate files become connected information?

Track, artist, and album files are related, but separate CSVs are not yet a dependable analytical dataset. Their relationships and transformation stages need to be explicit.

Explore a structured cloud workflow from raw ingestion to joined, cleaned datasets for downstream analysis.

02 / THE APPROACH
01

Organize the inputs

The lab centered on related track, artist, and album CSV datasets, with Amazon S3 as the raw-data landing area and separation between raw, staging, and transformed data.

02

Connect and transform

Explored AWS Glue transformations and joins to organize related music datasets into an analysis-ready structure.

03

Consider event-driven processing

Studied AWS Lambda event-driven processing concepts as part of the broader pipeline design. The diagram presents the learning architecture; an automated production trigger is not claimed.

03 / THE OUTCOME

What the work delivers.

A practical exploration of cloud storage, ETL transformations, dataset relationships, and reporting readiness, supported by AWS Academy Data Engineering training.

THE TAKEAWAY

A pipeline’s value is in the structure it produces. Explicit stages and well-understood join keys make it easier to reason about data quality and downstream use.

Project scopeA learning lab, not a production deployment. Processing volumes, cost savings, and runtime improvements are not reported. Redshift and Athena are broader skills, not asserted deployments in this lab.

KEEP EXPLORING

British Airways Customer Reviews