Cloudera → Azure Databricks migration
Moved more than 100 critical banking pipelines off on‑prem Cloudera onto Azure Databricks, with Delta Lake and Medallion layers.
100+pipelines
~30%lower cost
~55%faster
Technical Solutions · Data & AI Software Engineer
MatheusSantos.
Data and AI software engineer. Here you'll find my work and the things I write.
- Work
- Technical solutions · Data & AI
- Experience
- +5 years in data engineering
- Languages
- Português · English
Behold, I lay in Zion for a foundation a stone, a tried stone, a precious corner stone, a sure foundation: he that believeth shall not make haste.Isaiah 28:16 · KJV
Work
Projects I've built.
Results from team initiatives in earlier roles, as measured internally. No confidential employer information is shared.
Automated pipeline testing framework
A testing framework for batch pipelines across DB2, Oracle and Delta Lake, so changes shipped with evidence instead of hope.
~90%coverage
~40%fewer incidents
3source systems
Data Vault and Medallion models
Modelled risk and regulatory reporting data with Data Vault and Medallion architecture, delivered through Delta Live Tables.
Spark plan reader
A small tool idea: read an EXPLAIN plan and point out skew, wrong join strategies and spill risk in plain language. Placeholder until it ships.
Articles
Articles.
Contact
Say olá.
For work, writing, speaking, or just a good conversation. I reply in English or Portuguese.
- Book a call
- 30-minute call
- matheus-borges-2208
Donate
Support the work.
If something I wrote saved you a bad night in production, you can help keep the writing and open-source tools going.
Donate · link soon
Pix and international options coming