Skip to main content

About

Alwyn D'Souza

Data & AI Engineering Leader

I'm a data engineering leader with 20+ years building production-grade data platforms for enterprise teams. I specialize in the modern data stack — dbt, Databricks, DataOps, and increasingly, AI-powered systems.

My work sits at the intersection of data engineering and AI — from building MCP servers that give AI agents governed access to data platforms, to implementing semantic layers that make metrics first-class citizens.

I write extensively on these topics and build open-source reference architectures that teams can actually use in production.

Core Focus Areas

Established expertise

Lakehouse Architecture

Modern cloud-native analytics architectures using Databricks, Delta Lake, and scalable data platforms.

DataOps & Platform Engineering

Automated CI/CD, testing, observability, governance, and reliable data engineering workflows.

AI Agent Systems

Agentic workflows, orchestration frameworks, MCP tooling, and AI-enabled engineering systems.

Enterprise Data Platforms

Scalable enterprise modernization initiatives focused on cloud analytics and platform engineering.

Currently Exploring

Future-facing innovation

Agentic AI SystemsMCP ToolingEnterprise AI OrchestrationSpec-Driven DevelopmentDatabricks OptimizationAI-Augmented DataOps

Technical Expertise

Data Platforms

DatabricksSnowflakeBigQueryRedshiftDuckDBOracle

Transformation

dbt Coredbt CloudSQLSpark SQLJinja2SQLMesh

AI & Automation

AI AgentsMCP ServersLangChainOllamaRAGLLM APIs

Orchestration

Airflowdbt Cloud JobsGitHub ActionsDatabricks Workflows

Streaming

RedpandaKafkaRisingWaveDelta Live Tables

Languages

PythonSQLBashTypeScriptJinja2YAML

DevOps

DockerGitHub Actionspre-commitsqlfluffTerraform

Recent Writing

All articles