https://alwyndsouza.github.io Practical writing on Data Engineering, DataOps, dbt, Databricks, and AI Agents. Articles, open-source projects, and lessons from production data platforms. en Sat, 20 Jun 2026 04:09:19 GMT https://alwyndsouza.github.io/articles/altimate-code-and-the-rise-of-the-ai-engineering-harness https://alwyndsouza.github.io/articles/altimate-code-and-the-rise-of-the-ai-engineering-harness Tue, 16 Jun 2026 00:00:00 GMT data-engineering data-science software-engineering ai-agent coding https://alwyndsouza.github.io/articles/the-hidden-dependency-behind-reliable-ai-agents https://alwyndsouza.github.io/articles/the-hidden-dependency-behind-reliable-ai-agents Fri, 12 Jun 2026 00:00:00 GMT data-science technology artificial-intelligence data-engineering software-engineering https://alwyndsouza.github.io/articles/dbt-wizard-cli-ai-agent-built-for-analytics-engineering https://alwyndsouza.github.io/articles/dbt-wizard-cli-ai-agent-built-for-analytics-engineering Sun, 07 Jun 2026 00:00:00 GMT ai-agent dbt coding data-engineering data-analysis https://alwyndsouza.github.io/articles/dbt-wizard-cli-an-ai-agent-built-for-analytics-engineering https://alwyndsouza.github.io/articles/dbt-wizard-cli-an-ai-agent-built-for-analytics-engineering Sun, 07 Jun 2026 00:00:00 GMT ai-agent dbt coding data-engineering data-analysis https://alwyndsouza.github.io/articles/ai-cost-observability-two-open-source-tools-every-ai-developer-should-know https://alwyndsouza.github.io/articles/ai-cost-observability-two-open-source-tools-every-ai-developer-should-know Sat, 06 Jun 2026 00:00:00 GMT open-source developer software-engineering llm artificial-intelligence https://alwyndsouza.github.io/articles/ai-skills-need-ci-cd-too https://alwyndsouza.github.io/articles/ai-skills-need-ci-cd-too Sat, 06 Jun 2026 00:00:00 GMT ai ai-agent data-engineering agentic-ai data-science https://alwyndsouza.github.io/articles/stop-guessing-your-ai-spend-two-open-source-tools-that-track-every-token https://alwyndsouza.github.io/articles/stop-guessing-your-ai-spend-two-open-source-tools-that-track-every-token Sat, 06 Jun 2026 00:00:00 GMT open-source developer software-engineering llm artificial-intelligence https://alwyndsouza.github.io/articles/dbt-mcp-v1-20-0-your-ai-agents-was-reading-the-wrong-dbt-docs https://alwyndsouza.github.io/articles/dbt-mcp-v1-20-0-your-ai-agents-was-reading-the-wrong-dbt-docs Thu, 04 Jun 2026 00:00:00 GMT How dbt MCP v1.20.0 fixes a subtle but important problem in AI-assisted analytics engineeringOverviewdbt MCP v1.20.0 introduces version-aware documentation retr... dbt data-engineering data-analytics data-quality analytics-engineering https://alwyndsouza.github.io/articles/your-ai-agent-was-reading-the-wrong-dbt-docs https://alwyndsouza.github.io/articles/your-ai-agent-was-reading-the-wrong-dbt-docs Thu, 04 Jun 2026 00:00:00 GMT dbt data-engineering data-analytics data-quality analytics-engineering https://alwyndsouza.github.io/articles/dbt-v1-12-vars-yml-a-five-year-community-ask-finally-answered https://alwyndsouza.github.io/articles/dbt-v1-12-vars-yml-a-five-year-community-ask-finally-answered Tue, 02 Jun 2026 00:00:00 GMT dbt software-engineering analytics-engineering data-modeling data-engineering https://alwyndsouza.github.io/articles/dbt-core-v1-12-rewrites-the-semantic-layer-spec https://alwyndsouza.github.io/articles/dbt-core-v1-12-rewrites-the-semantic-layer-spec Sun, 31 May 2026 00:00:00 GMT semantic-layer analytics-engineering data-engineering data-modeling dbt https://alwyndsouza.github.io/articles/how-i-use-promptfoo-to-test-and-grade-an-agile-ai-skill https://alwyndsouza.github.io/articles/how-i-use-promptfoo-to-test-and-grade-an-agile-ai-skill Sun, 31 May 2026 00:00:00 GMT I treat agile story skills like software. That means I test them, score them, and grade them — using promptfoo — before users hit a regression.Here is why that... agentic-ai artificial-intelligence ai-agent llm quality-assurance https://alwyndsouza.github.io/articles/how-to-use-promptfoo-to-test-and-evaluate-ai-agent-skills https://alwyndsouza.github.io/articles/how-to-use-promptfoo-to-test-and-evaluate-ai-agent-skills Sun, 31 May 2026 00:00:00 GMT A practical guide to benchmarking AI skills against baseline agents, measuring quality improvements, and building confidence before production adoption.I treat... agentic-ai artificial-intelligence ai-agent llm quality-assurance https://alwyndsouza.github.io/articles/testing-ai-skills-like-a-software-engineer https://alwyndsouza.github.io/articles/testing-ai-skills-like-a-software-engineer Sun, 31 May 2026 00:00:00 GMT agentic-ai artificial-intelligence ai-agent llm quality-assurance https://alwyndsouza.github.io/articles/defining-better-sprint-goals-with-github-copilot-agent-skills https://alwyndsouza.github.io/articles/defining-better-sprint-goals-with-github-copilot-agent-skills Tue, 26 May 2026 00:00:00 GMT Using AI-powered problem framing and sprint-goal generation to align agile teams around outcomes instead of task lists.Agent skill GitHub Repo link in reference... data-engineering artificial-intelligence agile product-management software-engineering https://alwyndsouza.github.io/articles/my-copilot-agent-skill-splits-stories-better-than-most-agile-teams https://alwyndsouza.github.io/articles/my-copilot-agent-skill-splits-stories-better-than-most-agile-teams Mon, 25 May 2026 00:00:00 GMT How eight proven story-splitting patterns turn 13-point sprint killers into vertical slices that actually ship value.The agile-story-splitter Copilot Agent Skil... ai-agent software-development product-management data-engineering agile https://alwyndsouza.github.io/articles/why-your-user-stories-are-broken-and-how-a-copilot-agent-skill-can-fix-them https://alwyndsouza.github.io/articles/why-your-user-stories-are-broken-and-how-a-copilot-agent-skill-can-fix-them Mon, 25 May 2026 00:00:00 GMT Injecting Deterministic Requirements, BDD Acceptance Criteria, and Automated Quality Gates Directly into Your BacklogSkills Repository: https://github.com/alwyn... agile artificial-intelligence software-engineering product-management github-copilot https://alwyndsouza.github.io/articles/the-complete-guide-to-agent-skills-for-agile-four-skills-for-better-scrum https://alwyndsouza.github.io/articles/the-complete-guide-to-agent-skills-for-agile-four-skills-for-better-scrum Sun, 24 May 2026 00:00:00 GMT data-engineering agile ai-agent ai software-engineering https://alwyndsouza.github.io/articles/ai-agents-explained-without-the-hype-a-data-engineer-s-take https://alwyndsouza.github.io/articles/ai-agents-explained-without-the-hype-a-data-engineer-s-take Sat, 09 May 2026 00:00:00 GMT python machine-learning artificial-intelligence software-engineering data-engineering https://alwyndsouza.github.io/articles/mcp-vs-agentic-skills-which-architecture-should-you-choose https://alwyndsouza.github.io/articles/mcp-vs-agentic-skills-which-architecture-should-you-choose Sat, 09 May 2026 00:00:00 GMT data-engineering machine-learning model-context-protocol software-engineering artificial-intelligence https://alwyndsouza.github.io/articles/a-better-way-to-do-real-time-streaming-redpanda-risingwave-explained https://alwyndsouza.github.io/articles/a-better-way-to-do-real-time-streaming-redpanda-risingwave-explained Wed, 22 Apr 2026 00:00:00 GMT risingwave data-quality data-engineering red-panda streaming https://alwyndsouza.github.io/articles/bi-as-code-bridging-the-gap-between-data-engineering-and-analytics https://alwyndsouza.github.io/articles/bi-as-code-bridging-the-gap-between-data-engineering-and-analytics Sat, 18 Apr 2026 00:00:00 GMT BI-as-Code treats dashboards and metrics as version-controlled, testable, reusable code artefacts closing the last remaining gap in the modern data stack where... data-quality version-control bi-as-code automation dbt https://alwyndsouza.github.io/articles/mcp-vs-agentic-skills-what-s-the-difference-and-how-do-they-work-together https://alwyndsouza.github.io/articles/mcp-vs-agentic-skills-what-s-the-difference-and-how-do-they-work-together Sat, 28 Mar 2026 00:00:00 GMT Understanding where protocol ends and intelligence begins in modern AI agent architectures.MCP (Model Context Protocol) and agentic skills are not competing con... artificial-intelligence ai-agent claude-code mcp-server data-engineering https://alwyndsouza.github.io/articles/databricks-transitioning-to-the-direct-deployment-engine-for-declarative-automation-bundles https://alwyndsouza.github.io/articles/databricks-transitioning-to-the-direct-deployment-engine-for-declarative-automation-bundles Sun, 22 Mar 2026 00:00:00 GMT A “Software Engineering” mindset for data, without the infrastructure tax.The landscape of Databricks automation is shifting. With the release of Databricks CLI... software-engineering devops databricks data-engineering databricks-asset-bundles https://alwyndsouza.github.io/articles/the-dbt-mcp-server-how-the-model-context-protocol-bridges-governed-data-to-ai-agents https://alwyndsouza.github.io/articles/the-dbt-mcp-server-how-the-model-context-protocol-bridges-governed-data-to-ai-agents Sun, 15 Mar 2026 00:00:00 GMT LLMs are smart but blind. Your semantic layer is organised but silent. MCP is the bridge that lets AI see your data — and answer questions without hallucinating... data ai-agent mcp-server data-governance dbt https://alwyndsouza.github.io/articles/metrics-as-code-building-a-semantic-layer-with-dbt-and-metricflow https://alwyndsouza.github.io/articles/metrics-as-code-building-a-semantic-layer-with-dbt-and-metricflow Sat, 14 Mar 2026 00:00:00 GMT How to define business metrics once, version them in Git, and serve them consistently to every dashboard, notebook, and AI agent in your stackThe Idea in One Se... data data-governance dbt https://alwyndsouza.github.io/articles/why-data-teams-need-a-semantic-layer https://alwyndsouza.github.io/articles/why-data-teams-need-a-semantic-layer Sat, 14 Mar 2026 00:00:00 GMT The Problem: Metric Disagreement Across Tools and TeamsMost data teams have encountered this situation: two reports that should show the same number don’t. Fina... data data-quality dbt semantic-layer data-governance https://alwyndsouza.github.io/articles/dbt-fusion-under-the-hood-the-technical-architecture https://alwyndsouza.github.io/articles/dbt-fusion-under-the-hood-the-technical-architecture Sat, 13 Dec 2025 00:00:00 GMT dbt fusion : Under the Hood—The Technical ArchitectureMore Than Just “Faster”The dbt Fusion Engine represents a fundamental architectural evolution from the leg... dbt-labs data-transformation dbt data-engineering developer-experience https://alwyndsouza.github.io/articles/the-evolution-why-dbt-needed-a-revolution https://alwyndsouza.github.io/articles/the-evolution-why-dbt-needed-a-revolution Sat, 13 Dec 2025 00:00:00 GMT dbt rust dbt-cloud dbt-core dbt-labs https://alwyndsouza.github.io/articles/speed-up-your-dbt-development-with-sample-mode https://alwyndsouza.github.io/articles/speed-up-your-dbt-development-with-sample-mode Sun, 07 Dec 2025 00:00:00 GMT code-quality ci-cd-pipeline developer-experience speed dbt