Notes on data engineering and AI engineering — patterns, trade-offs, and hard-won lessons from 10+ years building data platforms and GenAI systems. 2026-05-25T00:00:00.000Z https://harisankarsivankutty.in/ Harisankar Sivankutty https://harisankarsivankutty.in/blog/beyond-the-api-data-engineer-guide-to-llm-memory-ladder/ 2026-05-25T00:00:00.000Z

What a data engineer learned trying to fine-tune an 8B model — the CUDA crash, the humbling, and the chain of trade-offs that decides whether a model will actually run on the hardware in front of you.

https://harisankarsivankutty.in/blog/from-bigquery-to-snowflake-real-world-analytics-migration/ 2026-05-23T00:00:00.000Z

The real story of migrating an analytics workload from BigQuery to Snowflake — not the clean version, but the actual trade-offs, surprises, and lessons from doing it inside a live enterprise.

https://harisankarsivankutty.in/blog/building-enterprise-data-platform-lessons-learned/ 2026-02-10T00:00:00.000Z

Nine months, twenty thousand jobs, petabytes of data. Here's what I learned building an enterprise data platform from scratch — the architecture decisions, the human dynamics, and six lessons I'd tell myself at the start.

https://harisankarsivankutty.in/blog/how-ai-agents-work-simple-explanation-non-technical-readers/ 2026-01-30T00:00:00.000Z

AI agents, memory, tools, and large language models — explained without jargon. A step-by-step breakdown for anyone trying to understand what an AI agent actually is and how it reasons.

https://harisankarsivankutty.in/blog/anatomy-of-a-langchain-application-core-components-explained/ 2025-10-14T00:00:00.000Z

A step-by-step walkthrough of building a RAG application with LangChain — from data indexing to retrieval and generation, explained through the core components you'll use every time.

https://harisankarsivankutty.in/blog/why-langchain-deep-dive-essential-framework-for-genai/ 2025-10-09T00:00:00.000Z

Why LangChain exists, what fragmentation it solves, and why it became the backbone of enterprise GenAI — a deep dive for engineers who want to understand the framework, not just use it.

https://harisankarsivankutty.in/blog/building-trust-in-data-productionizing-great-expectations-at-scale/ 2025-09-20T00:00:00.000Z

How we deployed Great Expectations in production — the challenges, the failures, and what it actually takes to make data validation a first-class citizen in a real pipeline.