ML

Author

Marcus Lee

Lead AI Infrastructure Engineer

Built and scaled AI systems that handle millions of requests. I write about what separates tutorial AI from production AI — the hard lessons, the battle-tested patterns.

DevOps & DeployAI AgentsAPIs & Backends

21 Articles by Marcus Lee

Deploying AI APIs on Kubernetes with Docker
DevOps & Deploy

Deploying AI APIs on Kubernetes with Docker

Deploy AI APIs on Kubernetes with Docker for scalable production environments, including intermediate guide and best practices

July 24, 202625 min
Building Conversational AI with LLMs and RAG
RAG & Search

Building Conversational AI with LLMs and RAG

Learn to build conversational AI systems using LLMs and RAG, with practical tips and production-ready code examples

July 17, 202625 min
Evaluating LLMs with Structured Output and Semantic Similarity
LLMs & Models

Evaluating LLMs with Structured Output and Semantic Similarity

Evaluate LLMs with structured output and semantic similarity for production-grade AI engineering, learn how to avoid common pitfalls

July 17, 202625 min
Multi-Agent Task Decomposition with RAG and Tool Calling
RAG & Search

Multi-Agent Task Decomposition with RAG and Tool Calling

Learn how to decompose tasks with RAG and tool calling for efficient AI workflows, boosting productivity

July 16, 202625 min
Building Self-Correcting RAG Pipelines with Automated Feedback
RAG & Search

Building Self-Correcting RAG Pipelines with Automated Feedback

Learn to build self-correcting RAG pipelines with automated feedback for efficient similarity search and evaluation metrics.

July 16, 202625 min
Building AI-Powered Recommender Systems with Surprise and scikit-learn
AI Tooling

Building AI-Powered Recommender Systems with Surprise and scikit-learn

Develop AI-powered recommender systems with Surprise and scikit-learn for personalized user experiences

July 16, 202625 min
Hybrid RAG System with LangGraph and ElasticSearch
RAG & Search

Hybrid RAG System with LangGraph and ElasticSearch

Build a hybrid RAG system with LangGraph and ElasticSearch for production-grade AI search

July 15, 202625 min
Deploying AI Models to Edge Devices with TensorFlow Lite
LLMs & Models

Deploying AI Models to Edge Devices with TensorFlow Lite

Deploy AI models to edge devices with TensorFlow Lite and Raspberry Pi for efficient inference, including model optimization and Raspberry Pi setup

July 15, 202625 min
AI Agents

Optimizing AI Agent Policies with Reinforcement Learning

Reinforcement learning optimizes AI agent policies in complex environments, skip the theory and focus on production-grade solutions

July 12, 202625 min
LLMs & Models

Securing LLM APIs with OAuth and JWT

Secure your LLM APIs with OAuth and JWT authentication using FastAPI and MongoDB, a production-ready solution

July 12, 202625 min
LLMs & Models

Deploying Question Answering Models with Hugging Face Transformers

Learn to deploy a question answering model using Hugging Face Transformers and AWS SageMaker for production-ready AI

July 12, 202625 min
AI Tooling

Explainable AI with SHAP and LIME Libraries

Implement explainable AI with SHAP and LIME libraries for transparent model predictions

July 11, 202625 min
AI Tooling

Building Distributed AI Training Clusters

Distributed AI training with Slurm and NVIDIA GPUs for production-grade performance

July 11, 202625 min
AI Tooling

Custom AI Dataset Creation with Active Learning

Learn how to create a custom AI dataset using active learning and weak supervision, essential for production-grade AI models

July 11, 202625 min
LLMs & Models

Monitoring AI Model Drift with Prometheus and Grafana

Monitor AI model drift with Prometheus and Grafana for production-grade reliability. Learn how to track changes in your AI model's performance over time.

July 11, 202625 min
AI Tooling

Automating AI Data Preprocessing with Apache Beam

Automate AI data preprocessing with Apache Beam and Google Cloud Dataflow for efficient pipelines, including data ingestion and model training

July 11, 202620 min
AI Tooling

Azure Machine Learning Hyperparameter Tuning

Automated hyperparameter tuning with Azure Machine Learning, boosting model performance

July 10, 202620 min
AI Tooling

Reinforcement Learning with PyTorch: A Production Guide

Implement reinforcement learning with PyTorch for production-grade AI. Learn from a battle-tested engineer.

July 10, 202625 min
APIs & Backends

Cache Smarter: Using Redis in Node.js

Boost app performance with Redis caching in Node.js. Skip the theory, here's what works

July 10, 202620 min
RAG & Search

Building Production RAG Pipelines with Supabase pgvector

Learn how to build a production-grade RAG pipeline using Supabase pgvector for efficient search and retrieval of data

July 9, 202625 min
AI Tooling

JavaScript Promises and Async Await Explained

Learn JavaScript Promises and Async Await with production examples. Master async programming for efficient code

July 8, 202625 min