Tag: #ab-testing
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 5 posts
Product Analytics & A/B Testing 2026 — Mixpanel / Amplitude / PostHog / Heap / Optimizely / Plausible / Segment Deep Dive
A May 2026 map of the product analytics, A/B testing, and CDP ecosystem in one place. Covers Mixpanel (long-time leader), Amplitude (expanding into experimentation), PostHog (open-source all-in-one), Heap (autocapture),
2026-05-16 · 24 min read #product-analytics#ab-testing#mixpanel#amplitude#posthogFeature Flags & Experimentation Platforms 2026 — LaunchDarkly / Statsig / GrowthBook / Unleash / PostHog / OpenFeature Deep Dive
A map of the feature flag and experimentation platform landscape in 2026. OpenFeature became the CNCF standard; LaunchDarkly remains the enterprise leader; Statsig bundles flags + experimentation + analytics; open source
2026-05-16 · 23 min read #feature-flags#experimentation#ab-testing#launchdarkly#statsigMLOps Complete Guide — Model Serving, Feature Store, Drift, A/B Testing, GPU Economics (Season 2 Ep 7, 2025)
Training a model and running it in production are completely different games. Serving (TorchServe, Triton, vLLM, TGI), Feature Stores (Feast, Tecton), training infra (Ray, Determined), experiment tracking (MLflow, W&B),
2026-04-15 · 12 min read #mlops#model-serving#feature-store#drift-detection#ab-testingLLMOps Platform Architecture Guide: Model Deployment, Monitoring, and A/B Testing
A comprehensive guide to designing and implementing an LLMOps platform. Covers vLLM/TGI-based model serving, token usage/latency/quality monitoring, prompt version management, A/B testing framework, guardrail integration
2026-03-13 · 14 min read #ai-platform#llmops#model-serving#monitoring#ab-testingChatbot Performance Monitoring and Conversation Quality Analysis: From Metric Design to A/B Test Automation
A practical guide to chatbot performance monitoring and conversation quality analysis. Covers core metric design, tracing with LangSmith/Langfuse, automated quality evaluation pipelines, and A/B testing framework with co
2026-03-08 · 30 min read #chatbot#monitoring#analytics#ab-testing#langsmith