Tag: #tensorrt
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 5 posts
Edge AI & TinyML 2026 — LiteRT / ExecuTorch / Edge Impulse / Jetson / Coral / Hailo / Sipeed K230 / llama.cpp / Phi-4 Deep-Dive Guide
A full-stack map of the 2026 Edge AI / TinyML ecosystem — the dual standard formed after TFLite Micro was rebranded as LiteRT and ExecuTorch reached GA, the TinyML cloud workflow created by Edge Impulse, the accelerator
2026-05-16 · 32 min read #edge-ai#tinyml#tflite-micro#litert#executorchEdge AI Complete Guide 2025: On-Device Inference, Model Optimization, TensorRT/ONNX/CoreML
Everything about Edge AI! On-device inference (TensorRT/ONNX Runtime/CoreML/TFLite), model optimization (quantization/pruning/knowledge distillation), hardware (NVIDIA Jetson/Apple Neural Engine/Qualcomm NPU), Federated
2026-04-13 · 21 min read #edge-ai#on-device#inference#tensorrt#onnxAI Model Serving and Inference Optimization Complete Guide: vLLM, TensorRT, Triton, Ollama
The complete guide to efficiently serving AI models in production. Master vLLM, TensorRT, NVIDIA Triton Inference Server, Ollama, quantization (INT8/INT4), batch processing, and latency optimization with real-world examp
2026-03-17 · 19 min read #mlops#model-serving#vllm#tensorrt#tritonThe Complete Autonomous Driving & Robotics Tech Stack: From C++, ROS2, CUDA, TensorRT to VLM/VLA, Simulation, and Beyond
A comprehensive guide to the core technology stack behind autonomous driving and robotics. Covering Modern C++, ROS/ROS2, CUDA parallel programming, TensorRT optimization, model compression (quantization/pruning), sensor
2026-03-01 · 22 min read #autonomous-driving#robotics#ros2#cuda#tensorrtMastering Slurm: A Practical Guide to the HPC/AI Cluster Workload Manager
A comprehensive, hands-on guide to the Slurm workload manager. Covers architecture (slurmctld/slurmd/slurmdbd), core concepts (Partitions/QoS/Fairshare), essential commands (sbatch/srun/salloc), GPU scheduling (GRES/MIG/
2026-03-01 · 15 min read #slurm#hpc#gpu#distributed-training#cluster