Tag: #ai
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 216 posts
Vibe Coding: Collins Word of the Year, AI Programming Revolution, and What It Means for Developers
Coined by Andrej Karpathy, crowned Collins Word of the Year 2025. Vibe Coding is reshaping how we write software. Cursor vs Claude Code vs Copilot comparison, survival strategies for professional developers, and the futu
2026-03-22 · 19 min read #vibe-coding#ai#cursor#claude-code#copilot10 Voices Shaping the AI Era: From Jensen Huang to Yann LeCun, the Defining Quotes of 2025
Jensen Huang's "1 trillion dollar AI infrastructure," Sam Altman's "GPT-5 is smarter than me," Dario Amodei's "trillions in revenue before 2030," Yann LeCun's "LLMs are complete nonsense" — the defining quotes of 10 lead
2026-03-22 · 24 min read #ai#nvidia#openai#anthropic#googleMarch 2025 Tech·AI·K-POP Weekly Digest: From GTC to BTS Comeback
A comprehensive roundup of March 2025 highlights: NVIDIA GTC Blackwell Ultra announcement, Gemini 2.5 Pro topping benchmarks, MCP becoming the industry standard, DeepSeek-R1 open-source shock, BTS full-group comeback aft
2026-03-21 · 12 min read #culture#ai#kpop#nvidia#gtc[Deep RL] 20. Deep RL Summary: Algorithm Comparison and Selection Guide
Systematic comparison and selection criteria for deep RL algorithms: value-based, policy-based, Actor-Critic, and model-based approaches
2026-03-19 · 9 min read #reinforcement-learning#deep-learning#ai[Deep RL] 17. Model-Based Reinforcement Learning: Imagination-Augmented Agent
Principles of model-based RL and I2A (Imagination-Augmented Agent): learning environment models and planning through imagination
2026-03-19 · 8 min read #reinforcement-learning#deep-learning#ai[Deep RL] 14. Continuous Action Spaces: DDPG and Distributional Policies
Methods for handling continuous action spaces: A2C extension, DDPG deterministic policy gradient, and distributional policy gradient
2026-03-19 · 7 min read #reinforcement-learning#deep-learning#ai[Deep RL] 11. A3C: Asynchronous Advantage Actor-Critic
How A3C solves the correlation problem of A2C through asynchronous parallel learning: data parallelism and gradient parallelism implementation
2026-03-19 · 7 min read #reinforcement-learning#deep-learning#ai[Deep RL] 08. Building a Stock Trading Agent with Reinforcement Learning
Define stock trading as a reinforcement learning problem, design a custom trading environment, and train trading agents using feedforward and CNN models.
2026-03-19 · 19 min read #reinforcement-learning#deep-learning#ai#finance[Deep RL] 05. Bellman Equation and Value Iteration
Understand the concepts of state value and action value, and apply value iteration and Q-learning to FrozenLake based on the Bellman optimality equation.
2026-03-19 · 9 min read #reinforcement-learning#deep-learning#ai[Deep RL] 02. Getting Started with Reinforcement Learning Using OpenAI Gym
Understand the structure and API of OpenAI Gym, and practice with random agents and wrappers in the CartPole environment.
2026-03-19 · 10 min read #reinforcement-learning#deep-learning#ai[Deep RL] 18. AlphaGo Zero: AI That Learns by Playing Itself
Core principles of AlphaGo Zero: MCTS and self-play, plus implementing a Connect4 bot
2026-03-19 · 9 min read #reinforcement-learning#deep-learning#ai[Deep RL] 15. Trust Region Methods: TRPO, PPO, ACKTR
Trust region techniques for stable policy updates: PPO clipping objective, TRPO constrained optimization, and ACKTR
2026-03-19 · 8 min read #reinforcement-learning#deep-learning#ai[Deep RL] 12. Training Chatbots with Reinforcement Learning
Combining Seq2Seq models with reinforcement learning for chatbot training: from RNN basics to Self-Critical Sequence Training (SCST)
2026-03-19 · 7 min read #reinforcement-learning#deep-learning#ai#nlp[Deep RL] 09. Policy Gradient: Policy-Based Reinforcement Learning
Understand the difference between value-based and policy-based methods, and apply the mathematical derivation of Policy Gradient and the REINFORCE algorithm to CartPole and Pong.
2026-03-19 · 6 min read #reinforcement-learning#deep-learning#ai#policy-gradient[Deep RL] 06. Deep Q-Network: Principles and Implementation of DQN
Understand the core ideas of DQN (experience replay, target network) that overcome the limitations of table-based Q-learning, and implement it in the Pong environment.
2026-03-19 · 10 min read #reinforcement-learning#deep-learning#ai#dqn[Deep RL] 03. PyTorch Deep Learning Basics: From Tensors to Neural Networks
Learn PyTorch tensor operations, automatic differentiation, and neural network components, then implement TensorBoard monitoring and a GAN example using Atari images.
2026-03-19 · 20 min read #reinforcement-learning#deep-learning#ai#pytorch[Deep RL] 19. Practical Applications of Deep Reinforcement Learning
Diverse real-world applications of deep RL: robot control, autonomous driving, resource management, recommendation systems, NLP, and game AI
2026-03-19 · 7 min read #reinforcement-learning#deep-learning#ai[Deep RL] 16. Black-Box Optimization: Evolution Strategies and Genetic Algorithms
Optimizing policies without gradients: principles and implementation of Evolution Strategies (ES) and Genetic Algorithms (GA)
2026-03-19 · 8 min read #reinforcement-learning#deep-learning#ai[Deep RL] 13. Web Navigation and Reinforcement Learning
Combining browser automation with reinforcement learning: implementing web agents using the Mini World of Bits benchmark and OpenAI Universe
2026-03-19 · 8 min read #reinforcement-learning#deep-learning#ai[Deep RL] 10. Actor-Critic Methods: A2C and Hyperparameter Tuning
Understand the Actor-Critic architecture that solves the variance problem of REINFORCE, apply the A2C algorithm to Pong, and analyze the impact of key hyperparameters such as learning rate and entropy coefficient.
2026-03-19 · 8 min read #reinforcement-learning#deep-learning#ai#actor-critic