Tag: #audio

Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts

Analyzing SOTA Multimodal LLMs — One Model to See, Hear, and Speak
How did a language model trained purely on text come to understand and generate images, audio, and video? This post walks through modality encoders and projectors, the unified token space, the any-to-any flow, native mul
2026-06-30 · 22 min read #multimodal-llm #any-to-any #vision-language #audio #architecture
The Complete torchaudio Guide — From Audio Processing to Speech Recognition, TTS, and Music Analysis
From audio loading and spectrogram transforms to Mel filter banks, MFCC, speech recognition (Wav2Vec2/Whisper), TTS, speaker diarization, and noise reduction — everything about audio AI with PyTorch.
2026-03-02 · 9 min read #ai-platform #pytorch #torchaudio #audio #speech-recognition

Analyzing SOTA Multimodal LLMs — One Model to See, Hear, and Speak