Bahadır AKDEMİR·Oct 2, 2025The Llama Model Family: Architecture Evolution from Llama (1) to Llama 4An Informative Explanation of Llama architectures with good visualizations (I hope)
Hugman Sangkeun Jung·Nov 22, 2024Mastering LLama — Rotary Positional Embedding (RoPE) 이해하기RoPE 심층 분석: 언어 모델의 고급 위치 인코딩 기술A response icon5A response icon5
Hugman Sangkeun Jung·Nov 22, 2024Mastering LLama —Understanding Rotary Positional Embedding (RoPE)Deep Dive into RoPE: Advanced Positional Encoding in Language Models
Hugman Sangkeun Jung·Nov 21, 2024Mastering LLama — FeedForward (2/2) : Gating 메커니즘라마의 피드포워드 모듈에서 게이팅 메커니즘 이해하기A response icon2A response icon2
Hugman Sangkeun Jung·Nov 21, 2024Mastering LLama — FeedForward (2/2): Gating MechanismUnderstanding Gating Mechanisms in LLaMA’s FeedForward ModuleA response icon1A response icon1
Hugman Sangkeun Jung·Nov 21, 2024Mastering LLama —FeedForward (1/2) : Up & Down Projection 과 그 효과LLaMA의 피드포워드 구조에서의 업다운 프로젝션 이해: 향상된 모델 표현력과 정보 처리
Hugman Sangkeun Jung·Nov 21, 2024Mastering LLama — FeedForward (1/2): Up & Down Projection and Its EffectsUnderstanding Up & Down Projection in LLaMA’s FeedForward Architecture: Enhanced Model Expressiveness and Information Processing
Hugman Sangkeun Jung·Nov 1, 2024Mastering LLama — Multihead Attention (3/3) : Grouped Query Attention그룹 쿼리 어텐션 이해하기: LLM의 성능과 효율성의 균형
Hugman Sangkeun Jung·Nov 1, 2024Mastering LLama — Multihead Attention (3/3) : Grouped Query AttentionUnderstanding Grouped Query Attention: Balancing Performance and Efficiency in LLMs