Machine Learning Articles

Discover AI, machine learning algorithms, and data science

4 articles · Newest first

All categories

CatBoost : Hype or Not ?

A deep dive into CatBoost's ordered target statistics, oblivious trees, and feature combinations, and why they beat XGBoost on categorical data.

Machine Learning Deep Learning Benchmarks

Byte Pair Encoding: Explained

How Byte Pair Encoding turns text into tokens, how vocabulary size and merge rules affect compression, and the traps to avoid when implementing BPE.

LLM GPT-2 Machine Learning

A Deep Dive into Attention Mechanisms: The Secret Ingredient of Modern NLP

A practical tour of attention mechanisms, from Bahdanau soft attention and hard attention to self-attention and multi-head transformers.

Deep Learning Transformers Attention

Choosing the Right Metrics: How to Actually Know if Your Model is Any Good

A guide to choosing evaluation metrics for classification, regression, and language models, and why accuracy alone can hide a failing model.

LLM GPT-2 Machine Learning