Machine Learning
Articles tagged Machine Learning.
Essays From 0.76 to 0.78: A 48-Hour Hackathon Journey in Data Science How a 48-hour team sprint on the PISA math-score challenge moved from R² 0.76 to 0.78, and what hardware limits and CatBoost tuning taught us. Machine Learning CatBoost : Hype or Not ? A deep dive into CatBoost's ordered target statistics, oblivious trees, and feature combinations, and why they beat XGBoost on categorical data. Machine Learning Byte Pair Encoding: Explained How Byte Pair Encoding turns text into tokens, how vocabulary size and merge rules affect compression, and the traps to avoid when implementing BPE. Mathematics Demystifying Linear Regression: From Basic Equations to Loss Functions Linear regression from first principles: the model, its assumptions, and how squared error, absolute error, Huber loss, and likelihood shape what i... Machine Learning Choosing the Right Metrics: How to Actually Know if Your Model is Any Good A guide to choosing evaluation metrics for classification, regression, and language models, and why accuracy alone can hide a failing model. Essays Diving Deep: My First Public Project - Training a GPT-2 Level LLM from Scratch! A from-scratch account of training a GPT-2-scale language model: the architecture, data pipeline, compute constraints, and lessons from my first pu...