Agile Data Science
  • Posts
  • Projects
  • Author
  • Github
Categories
All (29)
agile (1)
ai (1)
dataviz (1)
git (1)
history (1)
in-depth (2)
knapsack (1)
llm (1)
nlp (1)
p-value (1)
programming (15)
pythonprogramming (1)
rprogramming (5)
statistics (7)
text-analysis (1)
transformers (1)

England and Her Soldiers (1859): The Book That Made Statistics Visual

statistics
dataviz
history
TL;DR I walked into the London Science Museum and ended up standing for ten minutes in front of a glass case containing an original 1859 copy of England and Her Soldiers by…
Aug 31, 2026
Maciej Nasinski

Agents Are Easy. Products Are Still Hard.

programming
ai
agile
A year ago I wrote about vibe coding from the prototype side. This post is the continuation: what I learned while delivering AI-assisted statistical-programming products…
Aug 30, 2026
Maciej Nasinski

Are Em Dashes Really Suspicious? A Gutenberg Top-100 Check

text-analysis
statistics
programming
I checked em dash usage in a manually seeded sample of 100 top-downloaded Project Gutenberg books. The important detail is that Gutenberg plain text often writes an em dash…
Aug 29, 2026
Maciej Nasinski

R package downloads: reality, proxies, and better metrics

rprogramming
CRAN is a network of mirrors. There’s no single authoritative counter across all mirrors, binary caches, containers, or corporate pipelines. What’s widely used instead:
Oct 10, 2025
Maciej Nasinski

Understanding LLMs and Transformers: A Deep Dive into Modern AI

nlp
llm
transformers
Large Language Models (LLMs) and Transformers have revolutionized AI since 2017’s “Attention Is All You Need” paper. Understanding the difference between encoders…
Sep 13, 2025
Maciej Nasinski

Vibe Coding: Adopting the Exponential Future of AI-Assisted Development

programming
Vibe coding, highlighted by Andrej Karpathy, means “fully giving in to the vibes” and letting AI generate code while you guide it with natural language. My practical…
Sep 10, 2025
Maciej Nasinski

Visual Studio Code: Toolkit for Data Scientists

programming
TL;DR Visual Studio Code offers a complete toolkit for data science work. Its language-agnostic design supports Python, R, and other languages through extensions. GitHub…
Apr 21, 2025
Maciej Nasinski

GLM Residuals Distributions

statistics
TL;DR Explains residual analysis in generalized linear models (GLMs), particularly logistic (binary outcomes) and Poisson (count outcomes). Using R, we clearly introduce…
Mar 23, 2025
Maciej Nasinski

Curse of Dimensionality: Lessons from the U.S. Air Force Cockpit Design

statistics
TL;DR: In the late 1940s, the U.S. Air Force faced a practical design problem. Pilots were struggling with control and comfort issues, leading to accidents and reduced…
Jan 19, 2025
Maciej Nasinski

Open Source: Given enough eyeballs, all bugs are shallow

programming
TL:DR Open source is software (and sometimes hardware or data) whose source code is publicly accessible. Anyone can view, modify, and distribute it, which fosters…
Jan 12, 2025
Maciej Nasinski

Mermaid Diagrams in Markdown

programming
TL;DR Mermaid allows anyone to define and render professional-quality diagrams quickly. Whether you are a developer documenting a process, a project manager outlining…
Jan 11, 2025
Maciej Nasinski

WebAssembly: A True Web Revolution

programming
TL;DR: WebAssembly (WASM) lets code written in languages such as Rust, C++, R and Python run in the browser at near-native speed. With tools like shinylive, PyShiny, Quarto…
Jan 7, 2025
Maciej Nasinski

Python Enhancement Proposals (PEPs)

pythonprogramming
TL;DR Python Enhancement Proposals (PEPs) are the official way to propose, discuss and document changes to Python. They cover everything from coding style, such as PEP 8, to…
Jan 2, 2025
Maciej Nasinski

Object-Oriented Programming for Data Science Developers [In-Depth]

programming
in-depth
TL;DR For developers creating their own data science libraries or packages, Object-Oriented Programming (OOP) is fundamental for structuring and maintaining complex…
Jan 1, 2025
Maciej Nasinski

Containers for Data Scientists [In-Depth]

programming
in-depth
TL;DR: Containers provide reproducible, secure, and portable environments for data scientists and statistical programmers. While tools like renv for R and requirements.txt…
Dec 23, 2024
Maciej Nasinski

Conjugate Priors: Harnessing Closed-Form Solutions in Bayesian Inference

statistics
TL;DR: Conjugate priors are special prior distributions in Bayesian inference that, when combined with a given likelihood, yield a posterior in the same family as the prior.…
Dec 9, 2024
Maciej Nasinski

Bernstein–von Mises: Bridging Bayesian and Frequentist Worlds

statistics
TL;DR Bernstein–von Mises Theorem: Under certain regularity conditions and large sample sizes, the Bayesian posterior for a parameter converges to a normal distribution…


Dec 8, 2024
Maciej Nasinski

Celebrating a Classic: “How R Searches and Finds Stuff” by Suraj Gupta

rprogramming
TL;DR The blog post “How R Searches and Finds Stuff” by Suraj Gupta explains how R’s search mechanism works. Despite being over 12 years old, this post is still one of the…
Aug 1, 2024
Maciej Nasinski

Graph Database and GQL

programming
TL;DR Graph databases have emerged as a crucial technology for managing and analyzing data that is highly interconnected. Unlike traditional relational databases that store…
Jul 19, 2024
Maciej Nasinski

Scrum: Just a Framework, Agile: A General Philosophy

programming
TL;DR Agile is not the same thing as Scrum. Scrum is one framework for applying Agile ideas. The broader point is the Agile philosophy: short feedback loops, working…
Jul 18, 2024
Maciej Nasinski

Exploring the Tinyverse: A New Standard in R Package Development

rprogramming
TL;DR The “tinyverse” represents a modern approach in the R programming community, advocating for the creation of packages with minimal dependencies. This movement addresses…
May 19, 2024
Maciej Nasinski

Stack Overflow Developer Survey Insights for Strategic Tech Planning

programming
TL;DR The annual Stack Overflow Developer Survey is a useful snapshot of developer tools, languages and work habits. It should not decide your strategy on its own, but it is…
Apr 24, 2024
Maciej Nasinski

ggcall: Transparent R Packages with ggplot2

rprogramming
TL;DR Two functions in ggplot2 are overwritten (ggplot and +) to achieve code transparency and reproducibility when ggplot2 is used inside a function.
It is believed that…
Apr 13, 2024
Maciej Nasinski

GitHub Codespaces

programming
TL;DR GitHub Codespaces is a cloud-based development environment that simplifies and enhances the software development workflow. GitHub Codespaces provides fully configured…
Apr 2, 2024
Maciej Nasinski

GitHub Student Developer Pack: Learn to ship software like a pro

programming
TL;DR The GitHub Student Pack gives students free access to useful development tools, including Codespaces, GitHub Copilot, GitLens Pro, GitKraken and more. The GitHub…
Apr 1, 2024
Maciej Nasinski

Pre-commit: A framework for managing and maintaining multi-language pre-commit hooks

programming
TL;DR Pre-commit hooks are an essential tool for maintaining high code quality in software development, especially for R and Python projects. These hooks automatically run…
Apr 1, 2024
Maciej Nasinski

Analyzing the Kasa Romana Lottery with Knapsack Algorithm [Updated]

knapsack
rprogramming
TL;DR If you want to design the perfect lottery where participants believe they have a chance to win but can never actually do so, you’ll need the expertise of a skilled…
Apr 8, 2023
Maciej Nasinski

Moving Beyond P-Values in Scientific Research: Insights from the ASA Statement and Frank Harrell

p-value
statistics
TL;DR ASA suggests that researchers should report effect sizes, confidence intervals, and other measures of uncertainty alongside p-values.
Apr 7, 2023
Maciej Nasinski

Why Git is Here to Stay

git
TL;DR Git remains a staple in the programming community and is likely to continue being so for a long time.
Apr 6, 2023
Maciej Nasinski
No matching items