Training of useful small language models.

Mon, 04 May 2026 00:00:00 +0000

How full line complete works in PyCharm and other JetBrains IDEs

Paper explains how a tiny (100M parameters) code completion model was trained. I’m fascinated by SLMs (small language models), and it’s always a joy to find when they become more than just toys but useful in the products. You don’t need any math or deep learning knowledge to read this paper, it explains the setup and trainig data in plain english most of it will be accessible for an engineer.

Inroduction to cybernetics and Stafford Beer ideas.

Sun, 03 May 2026 00:00:00 +0000

The unaccountability machine is a great book as an intro to Stafford Beer ideas on cybernetics and how it could be applied to organizations. Together with Brain of the Firm and The Human Use of Human Beings episodes of GIU podcast it entertained me during the fall 2025.

Peak of Stafford’s ideas is project Cybersyn. Imagine the new Chilean government building a nationwide cybernetics network for distributed descision-making in the 70th before the Internet era. It’s pure sci-fi in real life. There is also a great The Santiago Boys podcast from Evgeny Morozov.

Readings on ~/

Training of useful small language models.

How full line complete works in PyCharm and other JetBrains IDEs

Inroduction to cybernetics and Stafford Beer ideas.