Skip to content

Parsing JSON at tens of gigabytes per second… in Python

7.9 relevance
Score Breakdown
technical depth
9
novelty
8
actionability
7
community
8
strategic
6
personal
8

Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.

High-performance JSON parsing in Python is directly actionable for data engineering and showcases novel optimization techniques.

Languages lemire.me
Parsing JSON at tens of gigabytes per second… in Python
Summary

12 October 2026 · 5 min Python used to have limited parallelism, due to its global interpreter lock (GIL). Only one thread could run Python code at a time. Python 3.14 comes in a free-threaded version ( python3.14t ), without the global interpreter lock. Several threads can now run Python code at the same time. Let us pick a realistic problem. GitHub publishes everything that happens on its public repositories: pushes, issues, pull requests, stars, and so forth. The GH Archive project collects these events

Author

View all posts by Daniel Lemire

More from View all posts by Daniel Lemire →