Python Trending Weekly
ISSUE 68

2023 Python Developer Survey Results

2024-09-07 Season 3

TL;DR

The Python Developers Survey 2023 results land, chDB makes Pandas queries 87x faster, and HivisionIDPhotos turns out AI ID photos in seconds.

Articles 12 Projects 12 Discussions 2
🦄

Articles & Tutorials

× 12
01 Python Developers Survey 2023 Results pyfound.blogspot.com

Python's official 7th annual developer survey results are out! Over 25,000 Python developers from nearly 200 countries and regions participated in the survey. Let's see what new trends emerged this year, what changed, and what stayed the same?

02 Why I Still Use Python Virtual Environments in Docker hynek.me

When developing Python projects with Docker, is it still necessary to use virtual environments? The author's recommendation is yes, and the article shares several reasons: predictability and familiarity of directory structure, unified standards for easier communication, reduced code import lookups, etc.

03 How I use Python to organize my data analyses joshuacook.netlify.app

The author is a computational biologist who shares their experience using Python for data analysis, including virtual environments, dependency management, module management, programming practice recommendations, and more.

04 Playing with the One Billion Row Challenge in Python old-panda.com

How to process a file containing one billion weather data records in the shortest time? The author took on this challenge with Python, optimizing from 8 minutes to just over half a minute in their local environment, sharing some Python optimization tricks.

05 Understanding the Template Method Pattern in Python startcodingnow.com

Using an example of preparing coffee and tea, this introduces the Template Method design pattern for creating flexible and reusable code structures that are easier to maintain and extend.

06 Lesser known parts of Python standard library trickster.dev

"Hidden gems" in Python's standard library - some are actually quite commonly used, like collection and contextlib, but others are truly rare like fractions, webbrowser, and zipapp.

07 How to implement a time-based LRU cache in Python jamesg.blog

There are two common caching strategies: time-based and least recently used. The article introduces both caching approaches and implements a caching algorithm from scratch in Python that combines both strategies.

08 The Design & Implementation of the CPython Virtual Machine blog.codingconfessions.com

A deep dive into the design and implementation of the CPython virtual machine, including bytecode format, the interpreter's bytecode evaluation loop, and how stack frames and computed jumps are used to optimize performance. Finally, it analyzes the execution process of a simple Python program, showing how the VM manages and executes compiled bytecode.

09 How we made querying Pandas DataFrames with chDB 87x faster clickhouse.com

chDB is an embedded version of ClickHouse that runs in-process. Its version 2.0 is 87x faster than 1.0 when querying Pandas DataFrames. The article explains how this was achieved: reducing serialization/deserialization steps, directly reading Python objects, batch data copying, and rewriting Python string encoding/decoding logic in C++.

10 Escaping from Anaconda's Stranglehold on macOS paulromer.net

Beginners who install Anaconda on macOS might not be able to find a way to run the official Python. The article introduces a simple solution: moving the .zshrc file out of the home directory to escape Anaconda's control over the Python environment.

11 Python: profile total memory allocated with tracemalloc adamj.eu

tracemalloc is a Python standard library that can track memory allocation. The article shows how to use it to implement a simple memory estimation function, compares it with sys.getsizeof(), and examines the memory size of importing numpy. (Also: What should you pay attention to when Python calculates memory?)

12 Habits of great software engineers vadimkravcenko.com

What habits do efficient, excellent software engineers have? The author summarizes some important points, such as focusing beyond just the code itself, pursuing efficiency, enjoying fixing things, systematic thinking, knowledge transfer, simplifying complex problems, etc.

🐿️

Projects & Resources

× 12
01 supertree: Visualize decision trees in Python github.com

Interactively visualize decision trees in Jupyter Notebooks, Jupyter Lab, Google Colab, and other notebooks that support HTML rendering.

supertree: Visualize decision trees in Python
02 kazam: Linux Screen Recorder, Broadcaster, Capture and OCR with AI in mind) github.com

A versatile toolbox supporting screen recording, audio recording, broadcasting, OCR, webcam, and other features.

03 python-training: Python training for business analysts and traders github.com

Python training course from JPMorgan Chase for business analysts and traders. (5.7K stars)

04 pymobiledevice3: Pure python3 implementation for working with iDevices (iPhone, etc...) github.com

For interacting with iPhone and other devices, supporting device discovery, TCP port forwarding, syslog viewing, app management, file management, firmware updates, notification monitoring and triggering, screenshots, backups, etc. (1.3K stars)

05 xiaomusic: Play music using Xiaomi AI speakers github.com

Play music using Xiaomi AI speakers, with music downloaded via yt-dlp. Supports multiple voice commands, multiple speaker devices, and various music formats. (1.4K stars)

06 amine: Distraction blocker which monitors your mouse and keyboard github.com

Customizable pomodoro timer with strict distraction prevention (disables key combinations that might interfere with focus, prevents mouse from moving to screen edges), forced fullscreen, and user-friendly interface.

07 asyncpal: Preemptive concurrency and parallelism for sporadic workloads github.com

Designed for preemptive concurrency and parallelism, using thread pools for concurrency and extending to multiprocessing for parallelism. Thread pools support automatic idle shrinking.

08 tinystatus: Tiny status page generated by a Python script github.com

Simple, customizable status page generator that can monitor the status of various services like HTTP endpoints, ping hosts, check ports, etc.

09 graphiti: Build and query dynamic, temporally-aware Knowledge Graphs github.com

Build knowledge graphs that represent complex relationships between entities that change over time. Supports extracting unstructured and structured data, and can query the generated graphs through time, full-text, semantic, and graph algorithms.

10 librosa: Python library for audio and music analysis github.com

Powerful music and audio analysis tool. (7K stars)

11 Nettacker: Automated Penetration Testing Framework - Open-Source Vulnerability Scanner - Vulnerability Management github.com

Aimed at automatically gathering information, scanning vulnerabilities, and generating reports, including services, bugs, vulnerabilities, misconfigurations, etc. Uses TCP SYN, ACK, ICMP, and other protocols to detect and bypass firewall/IDS/IPS devices. (3.3K stars)

12 HivisionIDPhotos: a lightweight and efficient AI ID photos tools github.com

Intelligent ID photo creation tool that can perform lightweight background removal and generate ID photos of different sizes. (7.2K stars)

HivisionIDPhotos: a lightweight and efficient AI ID photos tools
*

*[🥂Discussions & Questions](https://xiaobot.net/p/python_weekly)**

× 2
ESC
↑↓ select · ↵ open175 issues