Installing your Python application’s dependencies can be surprisingly slow. Whether you’re running tests in CI, building a Docker image, or installing an application, downloading and installing dependencies can take a while. So how do you speed up installation with pip? In this article I’ll cover: Avoiding the slow path of installing from source. pip download speed, and the alternatives: Pipenv and Poetry. A useful pip option that can, sometimes, speed up installation significantly. Avoiding installs from source When you install […]

The Real Python Community Slack is an English-medium Python community with members located worldwide. It’s a welcoming group in which you’re free to discuss any questions you may have, celebrate your progress, or hang out with the community at the virtual watercooler. This guide is for you if you want to: Get the most out of the Real Python Slack community Navigate some of Slack’s most valuable features Get your questions answered by other Real Python members Learn the dos […]

Python is famous for coming with batteries included, and many sophisticated capabilities are available in the standard library. However, to unlock the full potential of the language, you should also take advantage of the community contributions at PyPI: the Python Packaging Index. PyPI, typically pronounced pie-pee-eye, is a repository containing several hundred thousand packages. These range from trivial Hello, World implementations to advanced deep learning libraries. In this tutorial, you’ll learn how to upload your own package to PyPI. Publishing […]

Sometimes your program is slow not because of your code, but because of where it’s running. If you have other processes competing for the same limited hardware resources, your code will run more slowly. Once you add virtualization into the mix, those competing processes might be invisible… but they’re still there. In this article we’ll cover: The hardware limits of CPUs’ cores and “hyperthreads”. How operating systems deal with multiple processes that want to use limited number of CPU cores. […]

In this tutorial, you’ll build a URL shortener with Python and FastAPI. URLs can be extremely long and not user-friendly. This is where a URL shortener can come in handy. A URL shortener reduces the number of characters in a URL, making it easier to read, remember, and share. By following this step-by-step project, you’ll build a URL shortener with Python and FastAPI. At the end of this tutorial, you’ll have a fully functional API-driven web app that creates shortened […]

You’re living in an era of large amounts of data, powerful computers, and artificial intelligence. This is just the beginning. Data science and machine learning are driving image recognition, development of autonomous vehicles, decisions in the financial and energy sectors, advances in medicine, the rise of social networks, and more. Linear regression is an important part of this. Linear regression is one of the fundamental statistical and machine learning techniques. Whether you want to do statistics, machine learning, or scientific […]

If you need to process a large JSON file in Python, you want: Make sure you don’t use too much memory, so you don’t crash half-way through. Parse it as quickly as possible. Ideally, make sure the data is actually valid up-front, with the right structure, so you don’t blow up half-way through your analysis. You can put together solutions with multiple libraries, of course. Or, you can use msgspec a new library that offers schemas, fast parsing, and some […]

Whether you’ve just started working with pandas and want to master one of its core capabilities, or you’re looking to fill in some gaps in your understanding about .groupby(), this tutorial will help you to break down and visualize a pandas GroupBy operation from start to finish. This tutorial is meant to complement the official pandas documentation and the pandas Cookbook, where you’ll see self-contained, bite-sized examples. Here, however, you’ll focus on three more involved walkthroughs that use real-world datasets. […]