Scrapy is a robust Python web scraping framework that can manage requests asynchronously, follow links, and parse site content. To store scraped data, you can use MongoDB, a scalable NoSQL database, that stores data in a JSON-like format. Combining Scrapy with MongoDB offers a powerful solution for web scraping projects, leveraging Scrapy’s efficiency and MongoDB’s flexible data storage. If you’re new to web scraping and you’re looking for flexible and scalable tooling, then this is the right tutorial for you. […]

This course covers two problems from introductory astronomy to help you play with some Python libraries. You’ll use Astropy, NumPy, Matplotlib, and pandas to find planet conjunctions, and graph the best viewing times for a star. In this course you’ll learn about: Astronomy concepts of conjunction and optimal viewing The Python package Astropy Using pandas to process data Building graphs with Matplotlib Python’s warning module What’s Included: Downloadable Resources:    

Watch Now This tutorial has a related video course created by the Real Python team. Watch it together with the written tutorial to deepen your understanding: Python Basics: Setting Up Python Installing the latest version of Python on your computer could be a common requirement for you as a Python programmer. Fortunately, you’ll have a multitude of installation options. For example, you can download the official Python installer from Python.org, use your operating system’s package manager or app store, and […]

Interactive Quiz ⋅ 5 QuestionsBy Philipp Acsany Share In this quiz, you’ll test your understanding of Jinja templating. Jinja is a powerful tool for building rich templates in Python web applications, and it can also be used to create text files with programmatic content. The quiz contains 5 questions and there is no time limit. You’ll get 1 point for each correct answer. At the end of the quiz, you’ll receive a total score. The maximum score is 100%. Good […]

This course uses three problems often covered in introductory astro-physics courses to play in Python. Along the way you’ll learn some astronomy, and how to use a variety of datascience libraries like NumPy, Matplotlib, pandas, and pint. In this video course you’ll learn about: Introductory astrophysics topics Working with dataframes in pandas Writing code that uses scientific units Visualizing information with Matplotlib What’s Included: Downloadable Resources:    

Interactive Quiz ⋅ 8 QuestionsBy Geir Arne Hjelle Share Or copy the link: Copied! Happy Pythoning! In this quiz, you’ll test your understanding of the Python Walrus Operator. This operator, used for assignment expressions, was introduced in Python 3.8 and can be used to assign values to variables as part of an expression. The quiz contains 8 questions and there is no time limit. You’ll get 1 point for each    

Interactive Quiz ⋅ 13 QuestionsBy Martin Breuss Share Or copy the link: Copied! Happy Pythoning! In this quiz, you’ll test your understanding of Web Scraping with Scrapy and MongoDB. By working through this quiz, you’ll revisit how to set up a Scrapy project, build a functional web scraper, extract data from websites using selectors, store scraped data in a MongoDB database, and test and debug your Scrapy web scraper. The    

You’ve got a dictionary, but you’d like to sort the key-value pairs. Perhaps you’ve tried passing a dictionary to the sorted() function but didn’t receive the results you expected. In this video course, you’ll go over everything you need to know to sort dictionaries in Python. In this video course, you’ll: Review how to use the sorted() function Learn how to get dictionary views to iterate over Understand how dictionaries are cast to lists during sorting Learn how to specify […]