Filling the Gaps: A Comparative Guide to Imputation Techniques in Machine Learning

In our previous exploration of penalized regression models such as Lasso, Ridge, and ElasticNet, we demonstrated how effectively these models manage multicollinearity, allowing us to utilize a broader array of features to enhance model performance. Building on this foundation, we now address another crucial aspect of data preprocessing—handling missing values. Missing data can significantly compromise the accuracy and reliability of models if not appropriately managed. This post explores various imputation strategies to address missing data and embed them into our […]

September 15, 2024 Machine Learning

Automating Data Cleaning Processes with Pandas

Automating Data Cleaning Processes with Pandas Few data science projects are exempt from the necessity of cleaning data. Data cleaning encompasses the initial steps of preparing data. Its specific purpose is that only the relevant and useful information underlying the data is retained, be it for its posterior analysis, to use as inputs to an AI or machine learning model, and so on. Unifying or converting data types, dealing with missing values, eliminating noisy values stemming from erroneous measurements, and […]

September 12, 2024 Python

Quiz: Python Virtual Environments: A Primer

Interactive Quiz ⋅ 10 QuestionsBy Kate Finegan Share So you’ve been primed on Python virtual environments! Test your understanding of the tutorial here. The quiz contains 10 questions and there is no time limit. You’ll get 1 point for each correct answer. At the end of the quiz, you’ll receive a total score. The maximum score is 100%. Good luck! Start the Quiz » « Browse All Python Quizzes

September 12, 2024 Python

Quiz: Python 3.13: Free-Threading and a JIT Compiler

Interactive Quiz ⋅ 16 QuestionsBy Bartosz Zaczyński Share In this quiz, you’ll test your understanding of the new features in Python 3.13. By working through this quiz, you’ll revisit how to compile a custom Python build, disable the Global Interpreter Lock (GIL), enable the Just-In-Time (JIT) compiler, determine the availability of new features at runtime, assess the performance improvements in Python 3.13, and make a C extension module targeting Python’s new ABI. The quiz contains 16 questions and there is […]

September 12, 2024 Artificial intelligence Leave a comment

Research Focus: Week of September 9, 2024

Welcome to Research Focus, a series of blog posts that highlights notable publications, events, code/datasets, new hires and other milestones from across the research community at Microsoft. NEW RESEARCH Can LLMs be Fooled? Investigating Vulnerabilities in LLMs Large language models (LLMs) are the de facto standard for numerous machine learning tasks, ranging from text generation and

September 12, 2024 Machine Learning

Tips for Using Machine Learning in Fraud Detection

Tips for Using Machine Learning in Fraud DetectionImage by Editor | Midjourney The battle against fraud has become more intense than it ever has been. As transactions become increasingly digital and complex, fraudsters are constantly devising new ways to exploit vulnerabilities in financial systems. And this is where the power of machine learning comes into play. Machine learning offers a robust approach to identifying and even preventing fraudulent activities. By harnessing advanced algorithms and analytics, financial institutions can stay one […]

September 12, 2024 Machine Learning

Scaling to Success: Implementing and Optimizing Penalized Models

This post will demonstrate the usage of Lasso, Ridge, and ElasticNet models using the Ames housing dataset. These models are particularly valuable when dealing with data that may suffer from multicollinearity. We leverage these advanced regression techniques to show how feature scaling and hyperparameter tuning can improve model performance. In this post, we’ll provide a step-by-step walkthrough on setting up preprocessing pipelines, implementing each model with scikit-learn, and fine-tuning them to achieve optimal results. This comprehensive approach not only aids […]

September 11, 2024 Python

How to Use Conditional Expressions With NumPy where()

The NumPy where() function is a powerful tool for filtering array elements in lists, tuples, and NumPy arrays. It works by using a conditional predicate, similar to the logic used in the WHERE or HAVING clauses in SQL queries. It’s okay if you’re not familiar with SQL—you don’t need to know it to follow along with this tutorial. You would typically use np.where() when you have an array and need to analyze its elements differently depending on their values. For […]

September 10, 2024 Python

When to Use .repr() vs .str() in Python

One of the most common tasks that a computer program performs is to display data. The program often displays this information to the program’s user. However, a program also needs to show information to the programmer developing and maintaining it. The information a programmer needs about an object differs from how the program should display the same object for the user, and that’s where .__repr__() vs .__str__() comes in. A Python object has several special methods that provide specific behavior. […]

September 10, 2024 Artificial intelligence Leave a comment

MedFuzz: Exploring the robustness of LLMs on medical challenge problems

Large language models (LLMs) have achieved unprecedented accuracy on medical question-answering benchmarks, showcasing their potential to revolutionize healthcare by supporting clinicians and patients. However, these benchmarks often fail to capture the full complexity of real-world medical scenarios. To truly harness the power of LLMs in healthcare, we must go beyond these benchmarks by introducing challenges that bring us closer to the nuanced realities of clinical practice. Introducing MedFuzz Benchmarks like MedQA rely on simplifying assumptions to gauge accuracy. These assumptions […]

« 1 … 18 19 20 21 22 … 914 »