October 9, 2020 Machine Learning

Combined Algorithm Selection and Hyperparameter Optimization (CASH Optimization)

Machine learning model selection and configuration may be the biggest challenge in applied machine learning. Controlled experiments must be performed in order to discover what works best for a given classification or regression predictive modeling task. This can feel overwhelming given the large number of data preparation schemes, learning algorithms, and model hyperparameters that could be considered. The common approach is to use a shortcut, such as using a popular algorithm or testing a small number of algorithms with default […]

October 8, 2020 Nearest Neighbor MT, NLP

Issue #102 – Nearest Neighbour Machine Translation

08 Oct20 Issue #102 – Nearest Neighbour Machine Translation Author: Dr. Patrik Lambert, Senior Machine Translation Scientist @ Iconic Introduction Taking into account context information in neural MT is an active area of research, with applications in document-level translation, domain adaptation and multilingual neural MT. Today we take a look at a method which combines predictions from a neural MT model and from a nearest neighbour classifier, retrieved from similar contexts in a datastore of cached examples. This approach, called […]

October 7, 2020 Machine Learning

Hyperparameter Optimization With Random Search and Grid Search

Last Updated on September 19, 2020 Machine learning models have hyperparameters that you must set in order to customize the model to your dataset. Often the general effects of hyperparameters on a model are known, but how to best set a hyperparameter and combinations of interacting hyperparameters for a given dataset is challenging. There are often general heuristics or rules of thumb for configuring hyperparameters. A better approach is to objectively search different values for model hyperparameters and choose a […]

October 6, 2020 Python

Deep Learning in Keras – Building a Deep Learning Model

Introduction Deep learning is one of the most interesting and promising areas of artificial intelligence (AI) and machine learning currently. With great advances in technology and algorithms in recent years, deep learning has opened the door to a new era of AI applications. In many of these applications, deep learning algorithms performed equal to human experts and sometimes surpassed them. Python has become the go-to language for Machine Learning and many of the most popular and powerful deep learning libraries […]

October 5, 2020 Machine Learning

HyperOpt for Automated Machine Learning With Scikit-Learn

Automated Machine Learning (AutoML) refers to techniques for automatically discovering well-performing models for predictive modeling tasks with very little user involvement. HyperOpt is an open-source library for large scale AutoML and HyperOpt-Sklearn is a wrapper for HyperOpt that supports AutoML with HyperOpt for the popular Scikit-Learn machine learning library, including the suite of data preparation transforms and classification and regression algorithms. In this tutorial, you will discover how to use HyperOpt for automatic machine learning with Scikit-Learn in Python. After […]

October 3, 2020 Machine Learning

TPOT for Automated Machine Learning in Python

Automated Machine Learning (AutoML) refers to techniques for automatically discovering well-performing models for predictive modeling tasks with very little user involvement. TPOT is an open-source library for performing AutoML in Python. It makes use of the popular Scikit-Learn machine learning library for data transforms and machine learning algorithms and uses a Genetic Programming stochastic global search procedure to efficiently discover a top-performing model pipeline for a given dataset. In this tutorial, you will discover how to use TPOT for AutoML […]

October 2, 2020 NLP

A Simple Guide On Using BERT for Binary Text Classification.

Please consider using the Simple Transformers library as it is easy to use, feature-packed, and regularly updated. The article still stands as a reference to BERT models and is likely to be helpful with understanding how BERT works. However, Simple Transformers offers a lot more features, much more straightforward tuning options, all the while being quick and easy to use! The links below should help you get started quickly. Binary Classification

October 2, 2020 Leveraging Monolingual Data, NLP

Issue #101 – Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation

02 Oct20 Issue #101 – Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation Author: Dr. Chao-Hong Liu, Machine Translation Scientist @ Iconic Introduction Multilingual Neural Machine Translation (NMT), which enables zero-shot MT, is a significant development since the start of NMT. On the one hand, we have evidence that models trained with multiple languages can outperform those trained on a bilingual basis. On the other hand, multilingual NMT also enables us to train models of a language pair […]

October 1, 2020 3D OBJECT RECONSTRUCTION, Machine Learning

Amodal 3D Reconstruction for Robotic Manipulation via Stability and Connectivity

Learning-based 3D object reconstruction enables single- or few-shot estimation of 3D object models. For robotics, this holds the potential to allow model-based methods to rapidly adapt to novel objects and scenes… Existing 3D reconstruction techniques optimize for visual reconstruction fidelity, typically measured by chamfer distance or voxel IOU. We find that when applied to realistic, cluttered robotics environments, these systems produce reconstructions with low physical realism, resulting in poor task performance when used for model-based control. We propose ARM, an […]

October 1, 2020 Machine Learning

NITI: Training Integer Neural Networks Using Integer-only Arithmetic

While integer arithmetic has been widely adopted for improved performance in deep quantized neural network inference, training remains a task primarily executed using floating point arithmetic. This is because both high dynamic range and numerical accuracy are central to the success of most modern training algorithms… However, due to its potential for computational, storage and energy advantages in hardware accelerators, neural network training methods that can be implemented with low precision integer-only arithmetic remains an active research challenge. In this […]

« 1 … 757 758 759 760 761 … 911 »