Machine Learning

How to Use the TimeDistributed Layer in Keras

Last Updated on August 14, 2019 Long Short-Term Networks or LSTMs are a popular and powerful type of Recurrent Neural Network, or RNN. They can be quite difficult to configure and apply to arbitrary sequence prediction problems, even with well defined and “easy to use” interfaces like those provided in the Keras deep learning library in Python. One reason for this difficulty in Keras is the use of the TimeDistributed wrapper layer and the need for some LSTM layers to […]

Read more
Machine Learning

Learn to Add Numbers with an Encoder-Decoder LSTM Recurrent Neural Network

Last Updated on August 27, 2020 Long Short-Term Memory (LSTM) networks are a type of Recurrent Neural Network (RNN) that are capable of learning the relationships between elements in an input sequence. A good demonstration of LSTMs is to learn how to combine multiple terms together using a mathematical operation like a sum and outputting the result of the calculation. A common mistake made by beginners is to simply learn the mapping function from input term to the output term. […]

Read more
Machine Learning

The Promise of Recurrent Neural Networks for Time Series Forecasting

Last Updated on August 5, 2019 Recurrent neural networks are a type of neural network that add the explicit handling of order in input observations. This capability suggests that the promise of recurrent neural networks is to learn the temporal context of input sequences in order to make better predictions. That is, that the suite of lagged observations required to make a prediction no longer must be diagnosed and specified as in traditional time series forecasting, or even forecasting with […]

Read more
Machine Learning

A Gentle Introduction to Long Short-Term Memory Networks by the Experts

Last Updated on February 20, 2020 Long Short-Term Memory (LSTM) networks are a type of recurrent neural network capable of learning order dependence in sequence prediction problems. This is a behavior required in complex problem domains like machine translation, speech recognition, and more. LSTMs are a complex area of deep learning. It can be hard to get your hands around what LSTMs are, and how terms like bidirectional and sequence-to-sequence relate to the field. In this post, you will get […]

Read more
Machine Learning

On the Suitability of Long Short-Term Memory Networks for Time Series Forecasting

Last Updated on August 5, 2019 Long Short-Term Memory (LSTM) is a type of recurrent neural network that can learn the order dependence between items in a sequence. LSTMs have the promise of being able to learn the context required to make predictions in time series forecasting problems, rather than having this context pre-specified and fixed. Given the promise, there is some doubt as to whether LSTMs are appropriate for time series forecasting. In this post, we will look at […]

Read more
Machine Learning

7 Ways to Handle Large Data Files for Machine Learning

Exploring and applying machine learning algorithms to datasets that are too large to fit into memory is pretty common. This leads to questions like: How do I load my multiple gigabyte data file? Algorithms crash when I try to run my dataset; what should I do? Can you help me with out-of-memory errors? In this post, I want to offer some common suggestions you may want to consider. 7 Ways to Handle Large Data Files for Machine LearningPhoto by Gareth […]

Read more
Machine Learning

How to Evaluate the Skill of Deep Learning Models

Last Updated on August 14, 2020 I often see practitioners expressing confusion about how to evaluate a deep learning model. This is often obvious from questions like: What random seed should I use? Do I need a random seed? Why don’t I get the same results on subsequent runs? In this post, you will discover the procedure that you can use to evaluate deep learning models and the rationale for using it. You will also discover useful related statistics that […]

Read more
Machine Learning

How to Report Classifier Performance with Confidence Intervals

Last Updated on August 14, 2020 Once you choose a machine learning algorithm for your classification problem, you need to report the performance of the model to stakeholders. This is important so that you can set the expectations for the model on new data. A common mistake is to report the classification accuracy of the model alone. In this post, you will discover how to calculate confidence intervals on the performance of your model to provide a calibrated and robust […]

Read more
Machine Learning

How to Calculate Bootstrap Confidence Intervals For Machine Learning Results in Python

Last Updated on August 14, 2020 It is important to both present the expected skill of a machine learning model a well as confidence intervals for that model skill. Confidence intervals provide a range of model skills and a likelihood that the model skill will fall between the ranges when making predictions on new data. For example, a 95% likelihood of classification accuracy between 70% and 75%. A robust way to calculate confidence intervals for machine learning algorithms is to […]

Read more
Machine Learning

The 5 Step Life-Cycle for Long Short-Term Memory Models in Keras

Last Updated on August 27, 2020 Deep learning neural networks are very easy to create and evaluate in Python with Keras, but you must follow a strict model life-cycle. In this post, you will discover the step-by-step life-cycle for creating, training, and evaluating Long Short-Term Memory (LSTM) Recurrent Neural Networks in Keras and how to make predictions with a trained model. After reading this post, you will know: How to define, compile, fit, and evaluate an LSTM in Keras. How […]

Read more
1 … 807 808 809 810 811 … 914