P.S. Optimization Search

In the next demo visualization, we focused on finding a new internal state for a Recurrent Cell. On the left you can see the automatic Search of the internal configuration of the cell and, for comparison, on the right we have the internal state of an LSTM cell. With 4 hours of automatic search on single GPU we found an optimal unit for the task, obtaining comparable results to human-designed models.

Explanation of the demo

In the next demo visualization, we focused on finding a new internal state for a Recurrent Cell. On the left you can see the automatic Search of the internal configuration of the cell and, for comparison, on the right we have the internal state of an LSTM cell.

With 4 hours of automatic search on single GPU we found an optimal unit for the task, obtaining comparable results to human-designed models.

Demo information

Date
December 2018
Category
Author
Christian Sciuto
Master Student
Related