Prevention of overfitting in convolutional layers of a CNN : <p>I'm using TensorFlow to train a Convolutional Neural Network (CNN) for a sign language application.  The CNN has to classify 27 different labels, so unsurprisingly, a major problem has been addressing overfitting.  I've taken several steps to accomplish this:</p>

<ol>
<li>I've collected a large amount of high-quality training data (over 5000 samples per label).</li>
<li>I've built a reasonably sophisticated pre-processing stage to help maximize invariance to things like lighting conditions.</li>
<li>I'm using dropout on the fully-connected layers.</li>
<li>I'm applying L2 regularization to the fully-connected parameters.</li>
<li>I've done extensive hyper-parameter optimization (to the extent possible given HW and time limitations) to identify the simplest model that can achieve close to 0% loss on training data.</li>
</ol>

<p>Unfortunately, even after all these steps, I'm finding that I can't achieve much better that about 3% test error.  (It's not terrible, but for the application to be viable, I'll need to improve that substantially.)</p>

<p>I suspect that the source of the overfitting lies in the convolutional layers since I'm not taking any explicit steps there to regularize (besides keeping the layers as small as possible).  But based on examples provided with TensorFlow, it doesn't appear that regularization or dropout is typically applied to convolutional layers.</p>

<p>The only approach I've found online that explicitly deals with prevention of overfitting in convolutional layers is a fairly new approach called <a href="http://www.matthewzeiler.com/pubs/iclr2013/iclr2013.pdf" rel="noreferrer">Stochastic Pooling</a>.  Unfortunately, it appears that there is no implementation for this in TensorFlow, at least not yet.</p>

<p>So in short, is there a recommended approach to prevent overfitting in convolutional layers that can be achieved in TensorFlow?  Or will it be necessary to create a custom pooling operator to support the Stochastic Pooling approach?</p>

<p>Thanks for any guidance!</p>
