Is it good learning rate for Adam method? : <p>I am training my method. I got the result as below. Is it a good learning rate? If not, is it high or low?
This is my result</p>

<p><a href="https://i.stack.imgur.com/ihfKv.png" rel="noreferrer"><img src="https://i.stack.imgur.com/ihfKv.png" alt="enter image description here"></a></p>

<pre><code>lr_policy: "step"
gamma: 0.1
stepsize: 10000
power: 0.75
# lr for unnormalized softmax
base_lr: 0.001
# high momentum
momentum: 0.99
# no gradient accumulation
iter_size: 1
max_iter: 100000
weight_decay: 0.0005
snapshot: 4000
snapshot_prefix: "snapshot/train"
type:"Adam"
</code></pre>

<p>This is reference</p>

<blockquote>
  <blockquote>
    <p>With low learning rates the improvements will be linear. With high learning rates they will start to look more exponential. Higher learning rates will decay the loss faster, but they get stuck at worse values of loss 
    <a href="https://i.stack.imgur.com/iMASu.jpg" rel="noreferrer"><img src="https://i.stack.imgur.com/iMASu.jpg" alt="enter image description here"></a></p>
  </blockquote>
</blockquote>
