Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 380572

A Python library for deep learning developed by Google. Use this tag for any on-topic question that (a) involves tensorflow either as a critical part of the question or expected answer, & (b) is not just about how to use tensorflow.

1 vote
1 answer
665 views

How to calculate the decay rate given an initial learning rate and final learning rate for s...

I am training a neural network in TensorFlow and I would like to use firstly an exponential decay optimizer scheduler (https://www.tensorflow.org/api_docs/python/tf/keras/optimizers/schedules/ExponentialDecay …
user380572's user avatar
1 vote

How to calculate the decay rate given an initial learning rate and final learning rate for s...

I ended up figuring it out. For the exponential decay, it was easier than I thought, as the formula for the decay is initial_learning_rate * decay_rate ^ (step / decay_steps) and since by the end of …
user380572's user avatar