Subject
Computer Science
Topic
Artificial Intelligence
A weight is 2, learning rate 0.1, and loss gradient 0.5. What is the weight after one gradient-descent step?
A weight is 2, learning rate 0.1, and loss gradient 0.5. What is the weight after one gradient-descent step?
a)
2.05b)
1.5c)
0.05d)
1.95Explanation
New weight = old weight − learning rate × gradient = 2 − 0.1 × 0.5 = 1.95.Related questions
In the figure, a perceptron has weights 1,1, input 0,0, bias -1.5, and threshold 0. What output does it produce?In the figure, a perceptron has weights 1,1, input 1,1, bias -1.5, and threshold 0. What output does it produce?In the figure, a perceptron has weights 1,-1, input 2,1, bias 0, and threshold 0. What output does it produce?In the figure, what is sigmoid(-2) rounded to three decimals?In the figure, what is sigmoid(2) rounded to three decimals?In the figure, a fully connected layer has 4 inputs and 3 neurons, with one bias per neuron. How many trainable parameters does it have?What output does a ReLU unit produce for input -3?Why can a single-layer perceptron not represent XOR?