Skip to content

Commit

Permalink
Update Q_72193393.md
Browse files Browse the repository at this point in the history
  • Loading branch information
sugatoray authored May 23, 2022
1 parent 3297f1d commit 19f22a8
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/answers/Q_72193393/Q_72193393.md
Original file line number Diff line number Diff line change
Expand Up @@ -402,7 +402,7 @@ Now look at the `message` above (see 💡). If we run a google search on this, y

## D. Making the Loss Landscape Smoother

A binary evaluation if `value = 1 if x>5 else 0` is essentially a step-function that assigns `1` for all values of `x` that are greater than `5` and `0` otherwise. But this is introduces a kink - a discontinuity in smoothness and this could potentially introduce problems in traversing the loss-landscape.
A binary evaluation of `value = 1 if x>5 else 0` is essentially a step-function that assigns `1` for all values of `x` that are greater than `5` and `0` otherwise. But this introduces a kink - a discontinuity in smoothness and this could potentially introduce problems in traversing the loss-landscape.

What if we use a `sigmoid` function to introduce some smoothness?

Expand Down

0 comments on commit 19f22a8

Please sign in to comment.