@PublicationReference(author="Wikipedia", title="Rectifier", type=WebPage, year=2014, url="http://en.wikipedia.org/wiki/Rectifier_(neural_networks)") public class LeakyRectifiedLinearFunction extends AbstractDifferentiableUnivariateScalarFunction
RectifiedLinearFunction can be used
instead. Also, if the leakage is 1, then a IdentityScalarFunction
could be used.RectifiedLinearFunction,
Serialized Form| Modifier and Type | Field and Description |
|---|---|
static double |
DEFAULT_LEAKAGE
The default leakage is 0.01.
|
protected double |
leakage
The amount of leakage for when the value is less than zero.
|
| Constructor and Description |
|---|
LeakyRectifiedLinearFunction()
Creates a new
LeakyRectifiedLinearFunction with the default
amount of leakage. |
LeakyRectifiedLinearFunction(double leakage)
Creates a new
LeakyRectifiedLinearFunction with the given
leakage. |
| Modifier and Type | Method and Description |
|---|---|
LeakyRectifiedLinearFunction |
clone()
This makes public the clone method on the
Object class and
removes the exception that it throws. |
double |
differentiate(double input)
Differentiates the output of the function about the given input
|
double |
evaluate(double input)
Produces a double output for the given double input
|
double |
getLeakage()
Sets the leakage, which is the multiplier for the value when it is
less than zero.
|
void |
setLeakage(double leakage)
Sets the leakage, which is the multiplier for the value when it is
less than zero.
|
equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitdifferentiateevaluate, evaluateAsDoublepublic static final double DEFAULT_LEAKAGE
protected double leakage
public LeakyRectifiedLinearFunction()
LeakyRectifiedLinearFunction with the default
amount of leakage.public LeakyRectifiedLinearFunction(double leakage)
LeakyRectifiedLinearFunction with the given
leakage.leakage - The leakage amount. Must be between 0 and 1.public LeakyRectifiedLinearFunction clone()
AbstractCloneableSerializableObject class and
removes the exception that it throws. Its default behavior is to
automatically create a clone of the exact type of object that the
clone is called on and to copy all primitives but to keep all references,
which means it is a shallow copy.
Extensions of this class may want to override this method (but call
super.clone() to implement a "smart copy". That is, to target
the most common use case for creating a copy of the object. Because of
the default behavior being a shallow copy, extending classes only need
to handle fields that need to have a deeper copy (or those that need to
be reset). Some of the methods in ObjectUtil may be helpful in
implementing a custom clone method.
Note: The contract of this method is that you must use
super.clone() as the basis for your implementation.clone in interface CloneableSerializableclone in class AbstractCloneableSerializablepublic double evaluate(double input)
UnivariateScalarFunctioninput - Input to the Evaluatorpublic double differentiate(double input)
DifferentiableUnivariateScalarFunctioninput - Input about which to compute the derivative of the function outputpublic double getLeakage()
public void setLeakage(double leakage)
leakage - The leakage amount. Must be between 0 and 1.