Re: initialization of weights and bias of neural network




Jo wrote:
Dear all,

I want to establish several neural network models. Each model will be
trained for 50 times. The neural network are initialized with
function "init" before every training started. I found that the
initialization of weights and bias of the neural network seems
related with time. It is restored after the MATLAB is restored.

Now I want to restore the initialization when a new model is to be
trained for the first time without the need to close and restore the
MATLAB first, is it possible?

Yes. Just restore the RNG to its original state. Go to the CSSM
archives in Google Groups and search on

greg-heath RNG
greg-heath integer-states -RNG

Hope this helps.

Greg

.



Relevant Pages

  • initialization of weights and bias of neural network
    ... I want to establish several neural network models. ... Now I want to restore the initialization when a new model is to be ... trained for the first time without the need to close and restore the ...
    (comp.soft-sys.matlab)
  • Re: [RFC]disable msi mode in pci_disable_device
    ... The aim is to be able to recover from a memory parity error in the NIC. ... As saving currently disables MSI, ... restore the state right after saving it at the end of the initialization ...
    (Linux-Kernel)
  • Re: [RFC]disable msi mode in pci_disable_device
    ... As saving currently disables MSI, ... restore the state right after saving it at the end of the initialization ...
    (Linux-Kernel)
  • Re: [RFC]disable msi mode in pci_disable_device
    ... As saving currently disables MSI, ... restore the state right after saving it at the end of the initialization ... After a cold boot, some initialization is done by Linux before the ...
    (Linux-Kernel)
  • modifying ISAAC, a pseudo-random number generator
    ... but not changing the algorithm. ... examined the code, especiallt the C++ version, and I ... The values that are supplied for initialization are: ... Remembering that I intend to save restore ...
    (sci.crypt)