From 568100ab46d493d4dc2e27c50f44ee41123b3bca Mon Sep 17 00:00:00 2001 From: lukstafi Date: Sat, 23 Nov 2024 21:26:52 +0000 Subject: [PATCH] deploy: e698ef31eba9d4cc34821d2e9d070ef04501cd66 --- dev/neural_nets_lib/Ocannl/Train/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/dev/neural_nets_lib/Ocannl/Train/index.html b/dev/neural_nets_lib/Ocannl/Train/index.html index e86ce4c7..6855153d 100644 --- a/dev/neural_nets_lib/Ocannl/Train/index.html +++ b/dev/neural_nets_lib/Ocannl/Train/index.html @@ -83,7 +83,7 @@ post_sync:(num_synced_devices:Base.int -> Base.unit) -> updaten -> Base.unit -> - Base.unit

Performs one optimization step, potentially in parallel (if grad_updates are compiled for different devices). All jitted code must have the same bindings. Iterates over bindings with ranges, calling one of grad_updates in a round-robin fashion, and performs the following synchronization each time all grad_updates have been called:

1. merges all gradients into the device of grad_updates.(0), 2. calls sgd_update, 3. copies all parameters from the grad_updates.(0) device to the other devices, if needed, 4. calls post_sync with the number of devices synced since the previous sync.

All and only bindings with associated ranges are iterated, with the binding's initial value lost. Bindings without ranges remain at their initial values.

val get_all_suggested_streams : + Base.unit

Performs one optimization step, potentially in parallel (if grad_updates are linked with different streams or devices). All jitted code must have the same bindings. Iterates over bindings with ranges, calling one of grad_updates in a round-robin fashion, and performs the following synchronization each time all grad_updates have been called:

  • merges all gradients into the device of grad_updates.(0),
  • calls sgd_update,
  • copies all parameters from the grad_updates.(0) device to the other devices, if needed,
  • calls post_sync with the number of devices synced since the previous sync.

All and only bindings with associated ranges are iterated, with the binding's initial value lost. Bindings without ranges remain at their initial values.

val get_all_suggested_streams : ?max_num_streams:Base.int -> (module Backend with type buffer_ptr = 'buffer_ptr