deploy: e698ef3

dev/neural_nets_lib/Ocannl/Train/index.html

@@ -83,7 +83,7 @@
   <span><span class="label">post_sync</span>:<span>(<span><span class="label">num_synced_devices</span>:<span class="xref-unresolved">Base</span>.int <span class="arrow">&#45;&gt;</span></span> <span class="xref-unresolved">Base</span>.unit)</span> <span class="arrow">&#45;&gt;</span></span>
   <span><a href="#type-updaten">updaten</a> <span class="arrow">&#45;&gt;</span></span>
   <span><span class="xref-unresolved">Base</span>.unit <span class="arrow">&#45;&gt;</span></span>
-  <span class="xref-unresolved">Base</span>.unit</span></code></div><div class="spec-doc"><p>Performs one optimization step, potentially in parallel (if <code>grad_updates</code> are compiled for different devices). All jitted code must have the same bindings. Iterates over bindings with ranges, calling one of <code>grad_updates</code> in a round-robin fashion, and performs the following synchronization each time all <code>grad_updates</code> have been called:</p><p>1. merges all gradients into the device of <code>grad_updates.(0)</code>, 2. calls <code>sgd_update</code>, 3. copies all parameters from the <code>grad_updates.(0)</code> device to the other devices, if needed, 4. calls <code>post_sync</code> with the number of devices synced since the previous sync.</p><p>All and only bindings with associated ranges are iterated, with the binding's initial value lost. Bindings without ranges remain at their initial values.</p></div></div><div class="odoc-spec"><div class="spec value anchored" id="val-get_all_suggested_streams"><a href="#val-get_all_suggested_streams" class="anchor"></a><code><span><span class="keyword">val</span> get_all_suggested_streams : 
+  <span class="xref-unresolved">Base</span>.unit</span></code></div><div class="spec-doc"><p>Performs one optimization step, potentially in parallel (if <code>grad_updates</code> are linked with different streams or devices). All jitted code must have the same bindings. Iterates over bindings with ranges, calling one of <code>grad_updates</code> in a round-robin fashion, and performs the following synchronization each time all <code>grad_updates</code> have been called:</p><ul><li>merges all gradients into the device of <code>grad_updates.(0)</code>,</li><li>calls <code>sgd_update</code>,</li><li>copies all parameters from the <code>grad_updates.(0)</code> device to the other devices, if needed,</li><li>calls <code>post_sync</code> with the number of devices synced since the previous sync.</li></ul><p>All and only bindings with associated ranges are iterated, with the binding's initial value lost. Bindings without ranges remain at their initial values.</p></div></div><div class="odoc-spec"><div class="spec value anchored" id="val-get_all_suggested_streams"><a href="#val-get_all_suggested_streams" class="anchor"></a><code><span><span class="keyword">val</span> get_all_suggested_streams : 
   <span><span class="optlabel">?max_num_streams</span>:<span class="xref-unresolved">Base</span>.int <span class="arrow">&#45;&gt;</span></span>
   <span><span>(<span class="keyword">module</span> <a href="../../../arrayjit/Arrayjit/Backend_intf/module-type-Backend/index.html">Backend</a>
     <span class="keyword">with</span> <span class="keyword">type</span> <a href="../../../arrayjit/Arrayjit/Backend_intf/module-type-Backend/index.html#type-buffer_ptr">buffer_ptr</a> = <span class="type-var">'buffer_ptr</span>