server : do not get prompt in infill mode (ggml-org#7286)

* avoid to get prompt in infill mode and embedding mode * remove embedding mode * refactor format --------- Co-authored-by: wudexiang <[email protected]>
fairydreaming · Jun 7, 2024 · a5cabd7 · a5cabd7
1 parent d5c938c
commit a5cabd7
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/examples/server/server.cpp b/examples/server/server.cpp
@@ -888,7 +888,7 @@ struct server_context {
         slot.params.input_suffix = json_value(data, "input_suffix", default_params.input_suffix);
 
         // get prompt
-        {
+        if (!task.infill) {
             const auto & prompt = data.find("prompt");
             if (prompt == data.end()) {
                 send_error(task, "Either \"prompt\" or \"messages\" must be provided", ERROR_TYPE_INVALID_REQUEST);