Code

Workflows backend prototype#542

Code

Closed

andrii-i wants to merge 44 commits intojupyter-server:mainjupyter-server/jupyter-scheduler:mainfrom andrii-i:workflows-backendandrii-i/jupyter-scheduler:workflows-backendCopy head branch name to clipboard

+1,390-40

Commits

Commits on Sep 5, 2024

• initialize dask cluster

  andrii-i

  committed
  abedadf

  Copy full SHA for abedadf

Commits on Sep 9, 2024

• add workflow handler and endpoint

  andrii-i

  committed
  6c9de64

  Copy full SHA for 6c9de64

Commits on Sep 11, 2024

• make execute_workflow a flow

  andrii-i

  committed
  71aa7fe

  Copy full SHA for 71aa7fe

• add execute_workflow option to DefaultExecutionManager

  andrii-i

  committed
  c8e0bf6

  Copy full SHA for c8e0bf6

• Update job model to be used with workflows

  andrii-i

  committed
  b79b917

  Copy full SHA for b79b917

• Add workflow run and jobs endpoints

  andrii-i

  committed
  4ef2373

  Copy full SHA for 4ef2373

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for d77310e
  pre-commit-ci[bot]

  committed
  d77310e

  Copy full SHA for d77310e

• split create_workflow and run_workflow endpoints and methods

  andrii-i

  committed
  c5da5b0

  Copy full SHA for c5da5b0

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for c64a53b
  pre-commit-ci[bot]

  committed
  c64a53b

  Copy full SHA for c64a53b

Commits on Sep 12, 2024

• add GET workflow/{id}

  andrii-i

  committed
  b33191c

  Copy full SHA for b33191c

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for b07a765
  pre-commit-ci[bot]

  committed
  b07a765

  Copy full SHA for b07a765

• add workflow/{workflow_id}/tasks endpoint

  andrii-i

  committed
  044e3bb

  Copy full SHA for 044e3bb

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 5c351ac
  pre-commit-ci[bot]

  committed
  5c351ac

  Copy full SHA for 5c351ac

• add create_workflow_task to handler and scheduler

  andrii-i

  committed
  4aa3046

  Copy full SHA for 4aa3046

• make CreateWorkflow.tasks optional

  andrii-i

  committed
  c276385

  Copy full SHA for c276385

Commits on Sep 13, 2024

• add update workflow functionality

  andrii-i

  committed
  2f6938b

  Copy full SHA for 2f6938b

Commits on Sep 16, 2024

• execute notebook as task via DefaultExecutionManager

  andrii-i

  committed
  3ae8997

  Copy full SHA for 3ae8997

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for b9c466b
  pre-commit-ci[bot]

  committed
  b9c466b

  Copy full SHA for b9c466b

• Use prefect task to execute jobs, download files. Add flow and run names

  andrii-i

  committed
  69b34ca

  Copy full SHA for 69b34ca

• Remove Dask

  andrii-i

  committed
  f18071e

  Copy full SHA for f18071e

Commits on Sep 23, 2024

• change depends_on and tasks data type to not limit the size

  andrii-i

  committed
  440dfd1

  Copy full SHA for 440dfd1

• make workflow_id optional

  andrii-i

  committed
  6f9ec65

  Copy full SHA for 6f9ec65

• remove distributed dependency

  andrii-i

  committed
  5a29d03

  Copy full SHA for 5a29d03

• don't require workflow_id in the task creation body, only as a part of URL

  andrii-i

  committed
  cdafb4f

  Copy full SHA for cdafb4f

• add status to the workflow models

  andrii-i

  committed
  650a566

  Copy full SHA for 650a566

• add workflow definitions

  andrii-i

  committed
  6466c48

  Copy full SHA for 6466c48

Commits on Oct 7, 2024

• add workflow execution handlers and endpoints

  andrii-i

  committed
  9994767

  Copy full SHA for 9994767

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for be6a01f
  pre-commit-ci[bot]

  committed
  be6a01f

  Copy full SHA for be6a01f

Commits on Oct 9, 2024

• serve workflow definition on schedule

  andrii-i

  committed
  417f392

  Copy full SHA for 417f392

Commits on Oct 14, 2024

• fix parameters passed to create_and_run_workflow when served with schedule

  andrii-i

  committed
  5a2621b

  Copy full SHA for 5a2621b

• change worklow_definitions/{id}/activate endpoint to worklow_definitions/{id}/deploy

  andrii-i

  committed
  87306a8

  Copy full SHA for 87306a8

• add name, parameters fields to Workflow and WorkflowDefinition

  andrii-i

  committed
  e35607f

  Copy full SHA for e35607f

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 78e0818
  pre-commit-ci[bot]

  committed
  78e0818

  Copy full SHA for 78e0818

Commits on Oct 18, 2024

• replace prefect with dask

  andrii-i

  committed
  e9d22e1

  Copy full SHA for e9d22e1

• add workflow runner

  andrii-i

  committed
  14f5740

  Copy full SHA for 14f5740

• use dask instead of prefect

  andrii-i

  committed
  9321d41

  Copy full SHA for 9321d41

• add trigger_rule enum, field to Jobs and JobDefinitions

  andrii-i

  committed
  2b25c01

  Copy full SHA for 2b25c01

Commits on Oct 22, 2024

• add DRAFT Status enum and set it as a default workflow status

  andrii-i

  committed
  c2bcf13

  Copy full SHA for c2bcf13

Commits on Oct 24, 2024

• add DEPLOYED status

  andrii-i

  committed
  6e162cb

  Copy full SHA for 6e162cb

• rename activate_workflow_definition into deploy_workflow_definition

  andrii-i

  committed
  8866d24

  Copy full SHA for 8866d24

Commits on Oct 28, 2024

• add create_time to Workflow model

  andrii-i

  committed
  d49f930

  Copy full SHA for d49f930

• create and run workflow definitions including on schedule

  andrii-i

  committed
  ee9e067

  Copy full SHA for ee9e067

Commits on Oct 29, 2024

• Merge branch 'jupyter-server:main' into workflows-backend

  andrii-i

  authored
  75e0e37

  Copy full SHA for 75e0e37

• add more print statements

  andrii-i

  committed
  97ac530

  Copy full SHA for 97ac530