Need to deallocate resources by jobid and set of vertices

[milroy]

To permit deallocation of a subgraph of a running job's resources dfu_impl_t will need to be overloaded:

flux-sched/resource/traversers/dfu_impl_update.cpp

Line 386 in af4447f

int dfu_impl_t::rem_dfv (vtx_t u, int64_t jobid)

It will need to take a third argument (vector, associative container, etc.) that represents the subgraph to be removed.

[milroy]

The subgraph container will need to be chosen with removal performance in mind.

[milroy]

Upon further inspection, I don't think rem_dfv requires overloading or modification. The "root" vertex vtx_t u can be considered the root of the subgraph to be removed. It can be a subgraph of the job's resources and the functionality doesn't have to change.

However, this means there needs to be handling of the various root types passed to the dfu_impl_t::rem_dfv call. I think the overloading needs to occur here:

flux-sched/resource/traversers/dfu.cpp

Line 278 in af4447f

int dfu_traverser_t::remove (int64_t jobid)

which in turn will require modification here:

flux-sched/resource/modules/resource_match.cpp

Line 712 in af4447f

static int run_remove (std::shared_ptr<resource_ctx_t> &ctx, int64_t jobid)

to handle removal at a specific vertex of the job's resources.

Since run_remove is called by cancel_request_cb and this is not a job cancellation, we probably need a new method in DFU.

[milroy]

Note that since the functionality proposed here is conceptually more aligned with a job cancellation, modifying a job cancellation would be a possible direction. However, in the future deallocation will need to detach resources within the job's resource graph (rather than the parent or top level's).

With that in mind I think deallocation by jobid and vertex subset fits best within graph detach (issue #554).

[trws]

Doing some triage from the bottom of the stack, pretty sure this is partial release and covered by your recent work right @milroy?