Skip to content
This repository has been archived by the owner on Oct 23, 2024. It is now read-only.

Current Status

Paco Nathan edited this page Dec 3, 2013 · 12 revisions
  • 2013-12-03 added logging, building tarball/container for Executor downloads via HDFS
  • 2013-12-01 first complete run on Elastic Mesos with >1 executors (hash ring)
  • 2013-11-30 two-phase synchronization to determine generation end
  • 2013-11-29 running on multiple shards (w/o long-polling yet to determine generation end)
  • 2013-11-26 integrated the required Apache Mesos methods to manage a remote service
  • 2013-11-23 first successful launch of customized scheduler/executor on Elastic Mesos
  • 2013-11-21 running one master/one slave only (e.g., on a laptop)

TODO

  • de-Ubuntu-fy the installer scripts
  • log the per-generation details during "/pop/hist" sequence
  • serialize evicted Individuals to HDFS
  • automate Anaconda installations on the cluster
  • shard checkpoint to HDFS
  • shard recovery from HDFS
  • save/recover Framework state in Zookeeper
  • optimize bloom filter settings as a function of the max_pop and n_exe parameters
  • make service port configurable / discover port availability / run 2+ services per slave
Clone this wiki locally