chore(iatlas): create project iatlas-data

[tschaffter]

Closes #2408

Depends on #2412

Changelog

• Add the project iatlas-data that populates a Postgres DB
• Add the container of the project iatlas-data to the iAtlas stack

Preview

Prepare the workspace

workspace-install

Build the iAtlas images

iatlas-build-images

Start iAtlas Postgres DB and seed it

1. Set the config in apps/iatlas/data/.env.
   • The DB credentials must match those specified in apps/iatlas/postgres/.env
2. Start the Postgres container and the process that seeds it.
   • iAtlas data and data schema will be downloaded from Synapse.

nx serve-detach iatlas-data

You can follow the seeding process with:

docker logs -f iatlas-data

Visualize the content of the DB

Use the SQLTools extension for VS Code to visualize the content of the DB.

Bonus: Prepare iatlas-data development environment

• Create a venv with Poetry with the version of Python specified by the project.
• Install the project dependencies inside this venv.

nx prepare iatlas-data

The venv now lives in /workspaces/sage-monorepo/apps/iatlas/data/.venv.

Select the Python interpreter in VS Code to benefit from syntax highlighting.

Activate the venv from VS Code terminal in order to run Python scripts:

cd apps/iatlas/data
poetry shell

Possible improvements

• Install Python packages in the docker image with Poetry instead of relying on requirements.txt (not DRY)
• Prevent the iatlas-data container to run again if the DB has already been populated (save time to developers when redeploying the stack)