Skip to content

Commit

Permalink
style
Browse files Browse the repository at this point in the history
  • Loading branch information
mahinth1 committed Oct 22, 2024
1 parent 2b9ad8c commit 95ebc36
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,18 +9,18 @@ cd newbrick

2. Edit stages according to your needs:
Scripts:
- ``stages/01_get_openaccess.py`` :
``stages/01_get_openaccess.py`` :
- currently writting into 8 parquet output files
- updates new data into a file without rewriting the entire file
- ``stages/02_download.py`` :
``stages/02_download.py`` :
- downloads pdf files
- writes new metadata files containing information of the downloaded articles
- restarts from previously downloaded pdf
- can be further modified for parallel runs

3. Replace stages in dvc.yaml with your new stages
- Please modify according to your needs (e.g., multiple output directories or parallel runs)
- See dvc_parallel.yaml and run_parallel.sh as example
- See ``dvc_parallel.yaml`` and ``run_parallel.sh`` as example

4. Build your brick
```
Expand Down

0 comments on commit 95ebc36

Please sign in to comment.