Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added liftoff, integrated with pfr/nxf-modules, and some minor improvements #2

Merged
merged 59 commits into from
Jan 11, 2024
Merged
Changes from 1 commit
Commits
Show all changes
59 commits
Select commit Hold shift + click to select a range
ee9d0b9
Added updated info about nf-core modules
GallVp Nov 6, 2023
7f03697
Turned off SortMeRNA by default
GallVp Nov 7, 2023
232493a
Decouple target assemblies and read qc/align
GallVp Nov 8, 2023
4f2ed8e
A bit of reformatiing
GallVp Nov 9, 2023
8b83c61
Started implementing liftoff
GallVp Nov 9, 2023
37ce74e
Checkpoint before major reshuffle
GallVp Nov 10, 2023
d148f18
Reformatted local modules
GallVp Nov 10, 2023
e63e22f
Now using galaxy containers
GallVp Nov 10, 2023
1978308
Extracted some subworkflows
GallVp Nov 10, 2023
10a0158
Extracted a few subworkflows
GallVp Nov 12, 2023
2031790
Extracted subworkflows uptill BRAKER3
GallVp Nov 13, 2023
f315467
Inc liftoff
GallVp Nov 13, 2023
f10ae94
Added polished out channel to liftoff
GallVp Nov 13, 2023
80db270
Added gffread before liftoff
GallVp Nov 13, 2023
bb9b8b0
Updated flowchart
GallVp Nov 13, 2023
c982946
Added liftoff options
GallVp Nov 15, 2023
c8ff8da
Started moving to nf-core/tools
GallVp Nov 21, 2023
f285461
Reimported modules using nf-core/tools
GallVp Nov 21, 2023
bea59ef
Reimported kherronism modules with nf-core/tools
GallVp Nov 22, 2023
2dda752
Updated braker3
GallVp Nov 22, 2023
8efa34d
Updated repeatmasker
GallVp Nov 22, 2023
8d31976
Updated modules
GallVp Nov 22, 2023
5eaa87b
Imported fastavalidate and liftoff from pfr/nxf-modules
GallVp Nov 22, 2023
0a96c7f
Updated modules and subworkflows
GallVp Dec 12, 2023
8a6c5fe
Added EDTA from pfr/nxf-modules
GallVp Dec 12, 2023
26c33fa
Updated config
GallVp Dec 18, 2023
9e58314
Integrated fastavalidator
GallVp Dec 18, 2023
4534684
Added patch for star/genomegenerate
GallVp Dec 18, 2023
ec7ffc1
Incorporated fasta_edta_lai
GallVp Dec 19, 2023
2de0d22
Trying to add FASTQ_FASTQC_UMITOOLS_FASTP
GallVp Dec 20, 2023
48e7271
Updated modules and applied prettier
GallVp Dec 20, 2023
c526933
FASTP now has stub
GallVp Dec 20, 2023
ac45bbb
SORTMERNA now has stub
GallVp Dec 20, 2023
ed6aa33
Cleaned up prepare_assembly
GallVp Dec 21, 2023
144edb2
Cleaned up preprocess_rnaseq
GallVp Dec 21, 2023
a79c187
Reformatted and inc ALIGN_RNASEQ
GallVp Dec 21, 2023
6f61f5d
Cleaned up and inc PREPARE_EXT_PROTS
GallVp Dec 21, 2023
1184795
Cleanedup BRAKER3
GallVp Dec 21, 2023
a9f1fc6
Updated fastp, sortmerna and liftoff
GallVp Dec 21, 2023
d0faf8d
Cleaned up fasta_liftoff
GallVp Dec 21, 2023
27a1293
Updated fasta_edta_lai
GallVp Jan 7, 2024
3867ed5
Added script for local stub run
GallVp Jan 7, 2024
4761491
Samplesheet now accepts relative paths
GallVp Jan 7, 2024
8ced027
Updated modules
GallVp Jan 7, 2024
fce65a0
Removed -exclude_partial and updated flowchart
GallVp Jan 7, 2024
582f3fa
Separated test config for local and pfr
GallVp Jan 8, 2024
e213bd3
Fixed local script typo
GallVp Jan 8, 2024
c961ab0
Fixed apptainer scope bug in base config
GallVp Jan 8, 2024
260c706
Updated README
GallVp Jan 8, 2024
565e7d7
Readded -exclude_partial and now using teambraker container
GallVp Jan 8, 2024
47b7c40
Added config for test data and quay.io container for braker3
GallVp Jan 9, 2024
664fba1
Now using repeatmodeler by default
GallVp Jan 9, 2024
dea4bb5
BRAKER3 now runnable with test data
GallVp Jan 9, 2024
0535b1a
Added editor config
GallVp Jan 10, 2024
457a643
Disabled sortmerna by default added option to save cat bam
GallVp Jan 10, 2024
784bb54
Added pre-commit
GallVp Jan 10, 2024
a4ada59
Updated manifest
GallVp Jan 10, 2024
4de72ab
Fixed linting errors
GallVp Jan 11, 2024
12968f4
Updated base config for docker
GallVp Jan 11, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Samplesheet now accepts relative paths
GallVp committed Jan 11, 2024
commit 476149154cec16229c903624ccc8197b9a4e20c6
2 changes: 1 addition & 1 deletion nextflow.config
Original file line number Diff line number Diff line change
@@ -25,7 +25,7 @@ params {

repeatmasker_save_outputs = true

samplesheet = "./.test/samplesheet_small.csv"
samplesheet = "./.test/samplesheet.csv"
// Optional: Set to null if not available

skip_fastqc = false
3 changes: 2 additions & 1 deletion pangene_local_stub.sh
Original file line number Diff line number Diff line change
@@ -6,4 +6,5 @@ nextflow \
-resume \
-stub \
--max_cpus=1 \
--max_memory=1.GB
--max_memory=1.GB \
--samplesheet="./.test/samplesheet_small.csv"
25 changes: 17 additions & 8 deletions subworkflows/local/extract_samples.nf
Original file line number Diff line number Diff line change
@@ -22,7 +22,10 @@ workflow EXTRACT_SAMPLES {
SAMPLESHEET_CHECK ( samplesheet, permissible_target_assemblies )
.csv
| splitCsv ( header:true, sep:',' )
| map { create_fastq_channel(it) }
| combine ( samplesheet )
| map { row, sheet ->
create_fastq_channel(row, sheet.getParent())
}
| set { ch_reads }

reads = ch_reads.map { meta, fastq -> [[id:meta.id, single_end:meta.single_end], fastq]}
@@ -40,25 +43,31 @@ workflow EXTRACT_SAMPLES {
}

// Function to get list of [ meta, [ fastq_1, fastq_2 ] ]
def create_fastq_channel(LinkedHashMap row) {
def create_fastq_channel(LinkedHashMap row, sheetPath) {
// create meta map
def meta = [:]
meta.id = row.sample
meta.single_end = row.single_end.toBoolean()
meta.target_assemblies = row.target_assemblies.split(";").sort()

def fq1 = row.fastq_1.startsWith("/") ? row.fastq_1 : "$sheetPath/${row.fastq_1}"
def fq2 = row.fastq_2.startsWith("/") ? row.fastq_2 : "$sheetPath/${row.fastq_2}"

// add path(s) of the fastq file(s) to the meta map
def fastq_meta = []
if (!file(row.fastq_1).exists()) {
exit 1, "ERROR: Please check input samplesheet -> Read 1 FastQ file does not exist!\n${row.fastq_1}"
if (!file(fq1).exists()) {
exit 1, "ERROR: Please check input samplesheet -> Read 1 FastQ file does not exist!\n${fq1}"
}
if (meta.single_end) {
fastq_meta = [ meta, [ file(row.fastq_1) ] ]
fastq_meta = [ meta, [ file(fq1) ] ]
} else {
if (!file(row.fastq_2).exists()) {
exit 1, "ERROR: Please check input samplesheet -> Read 2 FastQ file does not exist!\n${row.fastq_2}"
if (!file(fq2).exists()) {
exit 1, "ERROR: Please check input samplesheet -> Read 2 FastQ file does not exist!\n${fq2}"
}
fastq_meta = [ meta, [ file(row.fastq_1), file(row.fastq_2) ] ]
fastq_meta = [ meta, [ file(fq1), file(fq2) ] ]
}

println fastq_meta

return fastq_meta
}