Skip to content
Check PR

Scrapper, Sofia Onofrienko - 22FPL1 #1834

Sign in to view logs

Scrapper, Sofia Onofrienko - 22FPL1

Scrapper, Sofia Onofrienko - 22FPL1 #1834

Triggered via pull request June 3, 2024 10:30
@soniaonofrienkosoniaonofrienko
synchronize #74
soniaonofrienko:main
Status Success
Total duration 12m 42s
Artifacts 2

crawler.yml

on: pull_request
Installing dependencies
53s
Installing dependencies
Code Style
1m 14s
Code Style
Mypy checks
48s
Mypy checks
Import style checks
46s
Import style checks
PR name check
54s
PR name check
Requirements check
37s
Requirements check
Crawler checks config
46s
Crawler checks config
Crawler checks
3m 42s
Crawler checks
Parser checks
2m 52s
Parser checks
Download articles
1m 28s
Download articles
Validate dataset
1m 33s
Validate dataset
Crawler is accepted!
0s
Crawler is accepted!
Starting pipeline checks!
0s
Starting pipeline checks!
Pipe processed student data
46s
Pipe processed student data
Pipe verifies dataset
43s
Pipe verifies dataset
CorpusManager detects articles
1m 1s
CorpusManager detects articles
Pipe processed admin data
47s
Pipe processed admin data
Validate final dataset
58s
Validate final dataset
POSFrequencyPipeline tests
44s
POSFrequencyPipeline tests
Pipeline is accepted!
0s
Pipeline is accepted!
Fit to window
Zoom out
Zoom in

Annotations

1 warning
POSFrequencyPipeline tests
No files were found with the provided path: tmp/articles. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size
processed-dataset Expired
42.4 KB
raw-dataset Expired
8.93 KB