Skip to content
Back to pull request #651

parallelise model loading #467

Sign in to view logs

parallelise model loading

parallelise model loading #467

Run time

Learn about OS pricing on GitHub Actions
Job Run time
three-m4-pro-cluster (llama-3.1-8b) / generate-matrix
1s
single-m4-pro (llama-3.2-1b) / generate-matrix
1s
single-m4-pro (llama-3.2-3b) / generate-matrix
1s
single-m4-pro (llama-3.1-8b) / generate-matrix
1s
three-m4-pro-cluster (llama-3.2-1b) / generate-matrix
1s
three-m4-pro-cluster (llama-3.2-3b) / generate-matrix
1s
three-m4-pro-cluster (llama-3.3-70b) / generate-matrix
1s
two-m4-pro-cluster (llama-3.1-8b) / generate-matrix
1s
two-m4-pro-cluster (llama-3.2-1b) / generate-matrix
1s
two-m4-pro-cluster (llama-3.2-3b) / generate-matrix
1s
single-m4-pro (llama-3.2-3b) / run-distributed-job (M4PRO_GPU16_24GB)
57s
single-m4-pro (llama-3.2-1b) / run-distributed-job (M4PRO_GPU16_24GB)
54s
three-m4-pro-cluster (llama-3.3-70b) / run-distributed-job (M4PRO_GPU16_24GB)
2m 36s
three-m4-pro-cluster (llama-3.2-1b) / run-distributed-job (M4PRO_GPU16_24GB)
2m 3s
three-m4-pro-cluster (llama-3.2-1b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 23s
three-m4-pro-cluster (llama-3.2-1b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 21s
three-m4-pro-cluster (llama-3.3-70b) / run-distributed-job (M4PRO_GPU16_24GB)
2m 36s
three-m4-pro-cluster (llama-3.3-70b) / run-distributed-job (M4PRO_GPU16_24GB)
2m 31s
three-m4-pro-cluster (llama-3.1-8b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 35s
three-m4-pro-cluster (llama-3.1-8b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 35s
three-m4-pro-cluster (llama-3.1-8b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 40s
two-m4-pro-cluster (llama-3.2-3b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 8s
two-m4-pro-cluster (llama-3.2-3b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 41s
two-m4-pro-cluster (llama-3.1-8b) / run-distributed-job (M4PRO_GPU16_24GB)
2m 18s
two-m4-pro-cluster (llama-3.1-8b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 27s
single-m4-pro (llama-3.1-8b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 2s
three-m4-pro-cluster (llama-3.2-3b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 17s
three-m4-pro-cluster (llama-3.2-3b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 45s
three-m4-pro-cluster (llama-3.2-3b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 24s
two-m4-pro-cluster (llama-3.2-1b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 15s
two-m4-pro-cluster (llama-3.2-1b) / run-distributed-job (M4PRO_GPU16_24GB)
1m 14s
33m 52s