Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

food101 dataset is unavailable to load #1

Open
Jaesung-Jun opened this issue Jan 24, 2025 · 0 comments
Open

food101 dataset is unavailable to load #1

Jaesung-Jun opened this issue Jan 24, 2025 · 0 comments

Comments

@Jaesung-Jun
Copy link

finetuning_setup.py line 188 vl-food101 huggingface repository is unavailabled.

-> https://huggingface.co/datasets/visual-layer/vl-food101

# https://github.com/VijayLingam95/SVFT/blob/0a48573ada0a1c7c77a9c5b857850fdcda51cdfc/vision_experiments/finetuning_setup.py#L186C1-L191C2

DATASET_NAME_TO_URL = {
    "cifar100": "cifar100",
    "food101": "visual-layer/vl-food101",
    "flowers102": "dpdl-benchmark/oxford_flowers102",
    "resisc45": "timm/resisc45",
}

need to modify code to below.

# https://github.com/VijayLingam95/SVFT/blob/0a48573ada0a1c7c77a9c5b857850fdcda51cdfc/vision_experiments/finetuning_setup.py#L186C1-
DATASET_NAME_TO_URL = {
    "cifar100": "cifar100",
    # "food101": "visual-layer/vl-food101",
    "food101": "ethz/food101", # Modified
    "flowers102": "dpdl-benchmark/oxford_flowers102",
    "resisc45": "timm/resisc45",
}
...
# https://github.com/VijayLingam95/SVFT/blob/0a48573ada0a1c7c77a9c5b857850fdcda51cdfc/vision_experiments/finetuning_setup.py#L209-L214
    elif dataset_name == "food101":
        dataset_url = DATASET_NAME_TO_URL[dataset_name]
        dataset = load_dataset(dataset_url, split="train")
        # dataset_test = load_dataset(dataset_url, split="test")
        dataset_test = load_dataset(dataset_url, split="validation") # Modified
        dataset_train, dataset_val = sampled_balanced_train_val(dataset)
        return dataset_train, dataset_val, dataset_test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant