Script to convert civitai.info -> .json

[MrKuenning]

We now have a native LoRA editor built into the WebUI. It generates .json files to store the activation text and preferred weight etc.

Someone should build a script to migrate the data the civitai helper generates to create the jason files.

---

An example json file that the webUI creates

{
    "description": "Beautiful Diamond Realm Style", 
    "sd version": "SD1", 
    "activation text": "diamondrealmstyle, sparkles", 
    "preferred weight": 0, 
    "notes": "https://civitai.com/models/81843?modelVersionId=86880"
}

Most of that data can be pulled from fields in the civitai.info files.

{
    "id": 86880,
    "modelId": 81843,
        "trainedWords": [  "diamondrealmstyle" , "sparkles" ],
    "description": "Beautiful Diamond Realm Style",
}

MAPPING:

• description: FROM description

• activation text: FROM trainedWords (Change list format to comma separated)

• notes: can create a URL FROM ModelID and ID like "https://civitai.com/models/[modelId]?modelVersionId=[id]"

• sd version: can be left off as the web UI detects this on its own.

• weight can be left off because users and set this as preferred.

The end result will look like this.

I have thousands of models and would love some help creating something like this.

[missionfloyd]

import re
import json
import glob

for file in glob.glob("**/*.civitai.info", recursive=True):
    out = {}
    with open(file) as f:
        info = json.load(f)
        
    out["description"] = info.get("description", "")
    out["activation text"] = ", ".join(info["trainedWords"])
    out["notes"] = f"https://civitai.com/models/{info['modelId']}?modelVersionId={info['id']}"
    
    with open(re.sub(r"\.civitai\.info$", ".json", file), "w") as f:
        json.dump(out, f, indent=4)

Looks for .civitai.info files in the current folder and subfolders.

[MrKuenning]

First of all, Thank you so much. I was able to run it on about 3000 civitai files in about 2 seconds.

I ran into some small snags.

• Files that had capitalized "Civitai.info" got skipped.

  • This was easily fixable with a batch rename.

• Files that had no data in them because they had no match on the website, stopped the script with an error.

  • This was fixable by deleting all civitai.info files smaller than 1KB

[chrme]

Files that had capitalized "Civitai.info" got skipped.
Files that had no data in them because they had no match on the website, stopped the script with an error.

Beware, there was a bug in open(re.sub(r"\.civitai\.info$", ".json", file), "w"), and if the file had capitalized "Civitai.info", the original file was overwritten. Here is the fix.

import json
import glob

for file in glob.glob("**/*.civitai.info", recursive=True):
    out = {}
    with open(file) as f:
        info = json.load(f)
    
    if not info:
        continue

    out["description"] = info.get("description", "")
    out["activation text"] = ", ".join(info.get("trainedWords", []))
    out["notes"] = f"https://civitai.com/models/{info['modelId']}?modelVersionId={info['id']}"
    
    with open(f"{file[:-12]}json", "w") as f:
        json.dump(out, f, indent=4)