Git Submodule cannot be updated on Azure DevOps

[carstencodes]

How are you running Renovate?

Self-hosted Renovate

If you're self-hosting Renovate, tell us which platform (GitHub, GitLab, etc) and which version of Renovate.

Azure DevOps

Please tell us more about your question or problem

Hi,

we are trying to extend our renovate.json to get updates for some of our ThirdParty Modules.

The Repo is hosted on dev.azure.com, the runner is running on premise using

docker run
      --rm
      -e LOG_LEVEL=debug
      -e GIT_LFS_SKIP_SMUDGE=1
      -e HTTP_PROXY=$(http_proxy)
      -e HTTPS_PROXY=$(https_proxy)
      -e NO_PROXY=$(no_proxy)
      renovate/renovate:latest
      --platform azure
      --endpoint $(System.TeamFoundationCollectionUri)
      --token $(System.AccessToken)
      --expose-all-env true
      $(System.TeamProject)/$(Build.Repository.Name)

Unfortunately, the renovatebot exits without an error, but prints issues that the submodule cannot be updated (see log below).

We're using no config.js, only a renovate.json file in the root of our repository.

Logs (if relevant)

Logs

2025-01-20T12:56:48.5840563Z DEBUG: Adding trailing slash to endpoint
2025-01-20T12:56:48.5841003Z DEBUG: Enabling forkProcessing while in non-autodiscover mode
2025-01-20T12:56:48.5841228Z DEBUG: Enabling onboardingNoDeps while in non-autodiscover mode
2025-01-20T12:56:48.5959006Z DEBUG: Found valid git version: 2.48.1
2025-01-20T12:56:48.6007954Z DEBUG: Setting global hostRules
2025-01-20T12:56:48.6008248Z DEBUG: Adding token authentication for dev.azure.com (hostType=azure) to hostRules
2025-01-20T12:56:48.6016046Z DEBUG: Using baseDir: /tmp/renovate
2025-01-20T12:56:48.6021897Z DEBUG: Using cacheDir: /tmp/renovate/cache
2025-01-20T12:56:48.6024962Z DEBUG: Using containerbaseDir: /tmp/renovate/cache/containerbase
2025-01-20T12:56:48.6031273Z DEBUG: Initializing Renovate internal cache into /tmp/renovate/cache/renovate/renovate-cache-v1
2025-01-20T12:56:48.6031518Z DEBUG: Commits limit = null
2025-01-20T12:56:48.6032093Z DEBUG: Setting global hostRules
2025-01-20T12:56:48.6046629Z DEBUG: Adding token authentication for dev.azure.com (hostType=azure) to hostRules
2025-01-20T12:56:48.6052121Z DEBUG: validatePresets()
2025-01-20T12:56:48.6470874Z DEBUG: Reinitializing hostRules for repo
2025-01-20T12:56:48.6471134Z DEBUG: Clearing hostRules
2025-01-20T12:56:48.6471306Z DEBUG: Adding token authentication for dev.azure.com (hostType=azure) to hostRules

...

2025-01-20T12:57:09.5505360Z DEBUG: Repository config (repository=VEOS/VEOS)
2025-01-20T12:57:09.5505627Z        "fileName": "renovate.json",
2025-01-20T12:57:09.5505755Z        "config": {
2025-01-20T12:57:09.5507008Z          "$schema": "https://docs.renovatebot.com/renovate-schema.json",
2025-01-20T12:57:09.5508259Z          "extends": ["config:base", ":rebaseStalePrs"],
2025-01-20T12:57:09.5508461Z          "azureWorkItemId": 1278531,
2025-01-20T12:57:09.5508597Z          "branchPrefix": "rls2025A/misc/",
2025-01-20T12:57:09.5508729Z          "additionalBranchPrefix": "RenovateBot/deps-",
2025-01-20T12:57:09.5508892Z          "ignoreDeps": ["Simulator/3rdParty/lwIP", "Simulator/3rdParty/libpcap"],
2025-01-20T12:57:09.5509098Z          "git-submodules": {"enabled": true},
2025-01-20T12:57:09.5509233Z          "nuget": {"enabled": false},
2025-01-20T12:57:09.5509379Z          "dockerfile": {"enabled": false},
2025-01-20T12:57:09.5509494Z          "packageRules": [
2025-01-20T12:57:09.5509603Z            {
2025-01-20T12:57:09.5509726Z              "description": "Update git submodules",
2025-01-20T12:57:09.5509912Z              "matchManagers": ["git-submodules"],
2025-01-20T12:57:09.5510030Z              "enabled": true,
2025-01-20T12:57:09.5510147Z              "automerge": true
2025-01-20T12:57:09.5510251Z            }
2025-01-20T12:57:09.5510347Z          ]
2025-01-20T12:57:09.5510443Z        }

...

2025-01-20T12:57:10.1807309Z DEBUG: extract() (repository=VEOS/VEOS)
2025-01-20T12:57:10.2809602Z DEBUG: Setting current branch to releases/rls2025A (repository=VEOS/VEOS)
2025-01-20T12:57:10.8184360Z DEBUG: latest commit (repository=VEOS/VEOS)
2025-01-20T12:57:10.8184675Z        "branchName": "releases/rls2025A",
2025-01-20T12:57:10.8185071Z        "latestCommitDate": "2025-01-20T12:45:15+01:00"

...

2025-01-20T12:57:24.4050513Z DEBUG: Matched 1 file(s) for manager git-submodules: .gitmodules (repository=VEOS/VEOS)

...

2025-01-20T12:57:24.6158168Z  INFO: Dependency extraction complete (repository=VEOS/VEOS, baseBranch=releases/rls2025A)
2025-01-20T12:57:24.6158321Z        "stats": {
2025-01-20T12:57:24.6158515Z          "managers": {"git-submodules": {"fileCount": 1, "depCount": 5}},
2025-01-20T12:57:24.6158669Z          "total": {"fileCount": 1, "depCount": 5}
2025-01-20T12:57:24.6158788Z        }

...

2025-01-20T12:57:24.8961723Z DEBUG: config.repoIsOnboarded=true (repository=VEOS/VEOS)
2025-01-20T12:57:24.8966731Z DEBUG: packageFiles with updates (repository=VEOS/VEOS, baseBranch=releases/rls2025A)
2025-01-20T12:57:24.8967410Z        "config": {
2025-01-20T12:57:24.8967949Z          "git-submodules": [
2025-01-20T12:57:24.8968164Z            {
2025-01-20T12:57:24.8968375Z              "deps": [
2025-01-20T12:57:24.8968562Z                {
2025-01-20T12:57:24.8968763Z                  "depName": "Admin/Build",
2025-01-20T12:57:24.8969051Z                  "packageName": "https://dev.azure.com/dSPACEGroup/VEOS/_git/BuildTargets",
2025-01-20T12:57:24.8969355Z                  "currentValue": "releases/rls2025A",
2025-01-20T12:57:24.8969639Z                  "currentDigest": "d0e7ca0978b68f60b3068cc5d176e83f2e55a129",
2025-01-20T12:57:24.8969884Z                  "updates": [
2025-01-20T12:57:24.8970132Z                    {
2025-01-20T12:57:24.8970341Z                      "updateType": "digest",
2025-01-20T12:57:24.8970582Z                      "newValue": "releases/rls2025A",
2025-01-20T12:57:24.8970855Z                      "newDigest": "a58d75b5a74bc4bce2803d7b822631e05c2335b9",
2025-01-20T12:57:24.8971297Z                      "branchName": "rls2025A/misc/RenovateBot/deps-admin-build-digest"
2025-01-20T12:57:24.8971543Z                    }
2025-01-20T12:57:24.8971718Z                  ],
2025-01-20T12:57:24.8971922Z                  "versioning": "git",
2025-01-20T12:57:24.8972242Z                  "warnings": []
2025-01-20T12:57:24.8972441Z                },
2025-01-20T12:57:24.8972626Z                {
2025-01-20T12:57:24.8972860Z                  "depName": "Simulator/DataDefinitions/Shared",
2025-01-20T12:57:24.8973173Z                  "packageName": "https://dev.azure.com/dSPACEGroup/VEOS/_git/Simulator.SharedDataDefinitions",
2025-01-20T12:57:24.8973488Z                  "currentValue": "releases/rls2025A",
2025-01-20T12:57:24.8973771Z                  "currentDigest": "a6765708f72b863cae6cb8beec02186b8be10ec9",
2025-01-20T12:57:24.8974025Z                  "updates": [],
2025-01-20T12:57:24.8974236Z                  "versioning": "git",
2025-01-20T12:57:24.8974436Z                  "warnings": []
2025-01-20T12:57:24.8974625Z                },
...
2025-01-20T12:57:24.8978211Z                  ],
2025-01-20T12:57:24.8978664Z                  "versioning": "git",
2025-01-20T12:57:24.8978877Z                  "warnings": []
2025-01-20T12:57:24.8979058Z                }
2025-01-20T12:57:24.8983149Z              ],
2025-01-20T12:57:24.8983443Z              "datasource": "git-refs",
2025-01-20T12:57:24.8983679Z              "packageFile": ".gitmodules"
2025-01-20T12:57:24.8983872Z            }
2025-01-20T12:57:24.8984046Z          ]
2025-01-20T12:57:24.8984221Z        }

...

2025-01-20T12:57:25.4077526Z DEBUG: submodule checkout error (repository=VEOS/VEOS, branch=rls2025A/misc/RenovateBot/deps-admin-build-digest)
2025-01-20T12:57:25.4077880Z        "err": {
2025-01-20T12:57:25.4078000Z          "task": {
2025-01-20T12:57:25.4078254Z            "commands": ["submodule", "update", "--checkout", "--init", "Admin/Build"],
2025-01-20T12:57:25.4078426Z            "format": "utf-8",
2025-01-20T12:57:25.4078560Z            "parser": "[function]"
2025-01-20T12:57:25.4078675Z          },
2025-01-20T12:57:25.4079723Z          "message": "Submodule 'BuildTargets' (https://**redacted**@dev.azure.com/dSPACEGroup/VEOS/_git/BuildTargets) registered for path 'Admin/Build'\nCloning into '/tmp/renovate/repos/azure/VEOS/VEOS/Admin/Build'...\nfatal: could not read Password for 'https://**redacted**@dev.azure.com': No such device or address\nfatal: clone of 'https://**redacted**@dev.azure.com/dSPACEGroup/VEOS/_git/BuildTargets' into submodule path '/tmp/renovate/repos/azure/VEOS/VEOS/Admin/Build' failed\nFailed to clone 'Admin/Build'. Retry scheduled\nCloning into '/tmp/renovate/repos/azure/VEOS/VEOS/Admin/Build'...\nfatal: could not read Password for 'https://**redacted**@dev.azure.com': No such device or address\nfatal: clone of 'https://**redacted**@dev.azure.com/dSPACEGroup/VEOS/_git/BuildTargets' into submodule path '/tmp/renovate/repos/azure/VEOS/VEOS/Admin/Build' failed\nFailed to clone 'Admin/Build' a second time, aborting\n",
2025-01-20T12:57:25.4082865Z          "stack": "Error: Submodule 'BuildTargets' (https://**redacted**@dev.azure.com/dSPACEGroup/VEOS/_git/BuildTargets) registered for path 'Admin/Build'\nCloning into '/tmp/renovate/repos/azure/VEOS/VEOS/Admin/Build'...\nfatal: could not read Password for 'https://**redacted**@dev.azure.com': No such device or address\nfatal: clone of 'https://**redacted**@dev.azure.com/dSPACEGroup/VEOS/_git/BuildTargets' into submodule path '/tmp/renovate/repos/azure/VEOS/VEOS/Admin/Build' failed\nFailed to clone 'Admin/Build'. Retry scheduled\nCloning into '/tmp/renovate/repos/azure/VEOS/VEOS/Admin/Build'...\nfatal: could not read Password for 'https://**redacted**@dev.azure.com': No such device or address\nfatal: clone of 'https://**redacted**@dev.azure.com/dSPACEGroup/VEOS/_git/BuildTargets' into submodule path '/tmp/renovate/repos/azure/VEOS/VEOS/Admin/Build' failed\nFailed to clone 'Admin/Build' a second time, aborting\n\n    at Object.action (/usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/simple-git/src/lib/plugins/error-detection.plugin.ts:42:29)\n    at PluginStore.exec (/usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/simple-git/src/lib/plugins/plugin-store.ts:54:29)\n    at /usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/simple-git/src/lib/runners/git-executor-chain.ts:124:42\n    at new Promise (<anonymous>)\n    at GitExecutorChain.handleTaskData (/usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/simple-git/src/lib/runners/git-executor-chain.ts:121:14)\n    at GitExecutorChain.<anonymous> (/usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/simple-git/src/lib/runners/git-executor-chain.ts:97:40)\n    at Generator.next (<anonymous>)\n    at fulfilled (/usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:52:24)\n    at processTicksAndRejections (node:internal/process/task_queues:105:5)"
2025-01-20T12:57:25.4084058Z        }

...

2025-01-20T12:57:25.4161595Z  WARN: Error updating branch: update failure (repository=VEOS/VEOS, branch=rls2025A/misc/RenovateBot/deps-admin-build-digest)

...

2025-01-20T12:57:25.8599307Z DEBUG: submodule checkout error (repository=VEOS/VEOS, branch=rls2025A/misc/RenovateBot/deps-simulator-datadefinitions-sharedvmhostdatadefinitions-digest)
2025-01-20T12:57:25.8599854Z        "err": {
2025-01-20T12:57:25.8599975Z          "task": {
2025-01-20T12:57:25.8600081Z            "commands": [
2025-01-20T12:57:25.8600201Z              "submodule",
2025-01-20T12:57:25.8600313Z              "update",
2025-01-20T12:57:25.8600460Z              "--checkout",
2025-01-20T12:57:25.8600589Z              "--init",
2025-01-20T12:57:25.8600726Z              "Simulator/DataDefinitions/SharedVmHostDataDefinitions"
2025-01-20T12:57:25.8600857Z            ],
2025-01-20T12:57:25.8600967Z            "format": "utf-8",
2025-01-20T12:57:25.8601076Z            "parser": "[function]"
2025-01-20T12:57:25.8601185Z          },
2025-01-20T12:57:25.8602626Z          "message": "Submodule 'SharedDataDefinitions' (https://**redacted**@dev.azure.com/dSPACEGroup/VEOS/_git/VeosVmHost.SharedDataDefinition) registered for path 'Simulator/DataDefinitions/SharedVmHostDataDefinitions'\nCloning into '/tmp/renovate/repos/azure/VEOS/VEOS/Simulator/DataDefinitions/SharedVmHostDataDefinitions'...\nfatal: could not read Password for 'https://**redacted**@dev.azure.com': No such device or address\nfatal: clone of 'https://**redacted**@dev.azure.com/dSPACEGroup/VEOS/_git/VeosVmHost.SharedDataDefinition' into submodule path '/tmp/renovate/repos/azure/VEOS/VEOS/Simulator/DataDefinitions/SharedVmHostDataDefinitions' failed\nFailed to clone 'Simulator/DataDefinitions/SharedVmHostDataDefinitions'. Retry scheduled\nCloning into '/tmp/renovate/repos/azure/VEOS/VEOS/Simulator/DataDefinitions/SharedVmHostDataDefinitions'...\nfatal: could not read Password for 'https://**redacted**@dev.azure.com': No such device or address\nfatal: clone of 'https://**redacted**@dev.azure.com/dSPACEGroup/VEOS/_git/VeosVmHost.SharedDataDefinition' into submodule path '/tmp/renovate/repos/azure/VEOS/VEOS/Simulator/DataDefinitions/SharedVmHostDataDefinitions' failed\nFailed to clone 'Simulator/DataDefinitions/SharedVmHostDataDefinitions' a second time, aborting\n",
2025-01-20T12:57:25.8606086Z          "stack": "Error: Submodule 'SharedDataDefinitions' (https://**redacted**@dev.azure.com/dSPACEGroup/VEOS/_git/VeosVmHost.SharedDataDefinition) registered for path 'Simulator/DataDefinitions/SharedVmHostDataDefinitions'\nCloning into '/tmp/renovate/repos/azure/VEOS/VEOS/Simulator/DataDefinitions/SharedVmHostDataDefinitions'...\nfatal: could not read Password for 'https://**redacted**@dev.azure.com': No such device or address\nfatal: clone of 'https://**redacted**@dev.azure.com/dSPACEGroup/VEOS/_git/VeosVmHost.SharedDataDefinition' into submodule path '/tmp/renovate/repos/azure/VEOS/VEOS/Simulator/DataDefinitions/SharedVmHostDataDefinitions' failed\nFailed to clone 'Simulator/DataDefinitions/SharedVmHostDataDefinitions'. Retry scheduled\nCloning into '/tmp/renovate/repos/azure/VEOS/VEOS/Simulator/DataDefinitions/SharedVmHostDataDefinitions'...\nfatal: could not read Password for 'https://**redacted**@dev.azure.com': No such device or address\nfatal: clone of 'https://**redacted**@dev.azure.com/dSPACEGroup/VEOS/_git/VeosVmHost.SharedDataDefinition' into submodule path '/tmp/renovate/repos/azure/VEOS/VEOS/Simulator/DataDefinitions/SharedVmHostDataDefinitions' failed\nFailed to clone 'Simulator/DataDefinitions/SharedVmHostDataDefinitions' a second time, aborting\n\n    at Object.action (/usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/simple-git/src/lib/plugins/error-detection.plugin.ts:42:29)\n    at PluginStore.exec (/usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/simple-git/src/lib/plugins/plugin-store.ts:54:29)\n    at /usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/simple-git/src/lib/runners/git-executor-chain.ts:124:42\n    at new Promise (<anonymous>)\n    at GitExecutorChain.handleTaskData (/usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/simple-git/src/lib/runners/git-executor-chain.ts:121:14)\n    at GitExecutorChain.<anonymous> (/usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/simple-git/src/lib/runners/git-executor-chain.ts:97:40)\n    at Generator.next (<anonymous>)\n    at fulfilled (/usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:52:24)\n    at processTicksAndRejections (node:internal/process/task_queues:105:5)"
2025-01-20T12:57:25.8607549Z        }

...

2025-01-20T12:57:25.8654166Z  WARN: Error updating branch: update failure (repository=VEOS/VEOS, branch=rls2025A/misc/RenovateBot/deps-simulator-datadefinitions-sharedvmhostdatadefinitions-digest)

...

2025-01-20T12:57:31.0623159Z DEBUG: branches info extended (repository=VEOS/VEOS)
2025-01-20T12:57:31.0623367Z        "branchesInformation": [
2025-01-20T12:57:31.0623500Z          {
2025-01-20T12:57:31.0623772Z            "branchName": "rls2025A/misc/RenovateBot/deps-admin-build-digest",
2025-01-20T12:57:31.0623934Z            "prNo": null,
2025-01-20T12:57:31.0624148Z            "prTitle": "chore(deps): update admin/build digest to a58d75b",
2025-01-20T12:57:31.0624317Z            "result": "error",
2025-01-20T12:57:31.0624430Z            "upgrades": [
2025-01-20T12:57:31.0624538Z              {
2025-01-20T12:57:31.0624707Z                "datasource": "git-refs",
2025-01-20T12:57:31.0624838Z                "depName": "Admin/Build",
2025-01-20T12:57:31.0624953Z                "displayPending": "",
2025-01-20T12:57:31.0625083Z                "currentValue": "releases/rls2025A",
2025-01-20T12:57:31.0625237Z                "currentDigest": "d0e7ca0978b68f60b3068cc5d176e83f2e55a129",
2025-01-20T12:57:31.0625443Z                "newValue": "releases/rls2025A",
2025-01-20T12:57:31.0625590Z                "newDigest": "a58d75b5a74bc4bce2803d7b822631e05c2335b9",
2025-01-20T12:57:31.0625728Z                "packageFile": ".gitmodules",
2025-01-20T12:57:31.0625859Z                "updateType": "digest",
2025-01-20T12:57:31.0626011Z                "packageName": "https://dev.azure.com/dSPACEGroup/VEOS/_git/BuildTargets"
2025-01-20T12:57:31.0626220Z              }
2025-01-20T12:57:31.0626309Z            ]
2025-01-20T12:57:31.0626404Z          },
2025-01-20T12:57:31.0626498Z          {
2025-01-20T12:57:31.0626735Z            "branchName": "rls2025A/misc/RenovateBot/deps-simulator-datadefinitions-sharedvmhostdatadefinitions-digest",
2025-01-20T12:57:31.0626889Z            "prNo": null,
2025-01-20T12:57:31.0627051Z            "prTitle": "chore(deps): update simulator/datadefinitions/sharedvmhostdatadefinitions digest to ca00f04",
2025-01-20T12:57:31.0627309Z            "result": "error",
2025-01-20T12:57:31.0627597Z            "upgrades": [
2025-01-20T12:57:31.0627689Z              {
2025-01-20T12:57:31.0627845Z                "datasource": "git-refs",
2025-01-20T12:57:31.0628013Z                "depName": "Simulator/DataDefinitions/SharedVmHostDataDefinitions",
2025-01-20T12:57:31.0628215Z                "displayPending": "",
2025-01-20T12:57:31.0628343Z                "currentValue": "releases/rls2025A",
2025-01-20T12:57:31.0628484Z                "currentDigest": "f9afdc996863c59eb970c2469488fd4fca6640ef",
2025-01-20T12:57:31.0628628Z                "newValue": "releases/rls2025A",
2025-01-20T12:57:31.0628771Z                "newDigest": "ca00f04b19765fd6fb8aae1cf3378f196e5363bd",
2025-01-20T12:57:31.0628916Z                "packageFile": ".gitmodules",
2025-01-20T12:57:31.0629032Z                "updateType": "digest",
2025-01-20T12:57:31.0629190Z                "packageName": "https://dev.azure.com/dSPACEGroup/VEOS/_git/VeosVmHost.SharedDataDefinition"
2025-01-20T12:57:31.0629331Z              }
2025-01-20T12:57:31.0629429Z            ]
2025-01-20T12:57:31.0629516Z          }
2025-01-20T12:57:31.0629610Z        ]

We"re stuck a little, as onboarding went well.

We also read the documentation on private packages and on git submodules

Before running the git commands to update the submodules, Renovate exports git [insteadOf](https://git-scm.com/docs/git-config#Documentation/git-config.txt-urlltbasegtinsteadOf) directives in environment variables.

The following logic is executed prior to "submodules" updating:

The token from the hostRules entry matching hostType=github and matchHost=api.github.com is added as the default authentication for github.com. For those running against github.com, this token will be the default platform token.

Next, all hostRules with both a token or username/password and matchHost will be fetched, except for any github.com one from above.

Rules from this list are converted to environment variable directives if they match any of the following characteristics:

No hostType is defined, or
hostType is git-tags or git-refs, or
hostType is a platform (github, gitlab, azure, etc.)

As the log states, the hostType azure was set.

What else can or do we have to do?

Regards

Carsten

[github-actions[bot]]

Hi there,

A maintainer has flagged this discussion as giving off some bad vibes. Maintainers will no longer participate in this discussion unless/until such "vibes" are resolved.

This is typically when someone is overly critical of the product or the assistance they're receiving. Or being unreasonably demanding or lazy, such as refusing to provide logs, or other information, when asked.

Open Source means you're welcome to use the software with few limits applied. But you should not give maintainers a bad day or contribute to Open Source burnout.

If you feel this message is wrong or due to a misunderstanding, please let us know. If you see this message but don't take it as a sign to cool off or back off, we may close the discussion and block you from the repository.

If you want to get the discussion back on track, we would like you to:

• Remove, or edit, the bad vibes parts of your comments
• Say that you understand the problem (we don't need a lengthy apology)
• Stop giving off more bad vibes

Thanks, the Renovate team