IOSXE driver returns invalid syntax: %r

[TomBubu]

Hello, thanks a ton for your library!

I reached some weird error when trying to connect to Cisco IOX-XE device, please see below:

Traceback (most recent call last):
  File "/Users/<user>/PycharmProjects/TopoMap/Cdp.py", line 5, in <module>
    connection = ssh.connect_to_device(svl_corps[0])
  File "/Users/<user>/PycharmProjects/TopoMap/SshCommands.py", line 130, in connect_to_device
    connection.open()
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/driver/base/sync_driver.py", line 116, in open
    self.on_open(self)
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/driver/core/cisco_iosxe/sync_driver.py", line 26, in iosxe_on_open
    conn.acquire_priv(desired_priv=conn.default_desired_privilege_level)
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/driver/network/sync_driver.py", line 165, in acquire_priv
    current_prompt = self.channel.get_prompt()
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/decorators.py", line 224, in decorate
    return _multiprocessing_timeout(
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/decorators.py", line 115, in _multiprocessing_timeout
    return future.result()
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/concurrent/futures/_base.py", line 438, in result
    return self.__get_result()
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/concurrent/futures/_base.py", line 390, in __get_result
    raise self._exception
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/concurrent/futures/thread.py", line 52, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/channel/sync_channel.py", line 450, in get_prompt
    buf += self.read()
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/channel/sync_channel.py", line 74, in read
    self.logger.debug("read: %r", buf)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/logging/__init__.py", line 1800, in debug
    self.log(DEBUG, msg, *args, **kwargs)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/logging/__init__.py", line 1844, in log
    self.logger.log(level, msg, *args, **kwargs)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/logging/__init__.py", line 1512, in log
    self._log(level, msg, args, **kwargs)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/logging/__init__.py", line 1589, in _log
    self.handle(record)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/logging/__init__.py", line 1599, in handle
    self.callHandlers(record)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/logging/__init__.py", line 1661, in callHandlers
    hdlr.handle(record)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/logging/__init__.py", line 952, in handle
    self.emit(record)
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/logging.py", line 226, in emit
    self._record_msg_buf = literal_eval(record.msg[self._read_msg_prefix_len :])  # noqa
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/ast.py", line 62, in literal_eval
    node_or_string = parse(node_or_string, mode='eval')
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/ast.py", line 50, in parse
    return compile(source, filename, mode, flags,
  File "<unknown>", line 1
    %r
    ^
SyntaxError: invalid syntax

This is my device configuration:

device = {
            "host": ip,
            "auth_username": self.web,
            "auth_password": self.web_pw,
            "auth_strict_key": False,
            "channel_log": 'logs/scrapli_channel.log',
            'transport': 'system', # paramiko, system
            "transport_options": {
                "open_cmd": [
                    "-o", "KexAlgorithms=+diffie-hellman-group-exchange-sha1, diffie-hellman-group1-sha1, diffie-hellman-group14-sha1",
                    "-c", "Ciphers=+aes128-ctr, aes128-cbc, aes192-ctr, aes192-cbc, aes256-ctr, aes256-cbc",
                    "-o", "PubkeyAcceptedAlgorithms=+ssh-rsa",
                    "-o", "HostKeyAlgorithms=+ssh-rsa",
                ]
            },
        }

I tried both paramiko and system transport. In the scrapli.log I have this:

1     | 2024-10-11 16:59:35,284 | DEBUG    | <ip>:22          | load core transport requested
2     | 2024-10-11 16:59:35,284 | DEBUG    | <ip>:22          | core transport 'system' loaded successfully
3     | 2024-10-11 16:59:35,284 | DEBUG    | <ip>:22          | generating combined network comms prompt pattern
4     | 2024-10-11 16:59:35,284 | DEBUG    | <ip>:22          | setting 'comms_prompt_pattern' value to '(^[\w.\-@/:]{1,63}>$)|(^[\w.\-@/:]{1,63}#$)|(^[\w.\-@/:]{1,63}\([\w.\-@/:+]{0,32}\)#$)|(^([\w.\-@/+>:]+\(tcl\)[>#]|\+>)$)'
5     | 2024-10-11 16:59:35,284 | INFO     | <ip>:22          | opening connection to '<ip>' on port '22'
6     | 2024-10-11 16:59:35,284 | DEBUG    | <ip>:22          | opening transport connection to '<ip>' on port '22'
7     | 2024-10-11 16:59:35,285 | DEBUG    | <ip>:22          | created transport 'open_cmd': '['ssh', '<ip>', '-p', '22', '-o', 'ConnectTimeout=15', '-o', 'ServerAliveInterval=30', '-l', '<username>', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-F', '/dev/null', '-o', 'KexAlgorithms=+diffie-hellman-group-exchange-sha1, diffie-hellman-group1-sha1, diffie-hellman-group14-sha1', '-c', 'Ciphers=+aes128-ctr, aes128-cbc, aes192-ctr, aes192-cbc, aes256-ctr, aes256-cbc', '-o', 'PubkeyAcceptedAlgorithms=+ssh-rsa', '-o', 'HostKeyAlgorithms=+ssh-rsa']'
8     | 2024-10-11 16:59:35,288 | DEBUG    | <ip>:22          | transport connection to '<ip>' on port '22' opened successfully
9     | 2024-10-11 16:59:35,288 | INFO     | <ip>:22          | channel log enabled, logging channel output to 'logs/scrapli_channel.log'
10    | 2024-10-11 16:59:35,288 | DEBUG    | <ip>:22          | attempting in channel ssh authentication

Any suggestions and help is most welcome, thank you!

[carlmontanari]

👋

check out #350 and let us know if that sorts it!

[TomBubu]

Oh, I see! That worked, thank you very much!

I reached a new exception:

Traceback (most recent call last):
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/transport/plugins/system/transport.py", line 179, in read
    buf = self.session.read(65535)
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/transport/plugins/system/ptyprocess.py", line 530, in read
    raise EOFError("End Of File (EOF). Empty string style platform.")
EOFError: End Of File (EOF). Empty string style platform.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/<user>/PycharmProjects/TopoMap/Cdp.py", line 5, in <module>
    connection = ssh.connect_to_device(svl_corps[0])
  File "/Users/<user>/PycharmProjects/TopoMap/SshCommands.py", line 127, in connect_to_device
    connection.open()
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/driver/base/sync_driver.py", line 106, in open
    self.channel.channel_authenticate_ssh(
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/decorators.py", line 224, in decorate
    return _multiprocessing_timeout(
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/decorators.py", line 115, in _multiprocessing_timeout
    return future.result()
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/concurrent/futures/_base.py", line 438, in result
    return self.__get_result()
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/concurrent/futures/_base.py", line 390, in __get_result
    raise self._exception
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/concurrent/futures/thread.py", line 52, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/channel/sync_channel.py", line 294, in channel_authenticate_ssh
    buf = self.read()
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/channel/sync_channel.py", line 71, in read
    buf = self.transport.read()
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/decorators.py", line 224, in decorate
    return _multiprocessing_timeout(
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/decorators.py", line 115, in _multiprocessing_timeout
    return future.result()
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/concurrent/futures/_base.py", line 438, in result
    return self.__get_result()
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/concurrent/futures/_base.py", line 390, in __get_result
    raise self._exception
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/concurrent/futures/thread.py", line 52, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/Users/<user>/PycharmProjects/TopoMap/venv/lib/python3.9/site-packages/scrapli/transport/plugins/system/transport.py", line 186, in read
    raise ScrapliConnectionError(msg) from exc
scrapli.exceptions.ScrapliConnectionError: encountered EOF reading from transport; typically means the device closed the connection

However, I fixed that by commenting out all the transport_options from the device parameters likeso:

        device = {
            "host": ip,
            'port': 22,
            "auth_username": self.web,
            "auth_password": self.web_pw,
            "auth_strict_key": False,
            "channel_log": False,     #'logs/scrapli_channel.log',
            'transport': 'system',      
            "ssh_config_file": "~/.ssh/config",
            "transport_options": {
                "open_cmd": [
                    # "-o", "KexAlgorithms=+diffie-hellman-group-exchange-sha1, diffie-hellman-group1-sha1, diffie-hellman-group14-sha1",
                    # "-c", "Ciphers=+aes128-ctr, aes128-cbc, aes192-ctr, aes192-cbc, aes256-ctr, aes256-cbc",
                    # "-o", "PubkeyAcceptedAlgorithms=+ssh-rsa",
                    # "-o", "HostKeyAlgorithms=+ssh-rsa",
                ]
            },
        }

and instead of those options, I included the ssh_config_file, with the following contents:

Host *
StrictHostKeyChecking no
Ciphers aes128-ctr,aes192-ctr,aes256-ctr,aes128-cbc,aes192-cbc,aes256-cbc
KexAlgorithms +diffie-hellman-group1-sha1,diffie-hellman-group-exchange-sha1,diffie-hellman-group14-sha1
HostkeyAlgorithms +ssh-dss

So I'm not sure what's the difference here. I tried changing up the ssh-dss for ssh-rsa in the device parameters and commenting out the config file but that didn't change anything. Nevertheless it works but I've no idea what's the difference between running it with config file set vs including the tranport options in the device config 😄.

Thanks again!

[carlmontanari]

nevertheless it works but I've no idea what's the difference between running it with config file set vs including the tranport options in the device config 😄.

should work either way of course. it (scrapli) is just invoking /bin/ssh w/ whatever args you've got. so could be typo or something silly. debug logs should show the complaints. usually scrapli should raise an exception w/ the cipher/kext/key error (there is some stuff in base channel for this) but must have missed this one, but logs should have something interesting/helpful.

[TomBubu]

Gotcha, thanks a ton for your help! 👍