Paused state on AutoQueue?

[casperse]

Everything works and I even got passwords-less working! on my Ubuntu VM
Speeds where a little slow, but changing VM LAN properties from to virtio helped!

BUT for some reason Seedsync pauses folders that are selected for AutoQueue´?

If I manually start them it all run fine again?
I really need it to run automatically any thing I am missing?
People who have it working are you not using AutoQueue?

Best regards

[casperse]

Maybee a stupid Q. But it seems like Seedsync keeps syncing files?
So if Sonarr/Radarr moves a file and do the renaming then Seedsync will fecth the file again?
Is this correct? (I thought it would be like synchting a one way sync and if I deleted the file it would not fecth it agan)

[quadcom]

Not sure what you are seeing here. In my exp SS only DL's once. If you delete, rename or move a download then it will still show in the list but it will only be reflecting the remote side. If you delete the folder on the source side then it will disappear in SS.

[casperse]

Ok I tried to remove a torrent file on the source side and I got a error on the Seedsync
Kind of look liked it stopped and needed a restart is that normal behavior?

[casperse]

Update I did a small test:

1. If I delete and remove the files from the host/master server - then the files already DL is kept on my local server (OK)
2. Deleting or moving files from my local server, will be synched again! if the files are still on the host/master server? (??)
   I will try to test this again making sure that there wasn't a manual synch request from my Seedsync UI

[quadcom]

I haven't seen that kind of behaviour before. If a seed was deleted locally it normally is shown as deleted in the SS UI. Only hitting the queue button would restart a DL.

Now, if files are renamed on the server, that might trigger SS to download them again as it believes they are new files.

I believe SS users some kind of internal list that keeps track of what had been dl'd. I seem to remember seeing an ignore list in with the config files when I was running the docker ver.

[casperse]

Thanks for the input quadcom I will look for the internal list to see what is going on..

The sync is running and the passwordless setup is great!
But I also have problem with stability sometimes if I do a search for *.lftp I found old file not finished and I also get this:

This requires a restart and then everything works again!

The system and the internet connection is rock solid (I am monitoring everything)
Also I have provided all the resources needed for it to run:

I used your input to do the same 4 cores and 4G RAM :-)

[quadcom]

I too see the parsing error now and then. I've tried debugging but nothing stands out to me nor has ipsingh been able to see anything in the logs that stands out AFAIK.

It doesn't happen all that often so I just hit the restart and it catches up again. DL's are quick so it doesn't take that long.

One thing I will point out is your CPU usage for this VM. It's pretty crazy for not doing anything. Mine is normally sitting at .46% MAX .42% AVG when it's not doing anything. It looks to me like yours is doing something at all times from the looks of it at around 60% AVG. That's a little red flag to some that some other processes are going on in that VM.

htop and some other process viewers will show you what is running. You can sort by resource usage to see the top offenders.

[casperse]

Ok so I tried running top:

I then uninstalled the Audio service and closed my Firefox browser (I had the UI running so I could monitor Seedsync):

So I really didn't think the UI on the VM on Firefox would draw so much CPU....its still high?

[casperse]

BTW: I have not enabled auto extraction!
I have also created a restart job every 8 hours

[quadcom]

Hmm, are you using the desktop version of Ubunutu? That might explain the higher CPU usage. I am using an Ubuntu v18 server not the desktop version. 4GB might not be enough RAM for it to run smoothly if you're using the desktop version.

[quadcom]

I'm curious if SS is having issues running in a desktop env. While the docs say Ubunutu it also points first to Debian which AFAIK is a server-based non-UI Linux distro by default. Yes, you can add a UI but it's third party and not a part of the Debian dev. I think that was what was meant when Ubunutu was included.

Only IPsingh can confirm this.

[casperse]

So what should I try next Debian headless or Ubuntu server non UI? (This is my 3 installation so I am getting pretty good at it)
Could you point me to the most correct version?

[quadcom]

Ubuntu server 18.

Mine worked on the first install.

[casperse]

Ok I took the new one 20.04.3 (Couldnt find the old one) but I would like to delete the scanner scripts on the remote host in TMP
but I cant find it? do you know the path to where seedsync saves and creates this tmp folder?

[quadcom]

Don't worry about it. It'll just get recreated when you connect the new SS.

If not, it's on the remote server where you've configured it within SS config. Use rtorrent's file manager to delete it "scanfs"

https://releases.ubuntu.com/18.04/

[casperse]

I really cant find this tmp foler? (I left it as standard) on the remote server?
I am using the filemanager on rtorrent but the tmp dir is empty?

Thanks for the link!

[quadcom]

So here's what I have mine set to

This will create a folder at the root level of your login which will make it easier to find and ensure that it does get created without there being a write permissions error.

[casperse]

Okay I tried changing the path and I got this error.

Seems it cant create the directory? (It has full access to my seed server)

I then did a SSH and created the folder and it worked:
2021/10/27 08:43:40 - INFO - RemoteScanner.RemoteScanner - Installing local:/usr/lib/seedsync/scanfs to remote:scanner/scanfs

But the speed is very slow?

I got much faster speeds before, I have done the same allocation of RAM & Cores
Cpu usage is much better:

Then sometimes it just stops?

I have tried to create new folders on the remote server to see if it would start but no its on pause?

I then run the debug logs to see what it was doing:
`2021/10/27 07:25:19 - DEBUG - LocalScanner - Running a scan

2021/10/27 07:25:20 - DEBUG - RemoteScanner.RemoteScanner.Sshcp - Return code: 0

2021/10/27 07:25:20 - DEBUG - RemoteScanner.RemoteScanner.Sshcp - Command took 1.029s

2021/10/27 07:25:20 - DEBUG - RemoteScanner - Scan took 1.050s

2021/10/27 07:25:20 - DEBUG - seedsync - Persisting states to file

2021/10/27 07:25:23 - DEBUG - LocalScanner - Scan took 3.992s

2021/10/27 07:25:23 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents'

2021/10/27 07:25:29 - DEBUG - LocalScanner - Running a scan

2021/10/27 07:25:31 - DEBUG - LocalScanner - Scan took 2.479s

2021/10/27 07:25:39 - DEBUG - LocalScanner - Running a scan

2021/10/27 07:25:41 - DEBUG - LocalScanner - Scan took 2.439s

2021/10/27 07:25:48 - DEBUG - RemoteScanner - Running a scan

2021/10/27 07:25:48 - DEBUG - RemoteScanner.RemoteScanner.Sshcp - Command: ssh -p 22 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o LogLevel=error -o PasswordAuthentication=no [email protected] "'/tmp/scanfs' '/home/user/data'"

 `
And it is working it is scanning the folders?
If I do a normal FTP transfer I get speed around +50 Mb/s?

I am almost ready to give up, any suggestion you might have to why this is happening?
it cant be a user access problem because its working just not very effective :-)

Again thanks for trying to help me out I have learned allot about Ubuntu LOL

[casperse]

I think the reason the speed is so slow is because its not transferring any files just checking files!
But if I do a local search I can see unfinished transfers:

So there should be plenty to do
2021/10/27 09:10:22 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:23 - DEBUG - RemoteScanner.RemoteScanner.Sshcp - Return code: 0 2021/10/27 09:10:23 - DEBUG - RemoteScanner.RemoteScanner.Sshcp - Command took 1.073s 2021/10/27 09:10:23 - DEBUG - RemoteScanner - Scan took 1.096s 2021/10/27 09:10:23 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:24 - DEBUG - seedsync - Persisting states to file 2021/10/27 09:10:25 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:28 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:28 - DEBUG - LocalScanner - Scan took 10.450s 2021/10/27 09:10:28 - DEBUG - LocalScanner - Running a scan 2021/10/27 09:10:30 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:32 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:34 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:36 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:38 - DEBUG - LocalScanner - Scan took 10.321s 2021/10/27 09:10:38 - DEBUG - LocalScanner - Running a scan 2021/10/27 09:10:38 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:41 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:42 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:44 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:46 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:48 - DEBUG - LocalScanner - Scan took 10.072s 2021/10/27 09:10:48 - DEBUG - LocalScanner - Running a scan 2021/10/27 09:10:48 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:50 - DEBUG - seedsync.Controller.Model - LftpModel: Updating file 'torrents' 2021/10/27 09:10:52 - DEBUG - RemoteScanner - Running a scan

(This is only after I push the manually start queue button)

[quadcom]

Can you post a screenshot of your SS config please

We don't need your server det.

[casperse]

Sure thing anything that can help

[General]
debug = True
verbose = False

[Lftp]
remote_address = server.seedhost.com
remote_username = username
remote_password = password
remote_port = 22
remote_path = /home30/username/data
local_path = /mnt/data
remote_path_to_scan_script = scanner/
use_ssh_key = True
num_max_parallel_downloads = 1
num_max_parallel_files_per_download = 1
num_max_connections_per_root_file = 10
num_max_connections_per_dir_file = 10
num_max_total_connections = 10
use_temp_file = True

[Controller]
interval_ms_remote_scan = 30000
interval_ms_local_scan = 10000
interval_ms_downloading_scan = 1000
extract_path = scanner/
use_local_path_as_extract_path = True

[Web]
port = 8800

[AutoQueue]
enabled = True
patterns_only = False
auto_extract = True
[General]
debug = True
verbose = False

[Lftp]
remote_address = server.seedhost.com
remote_username = username
remote_password = password
remote_port = 22
remote_path = /home/username/data
local_path = /mnt/data
remote_path_to_scan_script = scanner/

[casperse]

Or as a picture:

[quadcom]

I'm curious about the scanner location.

That path is relative to the dir that you are presented when logging in on the server. In my case I am presented with a writable dir so I am able to create the scanner dir. I've had it before with other hosts that the dir that I get logged into, I don't have write permission so I couldn't get anything working.

I noticed in the server path it started with '/home'. Normally this is the users for folder which your wouldn't have access too write to. I looks to me like you are pulling directly from the location that rtor saves dl's to. I think this can cause problems since there will be partial files constantly being written to.

Use the automove features of rtor, that's the folder that SS should pull from. The download folder of rtor can be the original data folder you have but you should either move or hotlink completed dl's to the folder that SS pulls from (ie data/sync). Mine's called 11-sync so it stays at the top in file manager. You can then store the scanner file in the root data store with the rtor dl's (/data/scanner/).

It's hard to determine completely when certain fields are redacted (understandibly).

Another thing I have noticed is if your local storage is a NAS. Your downloads will slow down if your array is data-scrubbing or re-silvering (each NAS provider had their own term). This isn't an issue with SS but it appears like it.

[quadcom]

remote_path = /home/username/data/11-sync
local_path = /mnt/data
remote_path_to_scan_script =/home/username/data/scanner/

remote_path_to_scan_script is entirely dependant on where you end up when logging in via SSH AFAIK.

[casperse]

My NAS is a Unraid server so it writes to my cache drive (nvme very fast-no bootlenecks) and get moved over night to the array, so not a problem - I also placed the VM with seedsync on a nvme drive and I can even bypass the virtuel LAN with a dedicated 3COM LAN card direct VM passthrough if I thought it would help?

No the remote server path is writable (I created the directory with the same user and password in SeedSync)
its placed at:

/home/username/scanner
I can move it to /home/username/data/scanner like you?

The tunnel also works no more use off passwords (The log file on the remote server shows this)

local path is my:
mnt/data/

Remote path is:
/home/username/data

All temp files are in the:
/home/username/data-incomplete

All files get moved when complete (Still seeding) to:
/home/username/data/torrents/tv/downloaded-foldername/file.mkv
/home/username/data/torrents/movies/downloaded-foldername/file.mkv
/home/username/data/torrents/music/downloaded-foldername/file.mkv

Seedsync - Is setup to sync my to folders under data to my local mnt/data/
/home/username/data/torrents
/home/username/data/usenets
(I could just have used synch for data, but I would like to see what part its downloading)

This structure is actually used by many-many people and described in the below Trash guide:
https://trash-guides.info/Hardlinks/How-to-setup-for/Unraid/#folder-structure

[casperse]

its not a access problem, I dont think Seedsync creates the dir?

[casperse]

I managed to get this out from the terminal - the UI was unresponsive

So even with 4G of ram over time - it crashes (I did try to run two processes so this could be why, but I think I saw this before I did this)

[TheFeelTrain]

I'm not sure if this is quite the same problem but mine will also randomly stop/pause, nothing in the logs.

My scanner is a writeable folder, and most of the time it works fine. Until it doesn't. I have to manually unpause it once or twice a week.

[cproxy]

Same here.