New install, images in tmp but WEBPortal shows no images

[bemo47]

Hi,

I did a fresh install on Pi4 with an ASI224 and it was working fine. Images were going in the Images folder on the Pi, and the Webgui was showing the live image and all list of images already stored.

Due to some linux issues, i decided to reinstall from scratch, Raspbian, Allsky, Webgui.

Now all images goes to temp and Webgui doesn't find any images.

Looks like there is a mix between tmp and images which has not been created this time.

I don't understand what i have done wrong....

[EricClaeys]

@bemo47 Did you follow the directions here exactly? It's very important to not simply copy the old config.sh file to the new one.
If you did follow the directions, please attach your config/config.sh file. Also, in the WebUI's "Live View" page, press F12 and on the right side click on the "Network" link (you may need to click on the ">>>" first). Then refresh the page and see what image the WebUI is trying to get. The URL will probably be highlighted in red.

[bemo47]

Yes, i followed exactly the same process as the first time, as described in the allsky page here, exact linux commands one after the other.

But this morning, surprise, the image folder is here !!!

What i see is that up to 2am this night all images were going to tmp folder, and at 2am, the image folder has been created and now all images are going in it, normally.
Seems to be something in the code doing that at 2pm i guess, each night ? or not... don't know...
Only thing strange is that the subfolder created is 20220107 and it should have been 20220108, all images inside are 20220108.
Also the Gui is now showing live image and files as they are at the correct place.

I will wait 24hrs and check what happens...

Here the image folder

Here the tmp folder

config.sh.txt

[bemo47]

And now the tmp has been emptied, but the images have not been copied to the image folder, just deleted.
Thats not an issue, only tests.. and what i noticed is that all images are written first to tmp and then, rifht after moved to image, every image goes first to tmp before image.
Now it seems working, except the daily folder which is from yesterday date....

[EricClaeys]

@bemo47 Check your latitude, longitude, and angle in the WebUI.
The tmp folder should only have one file with the date in its name, and that is only while it is being processed.
I will look in more detail tonight.

[bemo47]

Hmm, yes, right, i didn't update these fields in the webui, as i am still debugging, ok so, i will now !

[bemo47]

So i did the update of latitude and longitude but allsky start gaain to store all images in the tmp folder
I will wait to see when it will create the right one in images folder
Right before the change it was writing in the images folder with the right subfolder dated today.

config.sh.txt

[bemo47]

sorry, lat & long were wrong, here are the right ones, but same behaviour, still writing in the tmp folder all images

config.sh.txt

and webui not finding any images which sounds normal

[bemo47]

and again around 6pm here it changes by starting saving images to the right folder "images"... not so critical, just strange behaviour... but at the end it works...

fyi, i have mapped the image folder on my NAS so now it is writing directly to my NAS... not sure if all will work fine, timelapses, etc... but will see...

[EricClaeys]

@bemo47 6 pm is likely when you've told Allsky your night begins, via the Angle setting. See this Wiki page for how to determine your day/night times.

You've told Allsky to take pictures during the day but not save them (DAYTIME_SAVE="false"), which is why they aren't being saved to allsky/images during the day. However, there's a bug in the code that doesn't delete the images from allsky/tmp if you're not saving them - I just looked at the code based on your note. Thanks for pointing that out.
When allsky starts it clear allsky/tmp of any old images, which is why they eventually go away.

[EricClaeys]

@bemo47 Would you please try the attached file? It should fix the problem of the daytime images staying around in allsky/tmp.
To use it:

cd ~/allsky/scripts
mv saveImage.sh saveImage.sh-OLD
# copy the attached file, renaming it to saveImage.sh

Then see if any more daytime files are sticking around in allsky/tmp.
saveImage.sh.txt

[bemo47]

I am trying to test, but before i want to check if i still have the issue.
So i set again the DAYTIME_SAVE to "false", restart Allsky, now time is 6:30pm, hope night is not started ?
Anyway, no images goes to the images folder, but tmp stays clean, i can see images writtent to tmp and then deleted immediately.

So..... without the new saveImage.sh it seems to work normally.

Unclear, but should i test further the changes you made in this script ? I will just check if it works the same as i am not able to reproduce the issue...

here tmp folder after several images taken and not saved in the images folder of the day

[bemo47]

i tried also to empty the images folder, to be in the same condition, just after initial install, but same tmp is cleaned
one difference is that thre are some other files in the tmp now... but day images are cleaned

sorry

[EricClaeys]

@bemo47 FYI, The allsky/tmp directory is used for all temporary files, i.e., ones that can be deleted at a reboot. This includes image.jpg which is recreated the next time you start allsky, and a few *.txt files which are used for debugging if needed.
If you make allsky/tmp a memory-resident filesystem, it'll save a LOT of wear on your SD card, since that directory is where the majority of the Allsky processing is done.

[EricClaeys]

@bemo47 That's strange. I can explain the failure to remove the files - it's clearly a bug in the code, but I can't explain why it's working now, unless you're using the file I uploaded. Do a "tail scripts/upload.sh" and see if there's a line that includes # If it's daytime and we didn't.... If so, that's the new file.
When is your nighttime? It's also possible it's BEFORE 6;30 pm? Run this to see your sunrise and sunset times:

( cd ~/allsky; source config/config.sh; ./sunwait list angle $(jq -r ".angle,.latitude,.longitude" ${CAMERA_SETTINGS}) )

[bemo47]

Okkk, so...

1 - my night was starting before 6:30pm, so test conditions ere not ok
2 - i tried now, 11am, and i got the tmp keeping all images when daytime-save=false
3 - i changed the saveimage with the new one and searched for 15mins how to give exécution rights :) but ok
4 - after reboot : all is OK, tmp doesn't keep images, so the change is valid !

Thanks

[EricClaeys]

@bemo47 Excellent! Thanks for testing it. I just submitted the change. It should be approved in a few days. You don't need to grab it since it's exactly the same file I sent you.

[bemo47]

but maybe i need to apply the 8.3 version ?

One remark : how can we check which version we use ? I thought that in the System menu of GUI i could see it but its not mentionned...

[EricClaeys]

@bemo47 You can look in /var/log/allsky.log for "Software". It'll list the version.
It's somewhat hard to define a version when there are a lot of pieces that can change independently. Not just the "capture" program (which adds the version to the log file), but all the scripts/* files.

[bemo47]

Ok, found it, already 0.8.3 !