Unable to Package [to .mov] using 20221017/ Mac

[dmdunham]

David Dunham from OHC of UCBerkeley here. We were able to capture an 0:08:45 MiniDV tape using 20221017/ Mac today, but unable to execute Package to .mov. Maybe I am not seeing the execute button? User error certainly possible. File is under 2 GB. Screenshot attached.

For our previous efforts with first version we tried [10122017 perhaps], our first 3o minute tape captured to .dv completely, but none of our test full hour tapes captured completely.

Right now, would love to test the package to .mov with our goal of stitching oral history interviews from multiple tape into single session video and audio files. Thank you. David

[dericed]

Hi @dmdunham, thanks for contributing an issue. @libbyhopfauf also started a related issue about redesigning the interface a bit to make it more intuitive. The 'execute' button is the gray/black "PACKAGE" button in the top, to the left of the mov/mkv selection. Not great placement, we know. Let us know if this works otherwise for you. :)

[dmdunham]

Thanks for clarifying the PACKAGE button. Got it now. However, our 8m45s file has been in process > 3 hours. I'm hoping it should be faster than this, and I think this was the same indefinite cycle Georgia experienced in testing last week with previous versions of DVRescue. We are no using the most recent 20221017 version. Attaching screenshot in case that adds any info. Let me know if you have any suggestions. Are you successfully using PACKAGE to .mov? Do we need to download anything besides the .dmg file for Mac? Apologies if that's a stupid question and we do need to do so. Thanks again. David D

[dericed]

Hi David, ooo I thought that had been fixed since the 2022-10-11 build. Can you check and see if the output mov file and see if it plays and seems complete? Normally when the GUI gets ffmpeg to start packaging then it changes from the gray system to the arrow and then it runs and a pass or fail is returned so that it changes to a green checkmark (done) or red x (error). Seems like the process isn't returning a result to the gui.
Would you mind clicking on the DEBUG part and pasting in the info here?

[GeorgiamMiraeC]

Hi Dave,
I tried to package the clip again and now I'm getting the three blue dots symbol.
I hit DEBUG and this is what I got:
beginning commands log
/bin/bash /Applications/dvrescue.app/Contents/Helpers/dvpackager -v -X /Applications/dvrescue.app/Contents/Helpers/xmlstarlet -a n -T /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv

/bin/bash /Applications/dvrescue.app/Contents/Helpers/dvpackager -v -X /Applications/dvrescue.app/Contents/Helpers/xmlstarlet -a n -o /Users/oralhistorycenter/Desktop/_DVrescue tests -T /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv

||||||||||||2|||||||/Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1_part1.mov

||||||||||||2|||||||/Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1_part1.mov

/bin/bash /Applications/dvrescue.app/Contents/Helpers/dvpackager -v -X /Applications/dvrescue.app/Contents/Helpers/xmlstarlet -F /Applications/dvrescue.app/Contents/Helpers/ffmpeg -D /Applications/dvrescue.app/Contents/Helpers/dvrescue -M /Applications/dvrescue.app/Contents/Helpers/mediainfo -z -a n -o /Users/oralhistorycenter/Desktop/_DVrescue tests/DVRescue downloads -x /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv

#CONDENSE_OPTS is set to -s

#Using /Applications/dvrescue.app/Contents/Helpers/ffmpeg for ffmpeg operations.

Operation not permitted: /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml
Operation not permitted: /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml
failed to load external entity "/Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml"

#No xmlstarlet error

#DV_FRAME_COUNT=()

#SOURCE_FORMAT=()

#Trying to present a table of ranges

Operation not permitted: /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml
Operation not permitted: /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml
failed to load external entity "/Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml"

The results will be written to /Users/oralhistorycenter/Desktop/_DVrescue tests/DVRescue downloads

Operation not permitted: /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml
Operation not permitted: /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml
failed to load external entity "/Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml"

Packaging started: /Users/oralhistorycenter/Desktop/_DVrescue tests/DVRescue downloads/flapan_02_test1_part1.mov

(standard_in) 1: parse error

(standard_in) 1: parse error

Operation not permitted: /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml

Operation not permitted: /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml
failed to load external entity "/Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml"

#The audio range sublist (from frame to ) is

#Writing a chapter track at /var/folders/_0/kxv6ryfs3kb1b511v_623yv00000gp/T/net.MediaArea.dvrescue.mac-gui/dvpackager.XXXXXX.OGXXlMnM.ffmetadata.

Operation not permitted: /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml
Operation not permitted: /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml
failed to load external entity "/Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv.dvrescue.xml"

#Found 1 point(s) for chapter marks.

#Skipping the process to embed chapters since there would only be one.

#Trying to run: /Applications/dvrescue.app/Contents/Helpers/ffmpeg -y -nostdin -hide_banner -ss � -i /Users/oralhistorycenter/Desktop/_DVrescue tests/flapan_02_test1.dv -map 0:v:0 -c:v:0 copy -f rawvideo - | ffmpeg -y -nostdin -hide_banner -i - -filter_complex concat=n=0:v=0:a=1[aud] -t � -c:a pcm_s16le -c:v:0 copy -f mov -map 0:v:0 -map [aud] /Users/oralhistorycenter/Desktop/_DVrescue tests/DVRescue downloads/flapan_02_test1_part1.mov

Invalid duration specification for ss:

pipe:: Invalid data found when processing input

ERROR: flapan_02_test1_part1.mov is expected but missing. Please retry with the -v option and report to https://github.com/mipops/dvrescue/issues.

ERROR: flapan_02_test1.dv contained DV frames, but the outputs contain 0 frames of DV and 0 were skipped

Packaging flapan_02_test1.dv

Segmentation options. Split on: Recording_Start_Marker = 0, Recording_Timestamp_Jump = 0, Timecode_Jump = 0, Audio_characteristics_change = 0, Aspect_Ratio_change = 1

St='Flagged Start of a recording', ncTC='non-continuous timecode value', ncR='non-continuous recording timestamp value'

| PTS Range | Duration | Frame Range | Byte Range | Timecode | Recording Timestamp | Size | Frame Rate | DAR | ChSub | Audio | St | ncTC | ncR |

1 | - | 0.000 | 0 - 0 | 0 - 0 | | | | | | | 2ch 0 | | | |

[GeorgiamMiraeC]

Okay wait, after looking at the code I realized we needed to click the segment options. After I clicked all of the segment options except for audio setting change, exporting the file to .mov completely worked. So just to clarify, the segment options are necessary and we need to use them.

[GeorgiamMiraeC]

I've tried it again with a longer interview but so far I'm just getting the spinning orange arrow.
Edit: Okay I got the longer video downloaded, but it's in multiple segments. Is there a way to just get 1 video?
Edit: Okay it now seems to be working when I don't click any of the segment options and it exports it as 1 video

[GeorgiamMiraeC]

Hi Dave,
Alright from my experience, sometimes the software will work and I can export the file to .mov and other times I will just get an indefinite spinning orange circle. I thought selecting the segments was a factor, but it doesn't seem to make a difference. Also, I left a tape to be captured overnight and all I have is a page of code and no video. This has never happened before though and the capture function usually works well. When we're able to get the video captured and exported to .mov it looks great and works really well with Premiere Pro! We're all so excited about DVRescue and really grateful that you're letting us use it, thank you!

[dericed]

Hi @GeorgiamMiraeC I'm grateful for your work on troubleshooting this. Could you email me the dvrescue xml files for these files or zip them and drop them in a message here. That may help me recreate the issue better.

[GeorgiamMiraeC]

Hi @dericed I just wanted to update you. I downloaded the most recent version of dvrescue which has the date 10/29/2022. I was able to capture a video but it came out short, the tape length is 0:12:42 and dv captured 0:12:19. I'm still having some trouble with the packaging, I just get an orange spinning arrow. I can send you xml files but Github says they won't support the files. Let me know if you have any recommended ways I can upload xml files to Github. If there's any more info you need let me know! Thank you

[GeorgiamMiraeC]

Hello,
I was able to package two videos to .mov files, one that is 12 minutes and one that is a half hour long. The packaging for both worked after I restarted the computer. However, when I restarted the computer for a third time and tried to package a third video I just received the orange spinning arrow. I'm testing the capturing and so far it successfully captured a short 12 minute video. Thanks!

[GeorgiamMiraeC]

Hello,
I hope you're doing well!
I shared a google drive folder that has xml files and a spreadsheet detailing our experience with DvRescue. From my experience the primary issue we're having is that it's not consistently capturing and packaging the videos. Usually when I try to package a video I receive the orange spinning arrow. Occasionally if I restart the computer the packaging will work. Capturing is definitely better, but I've noticed the video occasionally skips. In the subfolder 11/05/2022 I attached a video in case you wanted to see the skipping. It occurs at 0:2:15. I also noticed that when I was uploading the xml files to the drive many of them had "no data" and appeared blank. I've detailed those below.
subfolder: Miscellaneous
gowan_fred_02_10142008
gowan_fred_03_10142008
gowan_fred_tape02_recaptured
subfolder: Version 10/20/2022
gowan_01_test10202022
subfolder: Version 10/22/2022
klein_daniel__03
subfolder: Version 10/29/2022
gowan_fred_tester
subfolder: Version 11/05/2022
All the xml files say they have no data.
Let me know if you have any questions or need any info. Thank you!

[dmdunham]

@dericed Wanted to see if you have had a chance to review the Google Drive folder with spreadsheet and xml files to help troubleshoot our experiences with DVRescue thus far.

Also, Georgia and I should be able to join your DVRescue workshop tomorrow. We may have to sit together at our DVRescue setup. Do we need two tickets to the workshop or is one okay?

What do you recommend for a cleaning tape?

Thanks again,

David

[dericed]

Oh, glad you're coming. We have a pull request finalizing soon which may help the situation you mentioned. See you soon. :)

[libbyhopfauf]

@dmdunham this was the cleaning tape I mentioned in the workshop yesterday. There are other brands out there and I am sure they work fine, I just haven't had any experience with them because these ones are usually the cheapest readily available option.

@dmdunham @GeorgiamMiraeC have you've tried using a different/new Firewire cable or different deck with any of these set-ups? Also, in the email I just sent, I asked if you'd had any success or experience with using the DVCapture tool in vrecord? I'm just wondering if what you're experiencing is a hardware issue vs. a software one.

[libbyhopfauf]

@dmdunham @GeorgiamMiraeC here are a few more additional thoughts I had after testing out one of the files you sent and reviewing the comments in your spreadsheet:

• The image being out of sync in the DVRescue GUI player vs. the display on your deck during capture is normal and should not affect the capture, it’s just the delay between what is playing and it being captured which is common for most capturing software. So no need to worry about that.
• It’s very strange that the XML docs are blank for a lot of the captures that you uploaded to Google Drive. Even though this should no longer be an issue, I’m wondering if you’ve either tried the newest version of DVRescue or if you’ve installed the corresponding CLI for any of these? It just seems like the dependencies aren’t properly communicating somehow?
• When I imported the Dynes_Robert_Tester2.dv file into dvanalysis, no information showed up at all, which is very strange, especially because I expected there to at least be some sort of deck error where the tape skips. Just to clarify, the tape does not do this when played back right? It’s purely something weird that happened during the capture? I only ask because after going through the following processes, the metadata seems to be pointing to it being recorded into the tape, but I’m not sure.
  • I deleted the corresponding XML file and ran the DV file through dvplay and was able to get more information. It looks like there is a possible headclog from the JPEGs generated.
  • After I ran the file through dvplay -x and it generated a new XML, when I imported that into dvanalysis, I again got a lot more information. It looks like there are a few places where the recording skips or speeds up. The analysis tool has flagged those frames as nonconsecutive and jumping ahead. For those frames, the timecode stays the same, but the recording time jumps ahead 10 frames or so for each.
  • Dave might have a better idea about how this would be happening, but I suspect there’s something going wrong with the communication between something regarding the background tools, especially since they are generating blank XML files. And this makes me think that the CLI tools are either not properly set-up to communicate with the GUI. If you have time to test either installing the newest version of the GUI or the corresponding version of the CLI for the version of DVRescue that you are using. I wonder if that might help resolve the issue.
    I uploaded all of the files I generated to Google Drive here. This includes the MOV I was able to package from the file.

[dericed]

Hi @dmdunham @GeorgiamMiraeC, I wanted to share that we did some updates to the packaging interface. Could you review the new build at https://mediaarea.net/download/snapshots/binary/dvrescue-gui/20230322/

[libbyhopfauf]

@dmdunham @GeorgiamMiraeC I just wanted to circle back and see if this was still an issue you are encountering. The packaging issues you were experiencing should hopefully be resolved, but there is currently an issue with ffmpeg and packaging to MOV (MKV is unaffected). Please see issue #950 for details.