From 724b8f76e700c19f95f5cdb494b2356b082ffb65 Mon Sep 17 00:00:00 2001 From: Sara Date: Sun, 1 Mar 2020 15:01:41 -0800 Subject: [PATCH] Updated with 1.11 features I've added tests for the following: * Transfer name with diacritics archivematica/Issues#1051 * Transfer has filenames with diacritics and a metadata.csv archivematica/Issues#1073 * PREMIS event import archivematica/Issues#710 * identifiers.json import archivematica/Issues#963 * Directory-level AIP metadata is indexed archivematica/Issues#888 * Directories not greyed out if there are still files that can be arranged archivematica/Issues#822 * Reingest encrypted AIP archivematica/Issues#820 * Zipped bag containing custom processing config archivematica/Issues#771 * Download AIP METS file archivematica/Issues#644 * Descriptive metadata added through GUI is indexed for searching archivematica/Issues#547 * Processing storage usage screen update archivematica/Issues#312 * User with accented characters archivematica/Issues#261 * Change filenames archivematica/Issues#230 * Start SIP using tags archivematica/Issues#1052 * Zipped directory transfers archivematica/Issues#682 --- regression-testing-checklist.csv | 62 +++++++++++++++++++------------- 1 file changed, 38 insertions(+), 24 deletions(-) diff --git a/regression-testing-checklist.csv b/regression-testing-checklist.csv index 7210039..d0eb298 100644 --- a/regression-testing-checklist.csv +++ b/regression-testing-checklist.csv @@ -10,7 +10,7 @@ Functional Area,ID,Feature,Then,External tools,Severity,Current Coverage in AMAU 1 - Transfer Types,1.4,When *SampleTransfer/DSpaceExport* (or one of the zips contained inside) is processed using the DSpace transfer type,"- [ ] The Identify DSpace files microservice executes successfully AND - [ ] All standard AIP structure and METS structure criteria apply",,High,None, 1 - Transfer Types,1.5,When *SampleTransfer/ISODiskImage* is processed using the Disk Image transfer type AND disk image metadata has been added before the transfer is started,"- [ ] The disk image metadata ends up in the AIP METS AND -- [ ] All standard AIP structure and METS structure criteria apply",tsk_recover (Sleuthkit); unrar-free,Medium,None, +- [ ] All standard AIP structure and METS structure criteria apply",tsk_recover (Sleuthkit), unrar-free,Medium,None 1 - Transfer Types,1.6,"When the three Dataverse sample transfers (*SampleTransfers/Dataverse/AStudyOfMyAfternoonDrinks*, *SampleTransfers/Dataverse/NDSAStaffingReport*, *SampleTransfers/Dataverse/XRayScansOfPolyodonSpathula*) are processed using the Dataverse transfer type AND Archivematica is not set to delete packages after extraction","- [ ] Microservice: parse external files succeeds AND - [ ] Dataverse metadata is parsed into the METS, e.g. DDI information for author and institution AND - [ ] All standard AIP structure and METS structure criteria apply",,Low ,Excellent,create-aip.feature @@ -30,6 +30,9 @@ Functional Area,ID,Feature,Then,External tools,Severity,Current Coverage in AMAU 2 - Transfer Variants ,2.8,"Given that a processing configuration XML file is included in the transfer When the transfer is processed as a Standard transfer","- [ ] then the Transfer and Ingest processing will follow the decisions set out in the processing configuration XML file, rather than the default configuration",,Medium,None, +2 - Transfer Variants ,2.8,"Given that a processing configuration XML file is included in the transfer + +When the transfer is processed as a Zipped Bag transfer","- [ ] then the Transfer and Ingest processing will follow the decisions set out in the processing configuration XML file, rather than the default configuration",,Medium,None, 2 - Transfer Variants ,2.9,When structural metadata is included in a Transfer using a mets_structmap.xml file,- [ ] the provided structural map will be included in the AIP METs file. ,,Low,None, 3 - Checksums & Integrity Checking,3.1,"When a transfer includes invalid external checksums (*TestTransfers/fixityCheckShouldFail*)","- [ ] Then the job ""Verify metadata directory checksums"" on the Transfer tab fails AND @@ -44,16 +47,15 @@ When the transfer is processed as a Standard transfer","- [ ] then the Transfer 4 - Virus scanning,4.2,When a transfer that does not contain a virus is processed,"- [ ] The job ""Scan for viruses"" will complete successfully ",,High,Excellent,virus.feature -5 - Package Extraction,5.1,When a transfer containing a package (*SampleTransfers/OfficeDocs*) is processed with the extract packages option set to Yes,"- [ ] The job ""Extract contents from compressed archives"" completes successfully AND -- [ ] a directory with the same name as the package + the timestamp of the unpacking event is created to contain the extracted contents AND -- [ ] sanitization, virus scanning, and file identification are run on the extracted contents AND -- [ ] the extracted contents are checked for further packages, which are then extracted &etc. AND -- [ ] an unpacking PREMIS event is created",,High,Excellent,extract-package.feature -5 - Package Extraction,5.2,When a transfer containing a broken package (*TestTransfers/broken_package_format_types*) is processed with the extract packages option set to Yes,"- [ ] The job ""Extract contents from compressed archives"" will fail (note: dashboard shows a success; known issue) AND -- [ ] the standard output indicates which file caused the job to fail AND -- [ ] the ""Failed transfer"" microservice will be triggered",,Medium,Excellent,extract-package.feature -5 - Package Extraction,5.3,"When a transfer containing a package (*SampleTransfers/OfficeDocs*) is processed with ""Extract packages"" set to Yes and ""Delete packages after extraction"" set to Yes",- [ ] The resulting AIP will not contain the original package,,Medium,None, -5 - Package Extraction,5.4,"When a transfer containing a package (*SampleTransfers/OfficeDocs*) is processed with ""Extract packages"" set to Yes and ""Delete packages after extraction"" set to No",- [ ] The resulting AIP will contain the original package,,Medium,None, +Special Characters,,When a transfer contains files and directories with non-ASCII characters in the file/directory name (*TestTransfers/badNames*),"- [ ] Then the ""Change transfer filenames"" microservice will complete successfully AND +- [ ] the AIP will contain a name cleanup log AND +- [ ] a name cleanup PREMIS event will be present in the METS",,High,None, +Special Characters,,When the transfer name contains non-ASCII characters,"- [ ] Then the ""Change transfer filenames"" microservice will complete successfully AND +- [ ] the transfer’s name will be changed to use ASCII characters",,Medium,None, +Special Characters,,When a transfer contains files with non-ASCII characters in the file name as well as a metadata.csv file (*SampleTransfers/DiacriticsTest*),"- [ ] Then the ""Change transfer filenames"" microservice will complete successfully AND +- [ ] the AIP will contain a name cleanup log AND +- [ ] a name cleanup PREMIS event will be present in the METS AND +- [ ] the METS will contain descriptive metadata for each of the files described in the metadata.csv",,,, 6 - File Identification,6.1,"Given that Siegfried is set as the file identification tool When a transfer is processed","- [ ] Then Siegfried is able to identify file formats and versions accurately AND @@ -89,6 +91,21 @@ When a transfer is processed with ""Perform file format identification (Transfer - [ ] the premis:eventDetail indicates that File Extension version=""0.1"" was the tool used",File extension script,High,None, 6 - File Identification,6.8,"When a transfer is processed with ""Perform file format identification (Transfer)"" set to No","- [ ] Then the standard output for the job ""Identify file format"" will be ""Skipping file format identification"" AND - [ ] there will be no format identification PREMIS events for the transfer objects in the METS",,Medium,None, +5 - Package Extraction,5.1,When a transfer containing a package (*SampleTransfers/OfficeDocs*) is processed with the extract packages option set to Yes,"- [ ] The job ""Extract contents from compressed archives"" completes successfully AND +- [ ] a directory with the same name as the package + the timestamp of the unpacking event is created to contain the extracted contents AND +- [ ] sanitization, virus scanning, and file identification are run on the extracted contents AND +- [ ] the extracted contents are checked for further packages, which are then extracted &etc. AND +- [ ] an unpacking PREMIS event is created",,High,Excellent,extract-package.feature +5 - Package Extraction,5.2,When a transfer containing a broken package (*TestTransfers/broken_package_format_types*) is processed with the extract packages option set to Yes,"- [ ] The job ""Extract contents from compressed archives"" will fail (note: dashboard shows a success; known issue) AND +- [ ] the standard output indicates which file caused the job to fail AND +- [ ] the ""Failed transfer"" microservice will be triggered",,Medium,Excellent,extract-package.feature +5 - Package Extraction,5.3,"When a transfer containing a package (*SampleTransfers/OfficeDocs*) is processed with ""Extract packages"" set to Yes and ""Delete packages after extraction"" set to Yes",- [ ] The resulting AIP will not contain the original package,,Medium,None, +5 - Package Extraction,5.4,"When a transfer containing a package (*SampleTransfers/OfficeDocs*) is processed with ""Extract packages"" set to Yes and ""Delete packages after extraction"" set to No",- [ ] The resulting AIP will contain the original package,,Medium,None, +8 - Characterization,8.1,When a transfer is processed,"- [ ] Then the ""Characterize and extract metadata"" microservice will run AND +- [ ] the appropriate characterization tool for a given format will be triggered AND +- [ ] the characterization tool outputs will be captured in the premis:objectCharacteristicsExtension container + +","FFprobe, ExifTool, MediaInfo, FITS, fiwalk (Sleuthkit)",High,TBC - need to check which tools we use now, 7 - Validation,7.1,When a transfer containing files that can be validated by JHOVE (*SampleTransfers/Images*) is processed,"- [ ] Then the job ""Validate formats"" will complete successfully AND - [ ] it will contain accurate validation information for a given format AND - [ ] one validation for each file will be present in the METS AND @@ -101,11 +118,11 @@ When a transfer is processed with ""Perform file format identification (Transfer When a transfer containing material that meets the policy criteria is processed with ""Perform policy checks on originals"" set to Yes","- [ ] Then the policy check will complete successfully AND - [ ] a validation PREMIS event for the policy check will be created",MediaConch,Low,None, -8 - Characterization,8.1,When a transfer is processed,"- [ ] Then the ""Characterize and extract metadata"" microservice will run AND -- [ ] the appropriate characterization tool for a given format will be triggered AND -- [ ] the characterization tool outputs will be captured in the premis:objectCharacteristicsExtension container +Examine contents,10.2,"Given that a transfer contains a file containing personally identifying information (*SampleTransfers/DemoTransferCSV*) -","FFprobe, ExifTool, MediaInfo, FITS, fiwalk (Sleuthkit)",High,TBC - need to check which tools we use now, +When a transfer is processed with ""Examine contents"" set to Yes","- [ ] Then the Examine contents microservice will complete successfully AND +- [ ] the AIP will contain Bulk Extractor logs +(See also: 14.7)",Bulk Extractor,Low,None, 9 - Normalization,9.1,"Given that a transfer contains file formats for which there are preservation and access normalization rules When the user selects ""normalize for preservation and access"" at the Normalize job ","- [ ] Then the files will be normalized for preservation and access as per the rules AND @@ -160,14 +177,6 @@ When the user reaches the Normalize job and chooses ""Normalize for Preservation When a transfer is processed with ""Transcribe files (OCR)"" set to Yes","- [ ] Then the Transcription microservice will complete successfully AND - [ ] the AIP will contain a text file of the transcribed contents in the /metadata/OCRfiles/ directory",Tesseract,Medium,, -10 - Sanitize Names & Special Characters,10.1,When a transfer contains files and directories with non-ASCII characters in the file/directory name (*TestTransfers/badNames*),"- [ ] Then the ""Clean up names"" microservice will complete successfully AND -- [ ] the AIP will contain a name cleanup log AND -- [ ] a name cleanup PREMIS event will be present in the METS",,High,None, -10 - Sanitize Names & Special Characters,10.2,"Given that a transfer contains a file containing personally identifying information (*SampleTransfers/DemoTransferCSV*) - -When a transfer is processed with ""Examine contents"" set to Yes","- [ ] Then the Examine contents microservice will complete successfully AND -- [ ] the AIP will contain Bulk Extractor logs -(See also: 14.7)",Bulk Extractor,Low,None, 11 - Performance & Resilience,11.1,When multiple transfers are started at the same time,"- [ ] Then Archivematica should gracefully handle processing multiple transfers at the same time (Note: this assumes that the Archivematica machine has enough memory and power to process the transfers; these metrics can be be scaled up significantly as needed.)",,Medium,None, 11 - Performance & Resilience,11.2,When a transfer with a large number of files is processed,"- [ ] Then Archivematica should process the individual files in the transfer as normal @@ -400,6 +409,9 @@ When the user clicks on ""Create an AIC""","- [ ] Then a metadata form will open When the user clicks on ""Download""",- [ ] Then the AIP should be downloaded,,High,, 17 - Archival Storage,17.8,"Given that an AIP has been stored and the user has navigated to the AIP storage page +When the user clicks on ""View"" to view the METS file",- [ ] Then the METS file should be downloaded,,Medium,, +17 - Archival Storage,17.8,"Given that an AIP has been stored and the user has navigated to the AIP storage page + When the user clicks on ""View"" to view the pointer file",- [ ] Then the pointer file should be downloaded,,Medium,, 17 - Archival Storage,17.9,"Given that an AIP with Dublin Core descriptive metadata has been stored and the user has navigated to the AIP storage page @@ -496,7 +508,9 @@ When the user views the dashboard",- [ ] Then the microservice tasks and interfa - [ ] the Agent code should correspond with the version",,Medium,None, 21 - Users & Permissions,21.1,"Given that a user is an administrator -When the user goes to Administration > Users","- [ ] Then the user will be able to add a new user, edit an existing user, or delete a user",,High,None, +When the user goes to Administration > Users","- [ ] Then the user will be able to add a new user, edit an existing user, or delete a user AND +- [ ] the new username can contain non-ASCII characters +",,High,None, 21 - Users & Permissions,21.2,"Given that a user is not an administrator When the user goes to the Administration tab",- [ ] Then the user will not see the Users menu item,,High,,