Modernize Firmware Testing Infrastructure and Broaden OS Compatibility Testing

[pietrushnic]

This issue highlights the need to improve our firmware testing processes to ensure they meet modern standards and effectively address community needs.

Identified Issues:

• Outdated Operating Systems and Kernels: Our testing currently relies on outdated OS versions and Linux kernels, such as Debian 9 with older kernels, TinyCore Linux 6.4, Xen hypervisor 4.8, Ubuntu 16.04, and Voyage Linux.
• Limited OS Variety: The variety of operating systems tested is too narrow, lacking coverage of newer systems crucial to our community, like OPNsense.

Planned Actions:

• Update OS and Kernel Versions: Upgrade the operating systems and Linux kernels to current versions to align with industry standards and enhance security.
• Expand OS Testing: Integrate additional relevant operating systems, such as OPNsense, into our testing routine to increase the relevance and utility of our compatibility checks.

NFS Reliability and Storage Issues:

• Problems with NFS: Our reliance on NFS for testing has proven unreliable.
• Storage-Related Issues: Issues potentially related to USB or SD card storage have been observed during tests.

Solutions:
Modernize Testing Infrastructure: We will transition from our legacy validation infrastructure to the new system as outlined in Dasharo Open Source Firmware Validation. This change will address NFS issues and introduce more robust mechanisms, like using netboot.xyz for OS installations.

• Address Storage Problems: Conduct in-depth investigations and remediate issues with USB and SD card storage to ensure a stable testing environment.

Additional Notes:
Implementing these changes will bring our firmware testing up to date with technological advancements and community expectations, thereby enhancing the reliability and effectiveness of our firmware updates.

Reference:
For a detailed discussion on related issues, see Dasharo Issue #844.

This approach keeps the GitHub issue concise, focused on actionable improvements, and easy to follow, facilitating better tracking and implementing necessary changes.