Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get Packer to start building the AMI in AWS #1

Merged
merged 42 commits into from
Jan 15, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
42 commits
Select commit Hold shift + click to select a range
3362e8d
[ubuntu] Add documentation on .NET core changes for 2404
lawrencegripper Dec 4, 2024
d7a4f1a
Update docs/dotnet-ubuntu.md
lawrencegripper Dec 5, 2024
ee59bae
Update docs/dotnet-ubuntu.md
lawrencegripper Dec 17, 2024
b0bcee8
Get Packer to start building the AMI in AWS
obscurerichard Dec 28, 2024
5e69d9c
[Windows] Add WSL2 to Windows-2025 image (#11242)
Alexey-Ayupov Dec 30, 2024
5a7153b
[windows] Add Android SDK 34 to windows-2025 (#11249)
shamil-mubarakshin Dec 30, 2024
03a8b0f
[windows] Fix WSL pester test (#11255)
shamil-mubarakshin Jan 2, 2025
b8e122b
[macOS] Add Xcode 16.2 Release to macOS14 (#11272)
sureshe456 Jan 3, 2025
92c3ecc
[Windows] removing Pthyon version:3.7.* (#11276)
vidyasagarnimmagaddi Jan 3, 2025
6cc2576
[Ubuntu] remvoving Python Version:3.7.* (#11275)
vidyasagarnimmagaddi Jan 3, 2025
aff0eea
Removing Dotnet version 7.0 from windows (#11278)
hemanthmanga Jan 6, 2025
c4f5865
Removing Dotnet version 7.0 from Ubuntu (#11277)
hemanthmanga Jan 6, 2025
c2becfa
Use all processors when installing zstd (#11067)
fahhem Jan 6, 2025
f1dc6ad
Get working AMI, update docs
obscurerichard Jan 6, 2025
19e81a0
[Windows] Update Service Fabric Versions (#11048)
lawrencegripper Jan 6, 2025
ffe7e6a
Implemented az-cli warmup (#11173)
lanni-energinet Jan 6, 2025
3d5f09a
Add libsql3 to ubuntu-24 (#11300)
kishorekumar-anchala Jan 6, 2025
e513320
[Windows-2025] Remove VS components related to 4.7.SDK (#11248)
Alexey-Ayupov Jan 7, 2025
bc11666
Revert "[Windows] Update Service Fabric Versions (#11048)" (#11318)
subir0071 Jan 7, 2025
4ac5909
Use GitHub markdown alert for note (#11288)
kutt Jan 7, 2025
bb3043b
Updating readme file for ubuntu24 version 20250105.1.1 (#11298)
github-actions[bot] Jan 8, 2025
6d67eed
Updating readme file for ubuntu22 version 20250105.1.1 (#11299)
github-actions[bot] Jan 8, 2025
989ed18
Updating readme file for macos-15 version 20250106.547 (#11307)
github-actions[bot] Jan 8, 2025
f7416ed
Updating readme file for win25 version 20250105.1.1 (#11313)
github-actions[bot] Jan 8, 2025
402d029
Updating readme file for ubuntu20 version 20250105.1.1 (#11302)
github-actions[bot] Jan 8, 2025
5d3ec3e
Updating readme file for macos-15-arm64 version 20250106.544 (#11308)
github-actions[bot] Jan 8, 2025
186e26b
Updating readme file for win22 version 20250105.1.1 (#11310)
github-actions[bot] Jan 8, 2025
2d35c44
Updating readme file for win19 version 20250105.1.1 (#11312)
github-actions[bot] Jan 8, 2025
8f8444e
add delete_on_termination, fmt
obscurerichard Jan 8, 2025
05c04b5
Updating readme file for macos-14-arm64 version 20250106.725 (#11306)
github-actions[bot] Jan 8, 2025
981fb1e
Updating readme file for macos-13 version 20250106.546 (#11304)
github-actions[bot] Jan 9, 2025
c2491bb
Updating readme file for macos-14 version 20250106.587 (#11315)
github-actions[bot] Jan 9, 2025
237fc1c
[macOS] Add .NET 9.0 environment to all images (#11325)
erik-bershel Jan 9, 2025
976232d
Update ubuntu-latest to Ubuntu 24.04 (#11332)
Setland34 Jan 9, 2025
8085da9
[macOS] Add ruby 3.4 to macos images. (#11346)
susmitamane Jan 10, 2025
0b3c476
Merge pull request #11098 from lawrencegripper/lg/dotnet-docs
lawrencegripper Jan 13, 2025
b127d3a
[Windows] Update EdgeDriver signature (#11361)
vidyasagarnimmagaddi Jan 13, 2025
1311053
[Windows] Update maven version to 3.9 (#11321)
vidyasagarnimmagaddi Jan 13, 2025
d1852f5
[Ubuntu] Updated maven version 9.0 (#11337)
vidyasagarnimmagaddi Jan 13, 2025
8184167
Add tags support to image generation script (#11367)
Alexey-Ayupov Jan 13, 2025
f3a98c6
Merge remote-tracking branch 'upstream/main' into fixup-packer
obscurerichard Jan 14, 2025
ef64f5f
Pull changes from upstream, ubuntu-22.04 tested OK
obscurerichard Jan 14, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -397,3 +397,6 @@ launch.json

# Ignore dynamic template
images/*/*-temp.json

# Ignore packer output
software-report.json
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@

# GitHub Actions Runner Images

**Table of Contents**
Expand All @@ -21,8 +20,8 @@ To build a VM machine from this repo's source, see the [instructions](docs/creat

| Image | YAML Label | Included Software | Rollout Status of Latest Image Release |
| --------------------|---------------------|--------------------|--------------------|
| Ubuntu 24.04 | `ubuntu-24.04` | [ubuntu-24.04] | ![Endpoint Badge](https://img.shields.io/endpoint?url=https%3A%2F%2Fgist.githubusercontent.com%2Fsubir0071%2F385e39188f4280878bada99250e99db7%2Fraw%2Fubuntu24.json) |
| Ubuntu 22.04 | `ubuntu-latest` or `ubuntu-22.04` | [ubuntu-22.04] | ![Endpoint Badge](https://img.shields.io/endpoint?url=https%3A%2F%2Fgist.githubusercontent.com%2Fsubir0071%2F385e39188f4280878bada99250e99db7%2Fraw%2Fubuntu22.json) |
| Ubuntu 24.04 | `ubuntu-latest` or `ubuntu-24.04` | [ubuntu-24.04] | ![Endpoint Badge](https://img.shields.io/endpoint?url=https%3A%2F%2Fgist.githubusercontent.com%2Fsubir0071%2F385e39188f4280878bada99250e99db7%2Fraw%2Fubuntu24.json) |
| Ubuntu 22.04 | `ubuntu-22.04` | [ubuntu-22.04] | ![Endpoint Badge](https://img.shields.io/endpoint?url=https%3A%2F%2Fgist.githubusercontent.com%2Fsubir0071%2F385e39188f4280878bada99250e99db7%2Fraw%2Fubuntu22.json) |
| Ubuntu 20.04 | `ubuntu-20.04` | [ubuntu-20.04] | ![Endpoint Badge](https://img.shields.io/endpoint?url=https%3A%2F%2Fgist.githubusercontent.com%2Fsubir0071%2F385e39188f4280878bada99250e99db7%2Fraw%2Fubuntu20.json) |
| macOS 15 <sup>beta</sup> | `macos-15-large`| [macOS-15] | ![Endpoint Badge](https://img.shields.io/endpoint?url=https%3A%2F%2Fgist.githubusercontent.com%2Fsubir0071%2F385e39188f4280878bada99250e99db7%2Fraw%2Fmacos-15.json) |
| macOS 15 Arm64 <sup>beta</sup> | `macos-15` or `macos-15-xlarge` | [macOS-15-arm64] | ![Endpoint Badge](https://img.shields.io/endpoint?url=https%3A%2F%2Fgist.githubusercontent.com%2Fsubir0071%2F385e39188f4280878bada99250e99db7%2Fraw%2Fmacos-15-arm64.json) |
Expand Down Expand Up @@ -121,15 +120,16 @@ The `-latest` migration process is gradual and happens over 1-2 months in order
| Go | 3 latest minor versions |
| Python <br/> Ruby | 5 most popular `major.minor` versions |
| PyPy | 3 most popular `major.minor` versions |
| .NET Core | 2 latest LTS versions and 1 latest version. For each feature version only latest patch is installed |
| .NET Core | 2 latest LTS versions and 1 latest version. For each feature version only latest patch is installed. Note for [Ubuntu images see details.](./docs/dotnet-ubuntu.md) |
| GCC <br/> GNU Fortran <br/> Clang <br/> GNU C++ | 3 latest major versions |
| Android NDK | 1 latest non-LTS, 2 latest LTS versions |
| Xcode | - only one major version of Xcode will be supported per macOS version <br/> - all minor versions of the supported major version will be available <br/> - beta and RC versions will be provided "as-is" in the latest available macOS image only no matter of beta/GA status of the image <br/> - when a new patch version is released, the previous patch version will be replaced |

### Package managers usage

We use third-party package managers to install software during the image generation process. The table below lists the package managers and the software installed.
> **Note**: third-party repositories are re-evaluated every year to identify if they are still useful and secure.
> [!NOTE]
> Third-party repositories are re-evaluated every year to identify if they are still useful and secure.

| Operating system | Package manager | Third-party repos and packages |
| :--- | :---: | ---: |
Expand Down
34 changes: 34 additions & 0 deletions docs/dotnet-ubuntu.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
# Ubuntu .NET Core Versions

.NET has changed the recommended install methods for Ubuntu from 2404.

This document gives an overview of these change and the impact this has on the `runner-images`.

## .NET Core for Ubuntu 2004 and 2204

2004 and 2204 use the [Microsoft Package repository](https://learn.microsoft.com/en-us/dotnet/core/install/linux-ubuntu-install?tabs=dotnet8&pivots=os-linux-ubuntu-2004) to install .NET deb files built and published by the .NET team.

## .NET Core Versions from Ubuntu 2404

The .NET Core team have worked with Canonical and Ubuntu now provides its own .NET packages.

These are the recommended install path and, as-such what is installed on the image.

> The release of Ubuntu 24.04 is just around the corner. Canonical-produced .NET 6, 7, and 8 packages will be available on day one, for "Noble Numbat". Microsoft will not be publishing .NET packages to the 24.04 feed at packages.microsoft.com.
You can read the [full announcement from .NET team here](https://github.com/dotnet/core/discussions/9258). We'll briefly summarize how this change may impact users of the image.

### [`Feature Bands`](https://learn.microsoft.com/dotnet/core/porting/versioning-sdk-msbuild-vs)

Going forward only the `1xx` feature band will be present in the image as Ubuntu only build and publish this band.

> Most distros, including Ubuntu, stick to the .1xx feature band for the lifetime of a major .NET version. They make this choice because .1xx is (effectively) the "compatibility band". Higher bands can have breaking changes.
> This means there will no longer be packages available for .2xx and later feature bands. Such packages have been exclusively available from Microsoft. If users see an incompatibility between .1xx and higher feature bands, we ask that you please report it in the dotnet/sdk repo. [link: dotnet/core discussion](https://github.com/dotnet/core/discussions/9258)
If you need a higher feature band for your Actions the recommendation is to use the [`setup-dotnet`](https://github.com/actions/setup-dotnet) action to install the desired version.

### .NET MAUI

.NET MAUI is [not included](https://github.com/dotnet/core/discussions/9258#discussioncomment-9548857) in the Ubuntu .NET package. There is work [ongoing to fix.](https://github.com/dotnet/core/discussions/9258#discussioncomment-9548857)

You should be able to resolve this by using the [`setup-dotnet`](https://github.com/actions/setup-dotnet) action to install the desired version.
6 changes: 5 additions & 1 deletion images.CI/linux-and-win/build-image.ps1
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,8 @@ param(
[String] [Parameter (Mandatory=$false)] $VirtualNetworkName,
[String] [Parameter (Mandatory=$false)] $VirtualNetworkRG,
[String] [Parameter (Mandatory=$false)] $VirtualNetworkSubnet,
[String] [Parameter (Mandatory=$false)] $AllowedInboundIpAddresses = "[]"
[String] [Parameter (Mandatory=$false)] $AllowedInboundIpAddresses = "[]",
[hashtable] [Parameter (Mandatory=$False)] $Tags = @{}
)

if (-not (Test-Path $TemplatePath))
Expand All @@ -33,6 +34,8 @@ $SensitiveData = @(
': ->'
)

$azure_tags = $Tags.GetEnumerator() | ForEach-Object { "{0}={1}" -f $_.Key, $_.Value } | Join-String -Separator ","

Write-Host "Show Packer Version"
packer --version

Expand All @@ -56,6 +59,7 @@ packer build -var "client_id=$ClientId" `
-var "virtual_network_resource_group_name=$VirtualNetworkRG" `
-var "virtual_network_subnet_name=$VirtualNetworkSubnet" `
-var "allowed_inbound_ip_addresses=$($AllowedInboundIpAddresses)" `
-var "azure_tags={$azure_tags}" `
-color=false `
$TemplatePath `
| Where-Object {
Expand Down
42 changes: 21 additions & 21 deletions images/macos/macos-13-Readme.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@
# macOS 13
- OS Version: macOS 13.7.2 (22H313)
- Kernel Version: Darwin 22.6.0
- Image Version: 20241216.479
- Image Version: 20250106.546

## Installed Software

Expand All @@ -26,7 +26,7 @@
- Mono 6.12.0.188
- Node.js 20.18.1
- Perl 5.40.0
- PHP 8.4.1
- PHP 8.4.2
- Python3 3.13.1
- Ruby 3.0.7p220

Expand All @@ -35,19 +35,19 @@
- Carthage 0.40.0
- CocoaPods 1.16.2
- Composer 2.8.4
- Homebrew 4.4.11
- Homebrew 4.4.14
- NPM 10.8.2
- NuGet 6.3.1.1
- Pip3 24.3.1 (python 3.13)
- Pipx 1.7.1
- RubyGems 3.5.23
- Vcpkg 2024 (build from commit b545373a9)
- Vcpkg 2024 (build from commit 65be70199)
- Yarn 1.22.22

### Project Management
- Apache Ant 1.10.15
- Apache Maven 3.9.9
- Gradle 8.11.1
- Gradle 8.12

### Utilities
- 7-Zip 17.05
Expand All @@ -59,10 +59,10 @@
- Curl 8.11.1
- Git 2.47.1
- Git LFS 3.6.0
- GitHub CLI 2.63.2
- GitHub CLI 2.64.0
- GNU Tar 1.35 - available by 'gtar' alias
- GNU Wget 1.25.0
- gpg (GnuPG) 2.4.6
- gpg (GnuPG) 2.4.7
- jq 1.7.1
- OpenSSL 1.1.1w 11 Sep 2023
- Packer 1.11.2
Expand All @@ -72,17 +72,17 @@
- zstd 1.5.6

### Tools
- AWS CLI 2.22.17
- AWS CLI 2.22.28
- AWS SAM CLI 1.132.0
- AWS Session Manager CLI 1.2.694.0
- Azure CLI 2.67.0
- Azure CLI (azure-devops) 1.0.1
- Bicep CLI 0.32.4
- Cmake 3.31.2
- Cmake 3.31.3
- CodeQL Action Bundle 2.20.0
- Fastlane 2.226.0
- SwiftFormat 0.55.3
- Xcbeautify 2.16.0
- SwiftFormat 0.55.4
- Xcbeautify 2.17.0
- Xcode Command Line Tools 14.3.1.0.1.1683849156
- Xcodes 1.6.0

Expand All @@ -92,11 +92,11 @@
### Browsers
- Safari 18.2 (18620.1.16.111.6)
- SafariDriver 18.2 (18620.1.16.111.6)
- Google Chrome 131.0.6778.140
- Google Chrome for Testing 131.0.6778.108
- ChromeDriver 131.0.6778.108
- Microsoft Edge 131.0.2903.99
- Microsoft Edge WebDriver 131.0.2903.87
- Google Chrome 131.0.6778.205
- Google Chrome for Testing 131.0.6778.204
- ChromeDriver 131.0.6778.204
- Microsoft Edge 131.0.2903.112
- Microsoft Edge WebDriver 131.0.2903.112
- Mozilla Firefox 133.0.3
- geckodriver 0.35.0
- Selenium server 4.27.0
Expand Down Expand Up @@ -133,8 +133,8 @@

#### Python
- 3.8.18
- 3.9.20
- 3.10.15
- 3.9.21
- 3.10.16
- 3.11.9
- 3.12.8
- 3.13.1
Expand Down Expand Up @@ -214,8 +214,8 @@
| Simulator - visionOS 1.0 | xrsimulator1.0 | 15.2 |
| visionOS 1.0 | xros1.0 | 15.2 |
| Asset Runtime SDK for macOS hosts targeting watchOS 9.4 | assetruntime.host.macosx.target.watchos9.4 | 14.3.1 |
| Asset Runtime SDK for macOS hosts targeting iOS 16.4 | assetruntime.host.macosx.target.iphoneos16.4 | 14.3.1 |
| Asset Runtime SDK for macOS hosts targeting tvOS 16.4 | assetruntime.host.macosx.target.appletvos16.4 | 14.3.1 |
| Asset Runtime SDK for macOS hosts targeting iOS 16.4 | assetruntime.host.macosx.target.iphoneos16.4 | 14.3.1 |
| DriverKit 22.1 | driverkit22.1 | 14.1 |
| DriverKit 22.2 | driverkit22.2 | 14.2 |
| DriverKit 22.4 | driverkit22.4 | 14.3.1 |
Expand Down Expand Up @@ -245,7 +245,7 @@
| Android Command Line Tools | 11.0 |
| Android Emulator | 35.2.10 |
| Android SDK Build-tools | 35.0.0<br>34.0.0<br>33.0.2 33.0.3 |
| Android SDK Platforms | android-35-ext14 (rev 1)<br>android-35 (rev 1)<br>android-34-ext8 (rev 1)<br>android-34-ext12 (rev 1)<br>android-34-ext11 (rev 1)<br>android-34-ext10 (rev 1)<br>android-34 (rev 3)<br>android-33-ext5 (rev 1)<br>android-33-ext4 (rev 1)<br>android-33 (rev 3) |
| Android SDK Platforms | android-35-ext14 (rev 1)<br>android-35 (rev 2)<br>android-34-ext8 (rev 1)<br>android-34-ext12 (rev 1)<br>android-34-ext11 (rev 1)<br>android-34-ext10 (rev 1)<br>android-34 (rev 3)<br>android-33-ext5 (rev 1)<br>android-33-ext4 (rev 1)<br>android-33 (rev 3) |
| Android SDK Platform-Tools | 35.0.2 |
| Android Support Repository | 47.0.0 |
| CMake | 3.31.0 |
Expand All @@ -269,7 +269,7 @@
#### Environment variables
| Name | Value |
| ----------------- | ----------------------------------------------------------------------------------------- |
| PARALLELS_DMG_URL | https://download.parallels.com/desktop/v20/20.1.2-55742/ParallelsDesktop-20.1.2-55742.dmg |
| PARALLELS_DMG_URL | https://download.parallels.com/desktop/v20/20.1.3-55743/ParallelsDesktop-20.1.3-55743.dmg |

##### Notes
```
Expand Down
Loading