Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add storage implementation for IndexedDB #496

Merged
merged 7 commits into from
Jan 24, 2025
Merged

Add storage implementation for IndexedDB #496

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
2b7b3de
add Sekiban.Infrastructure.IndexedDb
info-miura Jan 21, 2025
6339066
add Sekiban.Test.IndexedDb
info-miura Jan 21, 2025
1593d95
tweak cache expiry
info-miura Jan 21, 2025
6d02790
add some dependency helpers
info-miura Jan 21, 2025
370c91b
fix runtime builds
info-miura Jan 23, 2025
5c8a7f1
clean up code smells
info-miura Jan 24, 2025
e757707
add IndexedDB backend to regular tests
info-miura Jan 24, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
137 changes: 107 additions & 30 deletions .github/workflows/run_test.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ on:
- "src/**"
- "test/**"
- "samples/**"
concurrency:
concurrency:
group: CosmosDbConnect
cancel-in-progress: false
jobs:
Expand Down Expand Up @@ -52,7 +52,7 @@ jobs:
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoItemsTableDissolvable" "jjga_d_items_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoEventsTableDissolvable" "jjga_d_events_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3Region" "us-west-1"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
Expand All @@ -66,7 +66,7 @@ jobs:
- name: Test dotnet FeatureCheck .NET9
run: |
dotnet test tests/FeatureCheck.Test/FeatureCheck.Test.csproj --filter "Category!=Flaky&Category!=Performance" -v m -c Release -m:1 -f net9.0


regular80Mixed:
strategy:
Expand Down Expand Up @@ -108,19 +108,19 @@ jobs:
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoItemsTableDissolvable" "jjga_d_items_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoEventsTableDissolvable" "jjga_d_events_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3Region" "us-west-1"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
dotnet restore Sekiban.sln
- name: Test Build
run: |
dotnet build Sekiban.sln -c Release

- name: Test dotnet tests/Mixed.Test
run: |
dotnet test tests/Mixed.Test/Mixed.Test.csproj --filter "Category!=Flaky&Category!=Performance" -v m -c Release -m:1 -f net8.0


regularMultitenant:
strategy:
Expand Down Expand Up @@ -163,7 +163,7 @@ jobs:
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoItemsTableDissolvable" "jjga_d_items_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoEventsTableDissolvable" "jjga_d_events_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3Region" "us-west-1"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
Expand All @@ -177,7 +177,7 @@ jobs:
- name: Test dotnet tests/MultiTenant.AggregateTest .NET9
run: |
dotnet test tests/MultiTenant.AggregateTest/MultiTenant.AggregateTest.csproj --filter "Category!=Flaky&Category!=Performance" -v m -c Release -m:1 -f net9.0


regular80Cosmos:
strategy:
Expand Down Expand Up @@ -220,15 +220,15 @@ jobs:
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoItemsTableDissolvable" "jjga_d_items_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoEventsTableDissolvable" "jjga_d_events_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3Region" "us-west-1"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
dotnet restore Sekiban.sln
- name: Test Build
run: |
dotnet build Sekiban.sln -c Release

- name: Test dotnet tests/Sekiban.Test.CosmosDb
run: |
dotnet test tests/Sekiban.Test.CosmosDb/Sekiban.Test.CosmosDb.csproj --filter "Category!=Flaky&Category!=Performance" -v m -c Release -m:1 -f net8.0
Expand Down Expand Up @@ -275,15 +275,15 @@ jobs:
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoItemsTableDissolvable" "jjga_d_items_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoEventsTableDissolvable" "jjga_d_events_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3Region" "us-west-1"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
dotnet restore Sekiban.sln
- name: Test Build
run: |
dotnet build Sekiban.sln -c Release

- name: Test dotnet tests/Sekiban.Test.CosmosDb
run: |
dotnet test tests/Sekiban.Test.CosmosDb/Sekiban.Test.CosmosDb.csproj --filter "Category!=Flaky&Category!=Performance" -v m -c Release -m:1 -f net8.0
Expand Down Expand Up @@ -331,7 +331,7 @@ jobs:
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoItemsTableDissolvable" "jjga_d_items_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoEventsTableDissolvable" "jjga_d_events_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3Region" "us-west-1"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
Expand Down Expand Up @@ -383,22 +383,22 @@ jobs:
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoItemsTableDissolvable" "jjga_d_items_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoEventsTableDissolvable" "jjga_d_events_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3Region" "us-west-1"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
dotnet restore Sekiban.sln
- name: Test Build
run: |
dotnet build Sekiban.sln -c Release

- name: Test dotnet tests/Sekiban.Test.Dynamo .NET8
run: |
dotnet test tests/Sekiban.Test.Dynamo/Sekiban.Test.Dynamo.csproj --filter "Category!=Flaky&Category!=Performance" -v m -c Release -m:1 -f net8.0
- name: Test dotnet tests/Sekiban.Test.Dynamo .NET9
run: |
dotnet test tests/Sekiban.Test.Dynamo/Sekiban.Test.Dynamo.csproj --filter "Category!=Flaky&Category!=Performance" -v m -c Release -m:1 -f net9.0

regularPostgres:
strategy:
max-parallel: 4
Expand Down Expand Up @@ -439,28 +439,57 @@ jobs:
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoItemsTableDissolvable" "jjga_d_items_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoEventsTableDissolvable" "jjga_d_events_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3Region" "us-west-1"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
dotnet restore Sekiban.sln
- name: Test Build
run: |
dotnet build Sekiban.sln -c Release

- name: Test dotnet tests/Sekiban.Test.Postgres .NET8
run: |
dotnet test tests/Sekiban.Test.Postgres/Sekiban.Test.Postgres.csproj --filter "Category!=Flaky&Category!=Performance" -v m -c Release -m:1 -f net8.0
- name: Test dotnet tests/Sekiban.Test.Postgres .NET9
run: |
dotnet test tests/Sekiban.Test.Postgres/Sekiban.Test.Postgres.csproj --filter "Category!=Flaky&Category!=Performance" -v m -c Release -m:1 -f net9.0


regularIndexedDb:
strategy:
max-parallel: 4
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- name: Setup .NET 8
uses: actions/setup-dotnet@v4
with:
dotnet-version: 8.0.x
- name: Setup .NET 9
uses: actions/setup-dotnet@v4
with:
dotnet-version: 9.0.x
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
dotnet restore Sekiban.sln
- name: Test Build
run: |
dotnet build Sekiban.sln -c Release

- name: Test dotnet tests/Sekiban.Test.IndexedDb .NET8
run: |
dotnet test tests/Sekiban.Test.IndexedDb/Sekiban.Test.IndexedDb.csproj --filter "Category!=Flaky&Category!=Performance" -v m -c Release -m:1 -f net8.0
- name: Test dotnet tests/Sekiban.Test.IndexedDb .NET9
run: |
dotnet test tests/Sekiban.Test.IndexedDb/Sekiban.Test.IndexedDb.csproj --filter "Category!=Flaky&Category!=Performance" -v m -c Release -m:1 -f net9.0

flaky:
strategy:
max-parallel: 4

runs-on: ubuntu-latest
needs: [ regularMultitenant, regularPostgres,regularDynamo ,regular80Cosmos ]
needs: [ regularMultitenant, regularPostgres, regularDynamo, regularIndexedDb, regular80Cosmos ]
steps:
- uses: actions/checkout@v4
- name: Setup .NET 8
Expand Down Expand Up @@ -497,7 +526,7 @@ jobs:
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoItemsTableDissolvable" "jjga_d_items_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoEventsTableDissolvable" "jjga_d_events_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3Region" "us-west-1"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
Expand All @@ -516,7 +545,7 @@ jobs:
max-parallel: 4

runs-on: ubuntu-latest
needs: [ regularMultitenant, regularPostgres,regularDynamo ,regular90Cosmos ]
needs: [ regularMultitenant, regularPostgres, regularDynamo, regularIndexedDb, regular90Cosmos ]
steps:
- uses: actions/checkout@v4
- name: Setup .NET 8
Expand Down Expand Up @@ -553,7 +582,7 @@ jobs:
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoItemsTableDissolvable" "jjga_d_items_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoEventsTableDissolvable" "jjga_d_events_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3Region" "us-west-1"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
Expand All @@ -565,7 +594,7 @@ jobs:
max_attempts: 3
retry_on: error
command: dotnet test Sekiban.sln --filter "Category=Flaky" -v m -c Release -m:1 -f net9.0


performance80cosmos:
strategy:
Expand Down Expand Up @@ -628,7 +657,7 @@ jobs:
- name: Test dotnet
run: |
dotnet test tests/Sekiban.Test.CosmosDb/Sekiban.Test.CosmosDb.csproj --filter "Category=Performance" -v m -c Release -m:1 -f net8.0

performance80dynamo:
strategy:
max-parallel: 4
Expand Down Expand Up @@ -665,7 +694,7 @@ jobs:
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoItemsTableDissolvable" "jjga_d_items_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoEventsTableDissolvable" "jjga_d_events_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3Region" "us-west-1"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
Expand Down Expand Up @@ -717,15 +746,15 @@ jobs:
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoItemsTableDissolvable" "jjga_d_items_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:DynamoEventsTableDissolvable" "jjga_d_events_2"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3Region" "us-west-1"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
dotnet user-secrets set "Sekiban:Contexts:Secondary:Aws:S3BucketName" "jjga-s3"
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
dotnet restore Sekiban.sln
- name: Test dotnet
run: |
dotnet test tests/Sekiban.Test.Dynamo/Sekiban.Test.Dynamo.csproj --filter "Category=Performance" -v m -c Release -m:1 -f net9.0

performance80postgres:
strategy:
max-parallel: 4
Expand Down Expand Up @@ -755,7 +784,6 @@ jobs:
- name: Test dotnet
run: |
dotnet test tests/Sekiban.Test.Postgres/Sekiban.Test.Postgres.csproj --filter "Category=Performance" -v m -c Release -m:1 -f net8.0



performance90postgres:
Expand Down Expand Up @@ -787,4 +815,53 @@ jobs:
- name: Test dotnet
run: |
dotnet test tests/Sekiban.Test.Postgres/Sekiban.Test.Postgres.csproj --filter "Category=Performance" -v m -c Release -m:1 -f net9.0



performance80IndexedDb:
strategy:
max-parallel: 4

runs-on: ubuntu-latest
needs: [ flaky ]
steps:
- uses: actions/checkout@v4
- name: Setup .NET 8
uses: actions/setup-dotnet@v4
with:
dotnet-version: 8.0.x
- name: Setup .NET 9
uses: actions/setup-dotnet@v4
with:
dotnet-version: 9.0.x
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
dotnet restore Sekiban.sln
- name: Test dotnet
run: |
dotnet test tests/Sekiban.Test.IndexedDb/Sekiban.Test.IndexedDb.csproj --filter "Category=Performance" -v m -c Release -m:1 -f net8.0


performance90IndexedDb:
strategy:
max-parallel: 4

runs-on: ubuntu-latest
needs: [ flaky90 ]
steps:
- uses: actions/checkout@v4
- name: Setup .NET 8
uses: actions/setup-dotnet@v4
with:
dotnet-version: 8.0.x
- name: Setup .NET 9
uses: actions/setup-dotnet@v4
with:
dotnet-version: 9.0.x
- name: Restore dependencies
run: |
dotnet nuget add source -n benchmarknightly https://www.myget.org/F/benchmarkdotnet/api/v3/index.json
dotnet restore Sekiban.sln
- name: Test dotnet
run: |
dotnet test tests/Sekiban.Test.IndexedDb/Sekiban.Test.IndexedDb.csproj --filter "Category=Performance" -v m -c Release -m:1 -f net9.0
14 changes: 14 additions & 0 deletions Sekiban.sln
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -99,6 +99,10 @@ Project("{FAE04EC0-301F-11D3-BF4B-00C04F79EFBC}") = "MemStat.Net.Test", "tests\M
EndProject
Project("{FAE04EC0-301F-11D3-BF4B-00C04F79EFBC}") = "Sekiban.Pure.OrleansEventSourcing", "src\Sekiban.Pure.OrleansEventSourcing\Sekiban.Pure.OrleansEventSourcing.csproj", "{5EF54743-4A44-4B1F-830D-BB57A7BA07E0}"
EndProject
Project("{FAE04EC0-301F-11D3-BF4B-00C04F79EFBC}") = "Sekiban.Infrastructure.IndexedDb", "src\Sekiban.Infrastructure.IndexedDb\Sekiban.Infrastructure.IndexedDb.csproj", "{DF857388-7C42-42B7-AA13-6CCE11BB91FF}"
EndProject
Project("{FAE04EC0-301F-11D3-BF4B-00C04F79EFBC}") = "Sekiban.Test.IndexedDb", "tests\Sekiban.Test.IndexedDb\Sekiban.Test.IndexedDb.csproj", "{783ED104-CFEE-4D47-9D12-24D0E56E7D94}"
EndProject
Global
GlobalSection(SolutionConfigurationPlatforms) = preSolution
Debug|Any CPU = Debug|Any CPU
Expand Down Expand Up @@ -281,6 +285,14 @@ Global
{5EF54743-4A44-4B1F-830D-BB57A7BA07E0}.Debug|Any CPU.Build.0 = Debug|Any CPU
{5EF54743-4A44-4B1F-830D-BB57A7BA07E0}.Release|Any CPU.ActiveCfg = Release|Any CPU
{5EF54743-4A44-4B1F-830D-BB57A7BA07E0}.Release|Any CPU.Build.0 = Release|Any CPU
{DF857388-7C42-42B7-AA13-6CCE11BB91FF}.Debug|Any CPU.ActiveCfg = Debug|Any CPU
{DF857388-7C42-42B7-AA13-6CCE11BB91FF}.Debug|Any CPU.Build.0 = Debug|Any CPU
{DF857388-7C42-42B7-AA13-6CCE11BB91FF}.Release|Any CPU.ActiveCfg = Release|Any CPU
{DF857388-7C42-42B7-AA13-6CCE11BB91FF}.Release|Any CPU.Build.0 = Release|Any CPU
{783ED104-CFEE-4D47-9D12-24D0E56E7D94}.Debug|Any CPU.ActiveCfg = Debug|Any CPU
{783ED104-CFEE-4D47-9D12-24D0E56E7D94}.Debug|Any CPU.Build.0 = Debug|Any CPU
{783ED104-CFEE-4D47-9D12-24D0E56E7D94}.Release|Any CPU.ActiveCfg = Release|Any CPU
{783ED104-CFEE-4D47-9D12-24D0E56E7D94}.Release|Any CPU.Build.0 = Release|Any CPU
EndGlobalSection
GlobalSection(SolutionProperties) = preSolution
HideSolutionNode = FALSE
Expand Down Expand Up @@ -330,6 +342,8 @@ Global
{8DA8CCA4-3A14-4626-8883-207E80906911} = {76D7B2DA-2E6B-4078-AC01-B29BCA83411A}
{351D9C9B-3585-47E1-9E35-351A91CD4CA6} = {4C34F748-F223-44DD-899D-029F9CEF7780}
{5EF54743-4A44-4B1F-830D-BB57A7BA07E0} = {76D7B2DA-2E6B-4078-AC01-B29BCA83411A}
{DF857388-7C42-42B7-AA13-6CCE11BB91FF} = {76D7B2DA-2E6B-4078-AC01-B29BCA83411A}
{783ED104-CFEE-4D47-9D12-24D0E56E7D94} = {4C34F748-F223-44DD-899D-029F9CEF7780}
EndGlobalSection
GlobalSection(ExtensibilityGlobals) = postSolution
SolutionGuid = {2DFBE53E-69A7-453A-8D20-72271AE32016}
Expand Down
Loading
Loading