Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update to latest #87

Merged
merged 1 commit into from
Nov 22, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,11 +10,11 @@ This repository contains a set of tests to evaluate and compare the compatibilit

| Gateway | Compatibility | Test Cases | Test Suites |
| :-------------------------------------------------------------: | :-----------: | :----------: | :---------: |
| [Hive Gateway](https://the-guild.dev/graphql/hive/docs/gateway) | 100.00% | 🟢 171 | 🟢 41 |
| [Hive Gateway](https://the-guild.dev/graphql/hive/docs/gateway) | 99.42% | 🟢 170 ❌ 1 | 🟢 40 ❌ 1 |
| [Apollo Router](https://www.apollographql.com/) | 97.66% | 🟢 167 ❌ 4 | 🟢 39 ❌ 2 |
| [Apollo Gateway](https://www.apollographql.com/) | 97.08% | 🟢 166 ❌ 5 | 🟢 38 ❌ 3 |
| [Grafbase Gateway](https://grafbase.com) | 74.85% | 🟢 128 ❌ 43 | 🟢 29 ❌ 12 |
| [Cosmo Router](https://wundergraph.com) | 71.93% | 🟢 123 ❌ 48 | 🟢 21 ❌ 20 |
| [Grafbase Gateway](https://grafbase.com) | 66.08% | 🟢 113 ❌ 58 | 🟢 22 ❌ 19 |
| [Inigo Gateway](https://inigo.io) | 46.78% | 🟢 80 ❌ 91 | 🟢 12 ❌ 29 |

<!-- gateways:end -->
Expand Down
94 changes: 47 additions & 47 deletions REPORT.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,11 +4,11 @@

| Gateway | Compatibility | Test Cases | Test Suites |
| :-------------------------------------------------------------: | :-----------: | :----------: | :---------: |
| [Hive Gateway](https://the-guild.dev/graphql/hive/docs/gateway) | 100.00% | 🟢 171 | 🟢 41 |
| [Hive Gateway](https://the-guild.dev/graphql/hive/docs/gateway) | 99.42% | 🟢 170 ❌ 1 | 🟢 40 ❌ 1 |
| [Apollo Router](https://www.apollographql.com/) | 97.66% | 🟢 167 ❌ 4 | 🟢 39 ❌ 2 |
| [Apollo Gateway](https://www.apollographql.com/) | 97.08% | 🟢 166 ❌ 5 | 🟢 38 ❌ 3 |
| [Grafbase Gateway](https://grafbase.com) | 74.85% | 🟢 128 ❌ 43 | 🟢 29 ❌ 12 |
| [Cosmo Router](https://wundergraph.com) | 71.93% | 🟢 123 ❌ 48 | 🟢 21 ❌ 20 |
| [Grafbase Gateway](https://grafbase.com) | 66.08% | 🟢 113 ❌ 58 | 🟢 22 ❌ 19 |
| [Inigo Gateway](https://inigo.io) | 46.78% | 🟢 80 ❌ 91 | 🟢 12 ❌ 29 |

## Detailed Results
Expand Down Expand Up @@ -69,7 +69,7 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
<a href="./src/test-suites/null-keys">null-keys</a>
<pre>🟢</pre>
<a href="./src/test-suites/override-type-interface">override-type-interface</a>
<pre>🟢🟢🟢🟢</pre>
<pre>🟢🟢🟢</pre>
<a href="./src/test-suites/override-with-requires">override-with-requires</a>
<pre>🟢🟢🟢🟢</pre>
<a href="./src/test-suites/parent-entity-call">parent-entity-call</a>
Expand Down Expand Up @@ -296,31 +296,31 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
<pre>🟢🟢🟢🟢🟢🟢🟢🟢</pre>
</details>

<a id="cosmo-router"></a>
<a id="grafbase-gateway"></a>

### Cosmo Router
### Grafbase Gateway

- [Repository](https://github.com/wundergraph/cosmo)
- [Website](https://wundergraph.com)
- [Repository](https://github.com/grafbase/grafbase)
- [Website](https://grafbase.com)

<details>
<summary>Results</summary>
<a href="./src/test-suites/abstract-types">abstract-types</a>
<pre>🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢</pre>
<pre>🟢🟢❌🟢🟢❌❌❌❌❌❌❌❌❌❌❌❌</pre>
<a href="./src/test-suites/child-type-mismatch">child-type-mismatch</a>
<pre>❌❌❌🟢</pre>
<pre>🟢🟢🟢🟢</pre>
<a href="./src/test-suites/circular-reference-interface">circular-reference-interface</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/complex-entity-call">complex-entity-call</a>
<pre></pre>
<pre>🟢</pre>
<a href="./src/test-suites/corrupted-supergraph-node-id">corrupted-supergraph-node-id</a>
<pre>❌🟢🟢🟢🟢❌🟢🟢🟢🟢</pre>
<pre>❌🟢🟢🟢❌🟢🟢🟢🟢</pre>
<a href="./src/test-suites/enum-intersection">enum-intersection</a>
<pre>🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/fed1-external-extends">fed1-external-extends</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/fed1-external-extends-resolvable">fed1-external-extends-resolvable</a>
<pre></pre>
<pre>🟢</pre>
<a href="./src/test-suites/fed1-external-extension">fed1-external-extension</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/fed2-external-extends">fed2-external-extends</a>
Expand All @@ -332,82 +332,82 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
<a href="./src/test-suites/input-object-intersection">input-object-intersection</a>
<pre>🟢🟢🟢</pre>
<a href="./src/test-suites/interface-object-with-requires">interface-object-with-requires</a>
<pre>❌❌🟢🟢❌❌❌</pre>
<pre>🟢🟢❌🟢❌❌❌</pre>
<a href="./src/test-suites/keys-mashup">keys-mashup</a>
<pre>🟢</pre>
<a href="./src/test-suites/mutations">mutations</a>
<pre>🟢🟢</pre>
<pre>🟢🟢🟢</pre>
<a href="./src/test-suites/mysterious-external">mysterious-external</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/nested-provides">nested-provides</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/node">node</a>
<pre>🟢</pre>
<a href="./src/test-suites/non-resolvable-interface-object">non-resolvable-interface-object</a>
<pre>🟢🟢🟢🟢❌🟢❌</pre>
<pre>❌🟢❌🟢🟢🟢❌</pre>
<a href="./src/test-suites/null-keys">null-keys</a>
<pre>❌</pre>
<a href="./src/test-suites/override-type-interface">override-type-interface</a>
<pre>🟢❌🟢🟢</pre>
<pre>❌🟢🟢</pre>
<a href="./src/test-suites/override-with-requires">override-with-requires</a>
<pre>🟢🟢🟢🟢</pre>
<a href="./src/test-suites/parent-entity-call">parent-entity-call</a>
<pre>🟢</pre>
<a href="./src/test-suites/parent-entity-call-complex">parent-entity-call-complex</a>
<pre></pre>
<pre>🟢</pre>
<a href="./src/test-suites/provides-on-interface">provides-on-interface</a>
<pre>❌❌</pre>
<a href="./src/test-suites/provides-on-union">provides-on-union</a>
<pre>❌</pre>
<pre>🟢❌</pre>
<a href="./src/test-suites/requires-interface">requires-interface</a>
<pre>🟢🟢🟢🟢</pre>
<pre>🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/requires-requires">requires-requires</a>
<pre>🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/requires-with-argument">requires-with-argument</a>
<pre>❌❌❌❌❌</pre>
<pre>🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/requires-with-fragments">requires-with-fragments</a>
<pre>❌❌❌❌❌❌</pre>
<pre>❌🟢🟢🟢❌🟢</pre>
<a href="./src/test-suites/shared-root">shared-root</a>
<pre>🟢</pre>
<pre>🟢🟢</pre>
<a href="./src/test-suites/simple-entity-call">simple-entity-call</a>
<pre>🟢</pre>
<a href="./src/test-suites/simple-inaccessible">simple-inaccessible</a>
<pre>🟢🟢🟢🟢</pre>
<a href="./src/test-suites/simple-interface-object">simple-interface-object</a>
<pre>🟢❌🟢🟢🟢❌❌❌❌🟢❌❌❌</pre>
<pre>🟢🟢❌🟢❌❌❌🟢❌❌❌❌❌</pre>
<a href="./src/test-suites/simple-override">simple-override</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/simple-requires-provides">simple-requires-provides</a>
<pre>🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/typename">typename</a>
<pre>🟢🟢🟢🟢🟢</pre>
<pre>🟢🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/unavailable-override">unavailable-override</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/union-interface-distributed">union-interface-distributed</a>
<pre>❌🟢🟢🟢🟢🟢🟢</pre>
<pre>🟢❌🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/union-intersection">union-intersection</a>
<pre>🟢🟢🟢❌🟢🟢❌</pre>
<pre>🟢🟢🟢❌🟢🟢🟢❌</pre>
</details>

<a id="grafbase-gateway"></a>
<a id="cosmo-router"></a>

### Grafbase Gateway
### Cosmo Router

- [Repository](https://github.com/grafbase/grafbase)
- [Website](https://grafbase.com)
- [Repository](https://github.com/wundergraph/cosmo)
- [Website](https://wundergraph.com)

<details>
<summary>Results</summary>
<a href="./src/test-suites/abstract-types">abstract-types</a>
<pre>🟢🟢❌🟢🟢❌❌❌❌❌❌❌❌❌❌❌❌</pre>
<pre>🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/child-type-mismatch">child-type-mismatch</a>
<pre>❌❌❌🟢</pre>
<a href="./src/test-suites/circular-reference-interface">circular-reference-interface</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/complex-entity-call">complex-entity-call</a>
<pre>❌</pre>
<a href="./src/test-suites/corrupted-supergraph-node-id">corrupted-supergraph-node-id</a>
<pre>❌🟢🟢🟢❌🟢🟢🟢🟢</pre>
<pre>❌🟢🟢🟢🟢❌🟢🟢🟢🟢</pre>
<a href="./src/test-suites/enum-intersection">enum-intersection</a>
<pre>🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/fed1-external-extends">fed1-external-extends</a>
Expand All @@ -425,7 +425,7 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
<a href="./src/test-suites/input-object-intersection">input-object-intersection</a>
<pre>🟢🟢🟢</pre>
<a href="./src/test-suites/interface-object-with-requires">interface-object-with-requires</a>
<pre>🟢🟢❌🟢❌❌❌</pre>
<pre>❌❌🟢🟢❌❌❌</pre>
<a href="./src/test-suites/keys-mashup">keys-mashup</a>
<pre>🟢</pre>
<a href="./src/test-suites/mutations">mutations</a>
Expand All @@ -437,49 +437,49 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
<a href="./src/test-suites/node">node</a>
<pre>🟢</pre>
<a href="./src/test-suites/non-resolvable-interface-object">non-resolvable-interface-object</a>
<pre>❌🟢❌🟢🟢🟢❌</pre>
<pre>🟢🟢🟢🟢❌🟢❌</pre>
<a href="./src/test-suites/null-keys">null-keys</a>
<pre>❌</pre>
<a href="./src/test-suites/override-type-interface">override-type-interface</a>
<pre>❌🟢🟢</pre>
<pre>🟢❌🟢🟢</pre>
<a href="./src/test-suites/override-with-requires">override-with-requires</a>
<pre>🟢🟢🟢🟢</pre>
<a href="./src/test-suites/parent-entity-call">parent-entity-call</a>
<pre>❌</pre>
<a href="./src/test-suites/parent-entity-call-complex">parent-entity-call-complex</a>
<pre>🟢</pre>
<a href="./src/test-suites/parent-entity-call-complex">parent-entity-call-complex</a>
<pre>❌</pre>
<a href="./src/test-suites/provides-on-interface">provides-on-interface</a>
<pre>❌❌</pre>
<a href="./src/test-suites/provides-on-union">provides-on-union</a>
<pre>🟢❌</pre>
<pre>❌</pre>
<a href="./src/test-suites/requires-interface">requires-interface</a>
<pre>🟢🟢🟢🟢🟢</pre>
<pre>🟢🟢🟢🟢</pre>
<a href="./src/test-suites/requires-requires">requires-requires</a>
<pre>❌❌❌🟢❌</pre>
<pre>🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/requires-with-argument">requires-with-argument</a>
<pre>🟢❌❌❌❌</pre>
<pre>❌❌❌❌</pre>
<a href="./src/test-suites/requires-with-fragments">requires-with-fragments</a>
<pre>❌🟢🟢🟢❌🟢</pre>
<pre>❌❌❌❌❌❌</pre>
<a href="./src/test-suites/shared-root">shared-root</a>
<pre>🟢🟢</pre>
<pre>🟢</pre>
<a href="./src/test-suites/simple-entity-call">simple-entity-call</a>
<pre>🟢</pre>
<a href="./src/test-suites/simple-inaccessible">simple-inaccessible</a>
<pre>🟢🟢🟢🟢</pre>
<a href="./src/test-suites/simple-interface-object">simple-interface-object</a>
<pre>🟢🟢❌🟢❌❌❌🟢❌❌❌❌❌</pre>
<pre>🟢❌🟢🟢🟢❌❌❌❌🟢❌❌❌</pre>
<a href="./src/test-suites/simple-override">simple-override</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/simple-requires-provides">simple-requires-provides</a>
<pre>🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/typename">typename</a>
<pre>🟢🟢🟢🟢🟢🟢</pre>
<pre>🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/unavailable-override">unavailable-override</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/union-interface-distributed">union-interface-distributed</a>
<pre>🟢❌🟢🟢🟢🟢🟢</pre>
<pre>❌🟢🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/union-intersection">union-intersection</a>
<pre>🟢🟢🟢❌🟢🟢🟢❌</pre>
<pre>🟢🟢🟢❌🟢🟢❌</pre>
</details>

<a id="inigo-gateway"></a>
Expand Down
2 changes: 1 addition & 1 deletion gateways/cosmo-router/install.sh
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ set -u
BINARY_DOWNLOAD_PREFIX="https://github.com/wundergraph/cosmo/releases/download"

# https://github.com/wundergraph/cosmo/releases
DOWNLOAD_VERSION="0.143.2"
DOWNLOAD_VERSION="0.144.0"

download_binary() {
downloader --check
Expand Down
2 changes: 1 addition & 1 deletion gateways/grafbase-gateway/install.sh
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ set -euo pipefail
# to the current directory instead of /usr/local/bin

# https://github.com/grafbase/grafbase/releases
VERSION="0.19.0"
VERSION="0.20.1"

error() {
echo -e "${Red}error${Color_Off}:" "$@" >&2
Expand Down
18 changes: 9 additions & 9 deletions gateways/grafbase-gateway/results.txt
Original file line number Diff line number Diff line change
@@ -1,19 +1,19 @@
abstract-types
..X..XXXXXXXXXXXX
child-type-mismatch
XXX.
....
circular-reference-interface
..
complex-entity-call
X
.
corrupted-supergraph-node-id
X.X..X....
enum-intersection
.....
fed1-external-extends
..
fed1-external-extends-resolvable
X
.
fed1-external-extension
..
fed2-external-extends
Expand All @@ -29,7 +29,7 @@ interface-object-with-requires
keys-mashup
.
mutations
..X
...
mysterious-external
..
nested-provides
Expand All @@ -45,7 +45,7 @@ XX..
override-with-requires
....
parent-entity-call
X
.
parent-entity-call-complex
.
provides-on-interface
Expand All @@ -55,9 +55,9 @@ provides-on-union
requires-interface
.....
requires-requires
XXX.X
.....
requires-with-argument
.XXXX
.....
requires-with-fragments
X...X.
shared-root
Expand All @@ -83,5 +83,5 @@ union-intersection

---
Total: 171
Passed: 113
Failed: 58
Passed: 128
Failed: 43
2 changes: 1 addition & 1 deletion gateways/hive-gateway/install.sh
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
# https://github.com/graphql-hive/gateway/releases
curl -sSL https://graphql-hive.com/install-gateway.sh | sh -s "1.4.12"
curl -sSL https://graphql-hive.com/install-gateway.sh | sh -s "1.5.1"
6 changes: 3 additions & 3 deletions gateways/hive-gateway/results.txt
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ non-resolvable-interface-object
null-keys
.
override-type-interface
....
X...
override-with-requires
....
parent-entity-call
Expand Down Expand Up @@ -83,5 +83,5 @@ union-intersection

---
Total: 171
Passed: 171
Failed: 0
Passed: 170
Failed: 1
Loading
Loading