-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #308 from porters-xyz/documentation
let's take another iteration on this after the merge @plor @memosys
- Loading branch information
Showing
24 changed files
with
460 additions
and
162 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,138 @@ | ||
| # POKT Gateway Demo | ||
|
|
||
| Work related to https://forum.pokt.network/t/open-priority-gateway-demo/4874 | ||
|
|
||
| ## Proposal | ||
|
|
||
| ### ⚔️ Raid Guild Proposal <> POKT OPEN PRIORITY: Gateway Demo ⚔️ | ||
|
|
||
| > Building a User-facing Demo Gateway on top of the Nodies Gateway Kit | ||
| ##### Scope of Work | ||
| This Raid Party proposed to handle all aspects of the rebuild of the POKT website. We are thrilled to present our comprehensive proposal for developing a state-of-the-art Software as a Service (SaaS) web portal that leverages the Gateway Kit as its robust backend. Our goal is to exceed expectations by incorporating essential features and considering some nice-to-have enhancements, resulting in a scalable portal that aligns perfectly with the needs of modern self-service SaaS platforms. We are committed to delivering an agile development process with active involvement from PNF and the Pocket community. | ||
|
|
||
| #### POKT POP- Gateway SaaS Kit | ||
|
|
||
| ##### Detailed Modules Overview | ||
|
|
||
| ###### 1. Project Website & Documentation | ||
| - **A. Public-Facing Website Development** | ||
| - **Framework**: Utilize React.js for a responsive, dynamic project website. | ||
| - **B. Comprehensive Documentation** | ||
| - **Tool**: Employ Docusaurus or similar for user-friendly documentation. | ||
| - **Content**: Include thorough API docs and user manuals. | ||
|
|
||
| ###### 2. User Access Module | ||
| - **A. User Authentication System** | ||
| - **Authentication**: Implement OAuth2.0 or JWT for secure login. | ||
| - **User Management**: Full CRUD operations for user profiles. | ||
| - **B. App/Endpoint Management System** | ||
| - **App Settings**: Intuitive UI for configuration settings. | ||
| - **API Key Management**: Robust system for key generation and security. | ||
| - **Usage Reporting**: Detailed analytics and log dashboard for monitoring. | ||
|
|
||
| ###### 3. Drop-in Payment Module | ||
| - **A. User-Payment Plan Setup** | ||
| - **Payment Integration**: Pay as you go crypto payments in multiple tokens. | ||
| - **Subscription Tiers**: Multiple tiers to cater to different user needs. | ||
| - **B. Invoicing & Reporting** | ||
| - **Usage Notifications**: Automated alerts for usage and billing. | ||
|
|
||
| ###### 4. Gateway Admin Module - Frontend | ||
| - **A. Gateway Health & Monitoring** | ||
| - **Monitoring**: Real-time tracking and management of app stakes, utilizing Gateway Kit Prometheus metrics. | ||
| - **Visualization**: Dynamic, visual representation of stats and health indicators. | ||
| - **B. User Access & Monitoring** | ||
| - **Admin Panel**: Comprehensive user access management interface. | ||
| - **Audit Trails**: Detailed logging and auditing for security and compliance. | ||
|
|
||
| ###### 5. Gateway Proxy/Backend Setup | ||
| - **A. Request Relaying via Gateway Kit** | ||
| - **Load Balancing**: Implement effective load distribution and routing. | ||
| - **B. Backend Tasks** | ||
| - **Data Processing**: Efficient handling and processing of backend data. | ||
| - **Caching Setup**: Implement caching for enhanced performance and speed. | ||
|
|
||
|
|
||
| #### Stack Details | ||
|
|
||
| ##### Frontend | ||
| - **Framework**: Next.js | ||
| - Utilizes React.js, enabling server-side rendering and static site generation. | ||
| - Improved SEO, performance, easy routing, and Node.js integration. | ||
|
|
||
| ##### Backend | ||
| - **Framework**: NestJS with Prisma ORM | ||
| - NestJS offers modular architecture, maintainable and scalable code. | ||
| - TypeScript support for reliability and maintainability. | ||
| - Prisma ORM integrated for strong typing, model validation, and efficient database management. | ||
| - Simplified database operations with an easy-to-use query builder. | ||
|
|
||
| - **Database**: PostgreSQL and Redis | ||
| - Advanced SQL database with strong consistency and reliability for multi-tenancy user and application data. | ||
| - Ideal for scalable applications and large datasets. | ||
| - Redis offers low latency writes necessary for collecting usage stats on the reverse proxy | ||
|
|
||
| - **Reverse Proxy**: Golang | ||
| - Interfaces with the gateway kit to offer the reverse proxy. | ||
| - Performs authorization via API keys created by management system. | ||
| - Tracks usage for billing purposes. | ||
|
|
||
|
|
||
| ##### TEAM | ||
| ###### [Raid Guild](https://www.raidguild.org/portfolio) | ||
| We are a selected Raiding Party custom built to tackle this unique POP. Raid Guild is a service DAO founded in late 2020 to provide clients access to a network of technical and creative Web3 builders. Our organization is flat and true to the ideals of the Ethereum ecosystem. | ||
|
|
||
| - **SAYONARA** - Lead Front End Dev | ||
| - **PLOR** - BackEnd Dev and Systems Engineer | ||
| - **BENEDICTVS** - Bis Dev | ||
| - **SASQUATCH** - Account/Project Management | ||
| --- | ||
| #### Proposal from RaidGuild | ||
|
|
||
| ##### Expected Deliverables | ||
| - **Design** | ||
| - Wireframes for the user portal | ||
| - Shared via figma for open use by community | ||
| - **Portal** | ||
| - User management | ||
| - Endpoint management | ||
| - Usage statistics and Rate limits | ||
| - Billing | ||
| - **Documentation** | ||
| - Gateway usage information | ||
| - Open source dev docs | ||
| - **Reverse Proxy** | ||
| - Routes to gateway kit | ||
| - Tracks per endpoint usage | ||
| - Rate limiting | ||
|
|
||
|
|
||
| ##### **Milestones** | ||
| --- | ||
| ###### Sprint 1: | ||
| > - Design assets produced and reviewed | ||
| > - Backend components scaffolding and architecture design | ||
| ###### Sprint 2: | ||
| > - Portal initial development | ||
| > - Landing page and login | ||
| > - Database initialization | ||
| ###### Sprint 3: | ||
| > - Portal user creation | ||
| > - Reverse proxy development | ||
| ###### Sprint 4: | ||
| > - Portal endpoint creation | ||
| > - Documentation setup | ||
| > - Per endpoint usage tracking | ||
| ###### Sprint 5: | ||
| > - Portal usage and rate limiting | ||
| > - Payment accounting and processing | ||
| ###### Sprint 6: | ||
| > - Portal accounting reporting and payments | ||
| > - Finalize documentation | ||
| > - Final backend deploys and configuration |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,138 +1,58 @@ | ||
| # POKT Gateway Demo | ||
|
|
||
| Work related to https://forum.pokt.network/t/open-priority-gateway-demo/4874 | ||
|
|
||
| ## Proposal | ||
|
|
||
| ### ⚔️ Raid Guild Proposal <> POKT OPEN PRIORITY: Gateway Demo ⚔️ | ||
|
|
||
| > Building a User-facing Demo Gateway on top of the Nodies Gateway Kit | ||
| ##### Scope of Work | ||
| This Raid Party proposed to handle all aspects of the rebuild of the POKT website. We are thrilled to present our comprehensive proposal for developing a state-of-the-art Software as a Service (SaaS) web portal that leverages the Gateway Kit as its robust backend. Our goal is to exceed expectations by incorporating essential features and considering some nice-to-have enhancements, resulting in a scalable portal that aligns perfectly with the needs of modern self-service SaaS platforms. We are committed to delivering an agile development process with active involvement from PNF and the Pocket community. | ||
|
|
||
| #### POKT POP- Gateway SaaS Kit | ||
|
|
||
| ##### Detailed Modules Overview | ||
|
|
||
| ###### 1. Project Website & Documentation | ||
| - **A. Public-Facing Website Development** | ||
| - **Framework**: Utilize React.js for a responsive, dynamic project website. | ||
| - **B. Comprehensive Documentation** | ||
| - **Tool**: Employ Docusaurus or similar for user-friendly documentation. | ||
| - **Content**: Include thorough API docs and user manuals. | ||
|
|
||
| ###### 2. User Access Module | ||
| - **A. User Authentication System** | ||
| - **Authentication**: Implement OAuth2.0 or JWT for secure login. | ||
| - **User Management**: Full CRUD operations for user profiles. | ||
| - **B. App/Endpoint Management System** | ||
| - **App Settings**: Intuitive UI for configuration settings. | ||
| - **API Key Management**: Robust system for key generation and security. | ||
| - **Usage Reporting**: Detailed analytics and log dashboard for monitoring. | ||
|
|
||
| ###### 3. Drop-in Payment Module | ||
| - **A. User-Payment Plan Setup** | ||
| - **Payment Integration**: Pay as you go crypto payments in multiple tokens. | ||
| - **Subscription Tiers**: Multiple tiers to cater to different user needs. | ||
| - **B. Invoicing & Reporting** | ||
| - **Usage Notifications**: Automated alerts for usage and billing. | ||
|
|
||
| ###### 4. Gateway Admin Module - Frontend | ||
| - **A. Gateway Health & Monitoring** | ||
| - **Monitoring**: Real-time tracking and management of app stakes, utilizing Gateway Kit Prometheus metrics. | ||
| - **Visualization**: Dynamic, visual representation of stats and health indicators. | ||
| - **B. User Access & Monitoring** | ||
| - **Admin Panel**: Comprehensive user access management interface. | ||
| - **Audit Trails**: Detailed logging and auditing for security and compliance. | ||
|
|
||
| ###### 5. Gateway Proxy/Backend Setup | ||
| - **A. Request Relaying via Gateway Kit** | ||
| - **Load Balancing**: Implement effective load distribution and routing. | ||
| - **B. Backend Tasks** | ||
| - **Data Processing**: Efficient handling and processing of backend data. | ||
| - **Caching Setup**: Implement caching for enhanced performance and speed. | ||
|
|
||
|
|
||
| #### Stack Details | ||
|
|
||
| ##### Frontend | ||
| - **Framework**: Next.js | ||
| - Utilizes React.js, enabling server-side rendering and static site generation. | ||
| - Improved SEO, performance, easy routing, and Node.js integration. | ||
|
|
||
| ##### Backend | ||
| - **Framework**: NestJS with Prisma ORM | ||
| - NestJS offers modular architecture, maintainable and scalable code. | ||
| - TypeScript support for reliability and maintainability. | ||
| - Prisma ORM integrated for strong typing, model validation, and efficient database management. | ||
| - Simplified database operations with an easy-to-use query builder. | ||
|
|
||
| - **Database**: PostgreSQL and Redis | ||
| - Advanced SQL database with strong consistency and reliability for multi-tenancy user and application data. | ||
| - Ideal for scalable applications and large datasets. | ||
| - Redis offers low latency writes necessary for collecting usage stats on the reverse proxy | ||
|
|
||
| - **Reverse Proxy**: Golang | ||
| - Interfaces with the gateway kit to offer the reverse proxy. | ||
| - Performs authorization via API keys created by management system. | ||
| - Tracks usage for billing purposes. | ||
|
|
||
|
|
||
| ##### TEAM | ||
| ###### [Raid Guild](https://www.raidguild.org/portfolio) | ||
| We are a selected Raiding Party custom built to tackle this unique POP. Raid Guild is a service DAO founded in late 2020 to provide clients access to a network of technical and creative Web3 builders. Our organization is flat and true to the ideals of the Ethereum ecosystem. | ||
|
|
||
| - **SAYONARA** - Lead Front End Dev | ||
| - **PLOR** - BackEnd Dev and Systems Engineer | ||
| - **BENEDICTVS** - Bis Dev | ||
| - **SASQUATCH** - Account/Project Management | ||
| --- | ||
| #### Proposal from RaidGuild | ||
|
|
||
| ##### Expected Deliverables | ||
| - **Design** | ||
| - Wireframes for the user portal | ||
| - Shared via figma for open use by community | ||
| - **Portal** | ||
| - User management | ||
| - Endpoint management | ||
| - Usage statistics and Rate limits | ||
| - Billing | ||
| - **Documentation** | ||
| - Gateway usage information | ||
| - Open source dev docs | ||
| - **Reverse Proxy** | ||
| - Routes to gateway kit | ||
| - Tracks per endpoint usage | ||
| - Rate limiting | ||
|
|
||
|
|
||
| ##### **Milestones** | ||
| --- | ||
| ###### Sprint 1: | ||
| > - Design assets produced and reviewed | ||
| > - Backend components scaffolding and architecture design | ||
| ###### Sprint 2: | ||
| > - Portal initial development | ||
| > - Landing page and login | ||
| > - Database initialization | ||
| ###### Sprint 3: | ||
| > - Portal user creation | ||
| > - Reverse proxy development | ||
| ###### Sprint 4: | ||
| > - Portal endpoint creation | ||
| > - Documentation setup | ||
| > - Per endpoint usage tracking | ||
| ###### Sprint 5: | ||
| > - Portal usage and rate limiting | ||
| > - Payment accounting and processing | ||
| ###### Sprint 6: | ||
| > - Portal accounting reporting and payments | ||
| > - Finalize documentation | ||
| > - Final backend deploys and configuration | ||
| # PORTERS POKT RPC Gateway | ||
|
|
||
| ## Table of Contents | ||
|
|
||
| ## Background | ||
|
|
||
| - Gateway Kit | ||
| - POKT | ||
| - Sign-in-with-Ethereum | ||
|
|
||
| ### Dependencies | ||
|
|
||
| - Postgres | ||
| - Prisma | ||
| - Prometheus | ||
|
|
||
| ## Requirements | ||
|
|
||
| The PORTERS POKT RPC Gateway is build using **golang** for proxy, **javascript** for the frontend and backend. The portal, consisting of frontend and backend, requires **node.js** and you may follow our implementation design by using ```pnpm``` for package management, however, you may use other package managers if you desire. | ||
|
|
||
| ## Install | ||
|
|
||
| - required environment variables | ||
| - db pw, etc. | ||
| - .env | ||
| - docker compose | ||
|
|
||
| ## Build | ||
|
|
||
| - allow for short iterations | ||
| - split up descriptions into components | ||
|
|
||
| See the [just file](/gateway-demo/justfile) for further information. You can run the just commands to see which components you can run how. | ||
|
|
||
| - JUST file descriptions | ||
| - ``` just built``` | ||
| - top level vs component-specific | ||
| - include a definition of how one can contribute to it | ||
|
|
||
| ## Usage | ||
|
|
||
| Once you installed the PORTERS POKT RPC Gateway, you can use the PORTERS portal for generating RPC endpoints. | ||
|
|
||
| - Plor will think about this section as the portal is kind of counterintuitive | ||
|
|
||
| In the proxy is the file ```main.go``` that is used for configuration. It allows you to configure rate limiting and other core functionalities of an RPC service. | ||
|
|
||
| ## Contribute | ||
|
|
||
| We welcome contributions from outside contributors. For contributing, please fork the repository and open a pull request with the proposed changes. | ||
|
|
||
| All contributions shall be made to the ```develop``` branch. Contributions may then be merged into ```master```. | ||
|
|
||
| In the future, more stringent contribution rules may be put in place at the sole descretion of the PORTERS core team. | ||
|
|
||
| ## Licence | ||
|
|
||
| - MIT Licence |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -5,6 +5,7 @@ | |
| /.pnp | ||
| .pnp.js | ||
| .yarn/install-state.gz | ||
| package-lock.json | ||
|
|
||
| # testing | ||
| /coverage | ||
|
|
||
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,18 @@ | ||
| # Overview of the Contributor Documentation | ||
|
|
||
| This section of the documentation contains the following. First a brief overview of the architecture is given. Then, in sections two and three the frontend and backend of the portal are described. Fourth, the gateway (or proxy) is documented. Fifth, the gateway kit is described. Thereafter the schema is described, documenting the interation between the backend and the proxy. Seventh, the documentation describes the smart contract payment infrastructure. Lastly, this documentation covers the POKT integration. | ||
|
|
||
| For documentation on PORTERS PORTALS please refer to the [PORTAL section](/gateway-demo/docs/pages/PORTALS/0-PORTALS-index.mdx) of this documentation. | ||
|
|
||
| ## Table of Contents | ||
|
|
||
| 1. Architecture | ||
| 2. Frontend | ||
| 3. Backend | ||
| 4. Gateway (Proxy) | ||
| 5. Gateway Kit | ||
| 6. Schema | ||
| 7. Smart Contract Payment Infrastructure | ||
| 8. POKT Integration | ||
|
|
||
|
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,10 @@ | ||
| # Redis Data Store | ||
|
|
||
| The Redis data store is located between the gateway and the postgres server. Thus, it is a local cache for the information described in the schema. | ||
|
|
||
| It is important to note that there is one postgress instance, but one Redis instance per region, so that there is a local copy that can be quickly read or written. | ||
|
|
||
| Due to this setup individual Redis instances may differ, but are synced eventually. This is achieved because the only write of the Redis data store to the postgres instance is `append only`. Hence, no conflicts are possible. | ||
|
|
||
| For example, given two users of the same app are in two regions, they both will be accessing different Redis instances. However, their usage will be reflected in the postgres instance eventually. | ||
|
|
Oops, something went wrong.