news-layers

News aggregation layers

Data Service Layer

The news providers used by this layer are:

• General News Providers:
  • The New York Times - API - LIMITS
  • The Guardian - API - LIMITS
• Niche News Providers:
  • CryptoCompare - API - LIMITS
  • CryptoPanic - API - LIMITS
• News Aggregation Providers:
  • GNews - API - LIMITS

Messages structure

All the news our services will deal with will be expressed with the following structure:

{
    "title": "news title",
    "content": "link to the news",
    "publishedAt": "date in which the news was published",
    "source": "API source",
    "sentiment": "Sentiment of the news, from -1 (negative) to +1 (positive)"
}

Adapter Service Layer

News is retrieved from different news providers. Five routes are exposed:

• /cryptocompare: get latest or search for specific news from cryptocompare
• /cryptopanic: get latest or search for specific news from cryptopanic
• /gnews: get latest or search for specific news from gnews
• /nytimes: get latest or search for specific news from nytimes
• /theguardian: get latest or search for specific news from theguardian

The API documentation can be found under /api-docs - port 9000 if run with docker-compose.

Business Logic Layer

News is retrieved from the Adapter Service Layer, filtered based on pre-defined rules and checked for duplicates. The sentiment is calculated in this layer using VADER. Two routes are exposed:

• /latest: get latest news from crypto niche news providers;
• /search: search for specific news based on the time frame and the currency.

The API documentation can be found under /api-docs - port 9001 if run with docker-compose.

Process Centric Layer

A very simple process centric layer that exposes the last news. One route is exposed:

• /latest: get latest news from crypto niche news providers.

The API documentation can be found under /api-docs - port 9002 if run with docker-compose.