Skip to content

Commit

Permalink
Adding Draco to 7.5 release
Browse files Browse the repository at this point in the history
Merge branch 'master' into releases
  • Loading branch information
jason-fox committed Nov 23, 2018
2 parents 9fca5ca + 8d30eca commit 3f85ee0
Show file tree
Hide file tree
Showing 6 changed files with 71 additions and 16 deletions.
3 changes: 3 additions & 0 deletions .gitmodules
Original file line number Diff line number Diff line change
Expand Up @@ -175,3 +175,6 @@
[submodule "core/cygnus"]
path = core/cygnus
url = https://github.com/telefonicaid/fiware-cygnus
[submodule "core/draco"]
path = core/draco
url = https://github.com/ging/fiware-draco
32 changes: 19 additions & 13 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -81,8 +81,8 @@ FIWARE platform structured in chapters.
The Orion Context Broker Generic Enabler is the core and mandatory component of
any _“Powered by FIWARE”_ platform or solution. It enables to manage context
information in a highly decentralized and large-scale manner. It provides the
FIWARE NGSIv2 API which is a simple yet powerful Restful API enabling to perform
updates, queries or subscribe to changes on context information.
FIWARE NGSI v2 API which is a simple yet powerful Restful API enabling to
perform updates, queries or subscribe to changes on context information.

- The [Orion Context Broker](https://github.com/telefonicaid/fiware-orion/)
Generic Enabler holds information about the current context. However,
Expand All @@ -92,19 +92,25 @@ updates, queries or subscribe to changes on context information.
- The [STH Comet](https://github.com/ging/fiware-sth-comet/) Generic Enabler
brings the means for storing a short-term history of context data (typically
months) on MongoDB
- The [Cygnus](https://github.com/ging/fiware-cygnus/) Generic Enabler enables
a means of managing the history of context which is created as a stream of
data and can be injected into multiple data sinks, including many popular
databases such as PostgreSQL, MySQL, MongoDB or AWS DynamoDB or as Big Data
platforms such as Hadoop, Storm or Spark. The component is based on Apache
Flink
- The [Cygnus](https://github.com/ging/fiware-cygnus/) Generic Enabler is
enables a means of managing the history of context which is created as a
stream of data and can be injected into multiple data sinks, including many
popular databases such as PostgreSQL, MySQL, MongoDB or AWS DynamoDB or as
Big Data platforms such as Hadoop, Storm or Spark. The component is based on
Apache Flume

The following is a list of Generic Enablers under incubation within this
chapter:

- The [QuantumLeap](https://github.com/smartsdk/ngsi-timeseries-api/) Generic
Enabler supports the storage of FIWARE NGSIv2 data into a time series
database (CrateDB)
Enabler supports the storage of NGSI data into a time series database
(CrateDB)
- The [Draco](https://github.com/ging/fiware-draco) Generic Enabler is an
alternative data persistence mechanism for managing the history of context.
It is based on Apache NiFi and is a dataflow system based on the concepts of
flow-based programming. It supports powerful and scalable directed graphs of
data routing, transformation, and system mediation logic and also offers an
intuitive graphical interface

### Interface with IoT, Robots and Third-Party Systems

Expand Down Expand Up @@ -175,13 +181,13 @@ behaviour” expected in any application:
- The [Cosmos](https://github.com/ging/fiware-cosmos-orion-flink-connector)
Generic Enabler enables a more easy Bigdata analysis over context integrated
with most popular BigData platforms.
- The [FogFlow](https://github.com/smartfog/fogflow) Generic Enabler is a
distributed execution framework to support dynamic processing flows over
cloud and edges.

The following is a list of Generic Enablers under incubation within this
chapter:

- The [FogFlow](https://github.com/smartfog/fogflow) Generic Enabler is a
distributed execution framework to support dynamic processing flows over
cloud and edges.
- The [Perseo](https://github.com/telefonicaid/perseo-core/) Generic Enabler
introduces Complex Event Processing (CEP) defined using a rules-based
system, enabling you to fire events which send HTTP requests, emails,
Expand Down
48 changes: 46 additions & 2 deletions core/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -99,8 +99,8 @@ rated as follows:

Cygnus is a connector in charge of persisting context data sources into other
third-party databases and storage systems, creating a historical view of the
context. Internally, Cygnus is based on Apache Flink,
[Flink](https://flink.apache.org/) is a data flow system based on the concepts
context. Internally, Cygnus is based on Apache Flume,
[Flume](https://flume.apache.org/) is a data flow system based on the concepts
of flow-based programming. It supports powerful and scalable directed graphs of
data routing, transformation, and system mediation logic. It was built to
automate the flow of data between systems. While the term 'dataflow' can be used
Expand Down Expand Up @@ -240,3 +240,47 @@ complex queries such as cross-entity queries (e.g. an average of averages)

The **QuantumLeap** project is part of [FIWARE](https://fiware.org/) and will be
rated as part of the next release.

## :new: Draco (Incubated)

[![](https://nexus.lab.fiware.org/repository/raw/public/badges/chapters/core.svg)](https://www.fiware.org/developers/catalogue/)
![License](https://img.shields.io/github/license/ging/fiware-draco.svg)

- [Git Repository](https://github.com/ging/fiware-draco)
- [Docker Hub](https://hub.docker.com/r/ging/fiware-draco)
- [Documentation](https://fiware-draco.rtfd.io)

### What is Draco?

Draco is a connector in charge of persisting context data sources into other
third-party databases and storage systems, creating a historical view of the
context. Internally, Draco is based on Apache NiFi.
[NiFi](https://nifi.apache.org) is a popular framework for data management and
processing from multiple sources.

Draco plays the role of a connector between the Orion Context Broker (which is
an
[NGSI](https://swagger.lab.fiware.org/?url=https://raw.githubusercontent.com/Fiware/specifications/master/OpenAPI/ngsiv2/ngsiv2-openapi.json)
source of data) source of data) and a wide range of external systems such as
MySQL, MongoDB etc. You can use Draco if you need to process and persist context
data so that you can keep a historical record. Draco can also be used to filter
and repost context data back into Orion.

### Why Use Draco?

Persisting historical context data is useful for big data analysis - it can be
used to discover trends, or data can be sampled and aggregated to remove the
influence of outlying data measurements. However within each Smart Solution, the
significance of each entity type will differ and entities and attributes may
need to be sampled at different rates.

Since the business requirements for using context data differ from application
to application, there is no one standard use case for historical data
persistence. Therefore rather than overloading the context broker with the job
of historical context data persistence, this role has been separated out into
another enabler. Amongst the advantages of the component, Draco offers a
flexible graphical interface so it is possible to amend your data flows
according to your current business needs.

The **Draco** project is part of [FIWARE](https://fiware.org/) and will be rated
as part of the next release.
1 change: 1 addition & 0 deletions core/draco
Submodule draco added at 0c35a1
1 change: 1 addition & 0 deletions release.sh
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,7 @@ displayUpdatedTags (){


findRelease core/cygnus telefonicaid/fiware-cygnus 1.9.0
findRelease core/draco ging/fiware-draco FIWARE_7.5
findRelease core/orion telefonicaid/fiware-orion 2.0.0
findRelease core/quantum-leap smartsdk/ngsi-timeseries-api 0.4
findRelease core/sth-comet ging/fiware-sth-comet 2.3.0
Expand Down
2 changes: 1 addition & 1 deletion security/wilma

0 comments on commit 3f85ee0

Please sign in to comment.