Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/
This project comprises the whole Semantic Analytics Stack (SANSA). At a glance, it features the following functionality:
For a detailed description of SANSA, please visit http://sansa-stack.net.
The SANSA project is structured in the following five layers developed in their respective sub-folders:
A SANSA stack release is done every six months and consists of the latest stable versions of each layer at this point. This repository is used for organising those joint releases.
We currently require a Spark 3.x.x with Scala 2.12 setup. A Spark 2.x version can be built from source based on the spark2 branch.
Some of our dependencies are not in Maven central (yet), so you need to add following Maven repository to your project POM file repositories
section:
<repository>
<id>maven.aksw.internal</id>
<name>AKSW Release Repository</name>
<url>http://maven.aksw.org/archiva/repository/internal</url>
<releases>
<enabled>true</enabled>
</releases>
<snapshots>
<enabled>false</enabled>
</snapshots>
</repository>
If you want to import the full SANSA Stack, please add the following Maven dependency to your project POM file:
<!-- SANSA Stack -->
<dependency>
<groupId>net.sansa-stack</groupId>
<artifactId>sansa-stack-spark_2.12</artifactId>
<version>$LATEST_RELEASE_VERSION$</version>
</dependency>
If you only want to use particular layers, just replace $LAYER_NAME$
with the corresponding name of the layer
<!-- SANSA $LAYER_NAME$ layer -->
<dependency>
<groupId>net.sansa-stack</groupId>
<artifactId>sansa-$LAYER_NAME$-spark_2.12</artifactId>
<version>$LATEST_RELEASE_VERSION$</version>
</dependency>
While the release versions are available on Maven Central, latest SNAPSHOT versions have to be installed from source code:
git clone https://github.com/SANSA-Stack/SANSA-Stack.git
cd SANSA-Stack
Then to build and install the full SANSA Spark stack you can do
./dev/mvn_install_stack_spark.sh
or for a single layer $LAYER_NAME$
you can do
mvn -am -DskipTests -pl :sansa-$LAYER_NAME$-spark_2.12 clean install
Alternatively, you can use the following Maven repository and add it to your project POM file repositories
section:
<repository>
<id>maven.aksw.snapshots</id>
<name>AKSW Snapshot Repository</name>
<url>http://maven.aksw.org/archiva/repository/snapshots</url>
<releases>
<enabled>false</enabled>
</releases>
<snapshots>
<enabled>true</enabled>
</snapshots>
</repository>
Then do the same as for the release version and add the dependency:
<!-- SANSA Stack -->
<dependency>
<groupId>net.sansa-stack</groupId>
<artifactId>sansa-stack-spark_2.12</artifactId>
<version>$LATEST_SNAPSHOT_VERSION$</version>
</dependency>
We always welcome new contributors to the project! Please see our contribution guide for more details on how to get started contributing to SANSA.