Skip to content

RDF-Connect

Building Streaming and Cross-Environment Data Processing Pipelines with RDF-Connect

RDF-ConnectRDF-Connect

Discover Existing Work

Explore existing RDF-Connect processors, runners, orchestrators, and pipelines, contributed by developers across diverse use cases. Thanks to GitHub’s topic-based search, you can easily find and reuse what’s already available. Look for repositories tagged with rdf-connect and specific labels like rdfc-processor, rdfc-runner, rdfc-orchestrator, or rdfc-pipeline. If you’re contributing, tagging your work helps others discover and build upon it. Read more about discovering existing work.

rdf-connect/ldes-client

The TREE/LDES client to replicate and synchronize LDESs: the RDF Connect processor

___ rdf-connect/ldes-client

SHACL Validate Processor

https://w3id.org/rdf-connect#Validate

A processor that validates incoming RDF data against a SHACL shapes graph.

___ rdf-connect/shacl-processor-ts

rdf-connect/template-processor-ts

Template to kickstart the development of your next TypeScript processor.

___ rdf-connect/template-processor-ts

rdf-connect/rml-utils-processor-ts

Collection of Typescript utilities around RML tools that includes a wrapper over the RML Mapper to be reused within the RDF-Connect ecosystem

___ rdf-connect/rml-utils-processor-ts

rdf-connect/sds-storage-writer-ts

___ rdf-connect/sds-storage-writer-ts

Bucketizer processor

https://w3id.org/rdf-connect#Bucketize

___ rdf-connect/sds-processors-ts

Simple Data Generator

https://w3id.org/rdf-connect#Generate

___ rdf-connect/sds-processors-ts

Ldes Disk Writer

https://w3id.org/rdf-connect#LdesDiskWriter

Writes a LDES to local files

___ rdf-connect/sds-processors-ts

Ldesify processor

https://w3id.org/rdf-connect#Ldesify

___ rdf-connect/sds-processors-ts

Ldesify processor (for sds streams)

https://w3id.org/rdf-connect#LdesifySDS

___ rdf-connect/sds-processors-ts

Member to Named Graph member

https://w3id.org/rdf-connect#MemberAsNamedGraph

Transform a stream of SDS wrapped members into a named graph-based member.

___ rdf-connect/sds-processors-ts

Sdsify processor

https://w3id.org/rdf-connect#Sdsify

___ rdf-connect/sds-processors-ts

Shapify processor

https://w3id.org/rdf-connect#Shapify

___ rdf-connect/sds-processors-ts

Stream Join processor

https://w3id.org/rdf-connect#StreamJoin

Handle and pipe multiple input data streams into a single output stream.

___ rdf-connect/sds-processors-ts

ajuvercr/mumo-pipeline

___ ajuvercr/mumo-pipeline

TestProcessor

https://w3id.org/rdf-connect#TestProcessor

___ rdf-connect/template-processor-jvm

smessie/ldes-harvester-processor-ts

RDF-Connect processor to harvest an LDES with some additional options to the ldes-client

___ smessie/ldes-harvester-processor-ts

Python Template Processor

https://w3id.org/rdf-connect#TemplateProcessorPy

Template processor to kickstart the development of your next Python RDF-Connect processor.

___ rdf-connect/template-processor-py

Python Log Processor

https://w3id.org/rdf-connect#LogProcessorPy

A simple Python processor to log an incoming stream to the RDF-Connect logging system.

___ rdf-connect/log-processor-py

Python Send Processor

https://w3id.org/rdf-connect#SendProcessorPy

A simple Python processor to send an array of messages to a channel.

___ rdf-connect/log-processor-py

rdf-connect/xml-utils-processors-ts

Typescript util functions related to XML including a wrapper over the Saxon-HE library to be used within the RDF-Connect ecosystem

___ rdf-connect/xml-utils-processors-ts

RmlMapper

https://w3id.org/rdf-connect#RmlMapper

___ rdf-connect/rml-processor-jvm

rdf-connect/dumps-to-feed-processor-ts

A dumps to feed processor for the RDF Connect framework

___ rdf-connect/dumps-to-feed-processor-ts

rdf-connect/replication-processor-ts

A processor for the RDF Connect framework that writes an incoming stream to disk and later reads it into the output stream.

___ rdf-connect/replication-processor-ts

rdf-connect/osm-utils-processors-ts

RDF-Connect processors for interacting with OpenStreetMap data

___ rdf-connect/osm-utils-processors-ts

GlobRead

https://w3id.org/rdf-connect#GlobRead

Reads all files according to the Glob pattern

___ rdf-connect/file-utils-processors-ts

Folder Read

https://w3id.org/rdf-connect#FolderRead

Reads all files inside the folder

___ rdf-connect/file-utils-processors-ts

String substitute processor

https://w3id.org/rdf-connect#Substitute

Simple string manipulation processor. Transform a stream by applying the string substitution on the messages. The matching string can be a regex.

___ rdf-connect/file-utils-processors-ts

Environment substitute processor

https://w3id.org/rdf-connect#Envsub

Substitutes all declared environment variables to their respective values.

___ rdf-connect/file-utils-processors-ts

On demand file reader processor

https://w3id.org/rdf-connect#ReadFile

Reads a requested file on demand.

___ rdf-connect/file-utils-processors-ts

Unzip processor

https://w3id.org/rdf-connect#UnzipFile

Processor to unzip a compressed file and stream out its content.

___ rdf-connect/file-utils-processors-ts

Gunzip processor

https://w3id.org/rdf-connect#GunzipFile

Processor to gunzip a compressed file and stream out its content.

___ rdf-connect/file-utils-processors-ts

SPARQL Ingest Processor

https://w3id.org/rdf-connect#SPARQLIngest

A processor that ingests RDF data into a SPARQL endpoint

___ rdf-connect/sparql-ingest-processor-ts

rdf-connect/blank-to-named-node-identifiers-processor-ts

rdf-connect processor to map entities with blank node identifiers to equivalents with named node identifiers

___ rdf-connect/blank-to-named-node-identifiers-processor-ts

rdf-connect/buffer-processor-ts

A processor to buffer data for the RDF Connect framework.

___ rdf-connect/buffer-processor-ts

rdf-connect/log-processor-ts

A simple processor to log an incoming stream to the console for the RDF Connect framework.

___ rdf-connect/log-processor-ts

HTTP Fetch processor

https://w3id.org/rdf-connect#HttpFetch

___ rdf-connect/http-utils-processor-ts

rdf-connect/js-runner

___ rdf-connect/js-runner

PyRunner

https://w3id.org/rdf-connect#PyRunner

___ rdf-connect/py-runner

JvmRunner

https://w3id.org/rdf-connect#JvmRunner

___ rdf-connect/jvm-runner

rdf-connect/orchestrator-js

___ rdf-connect/orchestrator-js

smessie/dcat

Export of data.gov.be in DCAT-AP

___ smessie/dcat

smessie/DCAT-AP-Feeds

___ smessie/DCAT-AP-Feeds

ajuvercr/mumo-pipeline

___ ajuvercr/mumo-pipeline

rdf-connect/RDF-Connect-RINF-LDES

RDF-Connect pipelines for producing and consuming a LDES from RINF data

___ rdf-connect/RDF-Connect-RINF-LDES

rdf-connect/example-pipelines

Collection of example pipelines for RDF-Connect grouped per programming language.

___ rdf-connect/example-pipelines

rdf-connect/CA-Blue-Bike-LDES

Connector Architecture-based pipeline to publish an LDES from the Blue Bike API

___ rdf-connect/CA-Blue-Bike-LDES

rdf-connect/ldes2sparql

RDF-Connect pipeline for materializing an LDES into a SPARQL graph store

___ rdf-connect/ldes2sparql

rdf-connect/marine-regions-ldes-mirror

RDF-Connect pipeline to republish a content-wise mirrored LDES for the Marine Regions dataset

___ rdf-connect/marine-regions-ldes-mirror

rdf-connect/era-dcat-ap-feed

LDES feed for ERA's DCAT-AP metadata

___ rdf-connect/era-dcat-ap-feed