RDF-Connect

Appearance

Discover Existing Work ​

RDF-Connect empowers developers to build modular, reusable, and interoperable data processing pipelines. Since its inception, many developers have contributed processors, runners, orchestrators, and complete pipelines across various use cases and environments. This means you don’t have to start from scratch — much of what you need may already exist. On this page, you’ll be able to discover such existing components, ready to be reused and adapted to your own needs. By leveraging the work of those who came before you, you can accelerate development, ensure consistency, and focus on what makes your pipeline unique.

This discoverability is made possible through GitHub’s topic-based search. By using standardized topics, it’s easy to find RDF-Connect-related components across the platform. To support this, we encourage all developers to annotate their repositories with the topic rdf-connect for general inclusion in the ecosystem. Additionally, please use one or more of the following specific tags to classify your contribution: rdfc-processor, rdfc-runner, rdfc-orchestrator, or rdfc-pipeline. Consistent tagging not only increases visibility but also strengthens the discoverability and reusability of your work for others in the community.

ldes client

https://w3id.org/rdf-connect#LdesClient

An LDES client that can read a stream of members from an LDES.

___ rdf-connect/ldes-client

SHACL Validate Processor

https://w3id.org/rdf-connect#Validate

A processor that validates incoming RDF data against a SHACL shapes graph.

___ rdf-connect/shacl-processor-ts

rdf-connect/rml-utils-processor-ts

Collection of Typescript utilities around RML tools that includes a wrapper over the RML Mapper to be reused within the RDF-Connect ecosystem

___ rdf-connect/rml-utils-processor-ts

JS/TS Template Processor

https://w3id.org/rdf-connect#TemplateProcessorJs

Template processor to kickstart the development of your next TypeScript RDF-Connect processor.

___ rdf-connect/template-processor-ts

SDS Storage Writer

https://w3id.org/rdf-connect#IngestSDS

Processor that can ingest a SDS stream into a given storage system. It uses sds:Bucket to describe the used fragmentation strategy (see rdfc:Bucketize).

___ rdf-connect/sds-storage-writer-ts

Bucketizer processor

https://w3id.org/rdf-connect#Bucketize

___ rdf-connect/sds-processors-ts

Simple Data Generator

https://w3id.org/rdf-connect#Generate

___ rdf-connect/sds-processors-ts

Ldes Disk Writer

https://w3id.org/rdf-connect#LdesDiskWriter

Writes a LDES to local files

___ rdf-connect/sds-processors-ts

Ldesify processor

https://w3id.org/rdf-connect#Ldesify

___ rdf-connect/sds-processors-ts

Ldesify processor (for sds streams)

https://w3id.org/rdf-connect#LdesifySDS

___ rdf-connect/sds-processors-ts

Member to Named Graph member

https://w3id.org/rdf-connect#MemberAsNamedGraph

Transform a stream of SDS wrapped members into a named graph-based member.

___ rdf-connect/sds-processors-ts

Sdsify processor

https://w3id.org/rdf-connect#Sdsify

___ rdf-connect/sds-processors-ts

Shapify processor

https://w3id.org/rdf-connect#Shapify

___ rdf-connect/sds-processors-ts

Stream Join processor

https://w3id.org/rdf-connect#StreamJoin

Handle and pipe multiple input data streams into a single output stream.

___ rdf-connect/sds-processors-ts

Acl Auth

https://w3id.org/rdf-connect#AclAuth

Returns ACL files based on the current group configuration from the mumo dashboard

___ MuseumMonitoring/pipeline

Community Solid Server

https://w3id.org/rdf-connect#Css

Starts the community solid server with a file base

___ MuseumMonitoring/pipeline

Mumo Fetch

https://w3id.org/rdf-connect#MumoFetch

Fetches everything following link headers

___ MuseumMonitoring/pipeline

Mumo Mapper

https://w3id.org/rdf-connect#MumoMapper

Maps incoming JSON objects in MuMo measurements.

___ MuseumMonitoring/pipeline

Builds webIds on request

https://w3id.org/rdf-connect#WebIdBuilder

Interacts with a css endpoint and returns a WebId and client credential on request

___ MuseumMonitoring/pipeline

rdf-connect/xml-utils-processors-ts

Typescript util functions related to XML including a wrapper over the Saxon-HE library to be used within the RDF-Connect ecosystem

___ rdf-connect/xml-utils-processors-ts

RmlMapper

https://w3id.org/rdf-connect#RmlMapper

___ rdf-connect/rml-processor-jvm

LDES Harvester

https://w3id.org/rdf-connect#LdesHarvester

Processor that can harvest a specific subset of data from a Linked Data Event Stream (LDES).

___ smessie/ldes-harvester-processor-ts

WriteReplication

https://w3id.org/rdf-connect#WriteReplication

___ rdf-connect/replication-processor-ts

ReadReplication

https://w3id.org/rdf-connect#ReadReplication

___ rdf-connect/replication-processor-ts

rdf-connect/osm-utils-processors-ts

RDF-Connect processors for interacting with OpenStreetMap data

___ rdf-connect/osm-utils-processors-ts

Python Log Processor

https://w3id.org/rdf-connect#LogProcessorPy

A simple Python processor to log an incoming stream to the RDF-Connect logging system.

___ rdf-connect/log-processor-py

Python Send Processor

https://w3id.org/rdf-connect#SendProcessorPy

A simple Python processor to send an array of messages to a channel.

___ rdf-connect/log-processor-py

Python Template Processor

https://w3id.org/rdf-connect#TemplateProcessorPy

Template processor to kickstart the development of your next Python RDF-Connect processor.

___ rdf-connect/template-processor-py

SPARQL Ingest Processor

https://w3id.org/rdf-connect#SPARQLIngest

A processor that ingests RDF data into a SPARQL endpoint

___ rdf-connect/sparql-ingest-processor-ts

GlobRead

https://w3id.org/rdf-connect#GlobRead

Reads all files according to the Glob pattern

___ rdf-connect/file-utils-processors-ts

Folder Read

https://w3id.org/rdf-connect#FolderRead

Reads all files inside the folder

___ rdf-connect/file-utils-processors-ts

String substitute processor

https://w3id.org/rdf-connect#Substitute

Simple string manipulation processor. Transform a stream by applying the string substitution on the messages. The matching string can be a regex.

___ rdf-connect/file-utils-processors-ts

Environment substitute processor

https://w3id.org/rdf-connect#Envsub

Substitutes all declared environment variables to their respective values.

___ rdf-connect/file-utils-processors-ts

On demand file reader processor

https://w3id.org/rdf-connect#ReadFile

Reads a requested file on demand.

___ rdf-connect/file-utils-processors-ts

Unzip processor

https://w3id.org/rdf-connect#UnzipFile

Processor to unzip a compressed file and stream out its content.

___ rdf-connect/file-utils-processors-ts

Gunzip processor

https://w3id.org/rdf-connect#GunzipFile

Processor to gunzip a compressed file and stream out its content.

___ rdf-connect/file-utils-processors-ts

JavaScript file writer processor

https://w3id.org/rdf-connect#FileWriter

Writes incoming data to a file.

___ rdf-connect/file-utils-processors-ts

Dumps To Feed Processor

https://w3id.org/rdf-connect#DumpsToFeed

A processor that converts a dump of RDF data to a feed of RDF data based on a member SHACL shape.

___ rdf-connect/dumps-to-feed-processor-ts

TestProcessor

https://w3id.org/rdf-connect#TestProcessor

___ rdf-connect/template-processor-jvm

Buffer

https://w3id.org/rdf-connect#Buffer

___ rdf-connect/buffer-processor-ts

JS/TS Log Processor

https://w3id.org/rdf-connect#LogProcessorJs

A simple JS/TS processor to log an incoming stream to the RDF-Connect logging system.

___ rdf-connect/log-processor-ts

JS/TS Send Processor

https://w3id.org/rdf-connect#SendProcessorJs

A simple JS/TS processor to send messages to a writer channel.

___ rdf-connect/log-processor-ts

HTTP Fetch processor

https://w3id.org/rdf-connect#HttpFetch

___ rdf-connect/http-utils-processor-ts

Skolemization Processor

https://w3id.org/rdf-connect#SkolemizationProcessor

A processor that converts a RDF data to a skolemized form (removing blank nodes).

___ rdf-connect/skolemization-processor-ts

NodeRunner

https://w3id.org/rdf-connect#NodeRunner

___ rdf-connect/js-runner

BunRunner

https://w3id.org/rdf-connect#BunRunner

___ rdf-connect/js-runner

PyRunner

https://w3id.org/rdf-connect#PyRunner

___ rdf-connect/py-runner

JvmRunner

https://w3id.org/rdf-connect#JvmRunner

___ rdf-connect/jvm-runner

rdf-connect/orchestrator-js

___ rdf-connect/orchestrator-js

rdf-connect/vienna-weather-forecast-kg-pipeline

RDF-Connect pipeline to ingest Vienna's weather forecast in a knowledge graph. This repository contains the incremental solutions for the hands-on coding session of the tutorial at SEMANTiCS 2025.

___ rdf-connect/vienna-weather-forecast-kg-pipeline

rdf-connect/era-dcat-ap-feed

LDES feed for ERA's DCAT-AP metadata

___ rdf-connect/era-dcat-ap-feed

rdf-connect/RDF-Connect-RINF-LDES

RDF-Connect pipelines for producing and consuming a LDES from RINF data

___ rdf-connect/RDF-Connect-RINF-LDES

smessie/DCAT-AP-Feeds

___ smessie/DCAT-AP-Feeds

rdf-connect/CA-Blue-Bike-LDES

Connector Architecture-based pipeline to publish an LDES from the Blue Bike API

___ rdf-connect/CA-Blue-Bike-LDES

MareGraph-EU/eurobis-geo-tree

RDF-Connect pipeline to build and publish a geospatial TREE collection with Eurobis data

___ MareGraph-EU/eurobis-geo-tree

MareGraph-EU/ldes2sparql

RDF-Connect pipeline for materializing an LDES into a SPARQL graph store

___ MareGraph-EU/ldes2sparql

MuseumMonitoring/pipeline

Pipeline for the MuMo project, building a LDES from data generated by custom sensors

___ MuseumMonitoring/pipeline

smessie/dcat

Export of data.gov.be in DCAT-AP

___ smessie/dcat

MareGraph-EU/aphia-ldes-mirror

RDF-Connect pipeline to republish a content-wise mirrored LDES for the Aphia dataset

___ MareGraph-EU/aphia-ldes-mirror

rdf-connect/example-pipelines

Collection of example pipelines for RDF-Connect grouped per programming language.

___ rdf-connect/example-pipelines

MareGraph-EU/marine-regions-ldes-mirror

RDF-Connect pipeline to republish a content-wise mirrored LDES for the Marine Regions dataset

___ MareGraph-EU/marine-regions-ldes-mirror