Discover Existing Work
RDF-Connect empowers developers to build modular, reusable, and interoperable data processing pipelines. Since its inception, many developers have contributed processors, runners, orchestrators, and complete pipelines across various use cases and environments. This means you don’t have to start from scratch — much of what you need may already exist. On this page, you’ll be able to discover such existing components, ready to be reused and adapted to your own needs. By leveraging the work of those who came before you, you can accelerate development, ensure consistency, and focus on what makes your pipeline unique.
This discoverability is made possible through GitHub’s topic-based search. By using standardized topics, it’s easy to find RDF-Connect-related components across the platform. To support this, we encourage all developers to annotate their repositories with the topic rdf-connect for general inclusion in the ecosystem. Additionally, please use one or more of the following specific tags to classify your contribution: rdfc-processor, rdfc-runner, rdfc-orchestrator, or rdfc-pipeline. Consistent tagging not only increases visibility but also strengthens the discoverability and reusability of your work for others in the community.
rdf-connect/ldes-client
The TREE/LDES client to replicate and synchronize LDESs: the RDF Connect processor
rdf-connect/ldes-clientSHACL Validate Processor
https://w3id.org/rdf-connect#ValidateA processor that validates incoming RDF data against a SHACL shapes graph.
rdf-connect/shacl-processor-tsrdf-connect/template-processor-ts
Template to kickstart the development of your next TypeScript processor.
rdf-connect/template-processor-tsrdf-connect/rml-utils-processor-ts
Collection of Typescript utilities around RML tools that includes a wrapper over the RML Mapper to be reused within the RDF-Connect ecosystem
rdf-connect/rml-utils-processor-tsrdf-connect/sds-storage-writer-ts
rdf-connect/sds-storage-writer-tsBucketizer processor
https://w3id.org/rdf-connect#Bucketize rdf-connect/sds-processors-tsSimple Data Generator
https://w3id.org/rdf-connect#Generate rdf-connect/sds-processors-tsLdes Disk Writer
https://w3id.org/rdf-connect#LdesDiskWriterWrites a LDES to local files
rdf-connect/sds-processors-tsLdesify processor
https://w3id.org/rdf-connect#Ldesify rdf-connect/sds-processors-tsLdesify processor (for sds streams)
https://w3id.org/rdf-connect#LdesifySDS rdf-connect/sds-processors-tsMember to Named Graph member
https://w3id.org/rdf-connect#MemberAsNamedGraphTransform a stream of SDS wrapped members into a named graph-based member.
rdf-connect/sds-processors-tsSdsify processor
https://w3id.org/rdf-connect#Sdsify rdf-connect/sds-processors-tsShapify processor
https://w3id.org/rdf-connect#Shapify rdf-connect/sds-processors-tsStream Join processor
https://w3id.org/rdf-connect#StreamJoinHandle and pipe multiple input data streams into a single output stream.
rdf-connect/sds-processors-tsajuvercr/mumo-pipeline
ajuvercr/mumo-pipelineTestProcessor
https://w3id.org/rdf-connect#TestProcessor rdf-connect/template-processor-jvmsmessie/ldes-harvester-processor-ts
RDF-Connect processor to harvest an LDES with some additional options to the ldes-client
smessie/ldes-harvester-processor-tsPython Template Processor
https://w3id.org/rdf-connect#TemplateProcessorPyTemplate processor to kickstart the development of your next Python RDF-Connect processor.
rdf-connect/template-processor-pyPython Log Processor
https://w3id.org/rdf-connect#LogProcessorPyA simple Python processor to log an incoming stream to the RDF-Connect logging system.
rdf-connect/log-processor-pyPython Send Processor
https://w3id.org/rdf-connect#SendProcessorPyA simple Python processor to send an array of messages to a channel.
rdf-connect/log-processor-pyrdf-connect/xml-utils-processors-ts
Typescript util functions related to XML including a wrapper over the Saxon-HE library to be used within the RDF-Connect ecosystem
rdf-connect/xml-utils-processors-tsRmlMapper
https://w3id.org/rdf-connect#RmlMapper rdf-connect/rml-processor-jvmrdf-connect/dumps-to-feed-processor-ts
A dumps to feed processor for the RDF Connect framework
rdf-connect/dumps-to-feed-processor-tsrdf-connect/replication-processor-ts
A processor for the RDF Connect framework that writes an incoming stream to disk and later reads it into the output stream.
rdf-connect/replication-processor-tsrdf-connect/osm-utils-processors-ts
RDF-Connect processors for interacting with OpenStreetMap data
rdf-connect/osm-utils-processors-tsGlobRead
https://w3id.org/rdf-connect#GlobReadReads all files according to the Glob pattern
rdf-connect/file-utils-processors-tsFolder Read
https://w3id.org/rdf-connect#FolderReadReads all files inside the folder
rdf-connect/file-utils-processors-tsString substitute processor
https://w3id.org/rdf-connect#SubstituteSimple string manipulation processor. Transform a stream by applying the string substitution on the messages. The matching string can be a regex.
rdf-connect/file-utils-processors-tsEnvironment substitute processor
https://w3id.org/rdf-connect#EnvsubSubstitutes all declared environment variables to their respective values.
rdf-connect/file-utils-processors-tsOn demand file reader processor
https://w3id.org/rdf-connect#ReadFileReads a requested file on demand.
rdf-connect/file-utils-processors-tsUnzip processor
https://w3id.org/rdf-connect#UnzipFileProcessor to unzip a compressed file and stream out its content.
rdf-connect/file-utils-processors-tsGunzip processor
https://w3id.org/rdf-connect#GunzipFileProcessor to gunzip a compressed file and stream out its content.
rdf-connect/file-utils-processors-tsSPARQL Ingest Processor
https://w3id.org/rdf-connect#SPARQLIngestA processor that ingests RDF data into a SPARQL endpoint
rdf-connect/sparql-ingest-processor-tsrdf-connect/blank-to-named-node-identifiers-processor-ts
rdf-connect processor to map entities with blank node identifiers to equivalents with named node identifiers
rdf-connect/blank-to-named-node-identifiers-processor-tsrdf-connect/buffer-processor-ts
A processor to buffer data for the RDF Connect framework.
rdf-connect/buffer-processor-tsrdf-connect/log-processor-ts
A simple processor to log an incoming stream to the console for the RDF Connect framework.
rdf-connect/log-processor-tsHTTP Fetch processor
https://w3id.org/rdf-connect#HttpFetch rdf-connect/http-utils-processor-tsrdf-connect/js-runner
rdf-connect/js-runnerPyRunner
https://w3id.org/rdf-connect#PyRunner rdf-connect/py-runnerJvmRunner
https://w3id.org/rdf-connect#JvmRunner rdf-connect/jvm-runnerrdf-connect/orchestrator-js
rdf-connect/orchestrator-jssmessie/DCAT-AP-Feeds
smessie/DCAT-AP-Feedsajuvercr/mumo-pipeline
ajuvercr/mumo-pipelinerdf-connect/RDF-Connect-RINF-LDES
RDF-Connect pipelines for producing and consuming a LDES from RINF data
rdf-connect/RDF-Connect-RINF-LDESrdf-connect/example-pipelines
Collection of example pipelines for RDF-Connect grouped per programming language.
rdf-connect/example-pipelinesrdf-connect/CA-Blue-Bike-LDES
Connector Architecture-based pipeline to publish an LDES from the Blue Bike API
rdf-connect/CA-Blue-Bike-LDESrdf-connect/ldes2sparql
RDF-Connect pipeline for materializing an LDES into a SPARQL graph store
rdf-connect/ldes2sparqlrdf-connect/marine-regions-ldes-mirror
RDF-Connect pipeline to republish a content-wise mirrored LDES for the Marine Regions dataset
rdf-connect/marine-regions-ldes-mirror