Discover Existing Work
RDF-Connect empowers developers to build modular, reusable, and interoperable data processing pipelines. Since its inception, many developers have contributed processors, runners, orchestrators, and complete pipelines across various use cases and environments. This means you don’t have to start from scratch — much of what you need may already exist. On this page, you’ll be able to discover such existing components, ready to be reused and adapted to your own needs. By leveraging the work of those who came before you, you can accelerate development, ensure consistency, and focus on what makes your pipeline unique.
This discoverability is made possible through GitHub’s topic-based search. By using standardized topics, it’s easy to find RDF-Connect-related components across the platform. To support this, we encourage all developers to annotate their repositories with the topic rdf-connect for general inclusion in the ecosystem. Additionally, please use one or more of the following specific tags to classify your contribution: rdfc-processor, rdfc-runner, rdfc-orchestrator, or rdfc-pipeline. Consistent tagging not only increases visibility but also strengthens the discoverability and reusability of your work for others in the community.
ldes client
https://w3id.org/rdf-connect#LdesClientAn LDES client that can read a stream of members from an LDES.
rdf-connect/ldes-clientSHACL Validate Processor
https://w3id.org/rdf-connect#ValidateA processor that validates incoming RDF data against a SHACL shapes graph.
rdf-connect/shacl-processor-tsrdf-connect/rml-utils-processor-ts
Collection of Typescript utilities around RML tools that includes a wrapper over the RML Mapper to be reused within the RDF-Connect ecosystem
rdf-connect/rml-utils-processor-tsJS/TS Template Processor
https://w3id.org/rdf-connect#TemplateProcessorJsTemplate processor to kickstart the development of your next TypeScript RDF-Connect processor.
rdf-connect/template-processor-tsrdf-connect/sds-storage-writer-ts
rdf-connect/sds-storage-writer-tsBucketizer processor
https://w3id.org/rdf-connect#Bucketize rdf-connect/sds-processors-tsSimple Data Generator
https://w3id.org/rdf-connect#Generate rdf-connect/sds-processors-tsLdes Disk Writer
https://w3id.org/rdf-connect#LdesDiskWriterWrites a LDES to local files
rdf-connect/sds-processors-tsLdesify processor
https://w3id.org/rdf-connect#Ldesify rdf-connect/sds-processors-tsLdesify processor (for sds streams)
https://w3id.org/rdf-connect#LdesifySDS rdf-connect/sds-processors-tsMember to Named Graph member
https://w3id.org/rdf-connect#MemberAsNamedGraphTransform a stream of SDS wrapped members into a named graph-based member.
rdf-connect/sds-processors-tsSdsify processor
https://w3id.org/rdf-connect#Sdsify rdf-connect/sds-processors-tsShapify processor
https://w3id.org/rdf-connect#Shapify rdf-connect/sds-processors-tsStream Join processor
https://w3id.org/rdf-connect#StreamJoinHandle and pipe multiple input data streams into a single output stream.
rdf-connect/sds-processors-tsSPARQL Ingest Processor
https://w3id.org/rdf-connect#SPARQLIngestA processor that ingests RDF data into a SPARQL endpoint
rdf-connect/sparql-ingest-processor-tsajuvercr/mumo-pipeline
Pipeline for the MuMo project, building a LDES from data generated by custom sensors
ajuvercr/mumo-pipelinesmessie/ldes-harvester-processor-ts
RDF-Connect processor to harvest an LDES with some additional options to the ldes-client
smessie/ldes-harvester-processor-tsrdf-connect/xml-utils-processors-ts
Typescript util functions related to XML including a wrapper over the Saxon-HE library to be used within the RDF-Connect ecosystem
rdf-connect/xml-utils-processors-tsRmlMapper
https://w3id.org/rdf-connect#RmlMapper rdf-connect/rml-processor-jvmPython Template Processor
https://w3id.org/rdf-connect#TemplateProcessorPyTemplate processor to kickstart the development of your next Python RDF-Connect processor.
rdf-connect/template-processor-pyPython Log Processor
https://w3id.org/rdf-connect#LogProcessorPyA simple Python processor to log an incoming stream to the RDF-Connect logging system.
rdf-connect/log-processor-pyPython Send Processor
https://w3id.org/rdf-connect#SendProcessorPyA simple Python processor to send an array of messages to a channel.
rdf-connect/log-processor-pyrdf-connect/replication-processor-ts
A processor for the RDF Connect framework that writes an incoming stream to disk and later reads it into the output stream.
rdf-connect/replication-processor-tsGlobRead
https://w3id.org/rdf-connect#GlobReadReads all files according to the Glob pattern
rdf-connect/file-utils-processors-tsFolder Read
https://w3id.org/rdf-connect#FolderReadReads all files inside the folder
rdf-connect/file-utils-processors-tsString substitute processor
https://w3id.org/rdf-connect#SubstituteSimple string manipulation processor. Transform a stream by applying the string substitution on the messages. The matching string can be a regex.
rdf-connect/file-utils-processors-tsEnvironment substitute processor
https://w3id.org/rdf-connect#EnvsubSubstitutes all declared environment variables to their respective values.
rdf-connect/file-utils-processors-tsOn demand file reader processor
https://w3id.org/rdf-connect#ReadFileReads a requested file on demand.
rdf-connect/file-utils-processors-tsUnzip processor
https://w3id.org/rdf-connect#UnzipFileProcessor to unzip a compressed file and stream out its content.
rdf-connect/file-utils-processors-tsGunzip processor
https://w3id.org/rdf-connect#GunzipFileProcessor to gunzip a compressed file and stream out its content.
rdf-connect/file-utils-processors-tsrdf-connect/dumps-to-feed-processor-ts
A dumps to feed processor for the RDF Connect framework
rdf-connect/dumps-to-feed-processor-tsrdf-connect/osm-utils-processors-ts
RDF-Connect processors for interacting with OpenStreetMap data
rdf-connect/osm-utils-processors-tsHTTP Fetch processor
https://w3id.org/rdf-connect#HttpFetch rdf-connect/http-utils-processor-tsJS/TS Log Processor
https://w3id.org/rdf-connect#LogProcessorJsA simple JS/TS processor to log an incoming stream to the RDF-Connect logging system.
rdf-connect/log-processor-tsJS/TS Send Processor
https://w3id.org/rdf-connect#SendProcessorJsA simple JS/TS processor to send messages to a writer channel.
rdf-connect/log-processor-tsTestProcessor
https://w3id.org/rdf-connect#TestProcessor rdf-connect/template-processor-jvmrdf-connect/buffer-processor-ts
A processor to buffer data for the RDF Connect framework.
rdf-connect/buffer-processor-tsrdf-connect/blank-to-named-node-identifiers-processor-ts
rdf-connect processor to map entities with blank node identifiers to equivalents with named node identifiers
rdf-connect/blank-to-named-node-identifiers-processor-tsNodeRunner
https://w3id.org/rdf-connect#NodeRunner rdf-connect/js-runnerPyRunner
https://w3id.org/rdf-connect#PyRunner rdf-connect/py-runnerJvmRunner
https://w3id.org/rdf-connect#JvmRunner rdf-connect/jvm-runnerrdf-connect/orchestrator-js
rdf-connect/orchestrator-jsrdf-connect/CA-Blue-Bike-LDES
Connector Architecture-based pipeline to publish an LDES from the Blue Bike API
rdf-connect/CA-Blue-Bike-LDESrdf-connect/ldes2sparql
RDF-Connect pipeline for materializing an LDES into a SPARQL graph store
rdf-connect/ldes2sparqlrdf-connect/RDF-Connect-RINF-LDES
RDF-Connect pipelines for producing and consuming a LDES from RINF data
rdf-connect/RDF-Connect-RINF-LDESsmessie/DCAT-AP-Feeds
smessie/DCAT-AP-Feedsrdf-connect/example-pipelines
Collection of example pipelines for RDF-Connect grouped per programming language.
rdf-connect/example-pipelinesajuvercr/mumo-pipeline
Pipeline for the MuMo project, building a LDES from data generated by custom sensors
ajuvercr/mumo-pipelinerdf-connect/marine-regions-ldes-mirror
RDF-Connect pipeline to republish a content-wise mirrored LDES for the Marine Regions dataset
rdf-connect/marine-regions-ldes-mirror