DevOps Articles

Simplified Data Pipelines with Pulsar Transformation Functions

Using functions in the cloud is a very efficient way of creating iterable workflows that can transform data, analyze source code, make platform configurations, and do many other useful jobs. A typical function in production isn’t just one simple class doing some simple job — that’s usually hello world :).

These are pre-made Pulsar functions that can be your boilerplate processes in a data pipeline.

Here is an example of connecting multiple functions together in series, to manipulate message data: Say, for example, the Pulsar function using this transformation had a KeyValue input type.

The “enricher” function: The “filter” function: The “cbr” function: Getting Started with Transformation Functions