Ylem documentation
  • 🗒️General information
    • Introduction to Ylem
    • Quick start guide
    • Release notes
  • 🔬Open-source edition
    • Installation
    • Usage of Apache Kafka
    • Task processing architecture
    • Configuring integrations with .env variables
  • 💡Integrations
    • Connecting an integration
    • Library of integrations
      • Amazon Redshift
      • Apache Kafka
      • APIs
      • Atlassian Jira
      • AWS Lambda
      • AWS RDS
      • AWS S3
      • ClickHouse
      • ElasticSearch
      • E-mail
      • Google Big Query
      • Google Cloud SQL
      • Google Pub/Sub
      • Google Sheets
      • Immuta
      • Incident.io
      • Jenkins
      • Hubspot
      • Microsoft Azure SQL
      • MySQL
      • OpenAI ChatGPT
      • Opsgenie
      • PostgreSQL
      • PlanetScale
      • RabbitMQ
      • Salesforce
      • Slack
      • Snowflake
      • Tableau
      • Twilio. SMS
      • WhatsApp (through Twilio)
    • Initial demo data source
  • 🚡Pipelines
    • Pipeline management
    • Tasks
      • Aggregator
      • API Call
      • Code
      • Condition
      • External trigger
      • Filter
      • For each
      • GPT
      • Merge
      • Notification
      • Query
      • Pipeline runner
      • Processor
      • Transformer
    • Running and scheduling pipelines
    • Library of templates
    • Environment variables
    • Mathematical functions and operations
    • Formatting of messages
  • 📈Statistics and profiling
    • Statistics of runs
    • Slow tasks
  • 📊Metrics
    • Metric management
    • Using previous values of a metric
  • 💼Use cases, patterns, templates, examples
    • Use cases
    • Messaging patterns
      • Datatype Channel
      • Message Dispatcher
      • Messaging Bridge
      • Message Bus
      • Message Filter
      • Message Router
      • Point-to-Point Channel
      • Publish-Subscribe Channel
      • Pull-Push
    • Functional use cases
      • Streaming from Apache Kafka and messaging queues
      • Streaming from APIs
      • Streaming from databases
      • Data orchestration, transformation and processing
      • Usage of Python and Pandas
      • KPI Monitoring
      • OKRs and custom metrics
      • Data Issues & Incidents
      • Reporting
      • Other functional use cases
    • Industry-specific use cases
      • Finance and Payments
      • E-commerce & Logistics
      • Customer Success
      • Security, Risk, and Anti-Fraud
      • Anti-Money Laundering (AML)
  • 🔌API
    • OAuth clients
    • API Reference
  • 👁️‍🗨️Other resources
    • FAQ
    • Our blog on Medium
Powered by GitBook
On this page
  • Release history
  • Release 10.02.2025
  • Release 07.11.2024
  • Release 06.09.2024
  • Release 17.07.2024
  • Release 20.06.2024
  • Release 30.05.2024
  • Release 19.05.2024
  • Release 10.05.2024
  • Release 02.04.2024
  • Release 26.03.2024
  • Release 23.03.2024
  • Release 20.02.2024
  • Release 22.01.2024
  • Release 19.01.2024
  • Release 17.01.2024
  • Release 14.01.2024
  • Release 12.01.2024
  • Release 09.01.2024
  • Release 20.12.2023
  • Release 26.11.2023
  • Release 29.07.2023
  • Release 23.07.2023
  • Release 27.03.2023
  • Release 18.03.2023
  • Release 14.03.2023
  • Release 17.02.2023
  • Release 16.02.2023
  • Release 15.01.2023
  • Release 12.01.2023
  • Release 09.01.2023
  • Release 07.01.2023
  • Release 19.12.2022
  • Release: 09.12.2022
  • Release: 28.11.2022
  • Release date: 26.11.2022
  • Release date: 23.11.2022
  • Release date: 10.11.2022
  • Release date: 01.11.2022
  • Release date: 20.10.2022
  • Release date: 01.10.2022
  • Release date: 23.09.2022

Was this helpful?

Edit on GitHub
  1. General information

Release notes

PreviousQuick start guideNextInstallation

Last updated 2 months ago

Was this helpful?

Release history

Only important major releases are present in this list:

Release 10.02.2025

  • Integration with WhatsApp (through Twilio)

Release 07.11.2024

  • Open-source edition. The first beta version is on

Release 06.09.2024

  • Datamin becomes Ylem

Release 17.07.2024

  • Dark UI theme as the default theme

  • Logging and profiling for the "" task

  • Support of several new Python modules for the "" task

  • Pipeline canvas UI improvements

Release 20.06.2024

  • Improvements in the error logging for tasks and pipelines

  • Improvements in the UI for OAuth

Release 30.05.2024

  • Main dashboard improvements

  • Graphs of pipeline and metric runs per month on the dashboard

Release 19.05.2024

  • Streaming from AWS S3 to Datamin's pipeline through AWS Lambda

Release 10.05.2024

  • Brand new fully reworked documentation

Release 02.04.2024

  • Pipelines instead of workflows

Release 26.03.2024

  • Insert/Update data in SQL databases with Query task

Release 23.03.2024

  • Integrations instead of data sources and destinations.

Release 20.02.2024

  • Performance improvements for statistics and profiling modules

Release 22.01.2024

  • Frontend improvements and bugfixes

Release 19.01.2024

  • Significantly improved performance, load balancing, and resource consumption of the workflow scheduler and runner

Release 17.01.2024

  • Profiling of slow queries and other tasks

Release 14.01.2024

  • Logs for metrics

  • Improvements in statistics for workflows and metrics

Release 12.01.2024

  • "Pandas" Python data analytics library is available in the "Code" task

  • Logs of runs for workflows

Release 09.01.2024

  • Introduction of the dark mode/light mode

  • A new informative and powerful dashboard

  • Searching bar for workflows, metrics, and tasks

  • Performance improvements and a higher speed of resource loading

Release 20.12.2023

Release 26.11.2023

  • Better organized workflows and metric views with tabs

  • Bigger and more informative forms for editing tasks

  • Better code highlighting and line numbers in all the fields with SQL, Python, and Long texts

  • As a preparation for introducing more programming languages in workflows, the Python task was renamed to Code

Release 29.07.2023

  • Improved visibility of historical metric values on the statistics page and in the list of metrics

Release 23.07.2023

  • New UI for workflows for better profiling and debugging

Release 27.03.2023

  • New destination: Jenkins. Jobs can now be triggered directly from Datamin's workflows

  • Improvements in demo workflows and metrics

Release 18.03.2023

  • New functions for metrics: METRIC_QUANTILE, METRIC_MEDIAN.

Release 14.03.2023

  • Atlassian Opsgenie as a new destination for alerts

Release 17.02.2023

Release 16.02.2023

Release 15.01.2023

  • Sending messages in private groups in Slack

Release 12.01.2023

  • Folders and templates for metrics

  • Grid/list views for metrics and workflows

Release 09.01.2023

  • Supporting ClickHouse as a data source

Release 07.01.2023

  • Introducing metrics and thresholds

Release 19.12.2022

  • Amazon Redshift as a data source

Release: 09.12.2022

  • Environment variables

Release: 28.11.2022

  • Integration of workflows with data streaming platforms as data sources: Kafka first.

Release date: 26.11.2022

  • Integration with Google Spreadsheets as a destination

Release date: 23.11.2022

  • Extended API. Added multiple endpoints to pull statistics about workflow and task runs

Release date: 10.11.2022

  • Integration with Salesforce

Release date: 01.11.2022

  • Cloning of workflows

Release date: 20.10.2022

  • New task "Filter"

  • A possibility to edit the aggregator's variable name

Release date: 01.10.2022

  • Workflow templates are now visible in the list of workflows and marked with the "template" label

Release date: 23.09.2022

  • Integration with Hubspot Tickets as a destination

New : ABS, NEG, SIGN, INT, STRING

An open-source .

New task: Processor with the functionality of library

Open source library for streaming data from RabbitMQ:

Adding function to metrics

Introducing for data transformation in workflows

🗒️
https://github.com/ylem-co/ylem
Run pipeline
Code
math functions
AWS S3 to pipeline lambda trigger
jq
https://github.com/datamin-io/datamin-rabbitmq-consumer
METRIC_AVG
Python