Dados, filas e jobs

Event bus that routes events between AWS services and apps.

Usada poriFood

AWS's data warehouse for analytics with SQL.

Usada porCreditas

Managed message queue on AWS.

Usada poriFood,Olist

Apache Airflow

Código aberto

Schedules and monitors data pipelines written in Python.

Usada porAirbnb,QuintoAndar

Apache Spark

Código aberto

Engine for processing large amounts of data across many machines.

Usada porNotion,Nubank

Apache Superset

Código aberto

Open source dashboards and charts over your data, born at Airbnb.

Usada porAirbnb

BigQuery

Código aberto

Google's serverless data warehouse for SQL analytics at scale.

Usada porDiscord,Nubank

Orchestrates data pipelines with a focus on the data assets they produce.

Usada porDiscord,PostHog

Databricks

Código aberto

Data and AI platform built on Spark for analytics, ETL and machine learning.

Usada poriFood,Nubank,PicPay,QuintoAndar+1

Transforms data inside the warehouse with tested, versioned SQL.

Usada porDiscord

Streams every change from your database as events (change data capture).

Usada porNotion

Google Cloud Pub/Sub

Código aberto

Managed messaging between services on Google Cloud.

Usada porDiscord,Linear

Durable background jobs and workflows for TypeScript, Python and Go.

Usada porDocumenso

Kafka

Código aberto

Distributed event streaming: services publish and consume streams of events.

Usada porAirbnb,iFood,Notion,Nubank+6

Background jobs for Ruby, backed by Redis.

Usada porGitLab,RD Station

Snowflake

Código aberto

Cloud data warehouse for analytics on large datasets.

Usada porNotion,Vercel

Temporal

Código aberto

Durable workflows: long-running jobs that survive crashes and retries.

Usada porFigma,Linear,PostHog

Open source background jobs and long-running tasks for TypeScript.

Usada porCal.com