Cloud

Automate the deployment of applications in the cloud and help developers build data products.

Overview

We’re building open-source technology that empowers developers to build streaming data and real‑time AI applications with basic SQL skills. To make our platform easy to use we’re looking for a DevOps & Cloud Engineer to automate cloud deployment for the data pipelines.

You’ll design and operate deployment pipelines and an observability platform for data pipelines using Terraform and modern cloud‑native tooling. You’ll collaborate with a supportive team of data nerds and an open‑source community that’s eager for an easy path to production.

What You’ll Do

• Build and maintain automated deployment workflows for ‑compiled data pipelines.

• Define cloud infrastructure (primarily on AWS) using Infrastructure‑as‑Code (IaC) tools such as Terraform.

• Stand up and manage production‑grade services and data infrastructure.

• Implement end‑to‑end observability across multiple services for monitoring, incident detection, and operational management.

• Collaborate with contributors and internal engineers to simplify the path from prototype to production.

Technologies You’ll Work With

You’ll primarily work with Terraform and related DevOps tooling for AWS services, including:

• EMR, RDS, MSK (Managed Streaming for Apache Kafka), Fargate, Kinesis, and more.

Our initial focus is deployment on AWS, with other cloud providers to follow.

Skills We Value

• Cloud Services: Orchestrating and deploying cloud services for development and production workloads.

• Microservices Architecture: Understanding and operating microservices in production.

• AWS Ecosystem: Building applications and workflows with AWS services (EMR, RDS, MSK, Fargate).

• DevOps Automation: Automating deployment workflows with existing tools and custom implementations.

• Java Ecosystem: Understanding Java build systems, JAR packaging, and module systems for effective code organization and execution.

• Observability: Implementing cross‑service observability for monitoring, incident detection, and operations.

Qualities We Admire

• Automation Mindset: If a computer can do it, a computer should do it.

• Adaptability: Thrive in a dynamic environment with evolving challenges and tech updates.

• Analytical Thinking: Dissect complex problems to identify the optimal solution path.

• Community Building: Foster a welcoming, supportive, and safe open‑source community.

• Communication: Explain complex topics clearly to internal and external audiences.

• Simplicity: Prefer straightforward approaches, even in intricate systems.

Location & Work Style

• Americas and Europe. A distributed team with a strong remote‑work culture.