Maintain and extend collection of demo data pipelines
Our company has built a tool using Python to monitor data pipelines and services.
To test and demonstrate the tool's capabilities, we have a set of demo 'playground' pipelines with various simple tasks...
- data ingest
- ETL
- model training
- model deployment
The pipelines demonstrate the ability to work with a wide variety of common data science and analytics resources:
- AWS / GCP services (deployment with Pulumi)
- AWS S3 / GCP Cloud Storage
- APIs
- database operations
We want to keep extending and refining these demos as we continue to build features for our product:
- dbt
- Airbyte
- Databricks
- Snowflake
- etc
We'd like to find someone willing to take on a few tasks per week to help maintain and expand these demos and docs.
The budget is limited to start, with opportunity to renegotiate after 2 weeks. You are encouraged to use cursor and Claude Sonnet 3.5. We are very flexible on scheduling.
Example tasks we have for the upcoming few weeks:
- Establish an API Gateway (v1) for public access to an AWS Lambda, secured with rate limiting and a secret key
- Create a copy of an existing AWS Lambda pipeline with an event-driven architecture instead of a single python script
- Create a copy of an existing AWS Lambda model training script as a Databricks notebook
- Create a copy of an existing AWS Lambda pipeline using Airbyte
- Create a copy of an existing AWS Lambda pipeline using dbt
- Create a copy of an existing AWS Lambda pipeline using AWS Glue
- Create a sample dataset and load it into Snowflake
- Create a sample dataset and load it into Postgres (Neon)
- Update an existing pipeline task so that it will fail (timeout) every Saturday
- Update an existing pipeline task so that it will fail (bad API key) every Wednesday
If this is of interest, please introduce yourself and share
- a desired weekly budget,
- desired number of hours, and
- which of the above tasks you'd expect to be able to accomplish in a first week given ~4 hours (half a day
Similar Remote Jobs
Maintain and extend collection of demo data pipelines
Posted on: 27-08-2024 00:00
The Ideal Remote Job: Reviewing Products on Amazon
Posted on: 27-08-2024 00:00
Remote Data Entry Work From Home Research Panelist
Posted on: 27-08-2024 00:00
AirBNB Customer Service Representatives-Work from Home (Hiring Now)
Posted on: 27-08-2024 00:00
Fedex Data Entry Remote Jobs up to $25/Hour
Posted on: 27-08-2024 00:00
Overnight Customer Service Representative ( Part Time )
Posted on: 27-08-2024 00:00
Humana Hiring Remote Inbound Contacts Representative, Equipment Included
Posted on: 27-08-2024 00:00
Data Entry Clerk Full Time ( 100% Remote)
Posted on: 27-08-2024 00:00
Delta Data Entry Pharmacy Technician - Remote Jobs
Posted on: 27-08-2024 00:00
Amex Virtual Assistant ( Work At Home )
Posted on: 27-08-2024 00:00
Amazon Seller Chat Support Jobs: Work from Home, Earn $25-$35...
Posted on: 16-07-2024 18:42
Healthcare Data Analyst
Posted on: 22-09-2024 00:00
Business Analyst/Solution Architect/ peoplesoft consultant
Posted on: 14-02-2025 07:18
Experienced Travel Agent- Remote Late Night/Overnight/Weekends/ Holidays Mandatory
Posted on: 20-11-2024 13:46
Customs Brokerage Rep II Tues-Fri 9am to 5:30pm & Saturday 8am to 4:30pm - *REMOTE*(Must live in the Aiken, SC area)
Posted on: 04-12-2024 05:42
VP of Marketing
Posted on: 05-01-2025 17:57
Software Engineer, Oracle PL/SQL
Posted on: 20-01-2025 00:00
Lecturer: ICT for Development (Part-Time)
Posted on: 19-11-2024 06:06
Technical Support Pro
Posted on: 03-09-2024 00:00
System integration engineer
Posted on: 25-09-2024 00:00