Data Engineer-(Scala and Spark)
Job Description
We are looking for a highly skilled Data Engineer with expertise in Scala and Apache Spark to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and solutions to manage and process large datasets efficiently.
Key Responsibilities: ? Design and implement robust, scalable, and high-performance data pipelines using Scala and Apache Spark. ? Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. ? Optimize data processing systems and ensure their scalability and efficiency. ? Work on data extraction, transformation, and loading (ETL) processes for various structured and unstructured datasets. ? Implement best practices for data engineering, including data governance, data quality, and monitoring. ? Debug and resolve data processing and performance issues promptly. ? Ensure data security and compliance with relevant regulations and guidelines.
Skills & Qualifications: ? Strong programming skills in Scala with 3+ years of hands-on experience. ? Proficiency in Apache Spark for large-scale data processing. ? Familiarity with Hadoop Ecosystem (e.g., HDFS, Hive, HBase) is a plus. ? Experience with cloud platforms like AWS, Azure, or GCP. ? Knowledge of relational and non-relational databases (e.g., PostgreSQL, MongoDB). ? Hands-on experience with data versioning, CI/CD pipelines, and orchestration tools (e.g., Airflow). ? Strong problem-solving skills and ability to work in an Agile environment. ? Knowledge of containerization tools (Docker, Kubernetes) is an advantage.
Educational Background:
? Bachelor?s or Master?s degree in Computer Science, Engineering, or a related field.
Experience: 3-6 years
Similar Remote Jobs
Data Engineer-(Scala and Spark)
Posted on: 22-11-2024 05:34
Delta work from home jobs
Posted on: 22-11-2024 05:34
Remote Embedded Software Engineer Jobs
Posted on: 22-11-2024 05:34
Remote Customer Chat Support Specialist ? Entry Level
Posted on: 22-11-2024 05:34
(Ohio) Virtual Assistant, Remote Mystery Shopper Needed ???
Posted on: 22-11-2024 05:34
Behavioral Health | Flexible Schedule| Remote
Posted on: 22-11-2024 05:34
WFH Call Center Representative Remote
Posted on: 22-11-2024 05:34
Remote Data Entry Clerk No Experience
Posted on: 22-11-2024 05:34
Now Hiring Remote Sales Experts: Apply Today
Posted on: 22-11-2024 05:34
Remote Online Amazon Chat Jobs No Experience ? Easy Jobs Hiring Near Me ? No Experience Needed
Posted on: 22-11-2024 05:34
Online Amazon Chat Support Jobs No Experience /REMOTE/ – Part-Time
Posted on: 19-09-2024 00:00
Customer Support, Bilingual English/Spanish - Phones (4347)
Posted on: 20-11-2024 13:46
Data Analyst (Fully Remote)
Posted on: 14-10-2024 04:22
Remote Full-Stack Front-End-Focused Engineer Jobs | Turing
Posted on: 27-08-2024 00:00
Staff Software Engineer, Retail Media (Remote)
Posted on: 24-01-2025 04:52
Chewy Work-from-Home Careers ? Apply for Flexible Jobs
Posted on: 23-02-2025 00:00
Audio Post Production Engineer (Remote)
Posted on: 02-12-2024 03:11
Live Chat Assistant Call Center Jobs - Work From Home
Posted on: 24-01-2025 04:51
(Remote) Data Entry Jobs At Disney
Posted on: 30-11-2024 09:47
Part Time Digital Communications Manager (Education Charity, Remote in the UK)
Posted on: 15-10-2024 08:32