Data Engineer-(Scala and Spark)
Job Description
We are looking for a highly skilled Data Engineer with expertise in Scala and Apache Spark to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and solutions to manage and process large datasets efficiently.
Key Responsibilities: ? Design and implement robust, scalable, and high-performance data pipelines using Scala and Apache Spark. ? Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. ? Optimize data processing systems and ensure their scalability and efficiency. ? Work on data extraction, transformation, and loading (ETL) processes for various structured and unstructured datasets. ? Implement best practices for data engineering, including data governance, data quality, and monitoring. ? Debug and resolve data processing and performance issues promptly. ? Ensure data security and compliance with relevant regulations and guidelines.
Skills & Qualifications: ? Strong programming skills in Scala with 3+ years of hands-on experience. ? Proficiency in Apache Spark for large-scale data processing. ? Familiarity with Hadoop Ecosystem (e.g., HDFS, Hive, HBase) is a plus. ? Experience with cloud platforms like AWS, Azure, or GCP. ? Knowledge of relational and non-relational databases (e.g., PostgreSQL, MongoDB). ? Hands-on experience with data versioning, CI/CD pipelines, and orchestration tools (e.g., Airflow). ? Strong problem-solving skills and ability to work in an Agile environment. ? Knowledge of containerization tools (Docker, Kubernetes) is an advantage.
Educational Background:
? Bachelor?s or Master?s degree in Computer Science, Engineering, or a related field.
Experience: 3-6 years
Similar Remote Jobs
Data Engineer-(Scala and Spark)
Posted on: 22-11-2024 05:34
Delta work from home jobs
Posted on: 22-11-2024 05:34
Remote Embedded Software Engineer Jobs
Posted on: 22-11-2024 05:34
Remote Customer Chat Support Specialist ? Entry Level
Posted on: 22-11-2024 05:34
(Ohio) Virtual Assistant, Remote Mystery Shopper Needed ???
Posted on: 22-11-2024 05:34
Behavioral Health | Flexible Schedule| Remote
Posted on: 22-11-2024 05:34
WFH Call Center Representative Remote
Posted on: 22-11-2024 05:34
Remote Data Entry Clerk No Experience
Posted on: 22-11-2024 05:34
Now Hiring Remote Sales Experts: Apply Today
Posted on: 22-11-2024 05:34
Remote Online Amazon Chat Jobs No Experience ? Easy Jobs Hiring Near Me ? No Experience Needed
Posted on: 22-11-2024 05:34
Transportation Representative, NOC IB SKED
Posted on: 24-09-2024 00:00
Entry Level Nonprofit Researcher (Part Time)
Posted on: 20-01-2025 00:00
Part-Time Data Entry Clerk
Posted on: 12-09-2024 00:00
Remote Customer Care Associate - Immediate Start (Entry Level / No Prior Experience Required)
Posted on: 02-12-2024 03:10
Licensed Customer Success Associate
Posted on: 31-07-2024 19:12
Sr. Mgr Consumer Insights
Posted on: 05-11-2024 03:45
Remote Amazon Connect Developer Jobs | Turing
Posted on: 11-09-2024 00:00
Job At Home CVS Pharmacy $27/Hour
Posted on: 24-01-2025 00:00
Software Engineer II, Backend
Posted on: 16-07-2024 18:46
Vice President, Platform Product Management
Posted on: 16-07-2024 18:42