Senior Data Engineer – Enterprise Data Frameworks (Java Spark Focus)
About the position Senior Data Engineer – Enterprise Data Frameworks Overview The Enterprise Data Frameworks team is seeking a Senior Data Engineer with deep expertise in building scalable, high-performance data processing systems using Java, Apache Spark, and modern data engineering tools. This role is ideal for someone passionate about designing resilient data frameworks, optimizing distributed data pipelines, and enabling enterprise-grade data onboarding and automation. As a Senior Data Engineer, you will lead the development of core components within our data frameworks, integrating Spark-based processing with backend services and APIs. You will collaborate with architects, data engineers, and business stakeholders to deliver secure, compliant, and high-performing solutions. Responsibilities • Design and implement distributed data processing pipelines using Apache Spark (Java) for large-scale data ingestion, transformation, and analytics • Develop and maintain Java-based microservices and APIs to support data workflows and framework orchestration • Collaborate with UI engineers to integrate backend services with frontend applications for seamless user experiences • Translate business and technical requirements into scalable data engineering solutions • Optimize Spark jobs for performance, reliability, and cost-efficiency across cloud and on-prem environments • Lead code reviews, mentor junior engineers, and contribute to architectural decisions • Ensure compliance with data governance, security, and change management standards • Participate in Agile ceremonies and drive continuous improvement in engineering practices Requirements • 7+ years of experience in data engineering with strong proficiency in Java and Apache Spark • Proven experience building and optimizing Spark jobs for batch and streaming data • Solid understanding of data lake architectures, Iceberg/Parquet, and metadata-driven frameworks • Experience with Spring Boot, RESTful APIs, and microservices architecture • Familiarity with CI/CD pipelines, Git, and containerization (Docker/Kubernetes) • Exposure to cloud platforms such as AWS (S3, EMR, Lambda, API Gateway) is a plus • Experience working with data-centric applications and collaborating with frontend and platform teams • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field Nice-to-haves • Experience with Generative AI tools or frameworks for developer assistance, metadata analysis, or automation Benefits • We offer competitive pay, comprehensive medical, dental and vision coverage, retirement benefits, maternity/paternity leave, flexible work arrangements, education reimbursement, wellness programs and more. • Note, Citizens’ paid time off policy exceeds the mandatory, paid sick or paid time-away policy of very local and state jurisdiction in the United States. • For an overview of our benefits, visit Apply tot his job