Our client is seeking a Senior Data Engineer to design, build, and optimize scalable data platforms and pipelines that enable reliable, high-performance, data-driven decision-making across the organization. Must Have Skills 5+ years of experience in data engineering and building scalable data solutions. Strong hands-on experience with Scala and large-scale data processing. Expertise in Apache Spark for distributed data processing. Advanced proficiency in SQL and complex data transformations. Experience designing and developing scalable data pipelines. Strong knowledge of Data Lakes and modern data platform architecture. Solid understanding of data structures and data engineering best practices. Experience with data intelligence concepts and technologies. Experience with distributed systems and cloud platforms (AWS, Azure, or GCP). Strong understanding of data modeling, data warehousing, and data governance. Ability to work effectively in a collaborative Agile environment. Nice to Have Skills Experience with Python (PySpark). Exposure to Machine Learning workflows. Experience with ML pipelines or MLOps. Familiarity with data intelligence and data cataloging tools. Experience using Python for scripting and analytics. Responsibilities Design and build scalable data pipelines using Scala, Spark, and SQL. Develop core components of modern data platforms. Collaborate with data analysts, data scientists, and product teams to understand business and data requirements. Ensure data quality, consistency, and availability for analytics and reporting. Monitor, troubleshoot, and optimize data workflows for performance and reliability. Contribute to data platform architecture and cloud-native solution design. Evaluate and implement modern data intelligence tools and engineering practices. #LI-KS1 #D480
