Senior Data Engineer

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer based in United States. As a Senior Data Engineer, you will lead the design and development of scalable cloud-based data solutions that support complex business needs. You will build reliable data pipelines, optimize workflows, and transform diverse data sources into high-quality datasets for analysis and reporting. The role combines hands-on engineering with technical leadership, requiring close collaboration with architects, stakeholders, and client teams. You will work extensively across the Microsoft Azure ecosystem, modern data platforms, distributed processing, orchestration, and event-driven technologies. You will also provide technical guidance and mentorship to other data engineers while helping establish strong engineering practices. This fully remote U.S. role offers an opportunity to solve complex data challenges and contribute to innovative cloud data environments.

Design, develop, and maintain end-to-end data pipelines that efficiently collect, process, transform, and load data from multiple sources into cloud environments. Collaborate with data architects and stakeholders to ensure data pipelines are scalable, reliable, secure, and performant. Develop complex data transformation logic to prepare raw data for analysis, reporting, and downstream applications. Build, optimize, and maintain ETL/ELT processes while ensuring strong data quality, consistency, and integrity. Work directly with client stakeholders to understand data requirements and deliver effective data solutions and actionable insights. Lead and mentor a team of data engineers, providing technical direction and fostering a collaborative culture of innovation. Troubleshoot and resolve complex data engineering and platform issues. Apply modern cloud data engineering practices to improve data workflows, reliability, and operational efficiency. Stay current with advancements in cloud technologies, data platforms, distributed processing, and data engineering methodologies. Requirements: Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field. 5+ years of professional experience as a Data Engineer, with a strong focus on cloud-based data solutions. Strong hands-on expertise with Microsoft Azure and its data engineering services. Experience with Azure Databricks, Azure SQL Database, and Azure Synapse Analytics. Strong programming experience with Python, PySpark, and SparkSQL. Experience with orchestration and automation tools such as Azure Data Factory and Logic Apps. Experience with Azure Data Storage Gen2 and cloud-based storage architectures. Knowledge of event-processing technologies such as Kafka and Azure Event Hubs. Strong understanding of data modeling, ETL/ELT processes, data warehousing, and modern data architecture concepts. Proficiency with SQL and NoSQL databases and distributed data processing frameworks such as Apache Spark. Excellent analytical and problem-solving skills, with the ability to diagnose and resolve complex technical challenges. Strong leadership and communication skills, with the ability to guide, mentor, and collaborate effectively with technical teams and stakeholders. Relevant Microsoft Azure data certifications are considered a plus. Must be authorized to work in the United States; H-1B sponsorship is not available. Benefits: Fully remote position for candidates based in the United States. Opportunity to work on innovative cloud-based data engineering projects. Collaborative environment with opportunities to provide technical leadership and mentorship. Exposure to modern Microsoft Azure data technologies and distributed data platforms. Opportunities for professional growth and continued development of cloud and data engineering expertise.

laptop-ats-crawler v3