Data Engineer
Confidential client · Full-time
Key Responsibilities:
- Gather, analyze, design, and implement requirements and optimization projects, including reports, system integrations, business process automation, and data delivery optimization.
- Create, maintain, and optimize data pipelines to extract data from source systems (cloud and on‑premises) and load it into a Data Lake.
- Assemble large, complex data sets that meet functional business requirements.
- Adapt configurations in alignment with central IT requirements for optimal extraction, transformation, and loading of data from a wide variety of sources.
- Evaluate and propose improvements to current architecture.
- Build analytics tools that leverage the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
- Develop small data tools/applications for analytics and data‑science team members to support product and production needs.
What We're Looking For:
- At least 5 years of professional experience as a Data Engineer and a graduate degree in Computer Science, Statistics, Informatics, Information Systems, or a related quantitative field.
- Advanced SQL knowledge and experience with relational databases and query authoring.
- Experience building and optimizing big‑data pipelines, architectures, and data sets.
- Experience with SQL and NoSQL databases and ETL transformation tools (e.g., Apache Camel, TimeXtender, Data Factory) and familiarity with file formats such as Parquet, JSON, CSV, XML; programming languages such as DAX, PowerShell, Python, Java, C++.
- Experience with Azure data components and Databricks.
- Strong analytical skills for working with unstructured data sets.
- Working knowledge of message queuing, stream processing, and highly scalable big‑data stores.
- Strong Agile methodology skills and experience with Azure DevOps Platform.
- Project management, technical leadership, and organizational abilities.
- Excellent written and spoken communication skills.
- ML/AI experience, SAP knowledge, and Azure data‑related certifications are a plus.
- Fluent English required; German is a plus.
Apply with your resumeWe'll score your resume against this role and send you a free assessment. Sampoorna's team follows up directly with strong matches.