We are seeking an experienced Data Engineer to join our clients team. The ideal candidate should have a strong background in database technologies, proficient in advanced SQL, skilled in Python programming, and experienced with big data tools. The primary responsibilities will include developing and maintaining ETL pipelines, optimizing database performance, writing high-level SQL queries, and leveraging Python for data manipulation and automation.
Key Responsibilities:
- Design, develop, and maintain scalable ETL pipelines to process large volumes of data efficiently.
- Write and optimize advanced SQL queries for data analysis and reporting purposes.
- Utilize Python programming for data manipulation, automation, and building data processing workflows.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights.
- Implement data quality checks and ensure data integrity throughout the data pipeline.
- Stay up-to-date with emerging technologies and best practices in data engineering and big data processing.