As Data Engineer will responsible for developing and maintaining data platforms and deliver with our team of Data Engineers through challenges.
This key role embraces participating in the entire engineering lifecycle and ensuring successful data platform implementation. The ideal candidate will build and design data pipelines, act as a trusted advisor for Airflow technology for clients and enhance process effectiveness. A Data Engineer collaborates with project team on project delivery and standards, with expertise in Datawarehouse and Lakehouse development for large-scale customers. Essential skills include communication, collaboration, problem-solving, a data-driven mindset, and a passion for automation.
What makes you a great fit?
Key technologies
Airflow | Data Platforms | SQL | Python | CI/CD | Azure | Data Services | Databricks
- 3+ years of experience in configuration/release management, deployment, maintenance and familiarity with various Data Platforms and practices in data area
- Strong experience in Airflow pipeline orchestration and optimization
- Very good coding skills with knowledge of best practices in SQL, Python
- Conceptual and technical knowledge on CI/CD Pipelines, Automation Practices, Technical Operations Monitoring
- Experience in Azure Data services, Databricks is a must
Nice to have
- Experience with Vertica, AWS EMS
- Experience with Lakehouse automation tools and frameworks
Soft skills
- Analytical Thinking
Ability to interpret data, identify trends, and provide actionable insights to drive business decisions. - Problem-Solving Skills
Proactively identify and resolve issues related to BI systems, ensuring smooth operations and data accuracy. - Effective Communication
Ability to explain technical concepts to non-technical stakeholders clearly and concisely, fostering understanding and collaboration. - Attention to Detail
Meticulous in data validation, report generation, and ensuring data quality across BI platforms. - Team Collaboration
Strong interpersonal skills to work effectively in cross-functional teams, coordinating with IT, business analysts, and other stakeholders. - Adaptability and Continuous Learning
Open to learning new tools and technologies in the rapidly evolving BI landscape and adjusting to changing business needs.
What will you do?
- Design and build cloud-based data pipelines and architectures.
- Integrate data from various structured and unstructured sources and formats.
- Implement automation for data workflows and support CI/CD processes.
- Optimize performance and resource usage of cloud data solutions.
- Maintain up-to-date knowledge of new technologies in data and cloud engineering.
- Monitoring, troubleshooting, and optimizing data systems for performance and cost.
- Supporting deployment of analytics and machine learning solutions on cloud platforms.
- Documenting processes, infrastructure, and best practices for future scalability
Our benefits
Your journey with us starts here:
1. Initial Screening: If you meet our requirements, our recruiter will reach out to you for a chat about your motivations and expectations. Get ready to share your passion!
2. Technical Interview: Next, you'll be invited to showcase your skills in an interview with one of our technical experts or team members. This is your chance to shine and demonstrate your expertise.
3. Final Interview: Finally, you'll have the opportunity to meet your future Team Lead. This is the perfect moment to learn more about the role, the team, and to ask any questions you might have.