The Data Engineer will help in developing high performance & high scalability enterprise applications using one or more leading cloud platforms across SaaS and PaaS. They will be working closely with the data architects to jointly develop the data architecture and ensure security and maintenance. Their role also involves the diagnosis of existing architecture and data maturity and helping the organization identify gaps and possible solutions. They will also work with data scientists and business leadership to develop data pipelines for model development and production. Their work will involve a high level of interface with business heads and corporate leadership.
Key Responsibilities
- Gather requirements, assess gaps and build roadmaps and architectures
- Explore suitable options, design, and create data pipelines (data lake/data warehouses) for specific analytical solutions Define ETL / ELTdata security, quality and automationmaintenance, bug fixing and performance analysis along the data pipeline
- Build and manage cloud data services
Desired Skills / Competencies
Education + Technical skills/experience
- Bachelor's degree in Computer Science, Engineering, Mathematics or Statistics. Master's degree preferred3+ years of experienceSQL, PL/SQL or T-SQLPythonMicrosoft Azureaintaining and configuring data engineering and ETL toolsHive, Spark, Hadoop, or Presto
Managerial Skills
- Ability to work well in agile environments in diverse teams with multiple stakeholders
- Strong project management and organizational skills
- Ability to effectively communicate complex analytical and technical content
Mindset & Behavior
- High energy and passionate individual who inspires teammates to reach their
- maximum potential
- Excited about trying new solutions outside standard approved
- Willing to adopt an iterative approach; and experimental mindset to drive innovation