Associate Software Engineer

 Job Requirements

Design and implement scalable, reliable distributed data processing frameworks and analytical infrastructure.

Be part of a team to define, design, and implement data integration, management, storage, consumption, backup, and recovery solutions that ensure the high performance of the organization's enterprise data.

Develop Structured Query Language (SQL), Data Definition Language (DDL), and Python or equivalent programming scripts to support data pipeline development, problem-solving, data validation, and performance tuning.

Work with software engineers, devops, ML engineers, and data scientists to achieve the organization’s goals.

Shift: 9.00am - 6.00pm

Location: Battaramulla (On-Site)

Job Requirements

Minimum 0.6 - 1 years experience in the similar capacity with BS/MS degree in Computer Science, Engineering or a related subject.

Strong knowledge of python programming languages is required.

Experience with FastAPI, Django, Django REST Framework, and Celery for background task processing.

Strong understanding of SOLID principles and ability to write clean, reusable, and maintainable code.

Knowledge of MongoDB or AWS DocumentDB, along with caching technologies such as Redis.

Experience with data engineering tools and platforms, including Delta Lake and Data Lakehouse architectures

Proficiency in ELT/ETL data pipeline orchestration tools, such as Apache Airflow.

Understanding about data warehousing solutions, relational database theories and no-sql databases.

Good knowledge of new and emerging tools for extracting, ingesting and processing of large datasets (Kafka, Spark, Hadoop, DataBricks or equivalent).

Hands-on experience with Amazon Web Services is a big plus and knowledge about other cloud systems (Azure/GCP).

Understanding about dockerization and kubernetes, data modeling and design patterns is a big plus.

Knowledge of web scraping technologies is a big plus (selenium, beautiful soup etc.).

Familiarity with Linux.

Excellent interpersonal, communication and organizational skills are required.

You have to wait 20 seconds

Generating Apply Link...