Data Engineer - BCI

Job Title: Data Engineer

Location: [Location]
Experience: 4–8 Years
Employment Type: Full-Time

Job Summary

We are seeking a highly skilled and motivated Data Engineer to join our growing data team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data infrastructure to support analytics, reporting, and business intelligence initiatives. The candidate should have strong expertise in Python, SQL, and ETL processes, along with experience working with large datasets in cloud and on-premises environments.

Key Responsibilities

• Design, develop, and maintain robust ETL/ELT pipelines for processing structured and unstructured data from multiple sources.
• Build scalable data ingestion frameworks to collect, transform, and load data into data warehouses and data lakes.
• Develop and optimize SQL queries, stored procedures, and database objects to ensure efficient data processing.
• Collaborate with business analysts, data scientists, and application teams to understand data requirements and deliver reliable data solutions.
• Monitor, troubleshoot, and optimize data pipelines to ensure high availability, data quality, and performance.
• Implement data validation, cleansing, and quality checks to maintain data accuracy and consistency.
• Work with cloud-based data platforms and modern data engineering tools to support enterprise data initiatives.
• Participate in database design, data modeling, and architecture discussions.
• Automate repetitive data processing tasks and improve operational efficiency through scripting and workflow orchestration.
• Ensure compliance with data governance, security, and privacy standards.
• Create and maintain technical documentation for data pipelines, processes, and workflows.
• Support production deployments, incident resolution, and performance tuning activities.

Required Skills

• Strong programming experience in Python for data processing, automation, and pipeline development.
• Advanced knowledge of SQL, including complex queries, joins, stored procedures, functions, and performance optimization.
• Hands-on experience with ETL/ELT development and data integration processes.
• Experience working with relational databases such as SQL Server, PostgreSQL, MySQL, or Oracle.
• Knowledge of data warehousing concepts, dimensional modeling, and data lake architectures.
• Experience with workflow orchestration tools such as Apache Airflow, Azure Data Factory, or similar platforms.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP).
• Understanding of data quality, data governance, and data security best practices.
• Strong analytical, problem-solving, and troubleshooting skills.

Preferred Skills

• Experience with big data technologies such as Spark, Hadoop, or Databricks.
• Knowledge of version control systems such as Git.
• Exposure to CI/CD pipelines and DevOps practices.
• Experience working in Agile development environments.
• Knowledge of BI and reporting tools such as Power BI, Tableau, or Looker.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
• 4–8 years of experience in Data Engineering, ETL Development, or a similar role.
• Strong communication skills and ability to collaborate with cross-functional teams.