Senior Data Engineer

Job Description
Design, develop, and maintain robust data pipelines and ETL processes to ensure efficient data flow and integration across various systems.
Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions that meet business needs.
Optimize and manage databases, ensuring high performance, availability, and scalability of data storage solutions.
Implement and manage data workflows and orchestration using Airbyte and Airflow.
Develop and maintain data transformation processes using DBT.
Monitor and troubleshoot data pipeline issues to ensure data accuracy and integrity.
Perform data analysis and generate reports to support business decision-making processes.
Stay updated with the latest industry trends and best practices in data engineering and implement improvements as necessary.

Skills
MS SQL: 7+ years of experience in designing, implementing, and optimizing complex SQL queries and database solutions.
SQL: 8+ years of experience with strong proficiency in SQL programming.
SSIS: 7+ years of experience in developing and managing ETL processes using SQL Server Integration Services.
Python: 5+ years of experience in scripting and automating data processes using Python.
Airbyte: 3+ years of experience in data integration using Airbyte.
Airflow: 3+ years of experience in workflow orchestration and management using Apache Airflow.
DBT: 3+ years of experience in developing and managing data transformations using DBT (Data Build Tool).