Job Title: Data Engineer
Experience Level: Senior
Job Summary:
We are looking for a skilled and motivated Data Engineer to design, build, and maintain scalable data pipelines and architectures. As part of our data team, you will play a key role in enabling data-driven decision-making by ensuring that high-quality, reliable data is available across the organization. This role requires strong technical skills, a deep understanding of data systems, and a passion for clean, efficient, and reliable data solutions.
Key Responsibilities:
- Design, develop, and maintain robust, scalable data pipelines for ETL/ELT processes.
- Build and optimize data architectures for analytics, machine learning, and reporting use cases.
- Collaborate with data scientists, analysts, and business stakeholders to understand data needs.
- Ensure data integrity, quality, security, and compliance.
- Integrate data from various sources, including APIs, databases, and third-party systems.
- Monitor and troubleshoot pipeline performance and reliability.
- Automate data workflows and improve efficiency through scripting and tool integration.
- Support data warehousing solutions and data lake development.
Required Skills:
- Strong experience with SQL and relational databases (e.g., PostgreSQL, MySQL, SQL Server).
- Proficiency in a programming language such as Python, Scala, or Java.
- Experience with ETL tools and frameworks (e.g., Apache Airflow, dbt, Talend).
- Familiarity with cloud platforms (e.g., AWS, Azure, or GCP) and services like S3, Redshift, BigQuery, or Snowflake.
- Knowledge of data modeling, data warehousing, and best practices.
- Understanding of version control (e.g., Git) and CI/CD principles.
Nice to Have:
- Experience with big data technologies (e.g., Spark, Kafka, Hadoop).
- Exposure to containerization and orchestration tools (e.g., Docker, Kubernetes).
- Familiarity with infrastructure as code (e.g., Terraform, CloudFormation).
- Experience with real-time data streaming and processing.
- Knowledge of data governance and security best practices.
Education & Experience:
- Bachelor’s degree in computer science, Information Technology, or related field (or equivalent experience).
- 5+ years of development experience as a Data Engineer (depending on role level).
- Master’s degree in computer science, Information Technology, or related field preferred.