What we're looking for
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The successful candidate will work on a variety of projects across different domains, utilizing the latest technologies and methodologies to design, build, and maintain robust data systems. This role requires a deep understanding of data engineering principles and a passion for solving complex data challenges.
Responsibilities
- Design, develop, and maintain scalable data pipelines (both batch and streaming) to support diverse data needs.
- Architect and implement cloud data infrastructure solutions, ensuring high availability, performance, and security.
- Develop and optimize semantic layers and data models to facilitate efficient data querying and reporting.
- Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver high-quality data solutions.
- Implement and manage ETL processes to ensure data quality and integrity across various data sources.
- Build and maintain data visualization tools and dashboards to enable data-driven decision-making.
- Mentor junior data engineers and provide technical guidance to the team.
- Stay up-to-date with the latest industry trends and technologies to ensure our solutions remain cutting-edge.
Qualifications
- Bachelor's or Master’s degree in Computer Science, Information Technology, or a related field.
- 5+ years of experience in data engineering or a related role.
- Proficiency in programming languages such as Python, Java, or Scala.
- Extensive experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Strong knowledge of SQL and NoSQL databases.
- Experience with big data technologies such as Hadoop, Spark, Kafka, etc.
- Proven experience in building and maintaining data pipelines and ETL processes.