Role Overview
We are seeking a Senior Data Engineering Specialist who will play a crucial role in shaping our data infrastructure. You will collaborate with cross-functional teams to design and implement robust data pipelines that support our analytics and business intelligence efforts. The ideal candidate should be passionate about data architecture and able to tackle complex data challenges while ensuring high data quality and performance.
Key Responsibilities:
- Design and implement data pipelines to support analytics and reporting needs.
- Collaborate with data scientists to create data models that drive business insights.
- Monitor and optimize the performance of data workflows in real-time.
- Ensure high standards for data quality and consistency across the organization.
- Develop and maintain ETL processes for data ingestion and transformation.
- Work with cloud technologies to establish a scalable data infrastructure.
- Document the data architecture and integration processes for reference.
- Lead the enhancement of existing data solutions to adapt to new business requirements.
- Provide mentorship and guidance to junior data engineers.
Required Skills:
- Proficiency in Python for data manipulation and pipelines.
- Strong knowledge of SQL for querying and managing databases.
- Experience with ETL tools such as Apache NiFi or Talend.
- Familiarity with cloud platforms like AWS, Google Cloud, or Azure.
- Understanding of data warehousing concepts and technologies.
- Ability to work with NoSQL databases like MongoDB or Cassandra.
- Strong analytical skills for data interpretation and problem-solving.
- Knowledge of data governance and compliance frameworks.
Preferred Skills:
- Experience with big data technologies like Hadoop or Spark.
- Familiar with machine learning frameworks.
- Understanding of data visualization tools like Tableau or Power BI.
