%20(1).png)
About the Role
Data Pipeline Development: Design, build, and maintain high-performance,
scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and ADLS.
• Data Platform Enhancement: Contribute to the development and optimization
of our Azure-based Data Platform, ensuring efficiency, reliability, and security.
• IoT & High-Volume Data Processing: Work with large-scale IoT and operational
datasets, optimizing data ingestion, transformation, and storage.
• Data Governance & Quality: Implement data governance best practices,
ensuring data integrity, consistency, and compliance.
• Performance Optimization: Improve query performance and storage efficiency
for analytics and reporting use cases.
• Collaboration: Work closely with data scientists, architects, and business
teams to ensure data availability and usability.
• Innovation & Automation: Identify opportunities for automation and process
improvements, leveraging modern tools and technologies.
6+ years of experience in data engineering with a focus on Azure cloud
technologies.
• Strong expertise in Azure Data Factory, Databricks, ADLS, and Power BI.
• Proficiency in SQL, Python, and Spark for data processing and transformation.
• Experience with IoT data ingestion and processing, handling high-volume, real
time data streams.
• Strong understanding of data modeling, lakehouse architectures, and medallion
frameworks.
• Experience in building and optimizing scalable ETL/ELT processes.
• Knowledge of data governance, security, and compliance frameworks.
• Experience with monitoring, logging, and performance tuning of data workflows.
• Strong problem-solving and analytical skills with a platform-first mindset.
Requirements
Data Pipeline Development: Design, build, and maintain high-performance,
scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and ADLS.
• Data Platform Enhancement: Contribute to the development and optimization
of our Azure-based Data Platform, ensuring efficiency, reliability, and security.
• IoT & High-Volume Data Processing: Work with large-scale IoT and operational
datasets, optimizing data ingestion, transformation, and storage.
• Data Governance & Quality: Implement data governance best practices,
ensuring data integrity, consistency, and compliance.
• Performance Optimization: Improve query performance and storage efficiency
for analytics and reporting use cases.
• Collaboration: Work closely with data scientists, architects, and business
teams to ensure data availability and usability.
• Innovation & Automation: Identify opportunities for automation and process
improvements, leveraging modern tools and technologies.
6+ years of experience in data engineering with a focus on Azure cloud
technologies.
• Strong expertise in Azure Data Factory, Databricks, ADLS, and Power BI.
• Proficiency in SQL, Python, and Spark for data processing and transformation.
• Experience with IoT data ingestion and processing, handling high-volume, real
time data streams.
• Strong understanding of data modeling, lakehouse architectures, and medallion
frameworks.
• Experience in building and optimizing scalable ETL/ELT processes.
• Knowledge of data governance, security, and compliance frameworks.
• Experience with monitoring, logging, and performance tuning of data workflows.
• Strong problem-solving and analytical skills with a platform-first mindset.
About the Company
Cigres Technologies Private Limited is a technology consulting and services company that focuses on helping clients resolve their significant digital problems and enabling radical digital transformation using multiple technologies on premise or in the cloud. The company was founded with the goal of leveraging cutting-edge technology to deliver innovative solutions to clients across various industries.