About the Role
Responsibilities:
1. Data Integration and Management:
o Design, develop, and maintain scalable data processing pipelines using Azure
Databricks and PySpark/Scala. o Integrate data from various sources into Azure Data Lake and Azure SQL Data
Warehouse. o Developing and optimizing Apache Spark applications for data processing and
analytics.
o Implementing data quality checks and monitoring processes.
o Managing and configuring the Databricks environment, including clusters and
notebooks.
o Implement and optimize machine learning workflows using Databricks’ integrated
machine learning capabilities. 2. Business Intelligence and Reporting:
o Develop interactive dashboards and reports using Power BI to provide insights
and support decision-making. o Connect Power BI to Azure Databricks to leverage its performance and
technology for business users. o Ensure data accuracy and consistency across all reports and dashboards. o Knowledge of data security best practices and the ability to implement role-level
security, row-level security, and data encryption in Power BI.
o Perform complex data analysis tasks using DAX (Data Analysis Expressions)
functions to create calculated measures and solve intricate business problems.
Develop advanced DAX calculations for financial, statistical, or performance
analysis.
o Optimize report and dashboard performance by improving data queries, data
model efficiency, and report rendering speed. Identify and address bottlenecks
and resource constraints.
3. Collaboration and Communication:
o Work closely with data scientists, engineers, and other stakeholders to gather
requirements and deliver solutions. o Provide training and support to end-users on Power BI and other BI tools. o Communicate complex technical concepts to non-technical stakeholders
effectively. Requirements: Technical Skills:
o
Warehouse. Experience with data processing frameworks such as Apache Spark
and PySpark.
o
data models. o Knowledge of programming languages such as Python, Scala, or SQL. Analytical Skills:
o Ability to analyze and interpret complex data sets to provide actionable insights.
Requirements
Responsibilities:
1. Data Integration and Management:
o Design, develop, and maintain scalable data processing pipelines using Azure
Databricks and PySpark/Scala. o Integrate data from various sources into Azure Data Lake and Azure SQL Data
Warehouse. o Developing and optimizing Apache Spark applications for data processing and
analytics.
o Implementing data quality checks and monitoring processes.
o Managing and configuring the Databricks environment, including clusters and
notebooks.
o Implement and optimize machine learning workflows using Databricks’ integrated
machine learning capabilities. 2. Business Intelligence and Reporting:
o Develop interactive dashboards and reports using Power BI to provide insights
and support decision-making. o Connect Power BI to Azure Databricks to leverage its performance and
technology for business users. o Ensure data accuracy and consistency across all reports and dashboards. o Knowledge of data security best practices and the ability to implement role-level
security, row-level security, and data encryption in Power BI.
o Perform complex data analysis tasks using DAX (Data Analysis Expressions)
functions to create calculated measures and solve intricate business problems.
Develop advanced DAX calculations for financial, statistical, or performance
analysis.
o Optimize report and dashboard performance by improving data queries, data
model efficiency, and report rendering speed. Identify and address bottlenecks
and resource constraints.
3. Collaboration and Communication:
o Work closely with data scientists, engineers, and other stakeholders to gather
requirements and deliver solutions. o Provide training and support to end-users on Power BI and other BI tools. o Communicate complex technical concepts to non-technical stakeholders
effectively. Requirements: Technical Skills:
o
Warehouse. Experience with data processing frameworks such as Apache Spark
and PySpark.
o
data models. o Knowledge of programming languages such as Python, Scala, or SQL. Analytical Skills:
o Ability to analyze and interpret complex data sets to provide actionable insights.
About the Company
Cigres Technologies Private Limited is a technology consulting and services company that focuses on helping clients resolve their significant digital problems and enabling radical digital transformation using multiple technologies on premise or in the cloud. The company was founded with the goal of leveraging cutting-edge technology to deliver innovative solutions to clients across various industries.