Senior Data Engineer with Data Bricks

Mandatory Skills

Databricks Engineer, Power Bi Developer, Dax Queries, SQL, Data Warehousing, Power Automate



Skill to Evaluate

Databricks Engineer, Power Bi Developer, Dax Queries, SQL, Data Warehousing, Power Automate



Experience

5 to 9 Years

Key Responsibilities:



- Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes.

- Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders.

- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives.

- Optimize data storage and retrieval processes to enhance performance and reduce latency.

- Ensure data quality and integrity by implementing best practices for data governance and validation.

- Mentor junior data engineers and contribute to knowledge sharing within the team.

- Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs.



Skills and Tools Required:



- Proficiency in Databricks and experience with Spark for big data processing.

- Strong experience with Power BI, particularly in building reports and dashboards using DAX.

- Solid programming skills in Python or Scala for developing data pipelines.

- Knowledge of SQL and experience with relational databases and data warehousing concepts.

- Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing.

- Understanding of data modeling, ETL processes, and data integration methodologies.

- Excellent problem-solving skills and attention to detail.

- Strong communication and collaboration abilities to work effectively in a team-oriented environment.



Skill Area Tools & Technologies

Data Engineering Databricks, Apache Spark, Delta Lake

Programming Python, SQL, PySpark

BI & Visualization Power BI, DAX, Power Query

Cloud Platforms Azure

DevOps & CI/CD Git, Azure DevOps

Data Governance Unity Catalog, Data Lake Security



Preferred Qualifications:



- Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field.

- Previous experience in a similar data engineering role, particularly within a corporate environment.

- Knowledge of additional BI tools and data visualization platforms is a plus.

Requirements