Job Details
Job Description
Responsibilities:
Pipeline Development: Build and optimize scalable batch and real-time pipelines using Databricks, Python, and Scala.
Environment Management: Design ETL workflows in Notebooks and manage clusters for performance and cost efficiency.
Orchestration: Integrate Databricks with Azure Data Factory and other enterprise platforms for seamless data flow.
Innovation: Drive organizational maturity by integrating AI/ML capabilities into analytics workflows.
Visualization: Create high-impact dashboards and reports to enable global self-service analytics.
Modeling: Design optimized data models (Star/Snowflake schemas) and develop complex measures using advanced DAX.
Governance: Manage workspaces and implement Row-Level Security (RLS) and data masking to ensure compliance.
Support: Provide end-user training to foster a data-driven culture across the organization.
ETL/ELT Excellence: Maintain high data quality and lineage across data lakes and warehouses.
Collaboration: Partner with IT and business stakeholders to integrate analytics with ERP and CRM systems.
Troubleshooting: Resolve complex technical challenges related to data integration and reporting accuracy.
Minimum Requirements:
Degree: Bachelor’s in Computer Science, Data Science, or a related field.
Experience: 4+ years in analytics and data integration; 3+ years specifically with Databricks.
Cloud Proficiency: Strong experience within the Azure ecosystem.
Languages: Expert-level SQL and Python (or Scala).
BI Tools: Advanced Power BI, Power Query, and DAX.
ETL Tools: Azure Data Factory, Informatica, or Talend.
Preferred Certifications
Azure Data Engineer Associate
Databricks Certified Data Engineer Professional
Microsoft Certified: Power BI Data Analyst Associate
Benefits:
- Competitive salary based on experience (salary can potentially be more based on experience/skills)
IF you meet the above requirements and want to make a career-changing move, apply today by emailing your CV to [email protected]