🚀 Hiring: Data Engineer – CI/CD, Databricks & Data Quality (DQ) Frameworks

📍 Location: Remote / Hybrid (as per client requirement)
🧑‍💼 Experience: 4–8 Years
🕓 Start Date: Immediate

📌 Key Responsibilities

🔧 Pipeline Development & Automation

Design, build, and maintain CI/CD pipelines to automate deployment of DQ rules and data services across environments.
Optimize data pipelines and jobs for efficiency, scalability, and enterprise-grade reliability in Azure + Databricks.
Implement best practices in version control, testing, and automated deployments.

📊 Data Quality & Rule Development

Develop, optimize, and maintain DQ rules in PySpark/Python for self-serve capabilities.
Design & implement profiling frameworks for automated rule generation and remediation.
Ensure DQ frameworks meet enterprise governance, security, and audit standards.

🖥️ UI & Self-Serve Integration

Collaborate with Node.js / Angular front-end teams to enable rule configuration, validation, and monitoring via a low-code UI.
Build APIs and backend services to expose DQ outputs for dashboards and self-service tools.

🤝 Collaboration & Governance

Work with Data Stewards, GPOs, and business stakeholders to convert requirements into technical solutions.
Contribute to BRDs, SRDs, design documents, and architecture reviews.
Support governance, compliance, and change management processes.
Drive continuous improvements of pipelines, rules, dashboards, and monitoring frameworks.

🎯 Required Skills & Qualifications

Strong programming skills in PySpark, Python, SQL.
Hands-on experience with Databricks (clusters, notebooks, Delta Lake).
Expertise in designing CI/CD pipelines using Azure DevOps / GitHub Actions / Jenkins.
Familiarity with Node.js & Angular for UI integration.
Strong understanding of Data Governance, Data Quality frameworks, MDM concepts.
Excellent analytical, problem-solving, and stakeholder engagement skills.
Cloud expertise with Azure Data Lake, Data Factory, Synapse preferred.

🎓 Education & Experience

Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
4–8 years of relevant experience in data engineering, CI/CD, and DQ rule development.
Proven expertise in Databricks, Azure data services, and low-code self-serve frameworks.

📩 Apply / Refer Immediately

📧 Email: riyaz.ltpl@gmail.com

📱 WhatsApp: +91 9595175635

💬 WhatsApp Group:
https://chat.whatsapp.com/HllHQes4d2QLFyukXjsIZv
https://whatsapp.com/channel/0029Vb7OZnz65yDDa1kT6i0p

🔗 Telegram Channel: Rozgaar Ki Nayi Duniya

🌐 Blog: WorkNestProX.com

🔥 Trending Hashtags for Maximum Reach

#ServiceNow #ServiceNowJobs #IRM #GRC #RiskManagement #PolicyAndCompliance
#ServiceNowDeveloper #NowHiring #RemoteJobs #TechJobs #HiringAlert
#ImmediateJoiners #WorkNestProX #IndiaJobs #SNOWJobs #PlatformDeveloper
#ITJobsIndia