Hochster Pharmaceutical Industries
Senior Data Quality Engineer
0 views
0 applicants
Job Description
- 5+ years of professional experience in Data Quality, Data Engineering, or Big Data QA.
- Strong Python & PySpark: Advanced hands-on experience building distributed validation jobs and testing scripts.
- Database Proficiency: Solid expertise querying and validating structured (MySQL) and semistructured (MongoDB) stores.
- Search Engine Knowledge: Experience validating high-throughput search indices in Elasticsearch.
Architecture Understanding: Strong background in Data Warehouse and Data Lake design, multi-tenant schemas, and ETL/ELT pipelines.
- Software Engineering: Clean code principles, version control (Git), automated testing frameworks, and CI/CD.
Requirements & Qualifications
- Framework & Automated Pipeline Testing Data Quality Automation: Architect, implement, and extend automated testing frameworks (e.g., Great Expectations, Soda Core, or custom PySpark modules) within ETL/ELT pipelines.
- Data Reconciliation: Build distributed reconciliation jobs in PySpark to verify end-to-end data consistency across MongoDB, MySQL, Elasticsearch, and the Data Lake.
- Anomaly & Drift Detection: Implement real-time profiling to identify schema drift, unexpected NULL values, volume drops, and telemetry anomalies.
- 2.
Data Observability & Monitoring
- Alerting & SLAs: Define SLA/SLO metrics for data freshness, completeness, and accuracy; build real-time monitoring dashboards and alerting integrations.
- Root Cause Analysis (RCA): Lead technical investigations into pipeline failures, duplicate telemetry records, or corrupted time-series data, implementing permanent fixes.
- 3.
Engineering Standards & Governance Lineage & Documentation: Map data flows and maintain automated cataloging to ensure clear visibility from ingestion to analytics downstream.
- CI/CD Integration: Embed data validation gates into continuous integration/deployment (CI/CD) pipelines to prevent bad code or schema changes from hitting production.
- Cross-Team Collaboration: Partner closely with Data Engineering, Analytics, and IoT teams to align validation rules with business requirements.
EGjobank Analysis
Quick Role Summary
Opportunity as "Senior Data Quality Engineer" at Afaqy located in المعادي on a Hybrid basis, suited for Fresh Graduate candidates, within Marketing & Sales. Key details from listing: • 5+ years of professional experience in Data Quality, Data Engineering, or Big Data QA. • Strong Python & PySpark: Advanced hands-on experience building…
The Egyptian Job Bank editorial team prepares curated overviews and actionable application guidance for every listing, preserving official employer details.
Application Tips
- Tailor your CV headline to match "Senior Data Quality Engineer" and feature measurable achievements in the top third of your resume.
- Customize your cover note for المعادي: explain why this location and work arrangement suit your availability and how you add value to the team.
- Highlight collaboration software proficiencies (Slack, Notion, Jira, MS Teams) and commitment to dependable working hours.
- Showcase practical projects, accredited certifications, and strong language skills to complement experience.
- After applying, monitor your status from your dashboard and stay prepared for an interview invitation.
Readiness Checklist
- Updated CV in standard PDF format with a professional filename
- Skills aligned with the stated role requirements
- Availability for work in المعادي or remote if specified
- Measurable achievement examples prepared for interview talking points
- Egyptian Job Bank candidate profile ready for application tracking
Similar Jobs You Might Like
More openings in the same field or city
New Marina Plast
Cairo Three A Poultry
El Banna Group Company
Al Hoda Co. for Cargo & Clearance
شركة رائدة