hmcts/ARIAMigration-Databrick
May 2025 – Jun 2025
2 Months active
Languages Used
Python
Technical Skills
Data ValidationDatabricksPySparkPythonTest AutomationAutomation Testing
Avi Singh
PROFILE
Avi Singh
Worked on the hmcts/ARIAMigration-Databrick repository to enhance data quality assurance and automation testing for migration workflows, focusing on Archive, Appeals, and Bails functionalities. Developed Python-based test automation scripts using Databricks and PySpark to validate data integrity across JSON, A360, and HTML outputs, ensuring adherence to schemas and business rules. Improved test reliability by optimizing HTML parsing, implementing case-insensitive validation, and aligning automated checks with evolving data structures. These efforts reduced manual testing, minimized flaky failures, and accelerated feedback loops, resulting in more robust, auditable data pipelines and smoother migration releases with lower production risk.
Overall Statistics
Feature vs Bugs
100%Features
Repository Contributions
4Total
Bugs
0
Commits
4
Features
3
Lines of code
10,072
Activity Months2
Your Network
274 peopleShared Repositories
16
Asaleem-hmctsMember
AndrewMcDevittHMCTSMember
AndrewHMCTSMember
AndrewHMCTSMember
AraIHMCTSMember
AraIHMCTSMember
gburnside-hmctsMember
misbahulislam2Member
NaveenSriramAddagarlaMember
Work History
June 2025
3 Commits • 2 Features
Jun 1, 2025June 2025 monthly summary for hmcts/ARIAMigration-Databrick. Focused on automation test improvements and data quality alignment to accelerate feedback and reduce flaky tests in migration validation. Delivered two key feature clusters and aligned tests with current data structures, enabling more reliable releases.
3 Commits • 2 Features
Jun 1, 2025June 2025 monthly summary for hmcts/ARIAMigration-Databrick. Focused on automation test improvements and data quality alignment to accelerate feedback and reduce flaky tests in migration validation. Delivered two key feature clusters and aligned tests with current data structures, enabling more reliable releases.
June 2025
May 2025
1 Commits • 1 Features
May 1, 2025May 2025 monthly summary for hmcts/ARIAMigration-Databrick. Focused on strengthening data quality assurance for Archive functionality within the migration workflow. Delivered comprehensive Archive Data Quality Test Automation to validate Appeals and Bails data against schemas and business rules, with automated test data generation and end-to-end validation across JSON, A360, and HTML outputs. This work reduces data quality risk in migration, accelerates regression testing, and provides repeatable, auditable checks across data pipelines.
May 2025
1 Commits • 1 Features
May 1, 2025May 2025 monthly summary for hmcts/ARIAMigration-Databrick. Focused on strengthening data quality assurance for Archive functionality within the migration workflow. Delivered comprehensive Archive Data Quality Test Automation to validate Appeals and Bails data against schemas and business rules, with automated test data generation and end-to-end validation across JSON, A360, and HTML outputs. This work reduces data quality risk in migration, accelerates regression testing, and provides repeatable, auditable checks across data pipelines.
Activity
Loading activity data...
Quality Metrics
Correctness80.0%
Maintainability80.0%
Architecture65.0%
Performance80.0%
AI Usage20.0%
Skills & Technologies
Programming Languages
Python
Technical Skills
Automation TestingData EngineeringData Quality TestingData ValidationDatabricksPySparkPythonPython ScriptingSparkTest Automation
Repositories Contributed To
Overview of all repositories you've contributed to across your timeline