Preksha Shingadia

Data Engineer

Atos

01.2019 - 01.2023

Developed efficient Python and Scala scripts to fetch data from APIs and load it into source tables and files, streamlining ingestion processes.
Designed and optimized SQL queries to extract insights and fulfill reporting requirements.
Built and maintained Informatica ETL mappings tailored to client needs, enabling accurate reporting and analytics.
Created complex ETL transformations (using Joiner, Aggregate, Lookup, Expression, Source Qualifier, Filter, Union, Router, Stored Procedures) to populate target systems.
Reviewed and authored SQL validation scripts to ensure data accuracy between source and target.
Developed and automated sessions and workflows with pre/post SQL queries for robust data cleaning, extraction, and transformation.
Implemented error handling and email notifications in workflows to improve reliability and monitoring.
Designed Azure Data Factory (ADF) pipelines using linked services to extract, transform, and load (ETL) data from diverse sources (Azure SQL, Blob Storage, CSV, JSON, flat files).
Delivered both truncate-load and incremental-load strategies, including insert-update mechanisms, for scalable data solutions.
Migrated on-premises data to cloud platforms and executed historical data loads to support cloud adoption.
Performed end-to-end testing of workflows and data pipelines, ensuring data quality and performance.
Automated recurring workflows, reducing manual intervention and increasing efficiency.
Conducted analysis and enhancements of existing workflows, providing recommendations on gaps, timelines, and feasibility.
Authored comprehensive documentation covering code logic, error handling, corrections, and system workflows.
Worked with Active Directory File Services : created access groups with appropriate permissions using Prima, applied group policies at file-level, and managed user access approvals.
Executed data restoration using IBM Tivoli and managed secure file transfers between servers .