Este é o meu perfilContato pela CazVidEste perfil está escrito em inglês
Yuvaraj
Data Engineer
Contato
Competências
Demonstrated experience with Streams & Tasks.
Demonstrated experience with Snowpipe.
Demonstrated experience with Time Travel.
Demonstrated experience with Zero-Copy Cloning.
Demonstrated experience with External Tables.
Formação acadêmica
Resumo
Data Engineer open to new opportunities
Experiência
Data Engineer
Client: Informa. Legacy-to-Snowflake migration using DBT, with Informatica for ingestion.. Led migration of 150+ database objects from a legacy system to Snowflake using DBT, improving data accessibility and performance by 40%.. Built pipelines with Airflow, Snowflake and DBT to ingest and transform 10+ TB of data.. Implemented Streams & Tasks for change data capture and incremental loads.. Used Zero-Copy Cloning and Time Travel for safe testing and fast environment refreshes during migration cutovers.. Configured RBAC and reviewed virtual warehouse sizing to balance query performance and compute cost across environments.. Optimized Informatica ETL workflows, improving processing efficiency by 30%.. Supported modernization of 20+ QlikView dashboards to Tableau on the Snowflake reporting layer.
Data Engineer
Client: Booking.com. Migration of Hive/Oozie workflows to Snowflake using Airflow.. Migrated Hive objects and Oozie workflows to Snowflake and S3 external tables, improving scalability and performance.. Built Snowpipe ingestion for continuous loading from S3 external stages, reducing manual load effort.. Used Informatica PowerCenter to move data from Hive to Snowflake.. Rebuilt Oozie workflows as Airflow DAGs, improving orchestration flexibility and lowering maintenance effort.. Designed validation processes to confirm consistency between legacy and new systems, achieving migration with no data loss.
Data Engineer
Client: Onsemi. On-premises to Snowflake migration and modernization.. Migrated on-premises data to Snowflake and built transformation workflows using DBT and Snowflake SQL.. Developed modular DBT models across staging and analytics layers, applying business rules and standardization.. Implemented incremental load logic to process only new and updated records, minimizing redundant processing.. Automated source-to-target reconciliation and completeness checks in Python.. Added data quality checks for duplicates, nulls and mismatches, improving reliability of migrated data.. Optimized SQL and DBT transformations by refining joins and filters to improve Snowflake processing efficiency.. Delivered curated Snowflake datasets for Power BI reporting.
Intern
Built a Banking Management System using SQL, covering database design and query optimization.