As an illustration of my work, I optimized a critical workflow by migrating it from Python to the high-performance Trino (formerly Presto) SQL Engine for Big Data. This transition resulted in a remarkable decrease in execution time, plummeting from 2 hours and 40 minutes to just 6 minutes - a productivity increase of approximately 96.25%. This significant improvement was attributed to the superior parallel data processing capabilities of the Presto engine (MPP). The remarkable outcome not only accelerated information processing but also led to considerable cost savings for the client. This accomplishment showcases my ability to optimize processes and effectively utilize cutting-edge technologies, resulting in tangible and beneficial outcomes.
Qualifications:
AWS, AWS RDS, AWS databases, AWS Redshift, AWS Aurora, Amazon Athena, AWS DynamoDB, Apache Airflow, Big Data, Snowflake, Exasol, Apache Hadoop, Trino (formerly Presto) Query Engine for Big Data, Hive, ETL, MS SQL Server, Analytical skills, Database performance tuning, Data Engineering, MS SQL R Services, Data Analytics, Data Architecture, SQL, T-SQL, R, Python, DigDag, Git.
Skills:
Adaptable, Resourceful, Highly motivated, Flexible, 'Can-Do' attitude, Hardworking nature.
I love going for walks with my wife. I also like to sharpen knives; I have my own special machine for manual sharpening of knives (Hapstone) and all the necessary equipment for high-quality sharpening. I devote my free time to self-study and improving my qualifications.