Vijay Singh Shekhawat Data Engineer A software engineer, who is passionate about data.5 years of Hands-on and extensive experience with RDBMS(Redshift, Teradata, GreenPlum), Hadoop environment(HDFS, Hive) ,Spark, Kafka and Apache Airflow.A skilled ETL developer with strong problem solving, debugging and analytical capabilities, who creates the technical vision and actively engages in understanding customer requirements. Result oriented and hands-on, who skilfully balances between meeting resource and time constraints, while doing it right. Data Engineer LinkedIn Leading engineering efforts on LinkedIn's Competitive Analysis team. Responsibilities: Lead the design and development efforts while collaborating with various data science teams to enable state of the art Competitive analysis for Linkedin. • Enable external data ingestion using Goblin and build data model. • Build comprehensive dashboards using Retina. • Pioneered pre-computed metrics on Linkedin's Unified Metrics Platform using Spark Scala. • Software Engineer 2 - Data Engineer Zynga Inc Worked as Senior Data Engineer in central data engineering team at Zynga Inc Responsibilities: Key Impact: Redshift Cluster provisioning using Terraform along with Work Load Management configurations. • Implemented Redshift Spectrum best practices like partitioning, compression, predicate pushdown and columnar storage formats like parquet. • Data migration from Vertica to AWS Redshift, Using S3 as a staging layer and COPY function to import in Redshift. • Implementing columnar encoding standards for efficient space utilization and sort and distribution key for performance optimization. • Created Airflow DAGs for ETL jobs. • Loading JSON data in Redshift using Jsonpath files. • Reduced AWS Redshift Space utilization by 50% (400 TB to 200 TB) by implementing new column level encoding. • Summary Experience 2021-02 - present 2020-04 - 2021-02 Personal Info Address Bangelore Phone +918980765002 E-mail vijayshekhawat796@gmail.com Date of birth 1995-07-21 LinkedIn www.linkedin.com/in/vijayshekhawat7 96 Skills Programming Skills : Java,C,Python,SQL Advance Knowledge of Java, Python And SQL Advanced Cloud : AWS- Redshift, EC2, Lambda, Kinesis, S3,I AM, Secret Manager Advanced Hadoop and its ecosystem : Hadoop HDFS,PIG, Spark, Kafka(Cloudera Certified) and Airflow. Relational Databases: Extensive experience with Teradata,Greenplum,Redshift and Vertica. Data Engineer Expedia Group Worked as a Data engineer in Expedia Feedback Data Engineering (EDE) team. Roles and Responsibilities: Key Impact: Handling/managing Real-time Booking trends Streaming application build using AWS lambda, kinesis and timescale DB along with real- time reporting on Monocle dashboard. • Dealing with converting raw Nested JSON data to CSV and vice-versa. • Drove initiative to join customer feedback dataset with customer loyalty and reward dataset, in order to improve and prioritise customer grievances resolvement turn around time based on customer tier (i.e Gold, Silver or Bronze). • Data Engineer DELL International Worked as a Big Data Engineer in the Customer Engagement Team where the Company wanted to store, process & manage the huge amount of data in day to day operations collected from various sources. The system majorly checks the marketability of the customer. Responsibilities Key Impact: Collaborated with various team & management to understand the requirement & design the complete system Implemented the complete Big data pipeline with real-time processing • Import and Export data using Sqoop into HDFS. • Processing large sets of structured, semi-structured and unstructured- data and supporting systems application architecture • Hands on experience of creating tables in Hive with performance optimization using bucketing & partitioning • Implemented procedures for validation, reconciliation of metadata and error handling in ETL processes • Dell Champion Award. • Developed ETL(Streamsets) Development Automation tool. • Shiv Nadar University B.Tech in Computer Science and engineering Achievements Part of University football team and winner of SNU football league. • Winner of Iron-Man competition. • 2019-09 - 2020-02 2017-07 - 2019-09 Education 2013-08 - 2017-05