Built with datascienceportfol.io

Shourya singh Chouhan

Data Engineer

Based in Jersey City

About

Hi there! I'm Shourya Singh Chouhan, a passionate and results-driven Data Engineer based in NJ. With over 3 years of experience, I've honed my expertise in designing, developing, and enhancing Data Engineering, ETL frameworks, and Business Intelligence products. My journey in data has taken me through all phases of the SDLC, where I've embraced Agile and Waterfall methodologies to deliver exceptional solutions. As a versatile Data Engineer, I thrive in harnessing the power of Python, R, and Apache Spark, including Hadoop, Hive, and Pig, to transform raw data into actionable insights. I love working with cutting-edge technologies and have hands-on experience with AWS CloudWatch for monitoring and alerting. My proficiency in Python libraries such as NumPy, Pandas, SciPy, and Scikit-learn

Skills

Projects

Experience

2019-2021

Data Engineer at Doxtel infotech

• Developed business process models in Waterfall to document existing and future business processes. • Collaborated with cross-functional teams to analyze database performance metrics and identify areas for improvement, resulting in a 15% increase in overall system efficiency. • Implemented Spark using Python and Spark SQL for faster processing and testing of the data. • Worked with Hadoop infrastructure to store data in HDFS storage and use Hive SQL to migrate the underlying SQL codebase in Azure. • Designed complex SSIS Packages for extracting, transforming, and Load (ETL) with data from different sources. • Created notifications and alerts, and subscriptions to reports in the Power BI service. • Created various connections with various databases like AWS RedShift, MySQL, etc. • Used Git

2022-2023

Data Engineer at BlackRock

• Work in an Agile environment, with the ability to accommodate and test the newly proposed changes at any point of time during the release. • Implemented performance tuning techniques on existing T-SQL codebase, leading to a 20% improvement in database response time. • Working with Apache Spark on the Databricks platform using the Python API to extract the data from multiple sources. • Utilizing Azure Data Factory for data transformation, validation, and data cleansing tasks. • Designing, developing, and implementing complex SSIS packages, asynchronous ETL processing, Ad hoc reporting, and SSRS report server, and data mining in SSAS. • Using Pandas, NumPy, SciPy, and Scikit-learn in Python for scientific computing and data analysis. • Developing PowerBI visualizations and dashboards using

Education

2015 -2019

BTech in Information technology at Symbiosis Institute of technology

2021-2023

MS in Business intelligence analytics at Stevens institute of technology