Helping Hadoop Admins run their application in Amazon Elastic Map Reduce and provide support for any issues.
Analysis and processing of data in Hadoop ecosystem are much easier than in a traditional database
Used Sqoop to migrate the data from MySQL to Hadoop(HDFS/Hive).
Automated the processing of millions of rows coming from different data sources(Hadoop, Oracle) and create a power BI dashboard to support customer analytics.
Implemented big data solutions for ingesting data from various sources and processing the data-at-rest utilizing big data technologies such as Hadoop, HBase, etc.
Improve the performance of existing Hadoop implementation using Spark Context, Spark-SQL, and Data Frame.
Designed and developed Hadoop Map-Reduce jobs to support the batch processing analytics and reduced time to process data by 83%.