Rajat Gupta

Rajat Gupta

Data Engineer with total 8 years of work experience in the banking and telecom Fortune 500 clients. Worked as both member and team leader of cross-functional teams which has honed his leadership and cross-cultural skills.

Software Developer with extensive experience on Confluent Kafka, Cloud, Bigdata and ML/AI technologies.

• Extensive professional experience in software architecture, design, development and integration.
• Design, build and implementation of scalable analytics solutions with data engineering workflows and complex data pipelines both on-premise and AWS Cloud.
• Developing large-scale distributed applications using Hadoop (HDP & CDH), MR, Hive, Spark, Streaming, Kafka.
• Building enterprise cloud data platform on AWS
• Creating enterprise Data Lake and modern Data Warehouse capabilities and patterns.
• Creating DevOps CI/CD pipelines using Git, Jenkins, Dockers, Kubernetes.

AREAS OF EXPERTISE:
• Confluent Kafka
• Bigdata
• AWS
• Cloud Migrations
• Machine Learning and Deep Learning
• Client Server Applications
• Distributed Systems

Technical Specialties:
• Hadoop Technologies: HDFS, MapReduce, Hive, Pig, Sqoop, Oozie, Spark
• AWS Cloud: EMR, RedShift, Athena, AWS Lambda, AWS Glue, SageMaker
• Messaging/Real time streaming: Confluent Kafka
• ML/Deep Learning: ANN, CNN, RNN, TensorFlow, SparkML
• Hadoop Distributions: Apache Hadoop, Cloudera, Databricks, EMR
• NoSQL Databases: MongoDB, DynamoDB
• Programming: Java/Python/Scala
• Orchestration tools : Apache Airflow, Autosys

A Former Open-source Developer at IIT Bombay. Experience of working on global project for Scilab (Developed at INRIA in France) and worked as a freelancer at IIT Bombay. Mr. Gupta areas of interest are Coding and working on Research projects.