
DILIP KUMAR MANTENA
- Hadoop and Spark developer
- Chicago, IL
- Member Since Feb 18, 2023
Ø Overall 7+ Years of IT experience as Big Data analytics and Oracle Agile PLM Java developer in Scientific Games Corporation and NTT DATA Global Delivery Services.
Ø Proficient with Bigdata related technologies like Hadoop frameworks, Map Reduce, Hive, HBase, Storm, PIG, Sqoop, Spark, Kafka, Cassandra, Flume, ZooKeeper, Oozie.
Ø Experienced in writing complex MapReduce programs that work with different file formats like Text, Sequence, Xml, JSON and Avro.
Ø Having working experience on Cloudera Data Platform using VMware Player, Cent OS 6 Linux
environment. Strong experience on Hadoop distributions like Cloudera, and HortonWorks.
Ø Good knowledge of No-SQL databases Cassandra, MongoDB and HBase.
Ø Excellent Java development skills using J2EE, J2SE, Servlets, JSP, Spring, Hibernate, JDBC.
Ø Strong experience in writing complex queries for Oracle.
Ø Experience working with Build tools like Maven and Ant.
Ø Experienced in both Waterfall and Agile Development (SCRUM) methodologies
Ø Proficient with Agile PLM as Java Developer. Hands on experience on PC, PCM, PQM, PPM, Agile SDK , Process Extensions and Event based PXs
Ø Performed Data Flow Testing between Agile and Oracle EBS through Application Integration Architecture also known as D2R PIP
Ø Possess strong skills in Agile Development, testing and solution designing Agile SDK applications and working on Integration solution between Agile and Oracle Applications to AIAPIP.
Ø Deployed WebServices , URL based PXs in weblogic application.
Ø Basic functional understanding of SOA and Oracle Applications modules - Inventory, Engineering, Bill of Materials.
Ø Strong Debugging and problem solving skills with good understanding of system development methodologies, techniques and tools.
Ø Team player, highly productive and result-driven in team and individual projects, strong research, time management with good interpersonal and communication skills.
Ø Flexible enough to adapt new technologies.
Ø Outstanding Interpersonal and Communication Skills and Self-Starter.
Ø Ability to deliver high quality stuff very efficiently on time.
TECHNICAL SKILLS
|
Hadoop Technologies |
HDFS, YARN, MapReduce, Hive, Pig, Sqoop, Flume, Spark, Kafka, Zookeeper, and Oozie |
|
NO SQL Databases |
HBase, Cassandra |
|
Languages |
Java, Scala, SQL, PL/SQL, Pig Latin, HiveQL, Unix, Java Script, Shell Scripting |
|
Java & J2EE |
Core Java, Servlets, Hibernate, Spring, Structs |
|
Web Technologies |
HTML, JavaScript, XML |
|
Databases |
MySQL, Oracle |
|
IDE |
Eclipse , Tomcat |
|
Application Server |
Weblogic, JBoss, Tomcat |
|
PLM Technology |
Oracle Agile PLM |
|
Operating System |
UNIX, Windows, LINUX |
Professional Experience
Client – Scientific Games Corporation. (Chicago, IL)
Employer: IT People Corporation
Role – Hadoop and Spark developer
Duration: Jan 2016- present
Project Description: Scientific Games is a leading innovator in the global lottery and regulated gaming industries. Scientific games uses Big Data technologies offering diverse products, technology and services that can be customized to meet the unique requirements of virtually any lottery or gaming jurisdiction, including Instant Game Product Management, Licensed Properties, Loyalty & Rewards Programs, Video Gaming Systems, retail technology and many more. This project is to migrate the data from existing Data warehouse systems like Oracle and implement the existing use cases in Oracle PLM using hadoop technologies. Create high-security framework to prevent any misuse of the data using HDFS Encryption, Ranger, Kerberos.
Responsibilities
• Worked on analyzing Hadoop cluster using different big data tools including Pig, Hive and MapReduce.
• Involved in exploring Hadoop, Map Reduce programming and its ecosystems.
• Responsible for design development of Spark SQL Scripts based on Functional Specifications.
• Wrote the Map Reduce jobs to parse the web logs which are stored in HDFS.
• Importing and exporting data into HDFS and HIVE using Sqoop.
• Responsible for loading data from UNIX file systems to HDFS.
• Configured different topologies for spark cluster and deployed them on regular basis.
• Exploring with the Spark improving the performance and optimization of the existing algorithms in Hadoop.
• Import the data from different sources like HDFS/HBase into SparkRDD.
• Experienced with Spark Context, Spark-SQL, Data Frame, Pair RDDs, Spark YARN.
• Involved in converting Hive/SQL queries into Spark transformations using Spark RDD, Scala.
• Implemented Partitioning, Dynamic Partitions, Buckets in Hive.
• Writing UDF (User Defined Functions) in Pig, Hive when needed.
• Developing the Pig scripts for processing data.
• Managing work flow and scheduling for complex map reduce jobs using Apache Oozie.
• Load and transform large sets of structured, semi structured and unstructured data.
• Used AVRO, Parquet file formats for serialization of data.
• Responsible for Spark Streaming configuration based on type of Input Source.
• Developed Flume ETL job for handling data from HTTP Source and Sink as HDFS.
• Developed Kafka consumer API in Scala for consuming data from Kafka topics.
• Performed optimization of MapReduce for effective usage of HDFS by compression techniques.
• Performed validation and standardization of raw data from XML and JSON files with Pig and MapReduce.
• Implemented complex MapReduce programs to perform joins on the Map side using Distributed Cache in Java.
• Developed shell scripts for running Hive scripts in Hive and Impala.
• Used IMPALA to analyze data ingested into HBase and compute various metrics for reporting on the dashboard.
• Created Partitioned and Bucketed Hive tables in Parquet File Formats with Snappy compression and then loaded data into Parquet hive tables from Avro hive tables.
• Involved in performance tuning of Hive from design, storage and query perspectives.
• Developed customized classes for serialization and Deserialization in Hadoop
• Collected the Json data from HTTP Source and developed Spark APIs that helps to do inserts and updates in Hive tables.
• Created tables in HBase to handle terabytes of data and analyzed data with Hive Queries by implementing Hive and HBase integration.
• Worked on Sequence files, RC files, Map side joins, bucketing, partitioning for hive performance enhancement and storage improvement.
• Involved in performing the Linear Regression using Scala API and Spark.
• Created HBase tables to store various data formats of incoming data from different portfolios.
• Implemented Data Integrity and Data Quality checks in Hadoop using Hive and Linux scripts .
• Automated the History and Purge Process.
• Implemented Daily Cron jobs that automate parallel tasks of loading the data into HDFS and pre-processing with Pig using Oozie coordinator jobs.
• Developing reports using Tableau ETL
• Used Jira for bug tracking and BitBucket to check-in and checkout code changes.
• Continuous monitoring and managing the Hadoop cluster through Cloudera Manager.
Environment: Hive, Flume, Java, Maven, Impala, Spark, Oozie, Oracle, Yarn, GitHub, Junit, Tableau, Unix, Cloudera, Flume, Sqoop, HDFS, Tomcat, Eclipse, Java, Scala, Hbase.
Client – Aviat Networks Inc.
Employer: NTT DATA
Role – Development/Enhancements, Support and Agile Administrator
Version – Agile PLM 9.3.2 and 9.3.3
Duration: Apr 2013- Dec 2015
Project Description: Aviat Networks is a global provider of microwave networking solutions, providing public and private operators with communication networks to accommodate the exploding growth of IP-centric, multi-gigabit data services. Aviat uses Agile PLM to create different type of BOMS and Part numbers as per business rules and allow these BOMs or Part Numbers to transfer into Oracle EBS through D2R PIP and maintained through Change management process
Development & Enhancements:
Responsibilities
• Developed the web service- Tron services in which the services will get the data from Declaration Objects.
• Developed Workflow validations for post and Pre events
• Developed Part Submission Report and Part Compliance report and will get the data of the report related to jurisdiction, compliance data of all Items
• Created the URL PX- PRN document in which the data is written to the word document for the required attributes.
• Created International Image access PX where the users can download more than 10 GB of image files from network. Image files can be downloaded for a particular user who has approved jurisdictions from the compliance records.
• Migrated some of the PXs related from 9.3.2 to 9.3.3.
• Developed Queries for some of the data related to migration of data in PC, PG&C and PPM Modules.
• Developed the New Part MCO Process based on different Usergroups.
• Developed DMSParts Scheduler Event where this event will be generated on the daily basis and will get the desired report.
• Developed Critical Items project in which the change analysts will check for the critical items in the change order and will release the change order from Agile.
• When any Item being obsolete / inactivated the PX will enforce removal of the component from BOM’s in Production.
• Prevent the user from changing the status of the workflow without attaching the ECO Impact costing document.
• Validations on Change Status for Workflow and Update title Block Events for the users in order for the release of change Orders from Agile-PIP-Oracle.
• Update Contract Manufacturer External Access Field in all the Sub Components of a BOM and All Changes related to the BOM.
• Update Attributes on Save As Event
• Prepared Deployment and Technical documents.
Support Project:
Responsibilities:
• User Management
• Managing Roles and Privileges
• Managing existing Workflows and set up of new Workflows with modified Process
• Enabling Additional Classes, creation of sub classes etc.
• Support Issues involving between Agile-PIP-Oracle.
• Involved in restart of Production Agile Services and File Manger Services activities.
• Performed post refresh tasks in Development and Stage (Test) environments.
• Log Service Request with Oracle support and follow up with Oracle support for resolution
Upgrade Project:
Responsibilities
• Involved in Agile Support during the Upgrade from 9.3.2 to 9.3.3.
• Involved in the Integration issues from Agile-Oracle to AIAPIP.
• Deployed all of the existing PXs to the 9.3.3 Agile.
• Involved in Agile Content Service Configuration.
• Worked on Agile Application Server URL Configurations and Java Client Configurations.
• Log Service Request with Oracle support and follow up with Oracle support for resolution
Migration Project:
Responsibilities
• PC and PG&C Objects are migrated from 9.3.2 to 9.3.3
• PPM Migration of Projects from 9.3.2 to 9.3.3.
• Loading of BOMs from 9.3.2 to 9.3.3 and processed the BOMs from Agile-PIP-Oracle
• Configured ACS Integration for Aviat Networks data.
• Imported files to Aviat parts post migration using Agile SDK.
Client – Natus Medical Inc.
Employer: NTT DATA
Role – Development and Support
Version – Agile PLM 9.3.1.0
Duration: Mar 2012- Mar 2013
Project Description: Natus Medical Incorporated is a leading provider of medical devices, software and services for the Newborn Care, Neurology, Sleep, Hearing and Balance markets. Natus products are used in hospitals, clinics and laboratories worldwide. Natus is a leading provider of healthcare and medical products used for screening, detecting, monitoring and tracking of common medical ailments in newborn care, hearing impairment, neurological disjunction and disorders etc. Natus uses Agile PLM to create Model BOMS with Option Classes and Part numbers as per business rules and allow these BOMs to transfer into Oracle EBS through D2R PIP and maintained through Change management process.
Responsibilities:
• Involved in Integration testing between Agile PLM to Oracle EBS.
o Prepare Test Cases
o Execute Test Cases
o Document Results and follow for successful execution of all Tests
• Involved in configuration of Agile Content service (ACS) in Agile PLM.
• Involved in Post production Support
• Implemented Variant Management in Agile PLM.
o Agile Administration
o User Management
o Managing Roles and Privileges
o Enabling Additional Classes, creation of sub classes, new attributes etc.
o Involved in writing SDK Programs and PX extensions
Client – Miasole
Employer: NTT DATA
Duration: Oct 2011 –Mar 2012
Role - Agile Administrator
Version – Agile PLM 9.3.1
Project Description: Miasole is a solar energy company making the products of solar panels. All the board members in Miasole uses Agile PLM application for change process management. The CCB members act as approvers and observers to route the workflow and manage the Lifecycle of a component. Agile PLM is used to create the BOMs and Manufacturers as per the business rules.
Responsibilities:
• User Management
• Managing Roles and Privileges
• Managing existing Workflows and set up of new Workflows with modified Process.
• Adding Approvers and Observers in the Change Control Process as suggested by the Client.
• Creating and transmitting customized notifications to the members of the change control process about the escalation of the workflow.
• Enabling Additional Classes, creation of sub classes, new attributes etc.
• Validating the life cycle phases of the Agile Objects.
• Logging Service Request with Oracle support for the Bug’s found in Agile
• Requirements gathering for all customizations/enhancement using SDK.
Client – Dell
Employer: NTT DATA
Duration: June 2010 –Sep 2011
Role - Agile Developer and Support
Version – Agile PLM 9.3.0
Responsibilities:
• Worked on all of the existing PXs to the 9.3.0 Agile.
• Involved in ACP and ACS Configuration.
• Involved in the support role of Agile PLM
• Provided test cases for Agile PLM functionality on different modules
EDUCATION:
Bachelor’s from Electronics and Communication Engineering from Vellore Institute of technology.