
Vana Inikurti
- : Hadoop Developer
- Bellevue, WA
- Member Since Feb 19, 2023
Vana Inikurti
Professional Summary:
· 8+ Years of experience with emphasis on Big Data Technologies, Development, Administration and Design of Java based enterprise applications.
· Expertise in Hadoop Development/Administration.
· Expertise in Software Development Life Cycle (Requirements Analysis, Design, Development, Testing, Deployment and Support).
· Sounds Knowledge in databases design features including ER Diagrams, normalization, Tablets, Temporary tables, constraints, keys, data dictionaries, and data integrity
· Experienced in setting up standards and processes for Hadoop based application design and implementation.
· Hands on experience in installing, configuring and using ecosystem components like Hadoop Map Reduce ,HDFS ,Hbase ,Oozie ,Hive ,Pig, Flume.
· Experienced in developing Map Reduce programs using Apache Hadoop for working with Big Data.
· Developed Sqoop Scripts to extract data from DB2 EDW source databases onto HDFS.
· Experience in various data transformation and analysis tools like Map Reduce, Pig and Hive to handle files in multiple formats (JSON, Text, XML, Binary, Logs etc
· Extensive Experience on importing and exporting data using stream processing platforms like Flume and Kafka.
· Worked with Oracle and Teradata for data import/export operations from different data marts.
· Configured internode communication between Cassandra nodes and client using SSL encryption.
· Expertise in NoSQL databases including HBase.
· Developed Spark Application by using Python (Pyspark)
· Expertise in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.
· Expertize with the tools in Hadoop Ecosystem including Pig, Hive, HDFS, MapReduce, Sqoop, Spark, Kafka, Y/arn, Oozie, and Zookeeper.
· Excellent knowledge on Hadoop ecosystems such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm
· Experience in designing and developing applications in Spark using Scala to compare the performance of Spark with Hive and SQL/Oracle
· Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
· Performed data analysis using Hive and Pig.
· Loading log data into HDFS using Flume.
· Expertise in using Sqoop, Zoo Keeper and Cloudera Manager.
· Expertise in back-end procedure development, for RDBMS, Database Applications using SQL and PL/SQL. Hands on experience on writing Queries, Stored procedures, Functions and Triggers by using SQL.
· Excellent communication, interpersonal, analytical skills, and strong ability to perform as part of team.
· Exceptional ability to learn new concepts.
· Hard working, Quick learner and enthusiastic.
· End to end working experience in all the SDLC phases.
· Well versed with all stages of Software Development Life Cycle (SDLC) i.e. Requirement(s) gathering, analyzing the same, Design, Implementation with usage of SQL mappings, sessions and workflows.
· An excellent team player and self-starter with good communication skills and proven abilities to finish tasks before target deadlines.
Education:
K.L.University India
· Bachelor of Technology
Technical Skills:
|
Programming Languages |
SQL, PL/SQL,T-SQL, Databases. SQL, T-SQL, PL/SQL, C, C++, C#, CSS, HTML, Java. |
|
Databases |
NO SQL (HBase), MY SQL,MS SQL server. |
|
IDE’s & Utilities |
Eclipse and JCreator,NetBeans. |
|
WebDev.Technologies |
HTML, XML. |
|
Protocols |
TCP/IP, HTTP and HTTPS. |
|
Operating Systems |
Windows 7,8,10, Unix, Linux, Red hat. |
|
ETL tools |
Tableau,VMplayer |
|
Hadoop ecosystem |
Hadoop and Map Reduce, Sqoop, Hive, PIG, HBASE, HDFS, Zookeeper, Oozie, and Kafka.
|
Professional Experience:
T-Mobile,Bellevue,WA May 2017 to till date
Role: Hadoop Developer
As America's Un-carrier, T-Mobile US, Incis redefining the way consumers and businesses buy wireless services through leading product and service innovation. Our advanced nationwide 4G LTE network delivers outstanding wireless experiences to 72.6 million customers who are unwilling to compromise on quality and value. Based in Bellevue, Washington, T-Mobile US provides services through its subsidiaries and operates its flagship brands, T-Mobile and Metro PCS. Maintained the knowledge of current promotions and policies regarding payment and exchanges and security practices. Described services and explain operation of the wireless service to customers. Recommended mobile devices based on customer services. Greeted customers and ascertained customer’s needs.
Responsibilities:
· Installed and configured HadoopMap-Reduce, HDFS and developed multiple Map-Reduce jobs in Java for data cleansing and pre-processing.
· Evaluated business requirements and prepared detailed specifications that follow project guidelines required to develop written programs.
· Responsible for building scalable distributed data solutions using Hadoop.
· Analysed large amounts of data sets to determine optimal way to aggregate and report on it.
· Developed and executed hive queries for de-normalizing the data.
· Developed the Apache Storm, Kafka, and HDFS integration project to do a real-time data analyses.
· Responsible for executing hive queries using Hive Command Line, Web GUI HUE and Impala to read, write and query the data into HBase.
· Moved data from HDFS to Cassandra using Map-Reduce and Bulk Output Format class
· Developed bash scripts to bring the T-log files from ftp server and then processing it to load into hive tables.
· Developed Oozie Workflows for daily incremental loads, which gets data from Teradata and then imported into hive tables.
· Worked on analysing data with Hive and Pig.
· Handled importing of data from various data sources, performed transformations using Hive, Map-Reduce, and loaded data into HDFS.
· Importing and exporting data into HDFS using Sqoop.
· Wrote Map-Reduce code to make un-structured data into semi- structured data and loaded into Hive tables.
· Responsible for cluster maintenance, adding and removing cluster nodes, cluster monitoring and troubleshooting.
· Worked extensively in creating Map-Reduce jobs to power data for search and aggregation
· Worked extensively with Sqoop for importing metadata from Oracle.
· In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, MRv1 and MRv2 (YARN).
· Extensively used Pig for data cleansing.
· Created partitioned tables in Hive.
· Managed and reviewed Hadoop log files.
· Involved in creating Hive tables, loading with data and writing hive queries which will run internally in Map-Reduce way.
· Used Hive to analyse the partitioned and bucketed data and compute various metrics for reporting.
· Installed and configured Pig and also written PigLatin scripts.
· Developed Pig Latin scripts to extract the data from the web server output files to load into HDFS.
· Created H-base tables to store various data formats of data coming from different portfolios.
· Developed Map-Reduce jobs to automate transfer of data from Hbase.
· Used SVN, Tortoise SVN version control tools for code management (check-ins, checkouts and synchronizing the code with repository).
· Worked hands on with ETL process.
Environment:Hadoop, Map-Reduce, Hive, H-Base, HDFS, Hive,Java (JDK 1.6),Cloudera, Map-Reduce, PL/SQL, SQL*PLUS, UNIX Shell Scripting. Java 6, Eclipse,
Nike, Oregon, OR Feb 2015 to April 2017
Role: Hadoop Developer
Our diverse Nike team is the spark that ignites our imagination and drives innovation. We speak dozens of languages and live in more than 190 countries. We are some of the world’s top designers, engineers and salespeople. From the retail floor to our global offices, differences drive our excellence.Nike represents a global culture of sport, style and the pursuit of greatness. We are passionate about potential and believe everyone should have the tools to reach theirs. We invest in our employees, inspiring the new ideas, methods and products that drive the future of sport.”It’s not a single product model, nor a single manager, nor one ad, nor a single celebrity, not even a single innovation that is key to Nike. It is the people of Nike and their unique and creative way of working together.”
Responsibilities:
· Worked with business teams and created Hive queries for ad hoc access.
· Continuous monitoring and managing the Hadoop cluster through Cloudera Manager.
· Involved in review of functional and non-[functional requirements
· Responsible to manage data coming from different sources.
· Installed and configured Hadoop ecosystem like H-Base, Flume, Pig and Sqoop.
· Loaded daily data from websites to Hadoop cluster by using Flume.
· Involved in loading data from UNIX file system to HDFS.
· Developed batch processing pipeline to process data using python and airflow. Scheduled spark jobs using airflow.
· Created a new airflow DAG to find popular items in Red-shift and ingest in the main Postgres DB via a web service call.
· Worked on migrating Map-Reduce programs into Spark transformations using Spark and Scala.
· Involved in writing, testing, and running Map-Reduce pipelines using Apache Crunch.
· Creating Hive tables and working on them using Hive QL.
· Created complex Hive tables and executed complex Hive queries on Hive warehouse.
· Wrote Map-Reduce code to convert unstructured data to semi structured data.
· Used Pig to extract, transformation & load of semi structured data.
· Installed and configured Hive and also written Hive UDFs.
· Develop Hive queries for the analysts.
· Developed workflow in Oozie to automate the tasks of loading the data into HDFS and pre-processing with Pig.
· Cluster co-ordination services through Zoo-Keeper.
· Collected the logs data from web servers and integrated in to HDFS using Flume.
· Creating Hive tables and working on them using Hive QL.
· Worked on Hive for exposing data for further analysis and for generating transforming files from different analytical formats to text files.
· Design and implement Map Reduce jobs to support distributed data processing.
· Supported Map-Reduce Programs those are running on the cluster.
· Involved in HDFS maintenance and loading of structured and unstructured data.
· Wrote Map-Reduces job using Java API.
· Designing No-SQL schemas in H-base.
· Wrote the shell scripts to monitor the health check of Hadoop daemon services and respond accordingly to any warning or failure conditions.
· Involved in Hadoop cluster task like Adding and Removing Nodes without any effect to running jobs and data.
· Developed the Pig UDF’S to pre-process the data for analysis.
· Involved in Hadoop cluster task like Adding and Removing Nodes without any effect to running jobs and data.
Environment:Hadoop, Map-Reduce, HDFS, Hive, Pig, H-Base, Java, Cloudera Linux, XML, MySQL, MySQL Workbench, Java 6, Eclipse, Cassandra.
Texas Health Resources, Arlington, TX Nov 2013 to Jan 2015
Role: Hadoop Developer
Texas Health Resources is one of the largest faith-based, non-profit health care delivery systems in the United States and the largest in North Texas in terms of patients served. Respecting the dignity of all persons, fostering a corporate culture characterized by teamwork, diversity and empowerment.Conduct our corporate and personal lives with integrity. Relationships based on loyalty, fairness, truthfulness and trustworthiness. Sensitivity to the whole person, reflective of god’s compassion and love with particular concern for the poor. Continuously improving the quality of our service through education, research, competent and innovative personnel, effective leadership and responsible stewardship of resources.
Responsibilities:
· Involved in review of functional and non-functional requirements.
· Installed and configured Pig and also written Pig-Latin scripts.
· Wrote Map-Reduce job using Pig Latin.
· Involved in ETL, Data Integration and Migration
· Imported data using Sqoop to load data from Oracle to HDFS on regular basis.
· Developing Scripts and Batch Job to schedule various Hadoop Program.
· Written Hive queries for data analysis to meet the business requirements.
· Creating Hive tables and working on them using Hive QL.
· Importing and exporting data into HDFS from Oracle Database and vice versa using Sqoop.
· Experienced in defining job flows.
· Got good experience with NOSQL database H-Base.
· Involved in creating Hive tables, loading the data and writing hive queries that will run internally in a map reduce way.
· Developed a custom File System plugin for Hadoop so it can access files on Data Platform.
· The custom File System plugin allows Hadoop Map-Reduce programs, H-Base, Pig and Hive to work unmodified and access files directly.
· Designed and implemented Map-reduce-based large-scale parallel relation-learning system
· Extracted feeds form social media sites such as Facebook, Twitter using Python scripts.
· Setup and benchmarked Hadoop/H-Base clusters for internal use
Environment: Hadoop, Map-Reduce, HDFS, Java, Hadoopdistribution of Cloudera, Pig,H-base, UNIX.
Thrinaina Informatics Ltd, India Aug 2010 to Sep 2013
Role: PL/SQL developer
Responsibilities:
· Wrote Stored Procedures in PL/SQL.
· Defragmentation of tables, partitioning, compressing and indexes for improved performance and efficiency.
· Involved in table redesigning with implementation of Partition Table and Partition Indexes to make Database Faster and easier to maintain.
· Used SQL Server SSIStool to build high performance data integration solutions including extraction, transformation and load packages for data warehousing.
· Extracted data from the XML file and loaded it into the database.
· Created and modified SQL*Plus, PL/SQL and SQL*Loader scripts for data conversions.
· Worked on XML along with PL/SQL to develop and modify web forms.
· Designed Data Modelling, Design Specifications and to analyze Dependencies.
· Creating indexes on tables to improve the performance by eliminating the full table scans and views for hiding the actual tables and to eliminate the complexity of the large queries.
· Involved in creating UNIXShell Scripting.
· Maintaining Logical and Physical structure of the database.
· Creating tablespaces, tables, views, scripts for automatic operations of the database activities.