About OnSpot Serve

OnSpot Serve is a staffing and recruiting company.

company website →

Big Data- Hadoop Developer← All Jobs

2020-02-27 | NYC, NY. Edison, NJ. Charlotte, NC. Phoenix, AZ | DOE | 12 Months+ Contract


Description

Role: Big Data -Hadoop Developer
Location: NYC, NY; Edison, NJ; Charlotte, NC;
Job Type: Long Term Contract


Description:

10+ years of IT experience in all phases of Software Development Life Cycle (SDLC) with skills in data analysis, design, development, testing and deployment of software systems. Strong team player, ability to work independently and in a team as well, ability to adapt to a rapidly changing environment, commitment towards learning, Possess excellent communication, project management, documentation, interpersonal skills.

CHARACTERISTIC DUTIES AND RESPONSIBILITIES:
o At least 3+ years of strong experience, working on components like MapReduce, HDFS, HBase, Hive, Pig, Oozie, Zookeeper, Flume, Spark, Python with CDH4&5 distributions and EC2 cloud computing with AWS.
o Well conversed and hands on experience in UNIX, LINUX and NoSQL
o Key participant in all phases of software development life cycle with Analysis, Design, Development, Integration, Implementation, Debugging, and Testing of Software Applications in client server environment, Object Oriented Technology and Web based applications.
o Strong in Developing MapReduce applications, Configuring the Development Environment, Tuning Jobs and Creating MapReduce Workflows.
o Experience in performing data enrichment, cleansing, analytics, aggregations using Hive and Pig.
o Knowledge in Cloudera Hadoop distributions and few other majorly used distributions like Horton works and MapR.
o Hands on experience in working with Cloudera CDH3 and CDH4 platforms.
o Proficient in big data ingestion and streaming tools like Flume, Sqoop, Kafka, and Storm.
o Experience with different data formats like Json, Avro, parquet, RC and ORC and compressions like snappy & bzip.
o Experienced in analysing data using HQL, PigLatin and extending HIVE and PIG core functionality by using custom UDFs.
o Good Knowledge/Understanding of NoSQL data bases and hands on work experience in writing applications on NoSQL databases like Cassandra and MongoDB.
o Good knowledge on various scripting languages like Linux/Unixshell scripting and Python.
o Good knowledge of Data ware housing concepts and ETL processes.
o Involved in importing Streaming data using FLUME to HDFS and analyzing using PIG and HIVE.
o Experience in importing streaming data into HDFS using Flume sources, and Flume sinks and transforming the data using Flume interceptors.
o Configured Zookeeper to coordinate the servers in clusters to maintain the data consistency.
o Used Oozie and Control - M workflow engine for managing and scheduling Hadoop Jobs.
o Diverse experience in working with variety of Database like Teradata, Oracle, MySql, IBM DB2 and Netezza.

NICE TO HAVE
o Good knowledge in understanding Core Java and J2EE technologies such as Hibernate, JDBC, EJB, Servlets, JSP, JavaScript, Struts and spring.
o Experienced in using IDEs and Tools like Eclipse, Net Beans, GitHub, Jenkins, Maven and IntelliJ.
o Implemented POC to migrate map reduce programs into Spark transformations using Spark and Scala.
o Ability to spin up different AWS instances including EC2-classic and EC2-VPC using cloud formation templates.


Share:

Apply
Your Name here
Your Email Address
Enter your message to the company explaining why you are a fit for this job
Please use Microsoft Word format


Similar Jobs: