Data Ingestion / Hadoop Engineer
Posted on: December 8, 2018
Data Ingestion / Hadoop Engineer (Software Application Programmer -III)Join Network Performance Intelligence Team and help improve the reliability and performance of our network. You'll get the opportunity to work with the latest and greatest technologies for Big Data Ingestion and Transformation. The candidates will get to use many different connection protocols as well as be exposed to deeper and complicated uses interfacing with Hadoop architecture and Oracle database.Responsibilities will include --- Implement interfaces with different systems to ingest/distribute data using different protocols: TCP/IP sockets, SFTP/SCP, SOAP WS, REST, IBM MQ, JMS, SCP, SFTP, HTTP, SNMP --- Design, Develop and support data flows using: Apache NiFi, Apache Kafka --- Develop and support data processing scripts written in UNIX shell, Java, Python and PERL. --- Support data ingestion and processing routines written using Oracle SQL*Loader and stored PL/SQL procedures --- Develop automation of software delivery and infrastructure changes using DEVOPS tools. --- Manage BIG Data via Hadoop protocols and features using HDFS, HIVE, SQOOP --- Support scheduled production code deployments.Required Experience in Data Transfer Tools/Protocols -- NiFi -- Kafka -- SFTP/SCP -- TCP/IP -- Some exposure in (HTTP,SOAP WS,REST, JMS, RSYNC, Curl)Required Expert Experience in Languages -- Java -- UNIX Shell ScriptingExperience that is nice to have and a compliment in the position. -- Python Language -- Perl Language -- Hadoop Technologies (HDFS, Hive, HBASE,PIG, Sqoop, Oozie) -- Data Base Technologies (SQL/SQLDR, NoSQL -- Data Analytical, Dashboard Tools (Tableau / Splunk) -- Use of DevOps Tools - provided by Dice Nifi, Kafka, SFTP, TCPIP, BIg Data
Keywords: Incedo, Denver , Data Ingestion / Hadoop Engineer, Engineering , Littleton, Colorado
Didn't find what you're looking for? Search again!