IT - Technology Lead | Big Data | Big Data - ALL at Hire it People Inc / employment-usa.net

applicants

IT - Technology Lead | Big Data | Big Data - ALL

at Hire it People Inc in North Carolina

Must Have Skills:

Kafka Development
Hadoop Development
Python Scripting
Scala Development
Spark Development
Detailed Job Description:

Bachelor s Degree or foreign equivalent, will consider work experience in lieu of a degree
4+ years of experience with Information Technology
3+ years in Kafka programming, working knowledge around Big Data (Hadoop, Hbase, Hive, Scala, Spark, Python etc.).
Experience building and optimizing big data data pipelines, architectures and data sets using Kafka. Experience in Core Java/ OOPS.
Experience in Apache/Confluent Kafka components (Connect, Schema, Registry, KSQL, ControlCenter, brokers, KStream)
Provide expertise and hands on experience working on Kafka connectors such as MQ connectors, Elastic Search connectors, JDBC connectors, File stream connector, JMS source connectors, Tasks, Workers, converters, Transforms.
Create stubs for producers, consumers and consumer groups for helping onboard applications from different languages/platforms. Leverage Hadoop ecosystem knowledge to design, and develop capabilities to deliver solutions using Spark, Scala, Python, Hive, Kafka and other things in the Hadoop ecosystem.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
A successful history of manipulating, processing and extracting value from large disconnected datasets. Working knowledge of message queuing, stream processing and highly scalable big data data stores.
Good experience in end-to-end implementation of DW BI projects, especially in data warehouse and mart developments
Strong knowledge and hands-on experience in Unix shell scripting
Knowledge and experience with full SDLC lifecycle
Experience supporting and working with cross-functional teams in a dynamic environment.
Independently able to debug and support to prod support team as and when required
Experience with Lean / Agile development methodologies
Minimum years of experience : 10+
Reference : IT - Technology Lead | Big Data | Big Data - ALL jobs

» Apply now