Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

WTBoWXcyekpyS2xRRjBNNzQ2UytRYmo0b2c9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

American Security Group

Personal Protection Specialist (PPS) Job at American Security Group

 ...information, visit or explore career opportunities at Role Description This is a part to full-time on-site role for a Personal Protection Specialist (PPS) in Richmond, VA. The PPS will be responsible for providing physical security for an individual in the political... 

Classic Settlements

Real Estate Settlement Attorney Job at Classic Settlements

 ...Classic Settlements, a well-established real estate title company, is seeking a detail-...  ...experience overseeing residential and/or commercial real estate closings, reviewing title abstracts...  ...preferred (will consider strong entry-level candidates with relevant internship or... 

Barrington James

Facilities Manager Job at Barrington James

 ...automated vertical farming (AVF) processes for plant-based gene therapy production. This on-site role requires strong experience managing AVF systems and facility operations, with an understanding of whats needed to support progression into clinical trials. Key Responsibilities... 

Milton Hershey School

Program Assistant Project Market, Part-Time Job at Milton Hershey School

 ...Program Assistant Project Market, Part-Time - ( 25000238 ) Description Milton Hershey School (MHS) is one of the world's best pre-K through...  ...PA driver's license in good standing. Experience in safe food handling preferred. NSF ServSafe Certification or ability... 

Whydrate Newnan Llc

Infusion Specialist (RN or Medic) Job at Whydrate Newnan Llc

 ...our growing team. The position works in our comfortable, relaxing, spa-like, storefront location in premium retail locations. The Infusion Specialist's job is unique and low-stress and calls for a true IV specialist to serve upscale health and wellness clients. You will...