Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

WTBoWXcyekpyS2xRRjBNNzQ2UytRYmo0b2c9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Addition Management

Executive Sous Chef Job at Addition Management

 ...Job Description Position: Sous Chef Location: Sharon Hill, PA (Fully on site) Salary: $55K-$65K Growing Hospitality...  ...Responsibilities: Quality Control each order for adherence to Corporate and Government guidelines. Maintain consistency in food quality... 

CareScout

Registered Nurse RN (No direct care, assessments only) Job at CareScout

 ...Hematology Holistic Medicine Home Health Hospice & Palliative Medicine Hospital Medicine Hyperbaric Medicine Infectious Disease Internal Medicine Labor & Delivery Medical-Surgical Nephrology Neurology Nuclear Medicine Ob/Gyn... 

HouseSitter.com

House Sitter Wanted - Cheyenne, Wyoming House Sitter Needed Earn $50 Daily! Job at HouseSitter.com

 ...tending to the needs of my beloved plants.# OPEN TO NEGOTIATE !IN CASE OF A TRIP IN EUROPE I AM LOOKING FOR 3-4 weeks of someone living in the house effectively. I would like a retired cop or someone with a law enforcement background!If you are a responsible and... 

Morongo Casino Resort and Spa

Massage Therapist - Spa Job at Morongo Casino Resort and Spa

 ...The Massage Therapist is responsible for delivering professional massage and body therapy treatments in a luxury spa environment. This position ensures all guests receive 4-Star/4-Diamond service while upholding the highest standards of cleanliness, professionalism, and... 

Atomus

Cyber Security Engineer Job at Atomus

 ...About the Company Atomus' mission is to provide world class cybersecurity for the worlds most critical organizations. We build security compliance software delivered as managed services sold directly, with relevant professional services and support. Examples of our...