the smart solution for Denver jobs

Cloud Data Engineer

Company: Access Data Consulting Corp
Location: Englewood
Posted on: February 15, 2019

Job Description:

1. Python - needs to be an expert in this 4/5 level. They use python for data movement and transformation 2. Spark and spark eco system (transformation and manipulation 3. Scala (Spark) 4. Cloud datawarehouse experience - Snowflake is a plus, but Redshift or Google BigQuery would be good 5. Apache AirFlow 6. AWS experience and AWS Tools - Lamda, Kinesis, ECS (Elastic), EC2, S3 7. CI/CD - continuous integration, continuous delivery 8. Data lakes 9. SQL Experience (data migration, modeling, analysis)Actual job description:---Analyze data from multiple data sources and develop processes to integrate the data into a single but consistent view.---Develop, orchestrate and monitor complex ETL/ELT workflows using Python, AWS step-functions, Lambda coordinators and runner functions, Glue, Airflow, and/or other tools.---Implement robust data pipelines for batch and real-time analytics at scale, using a modern "Lambda" style architecture, ideally with the AWS toolset.---Develop custom Kinesis applications using the Kinesis API, KCL, and KPL, using Lambda polling to transform/aggregate in-stream data, and building tooling to monitor and dynamically re-shard as needed.---Light API development using AWS API Gateway, Kinesis, and Lambda to process push-based events at scale (200K+ records per second).---Implement serverless AWS architectures leveraging Lambda with state management via ElastiCache, Memcached, Redis, DynamoDB, etc. with careful consideration for monitoring, logging and error handling.---Infrastructure as code using Cloudformation or Terraform.---Implementation of modern CI/CD pipelines for automated code deployment/testing.---Ability to work heads down and independently on projects to meet tight deadlines with accurate results.---Strong communication and team building skills.---Ability to work with highly fluid requirements that may result in re-work of development items, as new data relationships are identified.---Experience with .Net, C#, Python, PowerShell, stored procedures, or other development tools required.---Expert level Python for ETL.---Expert with AWS toolset (EC2, Containers, Lambda, Networking).---Expertise with Snowflake a big plus. Tacit knowledge of Redshift and Google BigQuery. - provided by Dice CLOUD,AWS, Python, SQL Server,Scala, CI/CD

Keywords: Access Data Consulting Corp, Denver , Cloud Data Engineer, Engineering , Englewood, Colorado

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Other Engineering Jobs

Associate Civil Engineer
Description: Associate Civil Engineer br br Ready to be part of a team that tackles infrastructure challenges Want to take your Engineering skills to the next level to work on tough projects that will make a (more...)
Company: PARSONS
Location: Denver
Posted on: 02/18/2019

91B Light-Wheel Vehicle Mechanic
Description: As a Light-Wheel Vehicle Mechanic for the Army National Guard you'll ensure that anything that moves on wheels is ready to hit the road. In this role, you will primarily be responsible for supervising (more...)
Company: Army National Guard
Location: Denver
Posted on: 02/18/2019

Heavy Equipment Mechanic
Description: Heavy Equipment Mechanic GLH Construction is seeking an experienced heavy equipment/fleet maintenance mechanic.
Company: GLH Construction, Inc
Location: Windsor
Posted on: 02/18/2019

Maintenance Mechanic
Description: Position Description and Required Skills: A new opportunity exists for a Shift Maintenance Mechanic to join Carestream Health Group's, Innovative Polyester Manufacturing process. Innovative Polyester (more...)
Company: Carestream
Location: Windsor
Posted on: 02/18/2019

ASIC & FPGA Design Eng Stf
Description: Description:The coolest jobs on this planet or any other are with Lockheed Martin Space. br br At the dawn of a new space age, Lockheed Martin is a pioneer, partner, innovator and builder. Our amazing (more...)
Company: Lockheed Martin
Location: Louisville
Posted on: 02/18/2019

Sr. QA Engineer
Description: Sr. QA Engineer Position SummaryAs a Senior Quality Assurance Engineer, you will utilize automated and manual testing techniques to ensure the quality and stability of Payfone s suite of mobile identity (more...)
Company: Payfone
Location: Englewood
Posted on: 02/18/2019

Data Engineer - Watkins
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring
Company: Hired
Location: Watkins
Posted on: 02/18/2019

senior information security engineer
Description: Direct Client Requirement Title: senior information security engineerLocation: Denver, CORate: DOEDuration: 3 MONTHSInterview Type: Skype and PhoneWork Status: Successful applicants must be (more...)
Company: SohanIT INC
Location: Denver
Posted on: 02/18/2019

Data Operations Engineer - (Denver, CO)
Description: Role Description: On a day to day basis, the Data Operations Engineer will continually identify and execute on improvement opportunities within FareHarbor's data management processes. As needed, the Data (more...)
Company: FareHarbor
Location: Denver
Posted on: 02/18/2019

Splunk Engineer SME
Description: Description: Splunk Engineer SME Littleton, CO, on site role 6 months Contract-to-hire br br Splunk Engineer SME with 5-10 years of experience as a Splunk Engineer with security focus. Extensive experience (more...)
Company: Orgspire Inc
Location: Littleton
Posted on: 02/18/2019

Log In or Create An Account

Get the latest Colorado jobs by following @recnetCO on Twitter!

Denver RSS job feeds