Senior Data Engineer Job at Next Ventures, San Francisco, CA

cS9YaXVzUVFZbUsycDRBbXN3NkhPTngyclE9PQ==
  • Next Ventures
  • San Francisco, CA

Job Description

I am partnered with a Real Time Intelligence Company, who have built a platform that uses AI to transform publicly available data into real time operational insights.

With a huge part of their business growing, they are now looking to hire a Senior Data Engineer, who will be an integral part of the team, working on new and exciting projects, building new pipelines, migrating from one service to another service and building a data and analytics infrastructure.

Responsibilities

  • Build and maintain data pipelines for large scale data ingestion, real time analytics and Machine Learning Services
  • Develop and optimize NLP, LLMs and other AI powered applications
  • Write CI/CD pipelines and have the ability to do code reviews
  • Design and build a data analytics infrastructure

Qualifications

  • Professional Experience in using Apache Storm, Kafka or Flink for real time data or streaming
  • 5+ years experience in Data Engineering and building pipelines using Databricks and Spark
  • Can demonstrate experience in building CI/CD pipelines and DevOps best practises
  • Experience with real time data streaming

Job Tags

Permanent employment, Immediate start

Similar Jobs

Peraton

Background Investigator (FT Employee) - Riverside, CA Job at Peraton

Responsibilities Peraton is seeking to fill a critical role for a full-time background investigator near Riverside, CA . Applicants must reside within 40 miles of the city center of Riverside. What youll do: The Investigator will be responsible for the following... 

The LiRo Group

Sr Environmental Planner - Albany, NY Job at The LiRo Group

 ...manage a portfolio of multiple projects. ~ Candidate must have a degree from an accredited college in Environmental Science or Planning, Architecture, Engineering, Landscape Architecture, or related program. ~ Experience coordinating with designers and NYS and federal... 

Confidential

Travel Licensed Practical Nurse LPN Job Job at Confidential

 ...Associates, Inc. is seeking a reliable and compassionate Licensed Practical Nurse (LPN) to deliver quality patient care across a variety of clinical settings. This position is most likely a travel job , well-suited for LPNs who value flexibility, adaptability, and the... 

Aloma Healthcare, Inc.

Elderly Care Assistant / Companion (MVR & Clean Record) - Hempstead, Texas 77445 Job at Aloma Healthcare, Inc.

Crucial Requirements: Vaccination Status: Must be fully vaccinated against COVID-19 per the client's explicit request. Driving & MVR Requirement: Must be comfortable and willing to drive the client to medical appointments and errands using the clients personal vehicle...

Steadfast

Senior Irrigation Manager Job at Steadfast

 ... Minimum of 5 years of supervisory experience within the irrigation services, landscape installation or landscape maintenance industries...  ...for scheduling projects, supervising team members, and managing the resources needed for providing irrigation services and projects...