Ingest data from sources such as Microsoft SQL Server (BOSS) and Oracle into the Bronze layer, implementing CDC-based incremental ingestion
Develop dbt models for the Silver layer including cleansing, standardization, deduplication, and data quality testing
Develop Gold layer business-specific data marts and migrate existing Alteryx transformation logic
Configure Apache Iceberg tables and a REST Catalog, including schema evolution and time travel support
Develop and operate Apache Airflow DAGs, managing dependencies, scheduling, and failure notifications
Develop an MCP server enabling AI agents to query Gold-layer data marts, including catalog/metadata access, ontology integration, and query execution
Manage metadata and data lineage using OpenMetadata
Automate Excel reporting using Python and openpyxl
3+ years of hands-on data engineering experience in production environments
Advanced SQL skills, including window functions, CTEs, and query tuning
Hands-on dbt experience, including model design, incremental strategies, macros, and tests
Python proficiency for data processing and automation, including libraries such as pandas
Experience developing Apache Airflow DAGs
Experience with at least one analytical engine: Trino/Presto, Apache Spark, or DuckDB
Experience with at least one lakehouse table format: Apache Iceberg, Delta Lake, or Apache Hudi
Experience with Medallion Architecture and star schema/dimensional modeling
Experience integrating relational database sources, such as Microsoft SQL Server and Oracle, using CDC or batch processing
Required Technical Skills
SQL
dbt
Python
pandas
Apache Airflow
Trino/Presto or Apache Spark or DuckDB
Apache Iceberg or Delta Lake or Apache Hudi
Microsoft SQL Server
Oracle
Kubernetes
MinIO (S3-compatible storage)
Preferred Qualifications
Experience with EL tools such as Airbyte or Fivetran, and Iceberg REST Catalog implementations such as Apache Polaris
Experience with governance tools such as OpenMetadata or DataHub, and semantic layers such as Cube.dev
Ability to interpret Alteryx workflows (.yxmd) and migrate their logic to SQL/dbt
Experience developing MCP servers or building LLM, RAG, or AI agent pipelines
Experience developing applications, APIs, or backend services using Java and/or Python
Experience building Generative AI (GenAI) applications, including LLM integration, retrieval-augmented generation (RAG), and AI agent workflows
Hands-on experience with LangChain and/or LangGraph for developing tool-enabled AI agents and orchestrating multi-step workflows
Understanding of retail and home appliance business domains, including PSI (Production, Sales, and Inventory) and sales analytics
Understanding of retail and home appliance business domains, including PSI (Production, Sales, and Inventory) and sales analytics
Preferred Technical Skills
Java or Python
Generative AI (GenAI) and LLM integration
LangChain
LangGraph
RAG and AI agent pipelines
MCP server development
Airbyte
Fivetran
Apache Polaris
OpenMetadata
DataHub
Cube.dev
Alteryx
openpyxl
All your information will be kept confidential according to EEO guidelines.
Payrate : $10,371.64/m DOE
Work Location : Plano, TX
Contract Period: 1 year
We are seeking a mid-level Data Platform Engineer to build a new greenfield data platform integrating internal systems (GSCM, SEASI, SMART, and BOSS) using a Medallion Architecture.
This role owns the end-to-end data pipeline—from ingestion through Bronze/Silver/Gold transformation—while migrating existing Alteryx workflows to code-based dbt and Python implementations.
The engineer will also develop an MCP server enabling AI agents to query business-specific data marts, directly supporting the organization's AI-driven analytics initiatives.
Success in this role will deliver a scalable, governed data foundation that accelerates business insights and AI adoption.
Buffalo Toronto Public Media is your local source for television and radio - BTPM PBS, BTPM KIDS, BTPM Create, BTPM NPR, BTPM Classical, and BTPM The Bridge!We reach Western New York and Southern Ontario and can be streamed from your favorite device.Engaging our communities...
...you passionate about building strong relationships between labor and management? Do you thrive in high-impact roles where your... ...We are seeking a dynamic, collaborative, and strategic Labor Relations Specialist to support our mission of supporting Californias public...
...Physician 58724474 Physician Location: Napa, CA Napa is world-renowned for its stunning wine country, exceptional dining... ...comprehensive non-invasive cardiology services, including nuclear medicine, echocardiography, and stress treadmill testing, to both...
WHO WE ARE & WHAT WE ARE LOOKING FOR: Tradesmen Electric is a growth-minded, company that focuses on our employees success. We provide our employees with the opportunity to stay challenged and to be able to maximize their own potential. We arelooking to add long term...
...Now Hiring: Electrical Estimator Location: Serving Oakland, Macomb, Lapeer, and Wayne Counties Main office located in Auburn Hills, Michigan Join Our Growing Team at E.L. Electrical Contracting E.L. Electrical Contracting is seeking an experienced...