DataBricks Architect Job at Abidi Group LLC, Houston, TX

WE9RUkJVd1FFQlFBM21Oam83enVtWk9m
  • Abidi Group LLC
  • Houston, TX

Job Description

Technical Expertise:

  • Data bricks Mastery:  Deep, expert-level knowledge of the Data bricks Platform, including:
    • Unity Catalog:  Designing and implementing data governance and security.
    • Delta Lake & Delta Live Tables:  Architecture and building reliable, scalable data pipelines.
    • Performance & Cost Optimization:  Expertise in tuning Spark jobs, optimizing cluster usage, and managing platform costs.
    • MLOps:  Strong, practical understanding of the machine learning lifecycle on Data bricks using tools like MLflow.
    • Data bricks SQL:  Knowledge of designing and optimizing analytical workloads.
    • Mosaic AI:  Knowledge of designing and optimizing AI Agents.
  • Cloud & Infrastructure:  Deep knowledge of cloud architecture and services on AWS. Strong command of Infrastructure as Code (Terraform, YAML).
  • Data Engineering & Programming:  Strong background in data modeling, ETL/ELT development, and advanced, hands-on programming skills in Python and SQL.
  • CI/CD & Automation:  Experience with designing and implementing CI/CD pipelines (preferably with GitHub Actions) for data and ML workloads.
  • Severability:  Familiarity with implementing monitoring, logging, and alerting for data platforms.
  • Automation:  The platform is ephemeral, and all changes are implemented using Terraform and Python. Expertise in Terraform and Python is a must.

Job Tags

Contract work,

Similar Jobs

Weatherby Healthcare

Nephrologist Is Wanted for Locums Help in PA Job at Weatherby Healthcare

 ...Nephrologist Is Wanted for Locums Help in PA at Weatherby Healthcare summary: A locum tenens nephrologist position is available in Pennsylvania requiring an active state medical license and board certification. The role involves managing post-renal transplants, performing... 

Malone Healthcare - Nursing

Travel Paramedic - $1,588 per week Job at Malone Healthcare - Nursing

 ...Travel Paramedic - $1,588 per week at Malone Healthcare - Nursing summary: A Travel Paramedic provides emergency medical care and patient transport services, working shifts of 12 hours in ground transport units. This role requires specialized paramedic skills to support... 

APEX PRECISION SALES LLC

Verizon Account Representative Job at APEX PRECISION SALES LLC

 ...to take things to the next leveland we want YOU to be part of it! FULL-TIME POSITIONS OPEN NOW IN: Marketing Sales Customer Service Event Promotions Public Relations Entry-Level Management Were looking for go-getters with a killer attitude and... 

Sysco

CDL-A Truck Driver - Home Most Nights - Start at $28.24/Hour Job at Sysco

 ...employment background check and drug screen \n\t ~ License to drive - Valid Class A Commercial Driver License (CDL) with a clean...  ...pounds repeatedly \n\t ~ Flexibility overtime as required, weekends, and holidays as business needs require \n \n\n Preferred... 

Oceaneering

Level III Rope Access Technician Job at Oceaneering

 ...Job Description Company Profile Oceaneering Integrity Management and Digital Solutions (IMDS) delivers capability, safety, and reliability. We help our customers make informed decisions and manage risk associated with their oil and gas, renewables, and maritime assets...