Data Engineer (Databricks) Job at Global Soft Systems, Remote

WCtFUUFVY1ZHQmtDMzJsbHBiSGhtcE9mOFE9PQ==
  • Global Soft Systems
  • Remote

Job Description

Data Engineer (Databricks)

REMOTE

Client is seeking a talented and collaborative Data Engineer to join our North American Commercial Unit. In this role, you will work closely with analytics, data science, marketing, and sales teams to design, build, and operationalize efficient data pipelines and infrastructure that power insightful data products, dashboards, and advanced analytics. You will play a key role in automating, deploying, and maintaining production-grade data workflows, ensuring reliability, scalability, and reproducibility through modern DataOps practices.

What You'll Do

  • Data Pipeline Development:
  • Design, build, and maintain scalable data pipelines and ETL processes to support analytics, reporting, and data science initiatives.
  • Productionization & Automation:
  • Develop and automate robust workflows for data ingestion, transformation, and delivery using orchestration tools and CI/CD pipelines.
  • Cloud Data Engineering:
  • Leverage cloud platforms (Azure preferred) and technologies (Databricks, Azure Data Factory) to manage big data environments and enable advanced analytics.
  • Code Quality & Collaboration:
  • Participate in code reviews (PRs), enforce coding standards, and collaborate with cross-functional teams to ensure maintainable, high-quality solutions.
  • Monitoring & Troubleshooting:
  • Implement monitoring and observability for data pipelines, proactively identifying and resolving issues in production environments.
  • Data Governance & Quality:
  • Ensure data integrity, security, and compliance by applying best practices in data governance, quality management, and documentation.
  • Stakeholder Engagement:
  • Work closely with business partners to understand requirements, deliver custom data solutions, and provide training and support for end users.

What You'll Need

Education:

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field (Master's preferred).

Experience:

  • 2-3 years of relevant experience, or a Master's degree in a related field.
  • Strong proficiency with SQL, Python, and PySpark for data engineering tasks.
  • Hands-on experience with cloud computing technologies for big data (Azure preferred), including Databricks and Azure Data Factory.
  • Experience building and maintaining production-grade data pipelines, including monitoring and troubleshooting in live environments.
  • Proficiency in using Git for version control and collaboration; experience participating in code reviews (PRs) and enforcing code quality standards.
  • Experience working in an Agile environment, with knowledge of Agile methodologies and practices.
  • Hands-on experience with CI/CD pipelines for automating data pipeline deployment and testing.

Technical Skills:

  • Experience with orchestration tools (e.g., Airflow, dbt) and containerization (Docker, Kubernetes) for scalable data operations.
  • Familiarity with automation tools and processes for streamlining development, testing, and deployment workflows.
  • Understanding of DataOps concepts and best practices for reliable, reproducible, and scalable data workflows.
  • Ability to develop dashboards and data visualizations in Power BI or similar tools.
  • Basic understanding of data science concepts, techniques, and tools, such as machine learning algorithms, statistical analysis, and data preprocessing.

Business & Communication Skills:

  • Exceptional communication skills, with the ability to translate technical solutions into business value.
  • Ability to take vague requirements and convert them into scalable, actionable data solutions.
  • Strong problem-solving skills, business curiosity, and results-driven mindset.
  • Commitment to continuous learning and staying at the forefront of technology trends.
  • Takes initiative and builds relationships with key stakeholders to establish confidence, trust, and credibility.
  • Customer-focused and motivated by results, with the ability to proactively identify business needs and drive stakeholder satisfaction.

Preferred Qualifications

  • Deep understanding and experience with Azure's cloud architecture, services, and management tools.
  • Knowledge of MLOps best practices, including deployment, monitoring, and maintenance of machine learning models.
  • Experience participating in code reviews and collaborative development processes.
  • Experience with building automated pipelines for data workflow deployment and monitoring.
  • Experience supporting data-driven business transformation and data governance initiatives.

Job Tags

Full time, Remote work,

Similar Jobs

The California State University

Public Health & Recreation Special Sessions Lecturer Pool Job at The California State University

Join to apply for the Public Health & Recreation Special Sessions Lecturer Pool role at The California...  ...subject areas at university or college levels;Leadership or supervisory professional...  ....edu.Seniority level Seniority level Entry levelEmployment type Employment type... 

Steelville Senior Living

Business Office Job at Steelville Senior Living

 ...Steelville Senior Living is looking for a Business Office Manager to manage the day-to-day operations of the business office such as,...  ...The primary responsibilities are maintaining medical billing and cash collections, and the accurate reporting of same to corporate personnel... 

Essentia Health

Acupuncturist - Integrative Health - Duluth, MN Job at Essentia Health

 ...Experience:3 years of experience with acupuncture required Education Qualifications: Masters degree in acupuncture or oriental medicine Licensure/Certification Qualifications: Licensed to practice acupuncture in the state of MN Current certification... 

Manpower- Las Vegas

Epidemiology Surveillance Specialist Job at Manpower- Las Vegas

 ...Job Description Job Description Manpower is seeking an Epidemiology Specialist for one of our clients. This is a contractor thru end of September 2025. The Epidemiology Surveillance Specialist supports the implementation of public health surveillance systems and... 

Southwest Service Administrators Inc

Pension Analyst Job at Southwest Service Administrators Inc

Pension Analyst Location Murray, UT : The Pension Analyst provides customer service to pension participants along with computing and maintaining pension benefits and records. In addition, this role will respond to and resolve complex issues and plan provisions while maintaining...