Data Engineer Job at Interactive Resources - iR, Austin, TX

a0NWQk0wMjk0TW9WbmNmUlVwSElacTlkR3c9PQ==
  • Interactive Resources - iR
  • Austin, TX

Job Description

About the Role

We are seeking a highly skilled Databricks Data Engineer with strong expertise in modern data engineering, Azure cloud technologies, and Lakehouse architectures. This role is ideal for someone who thrives in dynamic environments, enjoys solving complex data challenges, and can lead end-to-end delivery of scalable data solutions.

What We're Looking For

  • 8+ years designing and delivering scalable data pipelines in modern data platforms
  • Deep experience in data engineering, data warehousing, and enterprise-grade solution delivery
  • Ability to lead cross-functional initiatives in matrixed teams
  • Advanced skills in SQL, Python , and ETL/ELT development , including performance tuning
  • Hands-on experience with Azure , Snowflake , and Databricks , including system integrations

Key Responsibilities

  • Design, build, and optimize large-scale data pipelines on the Databricks Lakehouse platform
  • Modernize and enhance cloud-based data ecosystems on Azure , contributing to architecture, modeling, security, and CI/CD
  • Use Apache Airflow and similar tools for workflow automation and orchestration
  • Work with financial or regulated datasets while ensuring strong compliance and governance
  • Drive best practices in data quality, lineage, cataloging, and metadata management

Primary Technical Skills

  • Develop and optimize ETL/ELT pipelines using Python, PySpark, Spark SQL , and Databricks Notebooks
  • Design efficient Delta Lake models for reliability and performance
  • Implement and manage Unity Catalog for governance, RBAC, lineage, and secure data sharing
  • Build reusable frameworks using Databricks Workflows, Repos, and Delta Live Tables
  • Create scalable ingestion pipelines for APIs, databases, files, streaming sources , and MDM systems
  • Automate ingestion and workflows using Python and REST APIs
  • Support downstream analytics for BI, data science, and application workloads
  • Write optimized SQL/T-SQL queries, stored procedures, and curated datasets
  • Automate DevOps workflows, testing pipelines, and workspace configurations

Additional Skills

  • Azure: Data Factory, Data Lake, Key Vault, Logic Apps, Functions
  • CI/CD: Azure DevOps
  • Orchestration: Apache Airflow (plus)
  • Streaming: Delta Live Tables
  • MDM: Profisee (nice-to-have)
  • Databases: SQL Server, Cosmos DB

Soft Skills

  • Strong analytical and problem-solving mindset
  • Excellent communication and cross-team collaboration
  • Detail-oriented with a high sense of ownership and accountability

Job Tags

Similar Jobs

UVM Health - Champlain Valley Physicians Hospital

Orthopaedic Surgeon Job at UVM Health - Champlain Valley Physicians Hospital

 ...Foot & Ankle Surgeon Plattsburgh, NY The Department of Orthopedics and Rehabilitation at The University of Vermont Health Network is seeking a skilled Foot and Ankle Surgeon for a full-time position at our Champlain Valley Physicians Hospital in Plattsburgh, New... 

Motion Recruitment

Administrative Assistant Job at Motion Recruitment

 ...and coordinate active calendars Greet visitors, handles incoming calls and performs general administrative duties. May also assist other administrative staff with overflow work, including word processing, data entry and internet research tasks. Takes messages... 

Addison Group

Graphic Designer Job at Addison Group

 ...We are seeking a highly professional Graphic Designer with a strong corporate background and a refined design sensibility. This role supports highvisibility projects and requires someone comfortable working directly with sophisticated, highend clients across industries... 

Donegal Insurance Group

Actuarial Analyst Job at Donegal Insurance Group

 ...About the Role Donegal Insurance Group is looking for a motivated Actuarial Analyst to support our team with the ratemaking process for commercial lines of business as well as capital modeling. This role will involve data analysis, forecasting, and reporting to ensure... 

BHE GT&S

Pipeline Field Specialist Job at BHE GT&S

 ...BHE GT&S has an exciting career opportunity for a Pipeline Field Specialist at our Silver Springs Transmission in Silver Springs, NY....  ...relations, report customer complaints and inquiries. May train and assist other coworkers as required. May lead or direct...