Data Engineer Job at Interactive Resources - iR, Austin, TX

a0NWQk0wMjk0TW9WbmNmUlVwSElacTlkR3c9PQ==
  • Interactive Resources - iR
  • Austin, TX

Job Description

About the Role

We are seeking a highly skilled Databricks Data Engineer with strong expertise in modern data engineering, Azure cloud technologies, and Lakehouse architectures. This role is ideal for someone who thrives in dynamic environments, enjoys solving complex data challenges, and can lead end-to-end delivery of scalable data solutions.

What We're Looking For

  • 8+ years designing and delivering scalable data pipelines in modern data platforms
  • Deep experience in data engineering, data warehousing, and enterprise-grade solution delivery
  • Ability to lead cross-functional initiatives in matrixed teams
  • Advanced skills in SQL, Python , and ETL/ELT development , including performance tuning
  • Hands-on experience with Azure , Snowflake , and Databricks , including system integrations

Key Responsibilities

  • Design, build, and optimize large-scale data pipelines on the Databricks Lakehouse platform
  • Modernize and enhance cloud-based data ecosystems on Azure , contributing to architecture, modeling, security, and CI/CD
  • Use Apache Airflow and similar tools for workflow automation and orchestration
  • Work with financial or regulated datasets while ensuring strong compliance and governance
  • Drive best practices in data quality, lineage, cataloging, and metadata management

Primary Technical Skills

  • Develop and optimize ETL/ELT pipelines using Python, PySpark, Spark SQL , and Databricks Notebooks
  • Design efficient Delta Lake models for reliability and performance
  • Implement and manage Unity Catalog for governance, RBAC, lineage, and secure data sharing
  • Build reusable frameworks using Databricks Workflows, Repos, and Delta Live Tables
  • Create scalable ingestion pipelines for APIs, databases, files, streaming sources , and MDM systems
  • Automate ingestion and workflows using Python and REST APIs
  • Support downstream analytics for BI, data science, and application workloads
  • Write optimized SQL/T-SQL queries, stored procedures, and curated datasets
  • Automate DevOps workflows, testing pipelines, and workspace configurations

Additional Skills

  • Azure: Data Factory, Data Lake, Key Vault, Logic Apps, Functions
  • CI/CD: Azure DevOps
  • Orchestration: Apache Airflow (plus)
  • Streaming: Delta Live Tables
  • MDM: Profisee (nice-to-have)
  • Databases: SQL Server, Cosmos DB

Soft Skills

  • Strong analytical and problem-solving mindset
  • Excellent communication and cross-team collaboration
  • Detail-oriented with a high sense of ownership and accountability

Job Tags

Similar Jobs

New York State Unified Court System

Social Worker - Buffalo City Drug Court Job at New York State Unified Court System

 ...solving parts and units throughout the Unified Court System and are responsible for establishing and maintaining relationships with community partners and service providers. Key Responsibilities: Reviewing work of case managers and other subordinate staff.... 

CALPAK

Senior Finance Manager Job at CALPAK

 ...foundations that enable sustainable, profitable scaling. The Senior Finance Manager will play a critical role in ensuring CALPAKs day-to-...  ..., and overall profitability to inform business decisions. Accounting Operations Oversee the month-end close process and ensure... 

Bare Home

Supply Chain Specialist Job at Bare Home

 ...The Role We're seeking a detail-oriented, Excel-savvy Supply Chain Associate who thrives on turning massive datasets into actionable...  ...allocation and inventory movement across multiple channels including Amazon FBA, our website, and international markets (UK, Canada, and... 

Beth Israel Deaconess Medical Center

Computational Biology / Bioinformatics / Machine Learning Postdoc - Single Cell and Spatial Technologies Job at Beth Israel Deaconess Medical Center

 ...analyzing Next Generation Sequencing data PhD in a relevant subject area (Computational Biology, Population Genetics/Genomics, Bioinformatics, Biostatistics) Strong quantitative background (e.g. BSc in Computer Science, Applied Math, Engineering, Biostatistics)... 

Hire Society

Palm Beach Private Chef Job at Hire Society

 ...Private family seeks an exceptional full-time Private Chef to create unparalleled culinary experiences that blend artistry and sophistication, with a strong focus on nutrition and wellness. The Chef will oversee all daily culinary needs at the familys primary residence...