Data Engineer
Data Engineer
Exciting contract opportunity for someone who loves technology, and is highly motivated to be successful and grow their career as a Data Engineer within a top notch enterprise environment.
RESPONSIBILITIES:
- Author, schedule, and maintain modular ETL/ELT workflows and DAGs using Apache Airflow and custom providers, ensuring seamless data integration across distributed storage and modern cloud data lakes/warehouses.
- Develop and tune complex SQL scripts and database schemas, continually resolving performance bottlenecks, optimizing cloud resource utilization, and maintaining efficient data warehousing structures.
- Configure, deploy, and manage data infrastructure using Docker or Kubernetes, integrating custom connectors and CI/CD deployment pipelines under strict operational and security guidelines.
- Monitor pipeline health to perform root cause analysis during DAG failures or database outages, proactively reducing recurring errors and establishing high data quality standards.
- Collaborate in an Agile environment to document data architectures and troubleshooting workflows while continuously identifying opportunities to automate and scale data delivery systems.
This is a 4 month contract opportunity. Candidates must be located in St. Louis, MO and work 4 days a week in office and 1 day remotely (Friday)!
Visionaire Partners offers all full-time W2 contractors a comprehensive benefits package for the contractor, their spouses/domestic partners, and dependents. Options include 401k with up to 4% match, medical, dental, vision, life insurance, short and long term disability, critical illness, hospital indemnity, accident coverage, and both Medical and Dependent Care Flexible Spending Accounts.
REQUIRED SKILLS:
- 4+ years of dedicated data engineering experience with a focus on scaling data delivery, automation, and optimizing system resources
- Advanced expertise in authoring, scheduling, and optimizing complex ETL/ELT pipelines and DAGs using Python, SQL, and Apache Airflow.
- Demonstrated experience in schema design, query performance tuning, and integrating modern cloud data lakes and data warehousing solutions.
- Hands-on experience with cloud platform infrastructure, Docker, Kubernetes, and automated CI/CD deployment pipelines.
- Proven ability to perform root cause analysis, resolve pipeline failures/outages, and maintain comprehensive technical documentation in an Agile environment.
Must be authorized to work in the US. Sponsorships are not available.
Pay range: $55-58/hour W2