AWS Data Automation Engineer

AWS Data Automation Engineer
100% Remote - Washington, D.C.
U.S. Citizenship Required - Ability to obtain Public Trust Clearance
Pay: $55.00 - $60.00 per hour
26-08455
Job Summary

The AWS Data Automation Engineer is responsible for designing, developing, testing, troubleshooting, and maintaining software-intensive data solutions and automated data pipelines. This role focuses on building production-grade data engineering solutions using Python, SQL, AWS services, Apache Spark, and data ingestion technologies. The position also requires hands-on experience integrating Generative AI and large language model (LLM) platforms into Python-based workflows. The successful candidate works independently on moderately complex assignments and collaborates with technical teams and project stakeholders to develop reliable, scalable data solutions.

Job Responsibilities

• Design, develop, test, troubleshoot, and debug software and data engineering solutions.
• Develop and maintain production ETL/ELT processes and automated data pipelines.
• Build and maintain AWS-based data pipelines and automation using services such as S3, Glue, Lambda, EMR, Step Functions, and AWS database services.
• Develop data engineering solutions using Python and SQL.
• Build and optimize data processing workflows using Apache Spark.
• Implement data ingestion and streaming solutions using technologies such as Kafka or Flume.
• Integrate REST APIs into Python-based data workflows.
• Integrate Generative AI and LLM platforms, such as Amazon Bedrock, Azure OpenAI, or open-source models, into Python applications and workflows.
• Apply software development standards, processes, procedures, and tools throughout the software development life cycle.
• Analyze software and data requirements and assess compatibility with supporting infrastructure and platforms.
• Troubleshoot technical issues and develop solutions using established engineering practices and collaboration with technical teams.
• Support CI/CD processes using tools such as GitHub, Azure DevOps, or Jenkins.
• Document technical solutions, practices, and procedures and communicate them effectively to project stakeholders and technical resources.
• Assist other technical staff with tasks and assignments as needed.

Job Requirements

• 5+ years of experience in data engineering, data automation, or a related field.
• U.S. citizenship.
• Ability to obtain a Federal Public Trust clearance.
• Bachelor's degree in Computer Science or a related field.
• Strong hands-on Python and SQL experience.
• Significant hands-on experience developing AWS data pipelines and automation.
• Experience with multiple AWS services, including S3, Glue, Lambda, EMR, Step Functions, and AWS database services.
• Strong Apache Spark experience.
• Experience with at least one ingestion or streaming technology, such as Kafka or Flume.
• Hands-on experience developing production ETL/ELT processes and data pipelines.
• Practical experience integrating an LLM or Generative AI platform into a Python-based workflow.
• Experience integrating REST APIs into Python-based workflows.
• CI/CD experience with GitHub, Azure DevOps, or Jenkins.
• Experience with Jira.
• Ability to work independently on moderately complex projects and assignments.
• Strong troubleshooting and problem-solving skills.
• Ability to communicate technical solutions, practices, and procedures effectively.

Preferred Experience

• AWS and Azure multi-cloud experience.
• Experience with Retrieval-Augmented Generation (RAG).
• Experience with embeddings and vector search.
• Experience with Solr or OpenSearch.
• Experience with Docker or Kubernetes.
• Experience with Terraform.

Education

• Bachelor's degree in Computer Science or a related field.

About Equiliem

Equiliem believes in empowering success. It's our job to cultivate relationships that connect people and employers in a way that is inclusive, intelligent, and allows both to thrive.

Across the U.S., leading companies in healthcare, government, engineering, manufacturing, professional services, and energy rely on us for their workforce solutions. Our recruiting and HR services include contract and direct hire staffing, Payrolling/EOR, Independent Contractor Compliance, and Managed Services.

For almost 30 years, we've helped shape our industry. Today, we continue to research, ask questions, and continuously enhance the candidate journey and client experience.

Benefits

We offer a comprehensive benefits package to our employees, which includes:

• Medical Insurance
• Vision & Dental Insurance
• Life Insurance
• Matching 401(k)
• Commuter Benefits
• Employee Discounts & Rewards
• Payroll Payment Options

By applying, you are providing consent for Equiliem to engage with you via phone calls, AI-generated calls, AI-generated text messages, standard text messages, and/or emails to share job opportunities. Consistent with our Privacy Policy, information obtained will not be shared with third parties for marketing or promotional purposes. Message frequency may vary for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You may reply STOP to cancel or HELP for assistance.

Equiliem is an equal opportunity employer. We do not discriminate or allow discrimination based on race, color, religion, creed, sex, age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Equiliem will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at [emailprotected] or (732) 238-6050.