Senior AWS Data Engineer
Job Title: Senior AWS Cloud Data Engineer
Location: Dallas, TX
Join Our Team as a Senior AWS Cloud Data Engineer!
Are you passionate about building innovative data solutions in the cloud? We're seeking a highly skilled Senior AWS Cloud Data Engineer to lead the design, development, and maintenance of cutting-edge data architectures on AWS. If you thrive in a dynamic environment, excel at creating scalable data pipelines, and have a passion for leveraging cloud technologies to solve complex data challenges, this is the opportunity for you!
Key Responsibilities:
-
Design and Architect Data Lakehouse Solutions: Develop scalable, reliable, and high-performance data lakehouse architectures on AWS, utilizing Apache Iceberg and other AWS services to ensure efficient data management and processing.
-
Build and Automate Data Pipelines: Design, construct, and optimize ETL/ELT workflows to ingest, transform, and load data from diverse sources into the AWS ecosystem, ensuring data quality and consistency.
-
Develop and Manage Data APIs: Create secure, scalable RESTful APIs using AWS services, enabling seamless data access for internal teams and enterprise applications.
-
Leverage AWS Technologies: Utilize a suite of AWS tools—including Amazon S3, EMR, Lake Formation, Lambda, and API Gateway—to process, store, and analyze large-scale data efficiently.
-
Manage Apache Iceberg Tables: Build, maintain, and optimize Iceberg tables on Amazon S3 to enable advanced data lake features such as ACID transactions, schema evolution, and time travel.
-
Optimize Data Performance: Implement partitioning strategies, data compaction, and fine-tuning techniques to maximize query performance and reduce latency.
-
Ensure Data Quality & Security: Implement data validation, error handling, and security best practices using AWS Lake Formation, IAM, and Cognito to maintain data integrity and compliance.
-
Collaborate Across Teams: Work closely with data scientists, analysts, software engineers, and business stakeholders to understand requirements and deliver impactful data solutions.
-
Provide Technical Support & Documentation: Troubleshoot data pipeline issues, support API functionalities, and maintain comprehensive technical documentation.
Qualifications & Skills:
Education:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
Experience:
- Proven hands-on experience in data engineering within cloud environments, with a strong emphasis on AWS services.
Technical Expertise:
- Programming in Python, Java, or Scala.
- Strong SQL skills for data modeling, querying, and database design.
- Extensive experience with AWS services such as S3, EMR, Lambda, Lake Formation, API Gateway, and IAM.
- Hands-on experience building and managing Apache Iceberg tables on cloud storage.
- Familiarity with big data frameworks like Apache Spark and Hadoop.
- API development, deployment, and security best practices.
- Experience with ETL workflows and orchestration tools like Apache Airflow.
- Knowledge of DevOps practices, including CI/CD pipelines and Infrastructure as Code (Terraform) is a plus.
Soft Skills:
- Excellent problem-solving and analytical abilities.
- Strong communication and collaboration skills.
- Ability to work independently and thrive within agile teams.
Certifications (Preferred):
- AWS Certified Data Analytics – Specialty
- AWS Certified Data Engineer – Specialty
- Other relevant AWS certifications.
What We Offer:
- Opportunity to work on innovative, large-scale data projects in a leading cloud environment.
- Competitive salary and comprehensive benefits package.
- Career development and continuous learning opportunities to advance your expertise.
- Collaborative team culture with a focus on innovation and impact.
Ready to make an impact with your cloud data engineering expertise? Apply today and join us in transforming data into strategic business insights in Dallas, TX!
