Job Details

Title: Senior Big Data Engineer
Location : Rockville, MD or McLean, VA
Target Start Date : ASAP
Type: contract
Pay Rate: DOE

We are seeking a Senior Big Data Engineer who goes beyond task execution and takes ownership of solving complex data challenges. This role requires someone who thinks critically about system design, questions assumptions, and actively contributes to modernizing data platforms.

The ideal candidate will design and build scalable, cloud-native data solutions, optimize data platforms for performance and reliability, and support advanced analytics and AI/ML use cases.

Key Responsibilities

• Design and build scalable data lakes and data pipelines on AWS using modern, automated, cloud-native architectures.
• Enable high-performance analytics through federated query engines such as Amazon Athena and Trino, including large-scale query optimization and tuning.
• Manage data metadata, schemas, and discovery processes using tools such as AWS Glue Data Catalog.
• Implement secure data governance and access control using Lake Formation, encryption, and enterprise security best practices.
• Deploy and manage data workloads on Kubernetes/EKS environments.
• Work within the Hadoop ecosystem (Spark, Hive, HDFS), applying partitioning strategies and columnar storage formats such as Parquet and ORC to optimize performance.
• Troubleshoot complex issues across data pipelines, distributed clusters, and query engines.
• Design and maintain CI/CD pipelines for data engineering workflows using tools such as Jenkins or similar platforms.
• Monitor and maintain data platforms using observability and monitoring tools such as CloudWatch and Grafana.
• Prepare and structure high-quality datasets to support AI and machine learning applications.
• Build and operate infrastructure supporting AI/ML integrations, including MCP server environments.
• Collaborate within Agile/Scrum teams to identify gaps, propose scalable solutions, and drive continuous improvement.

Required Qualifications

• 8 years of experience in Big Data Engineering or Data Platform Engineering.
• Strong hands-on experience with AWS data and analytics services, including S3, Glue Data Catalog, Lake Formation, Athena, EMR, and EKS.
• Experience with Trino or Presto and optimizing large-scale distributed queries.
• Practical experience working with Kubernetes/EKS environments supporting data workloads.
• Strong programming skills in SQL, Python, and shell scripting.
• Experience implementing CI/CD pipelines for data engineering workflows.
• Experience building or configuring infrastructure supporting AI/ML integration.
• Demonstrated ownership mindset with strong problem-solving ability and a focus on delivering business outcomes.

Preferred Qualifications

• Experience designing AI/ML data pipelines or supporting machine learning workflows.
• Experience with cloud data platform modernization initiatives.
• Familiarity with modern data lakehouse architectures and emerging data technologies.

Welcome to ConsultNet, a premier national provider of technology talent and solutions. Our expertise spans across project services, contract-to-hire, direct search, and managed services onshore, nearshore, and hybrid. For over 25 years, we have connected thousands of consultants with meaningful roles through a personal, communication-driven approach, partnering with a diverse client base to build high-performing teams and create lasting impact. Our comprehensive service offerings cover a wide range of technology and engineering positions across key markets nationwide. Learn more at www.consultnet.com .

We champion equality and inclusivity, proudly supporting an Equal Opportunity Employer policy. We welcome applicants regardless of Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other status protected by law.