Data Engineer Job at People Tech Group Inc, Washington DC

QkxNekloQ2RJUDZVbEdRekZkMUhGS09JTmc9PQ==
  • People Tech Group Inc
  • Washington DC

Job Description

Role: Data Engineer

Duration: Long-term project.

Location: Redmond WA

Key Skills

  • Apache Spark (PySpark or Scala) : Writing scalable distributed rule engines.
  • Apache Hive : Querying partitioned datasets, schema handling.
  • Amazon EMR : Cluster management, tuning jobs for large datasets (20+ TB).
  • AWS S3 : Data partitioning, object lifecycle, access patterns.
  • Glue Data Catalog : Managing Hive table metadata.
  • Data Quality Frameworks : (Great Expectations, Deequ, or custom rules).
  • CI/CD : Code deployment pipelines (Git, Jenkins, Airflow, etc

Job Tags

Similar Jobs

Fluet

Government Contracts Associate (Disputes) Job at Fluet

 ...Government Contracts practice, you will be advocating for government contractors of all sizes with all aspects of government contracts disputes...  ...Security background Judicial Clerkship in the Court of Federal Claims or Board of Contract Appeals Work experience with a... 

Alibaba Cloud

Data Engineer Job at Alibaba Cloud

Job Description Collaborate with BI teams to manage ETL processes to support data integration and transformation. Assist BI teams in performing raw data organization, desensitization, deduplication and governance to ensure data management timeliness, completeness...

Placed | Midwest | Construction | Engineering | Finance

Project Executive Job at Placed | Midwest | Construction | Engineering | Finance

 ...and resolve issues promptly. Contractor and Vendor Management: Select, negotiate contracts with, and manage contractors, subcontractors, and vendors. Oversee the bid process, evaluate proposals, and make recommendations for contract awards. Monitor contractor... 

Ankr Health

Personal Assistant Job at Ankr Health

 ...Job Title: Administrative Assistant Position Type: Part Time Location: Onsite-Houston Compensation: $10 $15 per hour (based on experience) About Us: Ankr Health is a multinational company with offices in San Francisco, Houston, and Bangalore. Our products... 

Softworld, a Kelly Company

Sr. IT Administrator - SDA Job at Softworld, a Kelly Company

 ...the United States, directly for an employer, without sponsorship now or anytime in the future. ~ This client is a US Federal Government contractor and is legally required to hire US Citizens. US Citizens will only be considered for this role. ~ Due to the nature of...