- Design and develop data applications using big data technologies (AWS, spark) to ingest, process and analyze large data sets.
- Build robust data pipelines on cloud using AWS Glue, Pyspark, lambda.
- Build rest-based data API using python,EKS, lambda.
- Good knowledge in SQL and No-SQL.
- Work across team to deliver meaningful reference architecture that outline architecture principles.
- Extract data from multiple data sources and load into data lake.
- Performs design and implementation of IT systems that require the integration of diverse and complex systems.
- Set up and support cloud infrastructure automation for CI/CD process utilizing AWS CloudFormation and terraform.
Job Category: AWS Data Engineer
Job Type: Full Time
Job Location: Wilmington DE