Job Description

Role: GCP Data Engineer

Duration: 6 month contract

Location: Hybrid- Alpharetta, GA

Required:

• Extensive knowledge/coding skills of Python including understanding of data modeling and data engineering.
• Highly skilled on RDMS (Oracle, SQL server), NoSQL Database, and Messaging services (Publish / Subscribe) systems.
• Collaborating with our Architecture group, recommend and ensure the optimal data architecture.
• Hands on experience in building complete CI/CD Pipeline creation and maintenance using Azure DevOps and Terraform/Terragrunt.,
• Data design and architecture.
• Multi-level Data Curation and modeling.
• ETL pipeline using Python builds and scalable solutions.
• Terraform/YAML etc
• Design, develop data foundation on cloud data platform using GCP tools and techniques e.g.: Google Cloud Platform, Pub/Sub, Big Query, Cloud SQL, BigTable, BigLake DataForm, DataFlow, DataStream, Google cloud storage, Cloud Composer/DAG, Cloud Run, Cloud RESTAPI, ADO GITREPO, CI/CD Pipelines, Secret Manager, Cloud IAM
• Ensure data security.
• Others – Artifact Registry, Cloud Logging, Cloud Monitoring
• Security – Secret Manager, Cloud IAM
• Data pipeline and analytics – Dataflow, DataForm, Cloud Run, Cloud Run Function, Datastream, Cloud Scheduler, Workflows, Composer, Dataplex, ADO GITREPO, CI/CD Pipelines, Terraform/YAML
• Event processing – Pub/Sub, EventArc
• Storage – BigQuery, GCS, Cloud SQL, BigTable, BigLake
• Leveraging cloud-native services for data processing and storage.
• Critical thinking.
• Familiarity with certain software development methodologies such as Agile, or Scrum.
• Expertise in programming languages including Python and SQL.

Job Tags

Similar Jobs